Sep 10 20:56:01.233705 ip-10-0-136-151 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 20:56:01.233715 ip-10-0-136-151 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 20:56:01.233722 ip-10-0-136-151 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 20:56:01.233885 ip-10-0-136-151 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 20:56:11.262567 ip-10-0-136-151 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 20:56:11.262582 ip-10-0-136-151 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b55c660b47274ed8bf5e2cb521c9a478 --
Sep 10 20:57:51.140309 ip-10-0-136-151 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 20:57:51.569318 ip-10-0-136-151 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:57:51.569318 ip-10-0-136-151 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 20:57:51.569318 ip-10-0-136-151 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:57:51.569318 ip-10-0-136-151 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 20:57:51.569318 ip-10-0-136-151 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:57:51.571261 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.571182    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 20:57:51.574968 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.574953    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:51.575009 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.574970    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:51.575009 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.574974    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:51.575009 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.574978    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:51.575009 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.574981    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:51.575009 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.574984    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:51.575009 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.574987    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:51.575009 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.574989    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:51.575009 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.574992    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:51.575009 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575000    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:51.575009 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575003    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:51.575009 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575006    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:51.575009 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575008    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:51.575009 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575011    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:51.575009 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575014    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575017    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575020    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575035    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575038    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575041    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575044    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575047    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575050    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575053    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575056    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575058    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575061    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575064    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575066    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575069    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575072    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575075    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575077    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575080    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:51.575371 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575082    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575085    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575088    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575090    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575093    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575095    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575098    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575101    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575104    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575108    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575110    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575113    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575116    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575118    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575122    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575125    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575127    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575130    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575133    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575135    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:51.575890 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575138    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575140    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575143    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575146    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575148    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575151    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575153    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575156    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575158    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575161    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575164    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575167    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575169    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575172    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575175    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575177    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575180    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575182    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575185    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575188    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:51.576385 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575190    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575193    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575196    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575200    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575204    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575208    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575212    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575215    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575218    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575221    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575225    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575228    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575231    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575234    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575237    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575240    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575242    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575245    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575248    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:51.576866 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575250    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575253    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575255    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575258    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575261    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575263    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575928    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575934    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575937    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575940    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575944    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575947    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575949    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575952    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575955    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575959    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575962    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575964    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575967    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:51.577352 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575971    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575974    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575977    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575980    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575982    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575986    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575988    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575991    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575994    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575997    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.575999    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576002    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576005    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576007    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576010    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576013    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576015    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576018    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576021    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576038    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:51.577826 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576041    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576045    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576049    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576052    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576055    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576058    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576062    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576065    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576067    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576071    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576073    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576076    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576080    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576083    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576086    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576090    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576094    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576098    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:51.578337 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576102    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576105    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576108    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576111    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576114    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576118    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576121    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576123    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576126    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576129    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576131    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576134    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576137    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576139    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576142    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576145    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576147    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576150    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576153    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:51.578806 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576155    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576158    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576161    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576163    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576167    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576170    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576172    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576175    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576178    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576181    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576184    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576186    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576189    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576191    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576194    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576197    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576200    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576202    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576205    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576208    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:51.579279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576210    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576213    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576215    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576218    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576221    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576223    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576226    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576228    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576231    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576589    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576593    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576596    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576599    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576604    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576607    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576611    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576614    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576617    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576620    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576623    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:51.579789 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576626    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576629    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576631    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576634    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576637    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576639    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576642    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576645    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576648    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576650    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576653    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576656    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576658    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576661    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576664    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576666    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576669    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576672    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576674    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576677    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:51.580290 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576680    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576683    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576685    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576688    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576691    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576694    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576697    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576700    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576702    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576705    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576708    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576713    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576716    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576718    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576721    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576724    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576726    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576729    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576731    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576734    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576737    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:51.580779 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576739    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576742    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576744    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576747    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576750    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576752    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576755    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576758    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576760    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576763    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576765    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576768    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576770    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576773    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576776    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576778    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576781    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576784    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576789    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:51.581328 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576792    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576796    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576798    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576803    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576806    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576809    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576812    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576816    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576819    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576822    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576825    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576828    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576831    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576834    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576837    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576839    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576842    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576844    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576847    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:51.581793 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576850    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576852    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576855    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576858    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576860    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576864    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576867    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576870    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.576872    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.576957    2577 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.576999    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577006    2577 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577010    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577014    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577018    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577034    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577040    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577044    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577048    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577051    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577055    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577058    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 20:57:51.582279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577061    2577 flags.go:64] FLAG: --cgroup-root=""
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577064    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577067    2577 flags.go:64] FLAG: --client-ca-file=""
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577070    2577 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577073    2577 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577077    2577 flags.go:64] FLAG: --cluster-domain=""
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577080    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577083    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577087    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577090    2577 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577094    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577097    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577100    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577104    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577107    2577 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577112    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577115    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577118    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577121    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577125    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577128    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577131    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577135    2577 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577138    2577 flags.go:64] FLAG: --enable-server="true"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577141    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 20:57:51.582863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577145    2577 flags.go:64] FLAG: --event-burst="100"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577148    2577 flags.go:64] FLAG: --event-qps="50"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577152    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577155    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577158    2577 flags.go:64] FLAG: --eviction-hard=""
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577162    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577165    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577168    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577171    2577 flags.go:64] FLAG: --eviction-soft=""
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577174    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577177    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577180    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577183    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577186    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577189    2577 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577192    2577 flags.go:64] FLAG: --feature-gates=""
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577196    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577199    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577202    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577205    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577209    2577 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577212    2577 flags.go:64] FLAG: --help="false"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577216    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-136-151.ec2.internal"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577219    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 20:57:51.583496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577222    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577225    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577229    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577232    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577235    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577238    2577 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577241    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577244    2577 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577247    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577251    2577 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577254    2577 flags.go:64] FLAG: --kube-reserved=""
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577257    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577260    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577263    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577266    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577269    2577 flags.go:64] FLAG: --lock-file=""
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577272    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577275    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577278    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577283    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577287    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577289    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577292    2577 flags.go:64] FLAG: --logging-format="text"
Sep 10 20:57:51.584135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577295    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577299    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577301    2577 flags.go:64] FLAG: --manifest-url=""
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577304    2577 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577309    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577312    2577 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577316    2577 flags.go:64] FLAG: --max-pods="110"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577320    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577323    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577327    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577330    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577333    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577336    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577339    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577346    2577 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577348    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577351    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577355    2577 flags.go:64] FLAG: --pod-cidr=""
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577358    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577363    2577 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577367    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577370    2577 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577373    2577 flags.go:64] FLAG: --port="10250"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577376    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 20:57:51.584711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577379    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ba8726142a9096ea"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577382    2577 flags.go:64] FLAG: --qos-reserved=""
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577385    2577 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577388    2577 flags.go:64] FLAG: --register-node="true"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577391    2577 flags.go:64] FLAG: --register-with-taints=""
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577395    2577 flags.go:64] FLAG: --registry-burst="10"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577398    2577 flags.go:64] FLAG: --registry-qps="5"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577400    2577 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577404    2577 flags.go:64] FLAG: --reserved-memory=""
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577407    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577410    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577413    2577 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577416    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577419    2577 flags.go:64] FLAG: --runonce="false"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577422    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577426    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577430    2577 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577433    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577436    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577439    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577442    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577445    2577 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577448    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577451    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577454    2577 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577457    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 20:57:51.585388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577461    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577465    2577 flags.go:64] FLAG: --system-cgroups=""
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577468    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577473    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577476    2577 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577479    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577484    2577 flags.go:64] FLAG: --tls-min-version=""
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577487    2577 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577489    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577493    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577496    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577499    2577 flags.go:64] FLAG: --v="2"
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577503    2577 flags.go:64] FLAG: --version="false"
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577507    2577 flags.go:64] FLAG: --vmodule=""
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577511    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.577514    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577628    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577632    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577635    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577638    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577641    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577645    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577648    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:51.586442 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577651    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577654    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577657    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577659    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577662    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577665    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577668    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577671    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577673    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577677    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577680    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577682    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577685    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577688    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577690    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577697    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577700    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577703    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577706    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577708    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:51.587263 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577711    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577713    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577716    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577719    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577721    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577724    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577727    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577729    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577732    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577735    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577739    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577742    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577745    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577748    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577752    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577755    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577759    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577762    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577765    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:51.587782 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577769    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577772    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577777    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577780    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577783    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577786    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577788    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577791    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577794    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577797    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577800    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577802    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577805    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577807    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577810    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577813    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577816    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577818    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577821    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577824    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:51.588268 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577827    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577829    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577832    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577838    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577842    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577845    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577848    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577851    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577854    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577856    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577859    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577861    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577864    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577867    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577871    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577873    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577876    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577879    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577881    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:51.588780 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577884    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577887    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577889    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577892    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577895    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577898    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577900    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577903    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577905    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577908    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577911    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577914    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577916    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.577919    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.578574    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.587592    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 20:57:51.589332 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.587607    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.588513    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.588520    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588591    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588597    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588600    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588604    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588607    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588609    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588612    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588616    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588619    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588623    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588626    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588629    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588632    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588634    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588637    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588640    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:51.589727 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588642    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588645    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588647    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588650    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588653    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588655    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588658    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588661    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588664    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588673    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588676    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588679    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588681    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588685    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588687    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588690    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588693    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588695    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588698    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588701    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:51.590199 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588703    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588706    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588708    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588711    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588714    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588716    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588719    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588722    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588725    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588727    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588731    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588734    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588736    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588739    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588742    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588744    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588747    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588750    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588753    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588756    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:51.590705 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588758    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588761    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588764    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588767    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588770    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588772    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588775    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588778    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588780    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588783    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588786    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588789    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588792    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588795    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588799    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588803    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588805    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588808    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588811    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:51.591214 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588814    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588817    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588820    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588822    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588826    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588828    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588831    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588835    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588839    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588842    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588845    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588848    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588851    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588855    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588858    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588861    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588864    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588867    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588870    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:51.591684 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588872    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:51.592231 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588875    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:51.592231 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588878    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:51.592231 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588881    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:51.592231 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.588884    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:51.592231 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.588889    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:57:51.592231 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589016    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:51.592231 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589032    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:51.592231 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589036    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:51.592231 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589039    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:51.592231 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589042    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:51.592231 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589045    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:51.592231 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589049    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:51.592231 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589053    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:51.592231 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589056    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589059    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589062    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589064    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589068    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589071    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589074    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589076    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589079    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589082    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589084    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589087    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589090    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589093    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589096    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589099    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589101    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589104    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589106    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589109    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:51.592582 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589112    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589114    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589117    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589120    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589123    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589125    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589128    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589131    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589135    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589138    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589142    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589144    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589147    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589149    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589152    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589155    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589157    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589160    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589165    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:51.593080 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589168    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589171    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589173    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589176    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589178    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589181    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589183    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589186    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589189    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589191    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589194    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589196    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589199    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589201    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589204    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589207    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589209    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589212    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589215    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589217    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:51.593537 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589220    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589222    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589225    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589228    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589231    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589233    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589236    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589239    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589241    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589244    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589246    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589251    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589254    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589256    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589259    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589261    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589264    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589266    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589269    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589271    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:51.594019 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589274    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:51.594500 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589277    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:51.594500 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589279    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:51.594500 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589282    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:51.594500 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589284    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:51.594500 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589287    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:51.594500 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589289    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:51.594500 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589293    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:51.594500 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589297    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:51.594500 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589300    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:51.594500 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589303    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:51.594500 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:51.589306    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:51.594500 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.589311    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:57:51.594500 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.589424    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 20:57:51.594500 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.592441    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 20:57:51.594856 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.593500    2577 server.go:1019] "Starting client certificate rotation"
Sep 10 20:57:51.594856 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.593603    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 20:57:51.594856 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.593636    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 20:57:51.596347 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.596334    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 20:57:51.600505 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.600481    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 20:57:51.614543 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.614524    2577 log.go:25] "Validated CRI v1 runtime API"
Sep 10 20:57:51.617775 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.617760    2577 log.go:25] "Validated CRI v1 image API"
Sep 10 20:57:51.618584 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.618570    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 20:57:51.621184 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.621164    2577 fs.go:135] Filesystem UUIDs: map[76d26e2c-cdf2-4358-bd69-79cfe1d3f35b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ac94cdee-23aa-41cf-93b8-27ee2fed4d27:/dev/nvme0n1p3]
Sep 10 20:57:51.621271 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.621182    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 20:57:51.627186 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.627170    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 20:57:51.627260 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.627083    2577 manager.go:216] Machine: {Timestamp:2026-09-10 20:57:51.625645515 +0000 UTC m=+0.370354758 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100761 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a827ee2949b522eef3a8401156d30 SystemUUID:ec2a827e-e294-9b52-2eef-3a8401156d30 BootID:b55c660b-4727-4ed8-bf5e-2cb521c9a478 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d5:55:8c:67:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d5:55:8c:67:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:04:c6:63:c1:b2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 20:57:51.627260 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.627216    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 20:57:51.627341 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.627330    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 20:57:51.631088 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.631065    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 20:57:51.631217 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.631089    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-151.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 20:57:51.631863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.631853    2577 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 20:57:51.631901 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.631865    2577 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 20:57:51.631901 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.631873    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 20:57:51.632675 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.632665    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 20:57:51.633902 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.633893    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 20:57:51.637320 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.637309    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 20:57:51.637431 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.637421    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 20:57:51.637464 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.637451    2577 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 20:57:51.637497 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.637465    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 20:57:51.637497 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.637483    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 20:57:51.637547 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.637498    2577 kubelet.go:398] "Adding apiserver pod source"
Sep 10 20:57:51.637547 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.637509    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 20:57:51.638601 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.638569    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 20:57:51.638601 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.638604    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 20:57:51.648270 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.648245    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 20:57:51.651155 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.651139    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 20:57:51.651254 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.651178    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 20:57:51.652916 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.652894    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 20:57:51.652966 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.652898    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-151.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 20:57:51.653131 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.653117    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 20:57:51.653191 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.653138    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 20:57:51.653191 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.653147    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 20:57:51.653191 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.653156    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 20:57:51.653191 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.653168    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 20:57:51.653191 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.653176    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 20:57:51.653370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.653196    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 20:57:51.653370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.653204    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 20:57:51.653370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.653214    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 20:57:51.653370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.653222    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 20:57:51.653370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.653235    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 20:57:51.653370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.653243    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 20:57:51.654124 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.654114    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 20:57:51.654182 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.654126    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 20:57:51.657902 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.657887    2577 server.go:1268] "Started kubelet"
Sep 10 20:57:51.658010 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.657954    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 20:57:51.658083 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.657990    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 20:57:51.658083 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.658075    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 20:57:51.658677 ip-10-0-136-151 systemd[1]: Started Kubernetes Kubelet.
Sep 10 20:57:51.659681 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.659564    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 20:57:51.661393 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.660768    2577 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 20:57:51.663639 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.663620    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 20:57:51.665076 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.665059    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-151.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 20:57:51.666160 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.664986    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-151.ec2.internal.18d4113515197db1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-151.ec2.internal,UID:ip-10-0-136-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-151.ec2.internal,},FirstTimestamp:2026-09-10 20:57:51.657860529 +0000 UTC m=+0.402569773,LastTimestamp:2026-09-10 20:57:51.657860529 +0000 UTC m=+0.402569773,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-151.ec2.internal,}"
Sep 10 20:57:51.666766 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.666749    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 20:57:51.667467 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.667451    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 20:57:51.667598 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.667584    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-151.ec2.internal\" not found"
Sep 10 20:57:51.668313 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.668300    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 20:57:51.668313 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.668302    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 20:57:51.668419 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.668321    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 20:57:51.668419 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.668403    2577 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 20:57:51.668419 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.668413    2577 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 20:57:51.670838 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.670823    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 20:57:51.670838 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.670837    2577 factory.go:55] Registering systemd factory
Sep 10 20:57:51.670947 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.670843    2577 factory.go:223] Registration of the systemd container factory successfully
Sep 10 20:57:51.671040 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.671018    2577 factory.go:153] Registering CRI-O factory
Sep 10 20:57:51.671073 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.671042    2577 factory.go:223] Registration of the crio container factory successfully
Sep 10 20:57:51.671073 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.671062    2577 factory.go:103] Registering Raw factory
Sep 10 20:57:51.671123 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.671075    2577 manager.go:1196] Started watching for new ooms in manager
Sep 10 20:57:51.671230 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.671209    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-151.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 20:57:51.671383 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.671362    2577 manager.go:349] Starting recovery of all containers
Sep 10 20:57:51.671438 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.671356    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 20:57:51.681394 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.681376    2577 manager.go:354] Recovery completed
Sep 10 20:57:51.685599 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.685506    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:51.687199 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.687183    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:51.687262 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.687211    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:51.687262 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.687221    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:51.687756 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.687741    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 20:57:51.687756 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.687754    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 20:57:51.687877 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.687775    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 20:57:51.687877 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.687755    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:51.688482 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.688465    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:51.688560 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.688495    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:51.688560 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.688507    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:51.688938 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.688926    2577 policy_none.go:49] "None policy: Start"
Sep 10 20:57:51.688988 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.688944    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 20:57:51.688988 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.688957    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 20:57:51.689167 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.689104    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-151.ec2.internal.18d4113516d9273e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-151.ec2.internal,UID:ip-10-0-136-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-151.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-151.ec2.internal,},FirstTimestamp:2026-09-10 20:57:51.687198526 +0000 UTC m=+0.431907769,LastTimestamp:2026-09-10 20:57:51.687198526 +0000 UTC m=+0.431907769,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-151.ec2.internal,}"
Sep 10 20:57:51.689987 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.689975    2577 policy_none.go:47] "Start"
Sep 10 20:57:51.692157 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.692139    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6nwnh"
Sep 10 20:57:51.696515 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.696440    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-151.ec2.internal.18d4113516d96b7d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-151.ec2.internal,UID:ip-10-0-136-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-151.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-151.ec2.internal,},FirstTimestamp:2026-09-10 20:57:51.687215997 +0000 UTC m=+0.431925239,LastTimestamp:2026-09-10 20:57:51.687215997 +0000 UTC m=+0.431925239,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-151.ec2.internal,}"
Sep 10 20:57:51.699982 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.699902    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-151.ec2.internal.18d4113516d99185  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-151.ec2.internal,UID:ip-10-0-136-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-151.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-151.ec2.internal,},FirstTimestamp:2026-09-10 20:57:51.687225733 +0000 UTC m=+0.431934976,LastTimestamp:2026-09-10 20:57:51.687225733 +0000 UTC m=+0.431934976,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-151.ec2.internal,}"
Sep 10 20:57:51.700606 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.700587    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6nwnh"
Sep 10 20:57:51.706620 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.706562    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-151.ec2.internal.18d4113516d9273e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-151.ec2.internal.18d4113516d9273e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-151.ec2.internal,UID:ip-10-0-136-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-151.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-151.ec2.internal,},FirstTimestamp:2026-09-10 20:57:51.687198526 +0000 UTC m=+0.431907769,LastTimestamp:2026-09-10 20:57:51.688480677 +0000 UTC m=+0.433190129,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-151.ec2.internal,}"
Sep 10 20:57:51.713767 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.713744    2577 manager.go:337] "Starting Device Plugin manager"
Sep 10 20:57:51.713767 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.713778    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 20:57:51.713767 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.713787    2577 server.go:87] "Starting device plugin registration server"
Sep 10 20:57:51.731047 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.714016    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 20:57:51.731047 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.714059    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 20:57:51.731047 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.714164    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 20:57:51.731047 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.714228    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 20:57:51.731047 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.714236    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 20:57:51.731047 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.715495    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 20:57:51.731047 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.715542    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-151.ec2.internal\" not found"
Sep 10 20:57:51.767964 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.767942    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 20:57:51.769115 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.769092    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 20:57:51.769181 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.769136    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 20:57:51.769181 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.769156    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 20:57:51.769265 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.769192    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 20:57:51.771253 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.771233    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:51.814979 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.814954    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:51.815818 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.815804    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:51.815891 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.815831    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:51.815891 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.815844    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:51.815891 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.815874    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-151.ec2.internal"
Sep 10 20:57:51.822623 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.822547    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-151.ec2.internal"
Sep 10 20:57:51.822623 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.822567    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-151.ec2.internal\": node \"ip-10-0-136-151.ec2.internal\" not found"
Sep 10 20:57:51.840738 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.840720    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-151.ec2.internal\" not found"
Sep 10 20:57:51.870021 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.869994    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-151.ec2.internal"]
Sep 10 20:57:51.870126 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.870077    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:51.870976 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.870957    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:51.871089 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.870989    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:51.871089 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.870999    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:51.873157 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.873144    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:51.873251 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.873238    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:51.873298 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.873275    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:51.873835 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.873820    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:51.873901 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.873843    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:51.873901 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.873853    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:51.873901 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.873821    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:51.874064 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.873921    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:51.874064 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.873941    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:51.875924 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.875908    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:51.875995 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.875938    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:51.876587 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.876574    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:51.876658 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.876593    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:51.876658 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.876610    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:51.896672 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.896651    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-151.ec2.internal\" not found" node="ip-10-0-136-151.ec2.internal"
Sep 10 20:57:51.900815 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.900802    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-151.ec2.internal\" not found" node="ip-10-0-136-151.ec2.internal"
Sep 10 20:57:51.940955 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:51.940937    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-151.ec2.internal\" not found"
Sep 10 20:57:51.970211 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.970180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f47af150f2ad7e8a6a0fa4881de13e4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-151.ec2.internal\" (UID: \"2f47af150f2ad7e8a6a0fa4881de13e4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:51.970211 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.970217    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c155f05dd9f5ffb18d4d643ddd3d79e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal\" (UID: \"3c155f05dd9f5ffb18d4d643ddd3d79e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:51.970344 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:51.970234    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c155f05dd9f5ffb18d4d643ddd3d79e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal\" (UID: \"3c155f05dd9f5ffb18d4d643ddd3d79e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:52.041368 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:52.041329    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-151.ec2.internal\" not found"
Sep 10 20:57:52.070697 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:52.070672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f47af150f2ad7e8a6a0fa4881de13e4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-151.ec2.internal\" (UID: \"2f47af150f2ad7e8a6a0fa4881de13e4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:52.070769 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:52.070699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c155f05dd9f5ffb18d4d643ddd3d79e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal\" (UID: \"3c155f05dd9f5ffb18d4d643ddd3d79e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:52.070769 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:52.070717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c155f05dd9f5ffb18d4d643ddd3d79e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal\" (UID: \"3c155f05dd9f5ffb18d4d643ddd3d79e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:52.070769 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:52.070746    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c155f05dd9f5ffb18d4d643ddd3d79e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal\" (UID: \"3c155f05dd9f5ffb18d4d643ddd3d79e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:52.070875 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:52.070768    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f47af150f2ad7e8a6a0fa4881de13e4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-151.ec2.internal\" (UID: \"2f47af150f2ad7e8a6a0fa4881de13e4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:52.070875 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:52.070775    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c155f05dd9f5ffb18d4d643ddd3d79e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal\" (UID: \"3c155f05dd9f5ffb18d4d643ddd3d79e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:52.142129 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:52.142062    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-151.ec2.internal\" not found"
Sep 10 20:57:52.199621 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:52.199590    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:52.204472 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:52.204080    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:52.242755 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:52.242727    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-151.ec2.internal\" not found"
Sep 10 20:57:52.343313 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:52.343276    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-151.ec2.internal\" not found"
Sep 10 20:57:53.614784 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:53.614757    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-151.ec2.internal\" not found"
Sep 10 20:57:53.715358 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:53.715322    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-151.ec2.internal\" not found"
Sep 10 20:57:53.764938 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:53.764754    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 20:57:53.765378 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:53.765081    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 20:57:53.783871 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:53.783851    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:53.816088 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:53.816063    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-151.ec2.internal\" not found"
Sep 10 20:57:53.877191 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:53.877085    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 20:52:52 +0000 UTC" deadline="2028-04-23 12:02:07.042270719 +0000 UTC"
Sep 10 20:57:53.877191 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:53.877130    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14175h4m13.165145985s"
Sep 10 20:57:53.916498 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:53.916470    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-151.ec2.internal\" not found"
Sep 10 20:57:53.974700 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:53.974653    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f47af150f2ad7e8a6a0fa4881de13e4.slice/crio-da5eff6b4fabbb9128a01db6eea870c7dabf750190a75ab4c8e263f2e687ddd6 WatchSource:0}: Error finding container da5eff6b4fabbb9128a01db6eea870c7dabf750190a75ab4c8e263f2e687ddd6: Status 404 returned error can't find the container with id da5eff6b4fabbb9128a01db6eea870c7dabf750190a75ab4c8e263f2e687ddd6
Sep 10 20:57:53.975006 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:53.974985    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c155f05dd9f5ffb18d4d643ddd3d79e.slice/crio-6af16c6d6881da05f6ba96d51f6ecd8baae4ace8d25e4a7b85cd421e91d6b273 WatchSource:0}: Error finding container 6af16c6d6881da05f6ba96d51f6ecd8baae4ace8d25e4a7b85cd421e91d6b273: Status 404 returned error can't find the container with id 6af16c6d6881da05f6ba96d51f6ecd8baae4ace8d25e4a7b85cd421e91d6b273
Sep 10 20:57:53.981089 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:53.981063    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:53.981962 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:53.981946    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 20:57:53.982375 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:53.982352    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:53.982460 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:53.982385    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:53.982460 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:53.982402    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:54.017300 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:54.017272    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-151.ec2.internal\" not found"
Sep 10 20:57:54.096637 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.096609    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:54.138844 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.138756    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:54.150293 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.150271    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 20:57:54.151104 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.151090    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-151.ec2.internal"
Sep 10 20:57:54.156880 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.156864    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 20:57:54.329773 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.329744    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:54.809805 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.809777    2577 apiserver.go:52] "Watching apiserver"
Sep 10 20:57:54.816990 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.816957    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 20:57:54.818983 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.818955    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql","openshift-dns/node-resolver-vrfnj","openshift-image-registry/node-ca-dhdcz","openshift-multus/multus-additional-cni-plugins-bs2jp","openshift-network-diagnostics/network-check-target-q27cq","openshift-network-operator/iptables-alerter-qx8pm","openshift-ovn-kubernetes/ovnkube-node-4rz57","kube-system/global-pull-secret-syncer-wdxkj","kube-system/kube-apiserver-proxy-ip-10-0-136-151.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8r8zk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal","openshift-multus/multus-rq9nm","openshift-multus/network-metrics-daemon-5ll4j","kube-system/konnectivity-agent-t4b45"]
Sep 10 20:57:54.821642 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.821624    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.823793 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.823757    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:57:54.823881 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:54.823829    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:57:54.824358 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.824339    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 20:57:54.824447 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.824360    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l7nkj\""
Sep 10 20:57:54.824447 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.824375    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 20:57:54.824547 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.824472    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 20:57:54.824598 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.824548    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 20:57:54.824781 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.824766    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 20:57:54.824854 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.824801    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 20:57:54.826132 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.826117    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dhdcz"
Sep 10 20:57:54.828113 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.828094    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 20:57:54.828309 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.828248    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rdjvf\""
Sep 10 20:57:54.828309 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.828283    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 20:57:54.828519 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.828499    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 20:57:54.828618 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.828525    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.830596 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.830576    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 20:57:54.830697 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.830661    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2tmcl\""
Sep 10 20:57:54.830697 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.830686    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:57:54.830811 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.830695    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 20:57:54.830811 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:54.830742    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:57:54.830811 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.830581    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 20:57:54.830956 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.830858    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 20:57:54.831008 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.830961    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 20:57:54.833144 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.833126    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qx8pm"
Sep 10 20:57:54.835184 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.835164    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:57:54.835713 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.835460    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 20:57:54.835880 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.835498    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 20:57:54.836009 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.835540    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w75tm\""
Sep 10 20:57:54.836289 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.836271    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t4b45"
Sep 10 20:57:54.838478 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.838449    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 20:57:54.838937 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.838919    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 20:57:54.839485 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.839304    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 20:57:54.839485 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.839399    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.840388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.840360    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g97jb\""
Sep 10 20:57:54.841947 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.841929    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 20:57:54.841947 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.841935    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 20:57:54.842240 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.842222    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 20:57:54.842314 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.842298    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zgj7m\""
Sep 10 20:57:54.842388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.842361    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vrfnj"
Sep 10 20:57:54.844544 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.844428    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 20:57:54.844544 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.844494    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pzmx8\""
Sep 10 20:57:54.844711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.844618    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 20:57:54.844869 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.844851    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.846724 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.846699    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rxq64\""
Sep 10 20:57:54.846724 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.846713    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 20:57:54.846863 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.846832    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:57:54.847135 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.847117    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:57:54.847231 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:54.847194    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:57:54.847757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.847738    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 20:57:54.849650 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.849630    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.851649 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.851566    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hcmdd\""
Sep 10 20:57:54.851915 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.851898    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 20:57:54.852737 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.852617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smr6w\" (UniqueName: \"kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w\") pod \"network-check-target-q27cq\" (UID: \"c6c63bba-eea7-4479-abbc-7084fb8c8f7b\") " pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:57:54.853066 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.852973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-node-log\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.853510 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.853258    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a0a76c1-fac6-4c96-baf9-345e0fcf9d52-host\") pod \"node-ca-dhdcz\" (UID: \"0a0a76c1-fac6-4c96-baf9-345e0fcf9d52\") " pod="openshift-image-registry/node-ca-dhdcz"
Sep 10 20:57:54.853510 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.853294    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ltlg\" (UniqueName: \"kubernetes.io/projected/0a0a76c1-fac6-4c96-baf9-345e0fcf9d52-kube-api-access-2ltlg\") pod \"node-ca-dhdcz\" (UID: \"0a0a76c1-fac6-4c96-baf9-345e0fcf9d52\") " pod="openshift-image-registry/node-ca-dhdcz"
Sep 10 20:57:54.853510 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.853318    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4-agent-certs\") pod \"konnectivity-agent-t4b45\" (UID: \"5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4\") " pod="kube-system/konnectivity-agent-t4b45"
Sep 10 20:57:54.853510 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.853342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-etc-openvswitch\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.853510 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.853366    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d352d84c-ee74-469f-a98f-93ebff5effea-system-cni-dir\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.853510 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.853391    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d352d84c-ee74-469f-a98f-93ebff5effea-cni-binary-copy\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.853510 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.853412    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d352d84c-ee74-469f-a98f-93ebff5effea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.853510 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.853438    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d352d84c-ee74-469f-a98f-93ebff5effea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.854003 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.853463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-device-dir\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.854109 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-run-ovn\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.854109 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-log-socket\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.854222 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854096    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-registration-dir\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.854222 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854159    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-sys-fs\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.854394 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854243    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-slash\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.854394 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854281    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-cni-bin\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.854394 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgn67\" (UniqueName: \"kubernetes.io/projected/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-kube-api-access-fgn67\") pod \"network-metrics-daemon-5ll4j\" (UID: \"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda\") " pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:57:54.854394 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a0a76c1-fac6-4c96-baf9-345e0fcf9d52-serviceca\") pod \"node-ca-dhdcz\" (UID: \"0a0a76c1-fac6-4c96-baf9-345e0fcf9d52\") " pod="openshift-image-registry/node-ca-dhdcz"
Sep 10 20:57:54.854394 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b43f658-f338-479a-b979-4461acdc7696-hosts-file\") pod \"node-resolver-vrfnj\" (UID: \"7b43f658-f338-479a-b979-4461acdc7696\") " pod="openshift-dns/node-resolver-vrfnj"
Sep 10 20:57:54.854394 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854379    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d352d84c-ee74-469f-a98f-93ebff5effea-cnibin\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.854635 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vplfm\" (UniqueName: \"kubernetes.io/projected/d352d84c-ee74-469f-a98f-93ebff5effea-kube-api-access-vplfm\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.854635 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854426    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.854635 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.854635 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854479    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-cni-netd\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.854635 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854503    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51f4f335-90ff-481d-98bc-3599dda22b78-ovn-node-metrics-cert\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.854635 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854527    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51f4f335-90ff-481d-98bc-3599dda22b78-ovnkube-script-lib\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.854635 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-run-openvswitch\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.854635 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51f4f335-90ff-481d-98bc-3599dda22b78-ovnkube-config\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.854635 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz5dh\" (UniqueName: \"kubernetes.io/projected/51f4f335-90ff-481d-98bc-3599dda22b78-kube-api-access-kz5dh\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.855070 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4-konnectivity-ca\") pod \"konnectivity-agent-t4b45\" (UID: \"5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4\") " pod="kube-system/konnectivity-agent-t4b45"
Sep 10 20:57:54.855070 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnpdd\" (UniqueName: \"kubernetes.io/projected/0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5-kube-api-access-hnpdd\") pod \"iptables-alerter-qx8pm\" (UID: \"0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5\") " pod="openshift-network-operator/iptables-alerter-qx8pm"
Sep 10 20:57:54.855070 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854782    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-socket-dir\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.855070 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854812    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs\") pod \"network-metrics-daemon-5ll4j\" (UID: \"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda\") " pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:57:54.855070 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854837    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b43f658-f338-479a-b979-4461acdc7696-tmp-dir\") pod \"node-resolver-vrfnj\" (UID: \"7b43f658-f338-479a-b979-4461acdc7696\") " pod="openshift-dns/node-resolver-vrfnj"
Sep 10 20:57:54.855070 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854914    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-686gf\" (UniqueName: \"kubernetes.io/projected/7b43f658-f338-479a-b979-4461acdc7696-kube-api-access-686gf\") pod \"node-resolver-vrfnj\" (UID: \"7b43f658-f338-479a-b979-4461acdc7696\") " pod="openshift-dns/node-resolver-vrfnj"
Sep 10 20:57:54.855070 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d352d84c-ee74-469f-a98f-93ebff5effea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.855070 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.854995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5-iptables-alerter-script\") pod \"iptables-alerter-qx8pm\" (UID: \"0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5\") " pod="openshift-network-operator/iptables-alerter-qx8pm"
Sep 10 20:57:54.855070 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.855041    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-kubelet\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.855070 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.855064    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-systemd-units\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.855520 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.855087    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-run-netns\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.855520 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.855108    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-run-systemd\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.855520 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.855131    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.855520 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.855156    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51f4f335-90ff-481d-98bc-3599dda22b78-env-overrides\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.855520 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.855179    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5-host-slash\") pod \"iptables-alerter-qx8pm\" (UID: \"0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5\") " pod="openshift-network-operator/iptables-alerter-qx8pm"
Sep 10 20:57:54.855520 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.855203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42lz9\" (UniqueName: \"kubernetes.io/projected/90769ce8-65c3-45b7-8df6-103d331c66d7-kube-api-access-42lz9\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.855520 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.855225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-var-lib-openvswitch\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.855520 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.855248    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-run-ovn-kubernetes\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.872445 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.872417    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gp9vt"
Sep 10 20:57:54.877742 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.877718    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gp9vt"
Sep 10 20:57:54.940638 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.940609    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 20:57:54.945069 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.945001    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-151.ec2.internal" event={"ID":"2f47af150f2ad7e8a6a0fa4881de13e4","Type":"ContainerStarted","Data":"da5eff6b4fabbb9128a01db6eea870c7dabf750190a75ab4c8e263f2e687ddd6"}
Sep 10 20:57:54.946184 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.946162    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal" event={"ID":"3c155f05dd9f5ffb18d4d643ddd3d79e","Type":"ContainerStarted","Data":"6af16c6d6881da05f6ba96d51f6ecd8baae4ace8d25e4a7b85cd421e91d6b273"}
Sep 10 20:57:54.956319 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-sys-fs\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.956448 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-slash\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.956448 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d352d84c-ee74-469f-a98f-93ebff5effea-cnibin\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.956448 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956353    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.956448 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956385    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-kubernetes\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.956448 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956408    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5399360e-7ba7-4137-a37c-d4546fb4fc23-cni-binary-copy\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.956448 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956410    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-slash\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956431    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-sys-fs\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d352d84c-ee74-469f-a98f-93ebff5effea-cnibin\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956474    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-etc-kubernetes\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnpdd\" (UniqueName: \"kubernetes.io/projected/0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5-kube-api-access-hnpdd\") pod \"iptables-alerter-qx8pm\" (UID: \"0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5\") " pod="openshift-network-operator/iptables-alerter-qx8pm"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956547    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-socket-dir\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956575    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs\") pod \"network-metrics-daemon-5ll4j\" (UID: \"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda\") " pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-686gf\" (UniqueName: \"kubernetes.io/projected/7b43f658-f338-479a-b979-4461acdc7696-kube-api-access-686gf\") pod \"node-resolver-vrfnj\" (UID: \"7b43f658-f338-479a-b979-4461acdc7696\") " pod="openshift-dns/node-resolver-vrfnj"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956628    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-systemd\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5-iptables-alerter-script\") pod \"iptables-alerter-qx8pm\" (UID: \"0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5\") " pod="openshift-network-operator/iptables-alerter-qx8pm"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-kubelet\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956686    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-socket-dir\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:54.956694    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956713    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-systemd-units\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956748    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-kubelet\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.956784 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:54.956781    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs podName:c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda nodeName:}" failed. No retries permitted until 2026-09-10 20:57:55.456754314 +0000 UTC m=+3.030460682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs") pod "network-metrics-daemon-5ll4j" (UID: "c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:54.957453 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956801    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-run-netns\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.957453 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956822    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-systemd-units\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.957453 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956829    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-run-systemd\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.957453 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956883    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51f4f335-90ff-481d-98bc-3599dda22b78-env-overrides\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.957453 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956897    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-run-netns\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.957453 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956919    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-run-systemd\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.957453 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.956921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef86594a-45b7-47a7-861e-2f8b19252048-etc-tuned\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.957453 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.957277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-var-lib-kubelet\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.958943 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.958917    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5-iptables-alerter-script\") pod \"iptables-alerter-qx8pm\" (UID: \"0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5\") " pod="openshift-network-operator/iptables-alerter-qx8pm"
Sep 10 20:57:54.960336 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960171    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5-host-slash\") pod \"iptables-alerter-qx8pm\" (UID: \"0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5\") " pod="openshift-network-operator/iptables-alerter-qx8pm"
Sep 10 20:57:54.960336 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42lz9\" (UniqueName: \"kubernetes.io/projected/90769ce8-65c3-45b7-8df6-103d331c66d7-kube-api-access-42lz9\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.960336 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960272    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5-host-slash\") pod \"iptables-alerter-qx8pm\" (UID: \"0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5\") " pod="openshift-network-operator/iptables-alerter-qx8pm"
Sep 10 20:57:54.960336 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960281    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-var-lib-openvswitch\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.960585 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-run-ovn-kubernetes\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.960585 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960454    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-run-ovn-kubernetes\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.960585 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-modprobe-d\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.960585 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960324    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-var-lib-openvswitch\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.960585 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960513    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-host\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.960585 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960569    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51f4f335-90ff-481d-98bc-3599dda22b78-env-overrides\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.960585 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smr6w\" (UniqueName: \"kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w\") pod \"network-check-target-q27cq\" (UID: \"c6c63bba-eea7-4479-abbc-7084fb8c8f7b\") " pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:57:54.960908 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960622    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ltlg\" (UniqueName: \"kubernetes.io/projected/0a0a76c1-fac6-4c96-baf9-345e0fcf9d52-kube-api-access-2ltlg\") pod \"node-ca-dhdcz\" (UID: \"0a0a76c1-fac6-4c96-baf9-345e0fcf9d52\") " pod="openshift-image-registry/node-ca-dhdcz"
Sep 10 20:57:54.960908 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960692    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4-agent-certs\") pod \"konnectivity-agent-t4b45\" (UID: \"5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4\") " pod="kube-system/konnectivity-agent-t4b45"
Sep 10 20:57:54.960908 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a0a76c1-fac6-4c96-baf9-345e0fcf9d52-serviceca\") pod \"node-ca-dhdcz\" (UID: \"0a0a76c1-fac6-4c96-baf9-345e0fcf9d52\") " pod="openshift-image-registry/node-ca-dhdcz"
Sep 10 20:57:54.960908 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960781    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d352d84c-ee74-469f-a98f-93ebff5effea-system-cni-dir\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.960908 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960855    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d352d84c-ee74-469f-a98f-93ebff5effea-system-cni-dir\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.960908 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d352d84c-ee74-469f-a98f-93ebff5effea-cni-binary-copy\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.961259 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.960941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d352d84c-ee74-469f-a98f-93ebff5effea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.961259 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-log-socket\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.961259 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961182    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-log-socket\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.961696 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961540    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-registration-dir\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.961802 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-cni-bin\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.961802 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgn67\" (UniqueName: \"kubernetes.io/projected/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-kube-api-access-fgn67\") pod \"network-metrics-daemon-5ll4j\" (UID: \"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda\") " pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:57:54.961802 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961750    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a0a76c1-fac6-4c96-baf9-345e0fcf9d52-serviceca\") pod \"node-ca-dhdcz\" (UID: \"0a0a76c1-fac6-4c96-baf9-345e0fcf9d52\") " pod="openshift-image-registry/node-ca-dhdcz"
Sep 10 20:57:54.961802 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961770    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b43f658-f338-479a-b979-4461acdc7696-hosts-file\") pod \"node-resolver-vrfnj\" (UID: \"7b43f658-f338-479a-b979-4461acdc7696\") " pod="openshift-dns/node-resolver-vrfnj"
Sep 10 20:57:54.961802 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef86594a-45b7-47a7-861e-2f8b19252048-tmp\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.962082 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961817    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-system-cni-dir\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.962082 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961840    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-var-lib-cni-bin\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.962082 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961866    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncxdf\" (UniqueName: \"kubernetes.io/projected/5399360e-7ba7-4137-a37c-d4546fb4fc23-kube-api-access-ncxdf\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.962082 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vplfm\" (UniqueName: \"kubernetes.io/projected/d352d84c-ee74-469f-a98f-93ebff5effea-kube-api-access-vplfm\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.962082 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961918    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.962082 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961942    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-cni-netd\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.962082 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961959    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d352d84c-ee74-469f-a98f-93ebff5effea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.962082 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961595    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-registration-dir\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.962082 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d352d84c-ee74-469f-a98f-93ebff5effea-cni-binary-copy\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.962082 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51f4f335-90ff-481d-98bc-3599dda22b78-ovn-node-metrics-cert\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.962082 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962051    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-cni-bin\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.962082 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51f4f335-90ff-481d-98bc-3599dda22b78-ovnkube-script-lib\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.962082 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.961658    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 20:57:54.962082 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962083    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-sysctl-d\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j45gw\" (UniqueName: \"kubernetes.io/projected/ef86594a-45b7-47a7-861e-2f8b19252048-kube-api-access-j45gw\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962125    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7c136d4-6105-4707-add6-396ab1649cc2-kubelet-config\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962183    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962217    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-cni-netd\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962282    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b43f658-f338-479a-b979-4461acdc7696-hosts-file\") pod \"node-resolver-vrfnj\" (UID: \"7b43f658-f338-479a-b979-4461acdc7696\") " pod="openshift-dns/node-resolver-vrfnj"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-run-openvswitch\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51f4f335-90ff-481d-98bc-3599dda22b78-ovnkube-config\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz5dh\" (UniqueName: \"kubernetes.io/projected/51f4f335-90ff-481d-98bc-3599dda22b78-kube-api-access-kz5dh\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-run-openvswitch\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4-konnectivity-ca\") pod \"konnectivity-agent-t4b45\" (UID: \"5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4\") " pod="kube-system/konnectivity-agent-t4b45"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7c136d4-6105-4707-add6-396ab1649cc2-dbus\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962460    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-multus-cni-dir\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-cnibin\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962511    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-multus-socket-dir-parent\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962540    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b43f658-f338-479a-b979-4461acdc7696-tmp-dir\") pod \"node-resolver-vrfnj\" (UID: \"7b43f658-f338-479a-b979-4461acdc7696\") " pod="openshift-dns/node-resolver-vrfnj"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962566    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-hostroot\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.962757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962590    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d352d84c-ee74-469f-a98f-93ebff5effea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962593    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51f4f335-90ff-481d-98bc-3599dda22b78-ovnkube-script-lib\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-run\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962692    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962791    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-run-k8s-cni-cncf-io\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962826    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-run-netns\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962827    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d352d84c-ee74-469f-a98f-93ebff5effea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962904    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4-konnectivity-ca\") pod \"konnectivity-agent-t4b45\" (UID: \"5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4\") " pod="kube-system/konnectivity-agent-t4b45"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962915    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b43f658-f338-479a-b979-4461acdc7696-tmp-dir\") pod \"node-resolver-vrfnj\" (UID: \"7b43f658-f338-479a-b979-4461acdc7696\") " pod="openshift-dns/node-resolver-vrfnj"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.962986    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-var-lib-cni-multus\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963012    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-multus-conf-dir\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963050    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51f4f335-90ff-481d-98bc-3599dda22b78-ovnkube-config\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963054    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-sysconfig\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963140    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-node-log\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a0a76c1-fac6-4c96-baf9-345e0fcf9d52-host\") pod \"node-ca-dhdcz\" (UID: \"0a0a76c1-fac6-4c96-baf9-345e0fcf9d52\") " pod="openshift-image-registry/node-ca-dhdcz"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963185    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-node-log\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.963613 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-sysctl-conf\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963237    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-sys\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963239    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a0a76c1-fac6-4c96-baf9-345e0fcf9d52-host\") pod \"node-ca-dhdcz\" (UID: \"0a0a76c1-fac6-4c96-baf9-345e0fcf9d52\") " pod="openshift-image-registry/node-ca-dhdcz"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963261    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-lib-modules\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963317    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963344    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5399360e-7ba7-4137-a37c-d4546fb4fc23-multus-daemon-config\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-run-multus-certs\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-etc-openvswitch\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d352d84c-ee74-469f-a98f-93ebff5effea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963469    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-etc-openvswitch\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-device-dir\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963506    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-run-ovn\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963528    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-var-lib-kubelet\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963571    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90769ce8-65c3-45b7-8df6-103d331c66d7-device-dir\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963619    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51f4f335-90ff-481d-98bc-3599dda22b78-run-ovn\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.964370 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.963934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d352d84c-ee74-469f-a98f-93ebff5effea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.967123 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.966795    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51f4f335-90ff-481d-98bc-3599dda22b78-ovn-node-metrics-cert\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.967123 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:54.966912    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:54.967123 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:54.966931    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:54.967123 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:54.966947    2577 projected.go:196] Error preparing data for projected volume kube-api-access-smr6w for pod openshift-network-diagnostics/network-check-target-q27cq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:54.967123 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.966968    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4-agent-certs\") pod \"konnectivity-agent-t4b45\" (UID: \"5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4\") " pod="kube-system/konnectivity-agent-t4b45"
Sep 10 20:57:54.967123 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:54.967013    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w podName:c6c63bba-eea7-4479-abbc-7084fb8c8f7b nodeName:}" failed. No retries permitted until 2026-09-10 20:57:55.466995199 +0000 UTC m=+3.040701572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-smr6w" (UniqueName: "kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w") pod "network-check-target-q27cq" (UID: "c6c63bba-eea7-4479-abbc-7084fb8c8f7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:54.967522 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.967245    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnpdd\" (UniqueName: \"kubernetes.io/projected/0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5-kube-api-access-hnpdd\") pod \"iptables-alerter-qx8pm\" (UID: \"0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5\") " pod="openshift-network-operator/iptables-alerter-qx8pm"
Sep 10 20:57:54.967522 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.967508    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-686gf\" (UniqueName: \"kubernetes.io/projected/7b43f658-f338-479a-b979-4461acdc7696-kube-api-access-686gf\") pod \"node-resolver-vrfnj\" (UID: \"7b43f658-f338-479a-b979-4461acdc7696\") " pod="openshift-dns/node-resolver-vrfnj"
Sep 10 20:57:54.968327 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.968302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42lz9\" (UniqueName: \"kubernetes.io/projected/90769ce8-65c3-45b7-8df6-103d331c66d7-kube-api-access-42lz9\") pod \"aws-ebs-csi-driver-node-hkzql\" (UID: \"90769ce8-65c3-45b7-8df6-103d331c66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:54.969230 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.969209    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ltlg\" (UniqueName: \"kubernetes.io/projected/0a0a76c1-fac6-4c96-baf9-345e0fcf9d52-kube-api-access-2ltlg\") pod \"node-ca-dhdcz\" (UID: \"0a0a76c1-fac6-4c96-baf9-345e0fcf9d52\") " pod="openshift-image-registry/node-ca-dhdcz"
Sep 10 20:57:54.977647 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.977625    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vplfm\" (UniqueName: \"kubernetes.io/projected/d352d84c-ee74-469f-a98f-93ebff5effea-kube-api-access-vplfm\") pod \"multus-additional-cni-plugins-bs2jp\" (UID: \"d352d84c-ee74-469f-a98f-93ebff5effea\") " pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:54.981874 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.981848    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz5dh\" (UniqueName: \"kubernetes.io/projected/51f4f335-90ff-481d-98bc-3599dda22b78-kube-api-access-kz5dh\") pod \"ovnkube-node-4rz57\" (UID: \"51f4f335-90ff-481d-98bc-3599dda22b78\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:54.982231 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:54.982209    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgn67\" (UniqueName: \"kubernetes.io/projected/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-kube-api-access-fgn67\") pod \"network-metrics-daemon-5ll4j\" (UID: \"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda\") " pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:57:55.064781 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.064698    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef86594a-45b7-47a7-861e-2f8b19252048-tmp\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.064781 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.064738    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-system-cni-dir\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.064998 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.064802    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-var-lib-cni-bin\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.064998 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.064842    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-var-lib-cni-bin\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.064998 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.064852    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncxdf\" (UniqueName: \"kubernetes.io/projected/5399360e-7ba7-4137-a37c-d4546fb4fc23-kube-api-access-ncxdf\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.064998 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.064893    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-system-cni-dir\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.064998 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.064894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-sysctl-d\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.064998 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.064950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j45gw\" (UniqueName: \"kubernetes.io/projected/ef86594a-45b7-47a7-861e-2f8b19252048-kube-api-access-j45gw\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.064998 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.064978    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7c136d4-6105-4707-add6-396ab1649cc2-kubelet-config\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065001    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-sysctl-d\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7c136d4-6105-4707-add6-396ab1649cc2-dbus\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-multus-cni-dir\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065077    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-cnibin\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-multus-socket-dir-parent\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7c136d4-6105-4707-add6-396ab1649cc2-kubelet-config\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065118    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-hostroot\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-run\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065155    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-cnibin\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-run-k8s-cni-cncf-io\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065198    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7c136d4-6105-4707-add6-396ab1649cc2-dbus\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065217    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-run\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065223    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-multus-socket-dir-parent\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-run-netns\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065237    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-hostroot\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-var-lib-cni-multus\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065278    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-multus-cni-dir\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.065342 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065272    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-run-k8s-cni-cncf-io\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065308    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-run-netns\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065306    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-var-lib-cni-multus\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-multus-conf-dir\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065341    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-sysconfig\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065347    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-multus-conf-dir\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065429    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-sysctl-conf\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065451    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-sys\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065454    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-sysconfig\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065476    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-lib-modules\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065500    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-sys\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5399360e-7ba7-4137-a37c-d4546fb4fc23-multus-daemon-config\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065546    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-sysctl-conf\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065560    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-run-multus-certs\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065585    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-var-lib-kubelet\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065601    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-lib-modules\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:55.065607    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:55.066136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-kubernetes\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065646    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-run-multus-certs\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5399360e-7ba7-4137-a37c-d4546fb4fc23-cni-binary-copy\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:55.065678    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret podName:f7c136d4-6105-4707-add6-396ab1649cc2 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:55.565657122 +0000 UTC m=+3.139363474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret") pod "global-pull-secret-syncer-wdxkj" (UID: "f7c136d4-6105-4707-add6-396ab1649cc2") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065693    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-kubernetes\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-etc-kubernetes\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-systemd\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065818    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef86594a-45b7-47a7-861e-2f8b19252048-etc-tuned\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065848    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-etc-kubernetes\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065871    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-systemd\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-var-lib-kubelet\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-modprobe-d\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065950    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-var-lib-kubelet\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-host\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.065976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5399360e-7ba7-4137-a37c-d4546fb4fc23-host-var-lib-kubelet\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.066046    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-etc-modprobe-d\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.066072    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef86594a-45b7-47a7-861e-2f8b19252048-host\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.066757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.066146    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5399360e-7ba7-4137-a37c-d4546fb4fc23-multus-daemon-config\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.067319 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.066164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5399360e-7ba7-4137-a37c-d4546fb4fc23-cni-binary-copy\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.067615 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.067595    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef86594a-45b7-47a7-861e-2f8b19252048-tmp\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.067909 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.067882    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef86594a-45b7-47a7-861e-2f8b19252048-etc-tuned\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.073375 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.073356    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncxdf\" (UniqueName: \"kubernetes.io/projected/5399360e-7ba7-4137-a37c-d4546fb4fc23-kube-api-access-ncxdf\") pod \"multus-rq9nm\" (UID: \"5399360e-7ba7-4137-a37c-d4546fb4fc23\") " pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.079108 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.079083    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j45gw\" (UniqueName: \"kubernetes.io/projected/ef86594a-45b7-47a7-861e-2f8b19252048-kube-api-access-j45gw\") pod \"tuned-8r8zk\" (UID: \"ef86594a-45b7-47a7-861e-2f8b19252048\") " pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.134054 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.134010    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:57:55.142909 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.142880    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dhdcz"
Sep 10 20:57:55.150836 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.150812    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bs2jp"
Sep 10 20:57:55.157343 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.157321    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qx8pm"
Sep 10 20:57:55.164932 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.164874    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t4b45"
Sep 10 20:57:55.171579 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.171561    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql"
Sep 10 20:57:55.179283 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.179259    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vrfnj"
Sep 10 20:57:55.186118 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.186090    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8r8zk"
Sep 10 20:57:55.192924 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.192907    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rq9nm"
Sep 10 20:57:55.205394 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.205372    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:55.467879 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.467849    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs\") pod \"network-metrics-daemon-5ll4j\" (UID: \"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda\") " pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:57:55.468051 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.467897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smr6w\" (UniqueName: \"kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w\") pod \"network-check-target-q27cq\" (UID: \"c6c63bba-eea7-4479-abbc-7084fb8c8f7b\") " pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:57:55.468051 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:55.468016    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:55.468051 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:55.468042    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:55.468188 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:55.468060    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:55.468188 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:55.468073    2577 projected.go:196] Error preparing data for projected volume kube-api-access-smr6w for pod openshift-network-diagnostics/network-check-target-q27cq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:55.468188 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:55.468099    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs podName:c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda nodeName:}" failed. No retries permitted until 2026-09-10 20:57:56.468080435 +0000 UTC m=+4.041786794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs") pod "network-metrics-daemon-5ll4j" (UID: "c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:55.468188 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:55.468117    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w podName:c6c63bba-eea7-4479-abbc-7084fb8c8f7b nodeName:}" failed. No retries permitted until 2026-09-10 20:57:56.468107389 +0000 UTC m=+4.041813740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-smr6w" (UniqueName: "kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w") pod "network-check-target-q27cq" (UID: "c6c63bba-eea7-4479-abbc-7084fb8c8f7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:55.568600 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.568556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:57:55.568766 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:55.568693    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:55.568766 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:55.568751    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret podName:f7c136d4-6105-4707-add6-396ab1649cc2 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:56.56873344 +0000 UTC m=+4.142439805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret") pod "global-pull-secret-syncer-wdxkj" (UID: "f7c136d4-6105-4707-add6-396ab1649cc2") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:55.831784 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:55.831750    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd352d84c_ee74_469f_a98f_93ebff5effea.slice/crio-e06bac667391ffaa881cff44983e13bb01932b8d96e3df0425a1f87317b5e850 WatchSource:0}: Error finding container e06bac667391ffaa881cff44983e13bb01932b8d96e3df0425a1f87317b5e850: Status 404 returned error can't find the container with id e06bac667391ffaa881cff44983e13bb01932b8d96e3df0425a1f87317b5e850
Sep 10 20:57:55.832356 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:55.832319    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0286e71e_f3dd_4a6f_9006_9c4a0e52ceb5.slice/crio-51aed888be4d0f6f51f5c1b7977c2c22c74013bf5e6d321ae8df3ad49ee41a66 WatchSource:0}: Error finding container 51aed888be4d0f6f51f5c1b7977c2c22c74013bf5e6d321ae8df3ad49ee41a66: Status 404 returned error can't find the container with id 51aed888be4d0f6f51f5c1b7977c2c22c74013bf5e6d321ae8df3ad49ee41a66
Sep 10 20:57:55.836990 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:55.836966    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f4f335_90ff_481d_98bc_3599dda22b78.slice/crio-4ffdf50dc9f88ddd0c4206d922a2c9154117dce31dfe344bdf6322963fdf4c2f WatchSource:0}: Error finding container 4ffdf50dc9f88ddd0c4206d922a2c9154117dce31dfe344bdf6322963fdf4c2f: Status 404 returned error can't find the container with id 4ffdf50dc9f88ddd0c4206d922a2c9154117dce31dfe344bdf6322963fdf4c2f
Sep 10 20:57:55.840450 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:55.840427    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef86594a_45b7_47a7_861e_2f8b19252048.slice/crio-bf2d576abe7ac97283fadadee35a2ef2efe75abecf31e2be5235e9846fde9d34 WatchSource:0}: Error finding container bf2d576abe7ac97283fadadee35a2ef2efe75abecf31e2be5235e9846fde9d34: Status 404 returned error can't find the container with id bf2d576abe7ac97283fadadee35a2ef2efe75abecf31e2be5235e9846fde9d34
Sep 10 20:57:55.842746 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:55.842728    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0ed195_24d8_48fe_b0f6_2c9d498ee2b4.slice/crio-89a95c2e772795b1a2e8171c52409106b182f1b438188fa0bc1bbd07e2c4dd33 WatchSource:0}: Error finding container 89a95c2e772795b1a2e8171c52409106b182f1b438188fa0bc1bbd07e2c4dd33: Status 404 returned error can't find the container with id 89a95c2e772795b1a2e8171c52409106b182f1b438188fa0bc1bbd07e2c4dd33
Sep 10 20:57:55.843497 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:55.843477    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5399360e_7ba7_4137_a37c_d4546fb4fc23.slice/crio-8a63a610adf0a7c6c529a3e163942d4f95b55d86480d76dbf76951dae38a5a25 WatchSource:0}: Error finding container 8a63a610adf0a7c6c529a3e163942d4f95b55d86480d76dbf76951dae38a5a25: Status 404 returned error can't find the container with id 8a63a610adf0a7c6c529a3e163942d4f95b55d86480d76dbf76951dae38a5a25
Sep 10 20:57:55.845478 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:55.845455    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b43f658_f338_479a_b979_4461acdc7696.slice/crio-3997b0fc268bf1d3932e18117fb6aa9a2d161ec1f530f9f146e79216ab92abba WatchSource:0}: Error finding container 3997b0fc268bf1d3932e18117fb6aa9a2d161ec1f530f9f146e79216ab92abba: Status 404 returned error can't find the container with id 3997b0fc268bf1d3932e18117fb6aa9a2d161ec1f530f9f146e79216ab92abba
Sep 10 20:57:55.846650 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:55.846632    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a0a76c1_fac6_4c96_baf9_345e0fcf9d52.slice/crio-d438a29ad541f780d91c5a9399545f2309a935380020f62b0b36937b7333ac54 WatchSource:0}: Error finding container d438a29ad541f780d91c5a9399545f2309a935380020f62b0b36937b7333ac54: Status 404 returned error can't find the container with id d438a29ad541f780d91c5a9399545f2309a935380020f62b0b36937b7333ac54
Sep 10 20:57:55.847804 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:57:55.847776    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90769ce8_65c3_45b7_8df6_103d331c66d7.slice/crio-dc9ad2f79d552359fcae65ea7180cb53f1b34ff95de3e25e3e00fec05a1ea9fe WatchSource:0}: Error finding container dc9ad2f79d552359fcae65ea7180cb53f1b34ff95de3e25e3e00fec05a1ea9fe: Status 404 returned error can't find the container with id dc9ad2f79d552359fcae65ea7180cb53f1b34ff95de3e25e3e00fec05a1ea9fe
Sep 10 20:57:55.881020 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.880986    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 20:52:54 +0000 UTC" deadline="2028-04-23 21:37:36.989372105 +0000 UTC"
Sep 10 20:57:55.881020 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.881019    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14184h39m41.108356194s"
Sep 10 20:57:55.940568 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.940542    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:57:55.940672 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:55.940652    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:57:55.957089 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.957061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t4b45" event={"ID":"5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4","Type":"ContainerStarted","Data":"89a95c2e772795b1a2e8171c52409106b182f1b438188fa0bc1bbd07e2c4dd33"}
Sep 10 20:57:55.958404 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.958378    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dhdcz" event={"ID":"0a0a76c1-fac6-4c96-baf9-345e0fcf9d52","Type":"ContainerStarted","Data":"d438a29ad541f780d91c5a9399545f2309a935380020f62b0b36937b7333ac54"}
Sep 10 20:57:55.959481 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.959459    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8r8zk" event={"ID":"ef86594a-45b7-47a7-861e-2f8b19252048","Type":"ContainerStarted","Data":"bf2d576abe7ac97283fadadee35a2ef2efe75abecf31e2be5235e9846fde9d34"}
Sep 10 20:57:55.960665 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.960640    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql" event={"ID":"90769ce8-65c3-45b7-8df6-103d331c66d7","Type":"ContainerStarted","Data":"dc9ad2f79d552359fcae65ea7180cb53f1b34ff95de3e25e3e00fec05a1ea9fe"}
Sep 10 20:57:55.961701 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.961680    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vrfnj" event={"ID":"7b43f658-f338-479a-b979-4461acdc7696","Type":"ContainerStarted","Data":"3997b0fc268bf1d3932e18117fb6aa9a2d161ec1f530f9f146e79216ab92abba"}
Sep 10 20:57:55.965711 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.965690    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rq9nm" event={"ID":"5399360e-7ba7-4137-a37c-d4546fb4fc23","Type":"ContainerStarted","Data":"8a63a610adf0a7c6c529a3e163942d4f95b55d86480d76dbf76951dae38a5a25"}
Sep 10 20:57:55.966811 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.966793    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57" event={"ID":"51f4f335-90ff-481d-98bc-3599dda22b78","Type":"ContainerStarted","Data":"4ffdf50dc9f88ddd0c4206d922a2c9154117dce31dfe344bdf6322963fdf4c2f"}
Sep 10 20:57:55.969147 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.969128    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qx8pm" event={"ID":"0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5","Type":"ContainerStarted","Data":"51aed888be4d0f6f51f5c1b7977c2c22c74013bf5e6d321ae8df3ad49ee41a66"}
Sep 10 20:57:55.970846 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.970827    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bs2jp" event={"ID":"d352d84c-ee74-469f-a98f-93ebff5effea","Type":"ContainerStarted","Data":"e06bac667391ffaa881cff44983e13bb01932b8d96e3df0425a1f87317b5e850"}
Sep 10 20:57:55.974303 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.974278    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-151.ec2.internal" event={"ID":"2f47af150f2ad7e8a6a0fa4881de13e4","Type":"ContainerStarted","Data":"85fc308743912f098957f0274c5114b698d2861750d6974909a1898c8cdc8cdb"}
Sep 10 20:57:55.988467 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:55.988412    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-151.ec2.internal" podStartSLOduration=1.98839448 podStartE2EDuration="1.98839448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:55.98805404 +0000 UTC m=+3.561760414" watchObservedRunningTime="2026-09-10 20:57:55.98839448 +0000 UTC m=+3.562100855"
Sep 10 20:57:56.475130 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:56.474820    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs\") pod \"network-metrics-daemon-5ll4j\" (UID: \"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda\") " pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:57:56.475130 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:56.475112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smr6w\" (UniqueName: \"kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w\") pod \"network-check-target-q27cq\" (UID: \"c6c63bba-eea7-4479-abbc-7084fb8c8f7b\") " pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:57:56.475332 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:56.475249    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:56.475332 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:56.475268    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:56.475332 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:56.475279    2577 projected.go:196] Error preparing data for projected volume kube-api-access-smr6w for pod openshift-network-diagnostics/network-check-target-q27cq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:56.475486 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:56.475336    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w podName:c6c63bba-eea7-4479-abbc-7084fb8c8f7b nodeName:}" failed. No retries permitted until 2026-09-10 20:57:58.475316853 +0000 UTC m=+6.049023218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-smr6w" (UniqueName: "kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w") pod "network-check-target-q27cq" (UID: "c6c63bba-eea7-4479-abbc-7084fb8c8f7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:56.475699 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:56.475680    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:56.475757 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:56.475735    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs podName:c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda nodeName:}" failed. No retries permitted until 2026-09-10 20:57:58.475720865 +0000 UTC m=+6.049427225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs") pod "network-metrics-daemon-5ll4j" (UID: "c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:56.576062 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:56.576016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:57:56.576243 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:56.576178    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:56.576315 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:56.576265    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret podName:f7c136d4-6105-4707-add6-396ab1649cc2 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:58.576246151 +0000 UTC m=+6.149952518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret") pod "global-pull-secret-syncer-wdxkj" (UID: "f7c136d4-6105-4707-add6-396ab1649cc2") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:56.881737 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:56.881643    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 20:52:54 +0000 UTC" deadline="2028-05-03 06:56:05.993040339 +0000 UTC"
Sep 10 20:57:56.881737 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:56.881709    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14409h58m9.111335976s"
Sep 10 20:57:56.944783 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:56.944180    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:57:56.944783 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:56.944318    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:57:56.945861 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:56.945139    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:57:56.945861 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:56.945242    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:57:56.987319 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:56.985958    2577 generic.go:356] "Generic (PLEG): container finished" podID="3c155f05dd9f5ffb18d4d643ddd3d79e" containerID="d8cf3b39f6d06b95bed28b4e6732378879873ad3cd7bebcb4415cc159b1b4d9d" exitCode=0
Sep 10 20:57:56.987319 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:56.986970    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal" event={"ID":"3c155f05dd9f5ffb18d4d643ddd3d79e","Type":"ContainerDied","Data":"d8cf3b39f6d06b95bed28b4e6732378879873ad3cd7bebcb4415cc159b1b4d9d"}
Sep 10 20:57:57.940719 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:57.940686    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:57:57.941205 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:57.940865    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:57:58.010931 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:58.010847    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal" event={"ID":"3c155f05dd9f5ffb18d4d643ddd3d79e","Type":"ContainerStarted","Data":"a58d7415b920752efbbb0b9e8326a24d0ead7d4ce93fa009c248ff70e7e30b23"}
Sep 10 20:57:58.491231 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:58.491180    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs\") pod \"network-metrics-daemon-5ll4j\" (UID: \"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda\") " pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:57:58.491429 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:58.491241    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smr6w\" (UniqueName: \"kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w\") pod \"network-check-target-q27cq\" (UID: \"c6c63bba-eea7-4479-abbc-7084fb8c8f7b\") " pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:57:58.491429 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:58.491410    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:58.491429 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:58.491427    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:58.491587 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:58.491440    2577 projected.go:196] Error preparing data for projected volume kube-api-access-smr6w for pod openshift-network-diagnostics/network-check-target-q27cq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:58.491587 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:58.491502    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w podName:c6c63bba-eea7-4479-abbc-7084fb8c8f7b nodeName:}" failed. No retries permitted until 2026-09-10 20:58:02.491484443 +0000 UTC m=+10.065190798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-smr6w" (UniqueName: "kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w") pod "network-check-target-q27cq" (UID: "c6c63bba-eea7-4479-abbc-7084fb8c8f7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:58.491916 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:58.491882    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:58.492010 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:58.491932    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs podName:c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda nodeName:}" failed. No retries permitted until 2026-09-10 20:58:02.491916943 +0000 UTC m=+10.065623299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs") pod "network-metrics-daemon-5ll4j" (UID: "c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:58.591648 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:58.591609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:57:58.591834 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:58.591752    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:58.591834 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:58.591815    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret podName:f7c136d4-6105-4707-add6-396ab1649cc2 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:02.591797949 +0000 UTC m=+10.165504304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret") pod "global-pull-secret-syncer-wdxkj" (UID: "f7c136d4-6105-4707-add6-396ab1649cc2") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:58.940945 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:58.940420    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:57:58.940945 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:58.940456    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:57:58.940945 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:58.940550    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:57:58.940945 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:58.940688    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:57:59.940899 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:57:59.940641    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:57:59.940899 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:57:59.940795    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:00.940477 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:00.940441    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:00.940650 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:00.940583    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:58:00.940650 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:00.940634    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:00.940769 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:00.940747    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:58:01.941430 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:01.941353    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:01.941890 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:01.941496    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:02.527672 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:02.527640    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs\") pod \"network-metrics-daemon-5ll4j\" (UID: \"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda\") " pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:02.527872 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:02.527693    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smr6w\" (UniqueName: \"kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w\") pod \"network-check-target-q27cq\" (UID: \"c6c63bba-eea7-4479-abbc-7084fb8c8f7b\") " pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:02.527872 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:02.527818    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:58:02.527872 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:02.527818    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:02.528045 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:02.527895    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs podName:c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda nodeName:}" failed. No retries permitted until 2026-09-10 20:58:10.52787294 +0000 UTC m=+18.101579294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs") pod "network-metrics-daemon-5ll4j" (UID: "c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:02.528045 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:02.527832    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:58:02.528045 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:02.527952    2577 projected.go:196] Error preparing data for projected volume kube-api-access-smr6w for pod openshift-network-diagnostics/network-check-target-q27cq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:02.528045 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:02.528020    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w podName:c6c63bba-eea7-4479-abbc-7084fb8c8f7b nodeName:}" failed. No retries permitted until 2026-09-10 20:58:10.527990949 +0000 UTC m=+18.101697308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-smr6w" (UniqueName: "kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w") pod "network-check-target-q27cq" (UID: "c6c63bba-eea7-4479-abbc-7084fb8c8f7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:02.628902 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:02.628871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:02.629099 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:02.629013    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:02.629099 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:02.629080    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret podName:f7c136d4-6105-4707-add6-396ab1649cc2 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:10.629066676 +0000 UTC m=+18.202773027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret") pod "global-pull-secret-syncer-wdxkj" (UID: "f7c136d4-6105-4707-add6-396ab1649cc2") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:02.942319 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:02.941728    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:02.942319 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:02.941833    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:58:02.942319 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:02.942186    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:02.942319 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:02.942278    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:58:03.941279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:03.941195    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:03.941441 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:03.941325    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:04.940525 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:04.940481    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:04.940525 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:04.940522    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:04.941043 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:04.940595    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:58:04.941043 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:04.940708    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:58:05.941210 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:05.941172    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:05.941634 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:05.941321    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:06.941243 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:06.941207    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:06.941679 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:06.941214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:06.941679 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:06.941351    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:58:06.941679 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:06.941448    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:58:07.940496 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:07.940456    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:07.940686 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:07.940585    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:08.940669 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:08.940633    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:08.941136 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:08.940779    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:58:08.941136 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:08.940833    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:08.941136 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:08.940936    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:58:09.941119 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:09.941081    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:09.941604 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:09.941213    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:10.587550 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:10.587511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs\") pod \"network-metrics-daemon-5ll4j\" (UID: \"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda\") " pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:10.587550 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:10.587556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smr6w\" (UniqueName: \"kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w\") pod \"network-check-target-q27cq\" (UID: \"c6c63bba-eea7-4479-abbc-7084fb8c8f7b\") " pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:10.587789 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:10.587679    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:10.587789 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:10.587743    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:58:10.587789 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:10.587753    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs podName:c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda nodeName:}" failed. No retries permitted until 2026-09-10 20:58:26.587729596 +0000 UTC m=+34.161435948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs") pod "network-metrics-daemon-5ll4j" (UID: "c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:10.587789 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:10.587759    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:58:10.587789 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:10.587771    2577 projected.go:196] Error preparing data for projected volume kube-api-access-smr6w for pod openshift-network-diagnostics/network-check-target-q27cq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:10.588000 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:10.587821    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w podName:c6c63bba-eea7-4479-abbc-7084fb8c8f7b nodeName:}" failed. No retries permitted until 2026-09-10 20:58:26.587809897 +0000 UTC m=+34.161516249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-smr6w" (UniqueName: "kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w") pod "network-check-target-q27cq" (UID: "c6c63bba-eea7-4479-abbc-7084fb8c8f7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:10.688334 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:10.688299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:10.688526 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:10.688472    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:10.688591 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:10.688545    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret podName:f7c136d4-6105-4707-add6-396ab1649cc2 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:26.688530579 +0000 UTC m=+34.262236931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret") pod "global-pull-secret-syncer-wdxkj" (UID: "f7c136d4-6105-4707-add6-396ab1649cc2") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:10.941325 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:10.941233    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:10.941729 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:10.941370    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:58:10.941729 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:10.941426    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:10.941729 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:10.941533    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:58:11.940388 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:11.940347    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:11.940559 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:11.940493    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:12.941770 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:12.941736    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:12.942258 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:12.941851    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:58:12.942258 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:12.941910    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:12.942258 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:12.942053    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:58:13.941337 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:13.941153    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:13.941476 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:13.941452    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:14.042920 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.042792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dhdcz" event={"ID":"0a0a76c1-fac6-4c96-baf9-345e0fcf9d52","Type":"ContainerStarted","Data":"0532d46512e93cee4f1c789e96e1c1a1cc5e0be36315197ab9efd94cd922332a"}
Sep 10 20:58:14.044568 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.044537    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8r8zk" event={"ID":"ef86594a-45b7-47a7-861e-2f8b19252048","Type":"ContainerStarted","Data":"a832200b4499a5c37c85517cb962b6efb4bd10b7b5706aff62385182a5ead5e1"}
Sep 10 20:58:14.046003 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.045982    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql" event={"ID":"90769ce8-65c3-45b7-8df6-103d331c66d7","Type":"ContainerStarted","Data":"331da5e7ba63b6895629630ebbbe302c7bbd0a7d89255b9e5b4d776306ebbb43"}
Sep 10 20:58:14.047443 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.047422    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vrfnj" event={"ID":"7b43f658-f338-479a-b979-4461acdc7696","Type":"ContainerStarted","Data":"c1ce9778e99cc02f924e4c23ce5327431479cdcbad0a7eed70763aeb7ba88e29"}
Sep 10 20:58:14.048957 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.048935    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rq9nm" event={"ID":"5399360e-7ba7-4137-a37c-d4546fb4fc23","Type":"ContainerStarted","Data":"8f08d755057aac6a1122c8924f2cf44a5d91b236834d8109db86e884e54a08f7"}
Sep 10 20:58:14.051824 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.051805    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57" event={"ID":"51f4f335-90ff-481d-98bc-3599dda22b78","Type":"ContainerStarted","Data":"68f798420e0959f89367c72ca63de61e907511acc300ea4b3af5bd0ae0b54a9b"}
Sep 10 20:58:14.051903 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.051864    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57" event={"ID":"51f4f335-90ff-481d-98bc-3599dda22b78","Type":"ContainerStarted","Data":"a64ede152606f2c42e06b3a205c6be0369a07a12bd9dd027c703d9dd9d947a4f"}
Sep 10 20:58:14.051903 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.051894    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57" event={"ID":"51f4f335-90ff-481d-98bc-3599dda22b78","Type":"ContainerStarted","Data":"6878129987ef93cd960f1aa3c0fa71e38ed2bb08a83c29168afdcf5861cab140"}
Sep 10 20:58:14.051981 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.051931    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57" event={"ID":"51f4f335-90ff-481d-98bc-3599dda22b78","Type":"ContainerStarted","Data":"daf385e1b53189c35e6fb5b03bf2c7dd50f6373dcc7bd57f622875fd6631d6e8"}
Sep 10 20:58:14.051981 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.051961    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57" event={"ID":"51f4f335-90ff-481d-98bc-3599dda22b78","Type":"ContainerStarted","Data":"f06713bf6dd54ce1209b3b0b23bcc6f7e44154d09c24a2beef2d8c5f7fb833fd"}
Sep 10 20:58:14.053264 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.053242    2577 generic.go:356] "Generic (PLEG): container finished" podID="d352d84c-ee74-469f-a98f-93ebff5effea" containerID="58500a6cb675a6b0a68d1f8b9821a717878771661b83d106cef44947670dc343" exitCode=0
Sep 10 20:58:14.053357 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.053318    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bs2jp" event={"ID":"d352d84c-ee74-469f-a98f-93ebff5effea","Type":"ContainerDied","Data":"58500a6cb675a6b0a68d1f8b9821a717878771661b83d106cef44947670dc343"}
Sep 10 20:58:14.055409 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.055387    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t4b45" event={"ID":"5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4","Type":"ContainerStarted","Data":"b76805874c3a3340d5ba0fa9fa67f7831d6fcca5924017a8217fd0f33c921983"}
Sep 10 20:58:14.061788 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.061739    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-151.ec2.internal" podStartSLOduration=20.061719487 podStartE2EDuration="20.061719487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:58.02575237 +0000 UTC m=+5.599458748" watchObservedRunningTime="2026-09-10 20:58:14.061719487 +0000 UTC m=+21.635425862"
Sep 10 20:58:14.062089 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.062061    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dhdcz" podStartSLOduration=3.407481303 podStartE2EDuration="21.062052336s" totalImagesPullingTime="17.654571033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:14.061338364 +0000 UTC m=+21.635044746" watchObservedRunningTime="2026-09-10 20:58:14.062052336 +0000 UTC m=+21.635758710"
Sep 10 20:58:14.075509 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.075466    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t4b45" podStartSLOduration=10.821348655 podStartE2EDuration="21.075452764s" totalImagesPullingTime="10.254104109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:14.075130001 +0000 UTC m=+21.648836383" watchObservedRunningTime="2026-09-10 20:58:14.075452764 +0000 UTC m=+21.649159137"
Sep 10 20:58:14.092355 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.092315    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rq9nm" podStartSLOduration=3.377836108 podStartE2EDuration="21.092300455s" totalImagesPullingTime="17.714464347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:14.091580422 +0000 UTC m=+21.665286807" watchObservedRunningTime="2026-09-10 20:58:14.092300455 +0000 UTC m=+21.666006829"
Sep 10 20:58:14.127216 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.127108    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vrfnj" podStartSLOduration=3.490178831 podStartE2EDuration="21.127095054s" totalImagesPullingTime="17.636916223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:14.126563435 +0000 UTC m=+21.700269808" watchObservedRunningTime="2026-09-10 20:58:14.127095054 +0000 UTC m=+21.700801429"
Sep 10 20:58:14.143019 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.142975    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8r8zk" podStartSLOduration=3.48115367 podStartE2EDuration="21.142962334s" totalImagesPullingTime="17.661808664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:14.142957279 +0000 UTC m=+21.716663657" watchObservedRunningTime="2026-09-10 20:58:14.142962334 +0000 UTC m=+21.716668708"
Sep 10 20:58:14.685679 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.685649    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t4b45"
Sep 10 20:58:14.940734 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.940585    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:14.940868 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.940617    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:14.940868 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:14.940829    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:58:14.940984 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:14.940891    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:58:14.948283 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:14.948256    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 20:58:15.061867 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:15.061785    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql" event={"ID":"90769ce8-65c3-45b7-8df6-103d331c66d7","Type":"ContainerStarted","Data":"2e583f320a0638a06fb002d4d642b3a3e0d993d4a8aee9f71210793af9aa07f0"}
Sep 10 20:58:15.065386 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:15.065355    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57" event={"ID":"51f4f335-90ff-481d-98bc-3599dda22b78","Type":"ContainerStarted","Data":"18904036f07ffcb7d521ded72b6ff439190f25dd25f0ef5ae66fd24f081462ef"}
Sep 10 20:58:15.066986 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:15.066954    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qx8pm" event={"ID":"0286e71e-f3dd-4a6f-9006-9c4a0e52ceb5","Type":"ContainerStarted","Data":"1f787c6e99710eebbfdb8db1fafcfcc5d0a691974c8c7cca78b608bb029a0852"}
Sep 10 20:58:15.079795 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:15.079736    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qx8pm" podStartSLOduration=4.430093694 podStartE2EDuration="22.079719745s" totalImagesPullingTime="17.649626051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:15.079501774 +0000 UTC m=+22.653208148" watchObservedRunningTime="2026-09-10 20:58:15.079719745 +0000 UTC m=+22.653426119"
Sep 10 20:58:15.898838 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:15.898737    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T20:58:14.948278304Z","UUID":"2d8457f8-d904-4faf-9ed4-0883d47b4017","Handler":null,"Name":"","Endpoint":""}
Sep 10 20:58:15.900245 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:15.900219    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 20:58:15.900373 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:15.900254    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 20:58:15.940995 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:15.940968    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:15.941159 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:15.941103    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:16.074091 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:16.074067    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t4b45"
Sep 10 20:58:16.074663 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:16.074642    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t4b45"
Sep 10 20:58:16.081651 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:16.081632    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t4b45"
Sep 10 20:58:16.940696 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:16.940668    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:16.940696 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:16.940706    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:16.941003 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:16.940803    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:58:16.941072 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:16.940998    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:58:17.073736 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:17.073683    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql" event={"ID":"90769ce8-65c3-45b7-8df6-103d331c66d7","Type":"ContainerStarted","Data":"697c4b700c1339d61fec7b11e391fd7e2e0aa17fc706c3a7b79e5e11d3b25246"}
Sep 10 20:58:17.077640 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:17.077614    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57" event={"ID":"51f4f335-90ff-481d-98bc-3599dda22b78","Type":"ContainerStarted","Data":"cc49f3bf7155a19747005612d4a10d59ad54d3a709525c0344da8535de14e1a0"}
Sep 10 20:58:17.089735 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:17.089695    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkzql" podStartSLOduration=4.245702204 podStartE2EDuration="24.089675368s" totalImagesPullingTime="19.843973164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:17.088696321 +0000 UTC m=+24.662402694" watchObservedRunningTime="2026-09-10 20:58:17.089675368 +0000 UTC m=+24.663381741"
Sep 10 20:58:17.941252 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:17.941214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:17.941411 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:17.941366    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:18.941246 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:18.941207    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:18.942179 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:18.941315    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:58:18.942179 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:18.941371    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:18.942179 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:18.941458    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:58:19.085409 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:19.085373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57" event={"ID":"51f4f335-90ff-481d-98bc-3599dda22b78","Type":"ContainerStarted","Data":"3e58cd76d858640302cea6906fab74ec56af7b84692ca1226507ec3daedf8810"}
Sep 10 20:58:19.085648 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:19.085619    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:58:19.085761 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:19.085700    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:58:19.085890 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:19.085762    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:58:19.087516 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:19.087493    2577 generic.go:356] "Generic (PLEG): container finished" podID="d352d84c-ee74-469f-a98f-93ebff5effea" containerID="0155c4e211ebba168a127acae99635dc14d10ad7a5e34f76713564bd28ffc91d" exitCode=0
Sep 10 20:58:19.087620 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:19.087522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bs2jp" event={"ID":"d352d84c-ee74-469f-a98f-93ebff5effea","Type":"ContainerDied","Data":"0155c4e211ebba168a127acae99635dc14d10ad7a5e34f76713564bd28ffc91d"}
Sep 10 20:58:19.101129 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:19.101106    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:58:19.101255 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:19.101213    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:58:19.108586 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:19.108547    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57" podStartSLOduration=8.347105024 podStartE2EDuration="26.108534108s" totalImagesPullingTime="17.761429084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:19.106968465 +0000 UTC m=+26.680674840" watchObservedRunningTime="2026-09-10 20:58:19.108534108 +0000 UTC m=+26.682240482"
Sep 10 20:58:19.941349 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:19.941204    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:19.941678 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:19.941428    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:20.314305 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:20.314269    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wdxkj"]
Sep 10 20:58:20.314425 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:20.314395    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:20.314538 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:20.314513    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:58:20.316882 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:20.316858    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q27cq"]
Sep 10 20:58:20.316960 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:20.316948    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:20.317068 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:20.317040    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:58:20.327206 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:20.327186    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5ll4j"]
Sep 10 20:58:20.327288 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:20.327276    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:20.327397 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:20.327380    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:21.094063 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:21.094020    2577 generic.go:356] "Generic (PLEG): container finished" podID="d352d84c-ee74-469f-a98f-93ebff5effea" containerID="580ed2778f744230d79adfe57b3c579407347e66bfb092dc8407b16ddaf4bd20" exitCode=0
Sep 10 20:58:21.094475 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:21.094107    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bs2jp" event={"ID":"d352d84c-ee74-469f-a98f-93ebff5effea","Type":"ContainerDied","Data":"580ed2778f744230d79adfe57b3c579407347e66bfb092dc8407b16ddaf4bd20"}
Sep 10 20:58:21.941083 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:21.941047    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:21.941083 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:21.941082    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:21.941268 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:21.941149    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:21.941268 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:21.941162    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:58:21.941268 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:21.941239    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:58:21.941393 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:21.941291    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:22.099196 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:22.099163    2577 generic.go:356] "Generic (PLEG): container finished" podID="d352d84c-ee74-469f-a98f-93ebff5effea" containerID="d4364a947a0be6e46d765f36bf71a3521c90d5b3fdb27d42c6a7037a57bbbadc" exitCode=0
Sep 10 20:58:22.099568 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:22.099204    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bs2jp" event={"ID":"d352d84c-ee74-469f-a98f-93ebff5effea","Type":"ContainerDied","Data":"d4364a947a0be6e46d765f36bf71a3521c90d5b3fdb27d42c6a7037a57bbbadc"}
Sep 10 20:58:23.941189 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:23.941162    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:23.941602 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:23.941270    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:23.941602 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:23.941281    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:58:23.941602 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:23.941296    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:23.941602 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:23.941346    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:58:23.941602 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:23.941419    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:25.941509 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:25.941299    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:25.942010 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:25.941315    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:25.942010 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:25.941612    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q27cq" podUID="c6c63bba-eea7-4479-abbc-7084fb8c8f7b"
Sep 10 20:58:25.942010 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:25.941364    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:25.942010 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:25.941700    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ll4j" podUID="c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda"
Sep 10 20:58:25.942010 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:25.941780    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdxkj" podUID="f7c136d4-6105-4707-add6-396ab1649cc2"
Sep 10 20:58:26.172919 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.172883    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-151.ec2.internal" event="NodeReady"
Sep 10 20:58:26.173108 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.173064    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 20:58:26.206921 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.206840    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb"]
Sep 10 20:58:26.231898 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.231869    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76fb84588b-9vf44"]
Sep 10 20:58:26.232077 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.232003    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb"
Sep 10 20:58:26.234336 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.234313    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:58:26.234336 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.234312    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mz4kf\""
Sep 10 20:58:26.234515 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.234477    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 10 20:58:26.234649 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.234631    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 10 20:58:26.234908 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.234878    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 10 20:58:26.245841 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.245818    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb"]
Sep 10 20:58:26.245976 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.245865    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wn27x"]
Sep 10 20:58:26.246057 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.245984    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.248223 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.248205    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 20:58:26.248309 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.248277    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 20:58:26.248633 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.248613    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-88l8n\""
Sep 10 20:58:26.248730 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.248625    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 20:58:26.253367 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.253345    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 20:58:26.264803 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.264616    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-2mqjs"]
Sep 10 20:58:26.265565 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.265427    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wn27x"
Sep 10 20:58:26.267382 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.267359    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:58:26.267682 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.267666    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tsd6w\""
Sep 10 20:58:26.267734 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.267708    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 10 20:58:26.290134 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.290110    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"]
Sep 10 20:58:26.290287 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.290248    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:26.292430 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.292399    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 10 20:58:26.292430 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.292410    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 10 20:58:26.292430 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.292423    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kx47x\""
Sep 10 20:58:26.292663 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.292424    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:58:26.292663 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.292469    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 10 20:58:26.297256 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.297230    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 10 20:58:26.306076 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.306057    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-w6jvn"]
Sep 10 20:58:26.306179 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.306123    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"
Sep 10 20:58:26.308171 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.308146    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dz6th\""
Sep 10 20:58:26.308255 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.308144    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 10 20:58:26.308426 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.308401    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 10 20:58:26.322119 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.322101    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-svh6n"]
Sep 10 20:58:26.322245 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.322227    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-w6jvn"
Sep 10 20:58:26.324346 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.324326    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 20:58:26.324486 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.324464    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hlp7f\""
Sep 10 20:58:26.324616 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.324389    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 20:58:26.342302 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.342277    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-84d6cf958b-xf674"]
Sep 10 20:58:26.342431 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.342390    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.344540 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.344513    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 10 20:58:26.344540 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.344535    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 20:58:26.344816 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.344800    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 20:58:26.345003 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.344984    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 10 20:58:26.345287 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.345270    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mhqk9\""
Sep 10 20:58:26.350263 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.350244    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 10 20:58:26.361850 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.361831    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h8z6q"]
Sep 10 20:58:26.361984 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.361964    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:26.363992 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.363957    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 10 20:58:26.364099 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.364069    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 20:58:26.364099 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.364092    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lc2fz\""
Sep 10 20:58:26.364220 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.364172    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 20:58:26.364220 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.364200    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 10 20:58:26.364346 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.364127    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 10 20:58:26.364346 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.364318    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 10 20:58:26.384967 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.384939    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7w8w9"]
Sep 10 20:58:26.385246 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.385164    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:26.387953 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.387931    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 20:58:26.388076 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.387996    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 20:58:26.388076 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.388019    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-56bmz\""
Sep 10 20:58:26.398606 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.398588    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll"]
Sep 10 20:58:26.398724 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.398707    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7w8w9"
Sep 10 20:58:26.399797 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.399773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8rz9\" (UniqueName: \"kubernetes.io/projected/6e48c5c5-910e-4763-baf4-92ae5b7eb84b-kube-api-access-c8rz9\") pod \"network-check-source-6f8b768455-w6jvn\" (UID: \"6e48c5c5-910e-4763-baf4-92ae5b7eb84b\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-w6jvn"
Sep 10 20:58:26.399890 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.399810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmz7b\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-kube-api-access-wmz7b\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.399890 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.399839    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/713c4120-1f4e-4ada-b6ed-58830761895e-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-7wkln\" (UID: \"713c4120-1f4e-4ada-b6ed-58830761895e\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"
Sep 10 20:58:26.399890 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.399862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg2kh\" (UniqueName: \"kubernetes.io/projected/b58c2c3a-5930-45ab-83b7-f51b29b82a1f-kube-api-access-dg2kh\") pod \"console-operator-696884fb9c-2mqjs\" (UID: \"b58c2c3a-5930-45ab-83b7-f51b29b82a1f\") " pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:26.400073 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.399930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-7wkln\" (UID: \"713c4120-1f4e-4ada-b6ed-58830761895e\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"
Sep 10 20:58:26.400073 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.399968    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/57ea0bf3-4ca1-484f-80f3-0f107c8895e7-config\") pod \"service-ca-operator-cf7c776b7-54vqb\" (UID: \"57ea0bf3-4ca1-484f-80f3-0f107c8895e7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb"
Sep 10 20:58:26.400073 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.399996    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-image-registry-private-configuration\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.400223 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.400154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-certificates\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.400223 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.400182    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-trusted-ca\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.400223 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.400207    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-bound-sa-token\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.400346 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.400231    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.400346 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.400255    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b58c2c3a-5930-45ab-83b7-f51b29b82a1f-config\") pod \"console-operator-696884fb9c-2mqjs\" (UID: \"b58c2c3a-5930-45ab-83b7-f51b29b82a1f\") " pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:26.400346 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.400317    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlv7v\" (UniqueName: \"kubernetes.io/projected/91a65d43-13c4-4d6c-9690-fe7ab89554e5-kube-api-access-jlv7v\") pod \"volume-data-source-validator-86695b7cc7-wn27x\" (UID: \"91a65d43-13c4-4d6c-9690-fe7ab89554e5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wn27x"
Sep 10 20:58:26.400468 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.400353    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkbbr\" (UniqueName: \"kubernetes.io/projected/57ea0bf3-4ca1-484f-80f3-0f107c8895e7-kube-api-access-vkbbr\") pod \"service-ca-operator-cf7c776b7-54vqb\" (UID: \"57ea0bf3-4ca1-484f-80f3-0f107c8895e7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb"
Sep 10 20:58:26.400468 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.400379    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b58c2c3a-5930-45ab-83b7-f51b29b82a1f-trusted-ca\") pod \"console-operator-696884fb9c-2mqjs\" (UID: \"b58c2c3a-5930-45ab-83b7-f51b29b82a1f\") " pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:26.400468 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.400421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/57ea0bf3-4ca1-484f-80f3-0f107c8895e7-serving-cert\") pod \"service-ca-operator-cf7c776b7-54vqb\" (UID: \"57ea0bf3-4ca1-484f-80f3-0f107c8895e7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb"
Sep 10 20:58:26.400468 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.400454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b58c2c3a-5930-45ab-83b7-f51b29b82a1f-serving-cert\") pod \"console-operator-696884fb9c-2mqjs\" (UID: \"b58c2c3a-5930-45ab-83b7-f51b29b82a1f\") " pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:26.400667 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.400515    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-installation-pull-secrets\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.400667 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.400554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-ca-trust-extracted\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.400857 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.400830    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 20:58:26.401183 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.401147    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 20:58:26.401282 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.401219    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jcxqf\""
Sep 10 20:58:26.401358 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.401160    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 20:58:26.420654 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.420617    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"]
Sep 10 20:58:26.420779 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.420740    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll"
Sep 10 20:58:26.423000 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.422979    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 20:58:26.423117 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.422979    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 20:58:26.423350 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.423330    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xg5hj\""
Sep 10 20:58:26.423428 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.423334    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:58:26.423509 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.423492    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 20:58:26.440715 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.440691    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"]
Sep 10 20:58:26.440813 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.440803    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"
Sep 10 20:58:26.442892 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.442872    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 10 20:58:26.443006 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.442950    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 10 20:58:26.443307 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.443225    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9m4tq\""
Sep 10 20:58:26.443458 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.443442    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:58:26.462813 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.462757    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76fb84588b-9vf44"]
Sep 10 20:58:26.462813 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.462788    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wn27x"]
Sep 10 20:58:26.462813 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.462802    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-w6jvn"]
Sep 10 20:58:26.463005 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.462818    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-2mqjs"]
Sep 10 20:58:26.463005 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.462838    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h8z6q"]
Sep 10 20:58:26.463005 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.462863    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll"]
Sep 10 20:58:26.463005 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.462880    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7w8w9"]
Sep 10 20:58:26.463005 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.462889    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:26.463005 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.462892    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84d6cf958b-xf674"]
Sep 10 20:58:26.463277 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.463052    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"]
Sep 10 20:58:26.463277 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.463084    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"]
Sep 10 20:58:26.463277 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.463113    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-svh6n"]
Sep 10 20:58:26.463277 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.463140    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"]
Sep 10 20:58:26.465276 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.465249    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 10 20:58:26.465949 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.465915    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b6tx6\""
Sep 10 20:58:26.465949 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.465918    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 20:58:26.466129 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.465922    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 10 20:58:26.466129 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.465923    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 20:58:26.501921 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.501889    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8rz9\" (UniqueName: \"kubernetes.io/projected/6e48c5c5-910e-4763-baf4-92ae5b7eb84b-kube-api-access-c8rz9\") pod \"network-check-source-6f8b768455-w6jvn\" (UID: \"6e48c5c5-910e-4763-baf4-92ae5b7eb84b\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-w6jvn"
Sep 10 20:58:26.502088 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.501928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7r9ll\" (UID: \"3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll"
Sep 10 20:58:26.502088 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.501957    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-trusted-ca\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.502088 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-bound-sa-token\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.502088 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502062    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.502278 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbbr\" (UniqueName: \"kubernetes.io/projected/57ea0bf3-4ca1-484f-80f3-0f107c8895e7-kube-api-access-vkbbr\") pod \"service-ca-operator-cf7c776b7-54vqb\" (UID: \"57ea0bf3-4ca1-484f-80f3-0f107c8895e7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb"
Sep 10 20:58:26.502278 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502146    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-config-volume\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:26.502278 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502172    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvmk4\" (UniqueName: \"kubernetes.io/projected/3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a-kube-api-access-hvmk4\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7r9ll\" (UID: \"3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll"
Sep 10 20:58:26.502278 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502204    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:26.502278 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502246    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-installation-pull-secrets\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.502479 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502363    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-tmp-dir\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:26.502479 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:26.502479 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.502439    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 20:58:26.502479 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.502462    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fb84588b-9vf44: secret "image-registry-tls" not found
Sep 10 20:58:26.502640 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.502515    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls podName:559d2df7-ee5d-48b6-98ad-22faaf8d2a23 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:27.002498822 +0000 UTC m=+34.576205179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls") pod "image-registry-76fb84588b-9vf44" (UID: "559d2df7-ee5d-48b6-98ad-22faaf8d2a23") : secret "image-registry-tls" not found
Sep 10 20:58:26.502640 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502437    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pssng\" (UniqueName: \"kubernetes.io/projected/2cb1e53a-557c-4fcb-aba1-165d52863de8-kube-api-access-pssng\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.502640 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-stats-auth\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:26.502640 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmz7b\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-kube-api-access-wmz7b\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.502640 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fbaa2ca-55f1-45b4-8b64-6e31f788e200-cert\") pod \"ingress-canary-7w8w9\" (UID: \"4fbaa2ca-55f1-45b4-8b64-6e31f788e200\") " pod="openshift-ingress-canary/ingress-canary-7w8w9"
Sep 10 20:58:26.502917 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhn24\" (UniqueName: \"kubernetes.io/projected/4fbaa2ca-55f1-45b4-8b64-6e31f788e200-kube-api-access-dhn24\") pod \"ingress-canary-7w8w9\" (UID: \"4fbaa2ca-55f1-45b4-8b64-6e31f788e200\") " pod="openshift-ingress-canary/ingress-canary-7w8w9"
Sep 10 20:58:26.502917 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/57ea0bf3-4ca1-484f-80f3-0f107c8895e7-config\") pod \"service-ca-operator-cf7c776b7-54vqb\" (UID: \"57ea0bf3-4ca1-484f-80f3-0f107c8895e7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb"
Sep 10 20:58:26.502917 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-image-registry-private-configuration\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.502917 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502743    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cb1e53a-557c-4fcb-aba1-165d52863de8-tmp\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.502917 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b58c2c3a-5930-45ab-83b7-f51b29b82a1f-trusted-ca\") pod \"console-operator-696884fb9c-2mqjs\" (UID: \"b58c2c3a-5930-45ab-83b7-f51b29b82a1f\") " pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:26.502917 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-certificates\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.502917 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-default-certificate\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:26.502917 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq74w\" (UniqueName: \"kubernetes.io/projected/0d76ce81-20d8-49cb-bf21-f01ab5f63317-kube-api-access-nq74w\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502946    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b58c2c3a-5930-45ab-83b7-f51b29b82a1f-config\") pod \"console-operator-696884fb9c-2mqjs\" (UID: \"b58c2c3a-5930-45ab-83b7-f51b29b82a1f\") " pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.502982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb1e53a-557c-4fcb-aba1-165d52863de8-service-ca-bundle\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503009    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlv7v\" (UniqueName: \"kubernetes.io/projected/91a65d43-13c4-4d6c-9690-fe7ab89554e5-kube-api-access-jlv7v\") pod \"volume-data-source-validator-86695b7cc7-wn27x\" (UID: \"91a65d43-13c4-4d6c-9690-fe7ab89554e5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wn27x"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503048    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503078    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/57ea0bf3-4ca1-484f-80f3-0f107c8895e7-serving-cert\") pod \"service-ca-operator-cf7c776b7-54vqb\" (UID: \"57ea0bf3-4ca1-484f-80f3-0f107c8895e7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503093    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-trusted-ca\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503098    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb1e53a-557c-4fcb-aba1-165d52863de8-trusted-ca-bundle\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb1e53a-557c-4fcb-aba1-165d52863de8-serving-cert\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-989lt\" (UniqueName: \"kubernetes.io/projected/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-kube-api-access-989lt\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b58c2c3a-5930-45ab-83b7-f51b29b82a1f-serving-cert\") pod \"console-operator-696884fb9c-2mqjs\" (UID: \"b58c2c3a-5930-45ab-83b7-f51b29b82a1f\") " pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503243    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2cb1e53a-557c-4fcb-aba1-165d52863de8-snapshots\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-ca-trust-extracted\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/713c4120-1f4e-4ada-b6ed-58830761895e-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-7wkln\" (UID: \"713c4120-1f4e-4ada-b6ed-58830761895e\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503309    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg2kh\" (UniqueName: \"kubernetes.io/projected/b58c2c3a-5930-45ab-83b7-f51b29b82a1f-kube-api-access-dg2kh\") pod \"console-operator-696884fb9c-2mqjs\" (UID: \"b58c2c3a-5930-45ab-83b7-f51b29b82a1f\") " pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:26.503361 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503330    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7r9ll\" (UID: \"3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll"
Sep 10 20:58:26.504097 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503357    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-7wkln\" (UID: \"713c4120-1f4e-4ada-b6ed-58830761895e\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"
Sep 10 20:58:26.504097 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503373    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/57ea0bf3-4ca1-484f-80f3-0f107c8895e7-config\") pod \"service-ca-operator-cf7c776b7-54vqb\" (UID: \"57ea0bf3-4ca1-484f-80f3-0f107c8895e7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb"
Sep 10 20:58:26.504097 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.503452    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 20:58:26.504097 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.503488    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert podName:713c4120-1f4e-4ada-b6ed-58830761895e nodeName:}" failed. No retries permitted until 2026-09-10 20:58:27.003477743 +0000 UTC m=+34.577184095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-7wkln" (UID: "713c4120-1f4e-4ada-b6ed-58830761895e") : secret "networking-console-plugin-cert" not found
Sep 10 20:58:26.504097 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503518    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-certificates\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.504097 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.503691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b58c2c3a-5930-45ab-83b7-f51b29b82a1f-trusted-ca\") pod \"console-operator-696884fb9c-2mqjs\" (UID: \"b58c2c3a-5930-45ab-83b7-f51b29b82a1f\") " pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:26.504097 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.504022    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b58c2c3a-5930-45ab-83b7-f51b29b82a1f-config\") pod \"console-operator-696884fb9c-2mqjs\" (UID: \"b58c2c3a-5930-45ab-83b7-f51b29b82a1f\") " pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:26.504422 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.504315    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/713c4120-1f4e-4ada-b6ed-58830761895e-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-7wkln\" (UID: \"713c4120-1f4e-4ada-b6ed-58830761895e\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"
Sep 10 20:58:26.504422 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.504346    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-ca-trust-extracted\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.507171 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.507145    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/57ea0bf3-4ca1-484f-80f3-0f107c8895e7-serving-cert\") pod \"service-ca-operator-cf7c776b7-54vqb\" (UID: \"57ea0bf3-4ca1-484f-80f3-0f107c8895e7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb"
Sep 10 20:58:26.507283 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.507175    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b58c2c3a-5930-45ab-83b7-f51b29b82a1f-serving-cert\") pod \"console-operator-696884fb9c-2mqjs\" (UID: \"b58c2c3a-5930-45ab-83b7-f51b29b82a1f\") " pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:26.507283 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.507259    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-image-registry-private-configuration\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.507283 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.507274    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-installation-pull-secrets\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.511283 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.511251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8rz9\" (UniqueName: \"kubernetes.io/projected/6e48c5c5-910e-4763-baf4-92ae5b7eb84b-kube-api-access-c8rz9\") pod \"network-check-source-6f8b768455-w6jvn\" (UID: \"6e48c5c5-910e-4763-baf4-92ae5b7eb84b\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-w6jvn"
Sep 10 20:58:26.511398 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.511341    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-bound-sa-token\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.511853 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.511752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg2kh\" (UniqueName: \"kubernetes.io/projected/b58c2c3a-5930-45ab-83b7-f51b29b82a1f-kube-api-access-dg2kh\") pod \"console-operator-696884fb9c-2mqjs\" (UID: \"b58c2c3a-5930-45ab-83b7-f51b29b82a1f\") " pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:26.511969 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.511894    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmz7b\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-kube-api-access-wmz7b\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:26.512464 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.512446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkbbr\" (UniqueName: \"kubernetes.io/projected/57ea0bf3-4ca1-484f-80f3-0f107c8895e7-kube-api-access-vkbbr\") pod \"service-ca-operator-cf7c776b7-54vqb\" (UID: \"57ea0bf3-4ca1-484f-80f3-0f107c8895e7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb"
Sep 10 20:58:26.512933 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.512914    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlv7v\" (UniqueName: \"kubernetes.io/projected/91a65d43-13c4-4d6c-9690-fe7ab89554e5-kube-api-access-jlv7v\") pod \"volume-data-source-validator-86695b7cc7-wn27x\" (UID: \"91a65d43-13c4-4d6c-9690-fe7ab89554e5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wn27x"
Sep 10 20:58:26.547230 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.547200    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb"
Sep 10 20:58:26.576056 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.576019    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wn27x"
Sep 10 20:58:26.600246 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.600224    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:26.604543 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604520    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:26.604647 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cb1e53a-557c-4fcb-aba1-165d52863de8-tmp\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.604647 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-default-certificate\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:26.604647 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq74w\" (UniqueName: \"kubernetes.io/projected/0d76ce81-20d8-49cb-bf21-f01ab5f63317-kube-api-access-nq74w\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:26.604647 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604640    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb1e53a-557c-4fcb-aba1-165d52863de8-service-ca-bundle\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.604846 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:26.604846 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb1e53a-557c-4fcb-aba1-165d52863de8-trusted-ca-bundle\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.604846 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604711    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb1e53a-557c-4fcb-aba1-165d52863de8-serving-cert\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.604846 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604733    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-989lt\" (UniqueName: \"kubernetes.io/projected/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-kube-api-access-989lt\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:26.604846 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2cb1e53a-557c-4fcb-aba1-165d52863de8-snapshots\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.604846 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7r9ll\" (UID: \"3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll"
Sep 10 20:58:26.604846 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604846    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a283a451-553e-4578-bc9c-643b9237e1d0-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:26.605190 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7r9ll\" (UID: \"3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll"
Sep 10 20:58:26.605190 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604905    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6kz5v\" (UID: \"b786dada-99f1-4c3b-8209-fb65c61e2ad7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"
Sep 10 20:58:26.605190 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpvg6\" (UniqueName: \"kubernetes.io/projected/a283a451-553e-4578-bc9c-643b9237e1d0-kube-api-access-bpvg6\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:26.605190 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604950    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cb1e53a-557c-4fcb-aba1-165d52863de8-tmp\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.605190 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.604979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs\") pod \"network-metrics-daemon-5ll4j\" (UID: \"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda\") " pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:26.605190 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.605011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-config-volume\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:26.605190 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.605057    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvmk4\" (UniqueName: \"kubernetes.io/projected/3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a-kube-api-access-hvmk4\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7r9ll\" (UID: \"3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll"
Sep 10 20:58:26.605190 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.605109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:26.605190 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.605153    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l64h\" (UniqueName: \"kubernetes.io/projected/b786dada-99f1-4c3b-8209-fb65c61e2ad7-kube-api-access-9l64h\") pod \"cluster-samples-operator-86499c89c4-6kz5v\" (UID: \"b786dada-99f1-4c3b-8209-fb65c61e2ad7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"
Sep 10 20:58:26.605190 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.605184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smr6w\" (UniqueName: \"kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w\") pod \"network-check-target-q27cq\" (UID: \"c6c63bba-eea7-4479-abbc-7084fb8c8f7b\") " pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:26.605639 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.605208    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-tmp-dir\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:26.605639 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.605216    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:26.605639 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.605234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:26.605639 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.605249    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb1e53a-557c-4fcb-aba1-165d52863de8-service-ca-bundle\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.605639 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.605265    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pssng\" (UniqueName: \"kubernetes.io/projected/2cb1e53a-557c-4fcb-aba1-165d52863de8-kube-api-access-pssng\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.605639 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.605281    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs podName:c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda nodeName:}" failed. No retries permitted until 2026-09-10 20:58:58.605264709 +0000 UTC m=+66.178971074 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs") pod "network-metrics-daemon-5ll4j" (UID: "c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:26.605639 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.605516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-stats-auth\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:26.605639 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.605558    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fbaa2ca-55f1-45b4-8b64-6e31f788e200-cert\") pod \"ingress-canary-7w8w9\" (UID: \"4fbaa2ca-55f1-45b4-8b64-6e31f788e200\") " pod="openshift-ingress-canary/ingress-canary-7w8w9"
Sep 10 20:58:26.605639 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.605582    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhn24\" (UniqueName: \"kubernetes.io/projected/4fbaa2ca-55f1-45b4-8b64-6e31f788e200-kube-api-access-dhn24\") pod \"ingress-canary-7w8w9\" (UID: \"4fbaa2ca-55f1-45b4-8b64-6e31f788e200\") " pod="openshift-ingress-canary/ingress-canary-7w8w9"
Sep 10 20:58:26.606044 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.605891    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2cb1e53a-557c-4fcb-aba1-165d52863de8-snapshots\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.606106 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.606057    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle podName:0d76ce81-20d8-49cb-bf21-f01ab5f63317 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:27.106020868 +0000 UTC m=+34.679727223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle") pod "router-default-84d6cf958b-xf674" (UID: "0d76ce81-20d8-49cb-bf21-f01ab5f63317") : configmap references non-existent config key: service-ca.crt
Sep 10 20:58:26.606450 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.606212    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-config-volume\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:26.606450 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.606268    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7r9ll\" (UID: \"3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll"
Sep 10 20:58:26.606450 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.606355    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:58:26.606450 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.606415    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs podName:0d76ce81-20d8-49cb-bf21-f01ab5f63317 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:27.106399689 +0000 UTC m=+34.680106107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs") pod "router-default-84d6cf958b-xf674" (UID: "0d76ce81-20d8-49cb-bf21-f01ab5f63317") : secret "router-metrics-certs-default" not found
Sep 10 20:58:26.606713 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.606475    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-tmp-dir\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:26.606842 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.606819    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb1e53a-557c-4fcb-aba1-165d52863de8-trusted-ca-bundle\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.607153 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.607134    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:26.607242 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.607188    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls podName:de7b33a4-bb24-4e27-a1c9-6eec4f07d263 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:27.107173049 +0000 UTC m=+34.680879403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls") pod "dns-default-h8z6q" (UID: "de7b33a4-bb24-4e27-a1c9-6eec4f07d263") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:26.608952 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.608149    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-default-certificate\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:26.608952 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.608914    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fbaa2ca-55f1-45b4-8b64-6e31f788e200-cert\") pod \"ingress-canary-7w8w9\" (UID: \"4fbaa2ca-55f1-45b4-8b64-6e31f788e200\") " pod="openshift-ingress-canary/ingress-canary-7w8w9"
Sep 10 20:58:26.608952 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.608944    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-stats-auth\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:26.609182 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.609045    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb1e53a-557c-4fcb-aba1-165d52863de8-serving-cert\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.609318 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.609300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smr6w\" (UniqueName: \"kubernetes.io/projected/c6c63bba-eea7-4479-abbc-7084fb8c8f7b-kube-api-access-smr6w\") pod \"network-check-target-q27cq\" (UID: \"c6c63bba-eea7-4479-abbc-7084fb8c8f7b\") " pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:26.609373 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.609300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7r9ll\" (UID: \"3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll"
Sep 10 20:58:26.613134 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.613100    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pssng\" (UniqueName: \"kubernetes.io/projected/2cb1e53a-557c-4fcb-aba1-165d52863de8-kube-api-access-pssng\") pod \"insights-operator-5844b856db-svh6n\" (UID: \"2cb1e53a-557c-4fcb-aba1-165d52863de8\") " pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.613241 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.613221    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq74w\" (UniqueName: \"kubernetes.io/projected/0d76ce81-20d8-49cb-bf21-f01ab5f63317-kube-api-access-nq74w\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:26.614290 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.614268    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhn24\" (UniqueName: \"kubernetes.io/projected/4fbaa2ca-55f1-45b4-8b64-6e31f788e200-kube-api-access-dhn24\") pod \"ingress-canary-7w8w9\" (UID: \"4fbaa2ca-55f1-45b4-8b64-6e31f788e200\") " pod="openshift-ingress-canary/ingress-canary-7w8w9"
Sep 10 20:58:26.614621 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.614605    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvmk4\" (UniqueName: \"kubernetes.io/projected/3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a-kube-api-access-hvmk4\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7r9ll\" (UID: \"3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll"
Sep 10 20:58:26.614943 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.614926    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-989lt\" (UniqueName: \"kubernetes.io/projected/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-kube-api-access-989lt\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:26.631583 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.631562    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-w6jvn"
Sep 10 20:58:26.652794 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.652769    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-svh6n"
Sep 10 20:58:26.706847 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.706802    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:26.706986 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.706854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:26.706986 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.706942    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a283a451-553e-4578-bc9c-643b9237e1d0-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:26.706986 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.706963    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 20:58:26.707190 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.707041    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:26.707190 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.707055    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls podName:a283a451-553e-4578-bc9c-643b9237e1d0 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:27.207015458 +0000 UTC m=+34.780721851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-9mmdw" (UID: "a283a451-553e-4578-bc9c-643b9237e1d0") : secret "cluster-monitoring-operator-tls" not found
Sep 10 20:58:26.707190 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.706972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6kz5v\" (UID: \"b786dada-99f1-4c3b-8209-fb65c61e2ad7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"
Sep 10 20:58:26.707190 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.707101    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret podName:f7c136d4-6105-4707-add6-396ab1649cc2 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:58.707084839 +0000 UTC m=+66.280791210 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret") pod "global-pull-secret-syncer-wdxkj" (UID: "f7c136d4-6105-4707-add6-396ab1649cc2") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:26.707190 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.707095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpvg6\" (UniqueName: \"kubernetes.io/projected/a283a451-553e-4578-bc9c-643b9237e1d0-kube-api-access-bpvg6\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:26.707190 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.707043    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 20:58:26.707190 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:26.707188    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls podName:b786dada-99f1-4c3b-8209-fb65c61e2ad7 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:27.207173997 +0000 UTC m=+34.780880366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-6kz5v" (UID: "b786dada-99f1-4c3b-8209-fb65c61e2ad7") : secret "samples-operator-tls" not found
Sep 10 20:58:26.707519 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.707208    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l64h\" (UniqueName: \"kubernetes.io/projected/b786dada-99f1-4c3b-8209-fb65c61e2ad7-kube-api-access-9l64h\") pod \"cluster-samples-operator-86499c89c4-6kz5v\" (UID: \"b786dada-99f1-4c3b-8209-fb65c61e2ad7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"
Sep 10 20:58:26.707712 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.707691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a283a451-553e-4578-bc9c-643b9237e1d0-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:26.708757 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.708727    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7w8w9"
Sep 10 20:58:26.715446 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.715382    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l64h\" (UniqueName: \"kubernetes.io/projected/b786dada-99f1-4c3b-8209-fb65c61e2ad7-kube-api-access-9l64h\") pod \"cluster-samples-operator-86499c89c4-6kz5v\" (UID: \"b786dada-99f1-4c3b-8209-fb65c61e2ad7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"
Sep 10 20:58:26.715532 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.715512    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpvg6\" (UniqueName: \"kubernetes.io/projected/a283a451-553e-4578-bc9c-643b9237e1d0-kube-api-access-bpvg6\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:26.731334 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:26.731312    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll"
Sep 10 20:58:27.010210 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.010119    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-7wkln\" (UID: \"713c4120-1f4e-4ada-b6ed-58830761895e\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"
Sep 10 20:58:27.010210 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.010197    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:27.010766 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:27.010271    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 20:58:27.010766 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:27.010338    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert podName:713c4120-1f4e-4ada-b6ed-58830761895e nodeName:}" failed. No retries permitted until 2026-09-10 20:58:28.010321001 +0000 UTC m=+35.584027367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-7wkln" (UID: "713c4120-1f4e-4ada-b6ed-58830761895e") : secret "networking-console-plugin-cert" not found
Sep 10 20:58:27.010766 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:27.010373    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 20:58:27.010766 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:27.010395    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fb84588b-9vf44: secret "image-registry-tls" not found
Sep 10 20:58:27.010766 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:27.010462    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls podName:559d2df7-ee5d-48b6-98ad-22faaf8d2a23 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:28.010437526 +0000 UTC m=+35.584143885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls") pod "image-registry-76fb84588b-9vf44" (UID: "559d2df7-ee5d-48b6-98ad-22faaf8d2a23") : secret "image-registry-tls" not found
Sep 10 20:58:27.111380 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.111344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:27.111551 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.111388    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:27.111551 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.111436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:27.111551 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:27.111448    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:27.111551 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:27.111512    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls podName:de7b33a4-bb24-4e27-a1c9-6eec4f07d263 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:28.111490246 +0000 UTC m=+35.685196601 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls") pod "dns-default-h8z6q" (UID: "de7b33a4-bb24-4e27-a1c9-6eec4f07d263") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:27.111776 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:27.111555    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:58:27.111776 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:27.111558    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle podName:0d76ce81-20d8-49cb-bf21-f01ab5f63317 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:28.111542657 +0000 UTC m=+35.685249011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle") pod "router-default-84d6cf958b-xf674" (UID: "0d76ce81-20d8-49cb-bf21-f01ab5f63317") : configmap references non-existent config key: service-ca.crt
Sep 10 20:58:27.111776 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:27.111620    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs podName:0d76ce81-20d8-49cb-bf21-f01ab5f63317 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:28.111606341 +0000 UTC m=+35.685312708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs") pod "router-default-84d6cf958b-xf674" (UID: "0d76ce81-20d8-49cb-bf21-f01ab5f63317") : secret "router-metrics-certs-default" not found
Sep 10 20:58:27.215464 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.214491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:27.215464 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.214636    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6kz5v\" (UID: \"b786dada-99f1-4c3b-8209-fb65c61e2ad7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"
Sep 10 20:58:27.215464 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:27.214815    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 20:58:27.215464 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:27.214889    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls podName:b786dada-99f1-4c3b-8209-fb65c61e2ad7 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:28.214870231 +0000 UTC m=+35.788576601 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-6kz5v" (UID: "b786dada-99f1-4c3b-8209-fb65c61e2ad7") : secret "samples-operator-tls" not found
Sep 10 20:58:27.215464 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:27.215237    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 20:58:27.215464 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:27.215285    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls podName:a283a451-553e-4578-bc9c-643b9237e1d0 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:28.215270594 +0000 UTC m=+35.788976961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-9mmdw" (UID: "a283a451-553e-4578-bc9c-643b9237e1d0") : secret "cluster-monitoring-operator-tls" not found
Sep 10 20:58:27.500344 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.500166    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb"]
Sep 10 20:58:27.504423 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.504352    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-w6jvn"]
Sep 10 20:58:27.506702 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.505919    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7w8w9"]
Sep 10 20:58:27.507529 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.507217    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wn27x"]
Sep 10 20:58:27.508621 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.508566    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-2mqjs"]
Sep 10 20:58:27.510561 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.510011    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll"]
Sep 10 20:58:27.511534 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.511453    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-svh6n"]
Sep 10 20:58:27.524332 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:58:27.524305    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbaa2ca_55f1_45b4_8b64_6e31f788e200.slice/crio-b16b68d3993de3255b381fe9bf69b6b7a890accccff252c01376dc83cbfbf18c WatchSource:0}: Error finding container b16b68d3993de3255b381fe9bf69b6b7a890accccff252c01376dc83cbfbf18c: Status 404 returned error can't find the container with id b16b68d3993de3255b381fe9bf69b6b7a890accccff252c01376dc83cbfbf18c
Sep 10 20:58:27.941007 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.940972    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:27.941215 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.940979    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:27.941215 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.941139    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:27.943547 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.943521    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 20:58:27.943688 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.943532    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pbskf\""
Sep 10 20:58:27.943688 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.943569    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 20:58:27.943688 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.943605    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g6p7f\""
Sep 10 20:58:27.959002 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:27.958985    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:28.022003 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.021713    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:28.022003 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.021928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-7wkln\" (UID: \"713c4120-1f4e-4ada-b6ed-58830761895e\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"
Sep 10 20:58:28.022823 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:28.022010    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 20:58:28.022823 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:28.022048    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fb84588b-9vf44: secret "image-registry-tls" not found
Sep 10 20:58:28.022823 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:28.022102    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 20:58:28.022823 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:28.022113    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls podName:559d2df7-ee5d-48b6-98ad-22faaf8d2a23 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:30.022092682 +0000 UTC m=+37.595799058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls") pod "image-registry-76fb84588b-9vf44" (UID: "559d2df7-ee5d-48b6-98ad-22faaf8d2a23") : secret "image-registry-tls" not found
Sep 10 20:58:28.022823 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:28.022179    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert podName:713c4120-1f4e-4ada-b6ed-58830761895e nodeName:}" failed. No retries permitted until 2026-09-10 20:58:30.02216126 +0000 UTC m=+37.595867617 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-7wkln" (UID: "713c4120-1f4e-4ada-b6ed-58830761895e") : secret "networking-console-plugin-cert" not found
Sep 10 20:58:28.117189 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.117132    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-svh6n" event={"ID":"2cb1e53a-557c-4fcb-aba1-165d52863de8","Type":"ContainerStarted","Data":"b86e2d18204916e556a2f0dcfb2992607aa5155d8e81cd39634080d9a332ed2d"}
Sep 10 20:58:28.119199 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.119132    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wn27x" event={"ID":"91a65d43-13c4-4d6c-9690-fe7ab89554e5","Type":"ContainerStarted","Data":"5324b193013b162809c1199a53b9fb3cb94e8f0dc782f0bc87bb578482fd1701"}
Sep 10 20:58:28.121500 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.121445    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7w8w9" event={"ID":"4fbaa2ca-55f1-45b4-8b64-6e31f788e200","Type":"ContainerStarted","Data":"b16b68d3993de3255b381fe9bf69b6b7a890accccff252c01376dc83cbfbf18c"}
Sep 10 20:58:28.122467 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.122346    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:28.122572 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:28.122475    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle podName:0d76ce81-20d8-49cb-bf21-f01ab5f63317 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:30.12245586 +0000 UTC m=+37.696162236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle") pod "router-default-84d6cf958b-xf674" (UID: "0d76ce81-20d8-49cb-bf21-f01ab5f63317") : configmap references non-existent config key: service-ca.crt
Sep 10 20:58:28.122572 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.122511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:28.122572 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.122561    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:28.123462 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:28.122792    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:28.123462 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:28.122839    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls podName:de7b33a4-bb24-4e27-a1c9-6eec4f07d263 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:30.122825997 +0000 UTC m=+37.696532361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls") pod "dns-default-h8z6q" (UID: "de7b33a4-bb24-4e27-a1c9-6eec4f07d263") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:28.123462 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:28.123309    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:58:28.123462 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:28.123361    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs podName:0d76ce81-20d8-49cb-bf21-f01ab5f63317 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:30.123343781 +0000 UTC m=+37.697050150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs") pod "router-default-84d6cf958b-xf674" (UID: "0d76ce81-20d8-49cb-bf21-f01ab5f63317") : secret "router-metrics-certs-default" not found
Sep 10 20:58:28.124263 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.124235    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs" event={"ID":"b58c2c3a-5930-45ab-83b7-f51b29b82a1f","Type":"ContainerStarted","Data":"df6564c60bd4340933491fdaef580a2069208d7ca53f0efd1c26695ba4da6138"}
Sep 10 20:58:28.125737 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.125683    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll" event={"ID":"3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a","Type":"ContainerStarted","Data":"394d7318a833f44e2cecd100503d242ed82c8013238dd4b69f2b5f79ca61caca"}
Sep 10 20:58:28.127213 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.127156    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-w6jvn" event={"ID":"6e48c5c5-910e-4763-baf4-92ae5b7eb84b","Type":"ContainerStarted","Data":"3ce394487e2496305eb52416e0acf53f56249572627bd16beded02e3944abc0c"}
Sep 10 20:58:28.132506 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.131572    2577 generic.go:356] "Generic (PLEG): container finished" podID="d352d84c-ee74-469f-a98f-93ebff5effea" containerID="039246af347c4c5fcd07f2f35de4575c1b7e8e538c01e29975177b1b07628f28" exitCode=0
Sep 10 20:58:28.132506 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.131640    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bs2jp" event={"ID":"d352d84c-ee74-469f-a98f-93ebff5effea","Type":"ContainerDied","Data":"039246af347c4c5fcd07f2f35de4575c1b7e8e538c01e29975177b1b07628f28"}
Sep 10 20:58:28.133846 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.133803    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb" event={"ID":"57ea0bf3-4ca1-484f-80f3-0f107c8895e7","Type":"ContainerStarted","Data":"8ab5f95de1cd23f5e59ead54de877a925dd28d7f369276f5c91e3c0d53da326d"}
Sep 10 20:58:28.226106 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.223996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:28.226106 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.224144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6kz5v\" (UID: \"b786dada-99f1-4c3b-8209-fb65c61e2ad7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"
Sep 10 20:58:28.226106 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:28.225002    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 20:58:28.226106 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:28.225084    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls podName:a283a451-553e-4578-bc9c-643b9237e1d0 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:30.225064072 +0000 UTC m=+37.798770426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-9mmdw" (UID: "a283a451-553e-4578-bc9c-643b9237e1d0") : secret "cluster-monitoring-operator-tls" not found
Sep 10 20:58:28.226106 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:28.225171    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 20:58:28.226106 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:28.225204    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls podName:b786dada-99f1-4c3b-8209-fb65c61e2ad7 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:30.225194009 +0000 UTC m=+37.798900363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-6kz5v" (UID: "b786dada-99f1-4c3b-8209-fb65c61e2ad7") : secret "samples-operator-tls" not found
Sep 10 20:58:28.252984 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:28.252921    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q27cq"]
Sep 10 20:58:29.146061 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:29.145950    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q27cq" event={"ID":"c6c63bba-eea7-4479-abbc-7084fb8c8f7b","Type":"ContainerStarted","Data":"a7ebc520a847fecb03934c0b86623ff615bfec8c51f1a28e0f14ada83c48f743"}
Sep 10 20:58:29.158355 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:29.158323    2577 generic.go:356] "Generic (PLEG): container finished" podID="d352d84c-ee74-469f-a98f-93ebff5effea" containerID="222de385d803e76bc9ddab550b2d4ef7c631fc6a75573b460fbac7ee7c759781" exitCode=0
Sep 10 20:58:29.158504 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:29.158386    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bs2jp" event={"ID":"d352d84c-ee74-469f-a98f-93ebff5effea","Type":"ContainerDied","Data":"222de385d803e76bc9ddab550b2d4ef7c631fc6a75573b460fbac7ee7c759781"}
Sep 10 20:58:30.043604 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:30.043343    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-7wkln\" (UID: \"713c4120-1f4e-4ada-b6ed-58830761895e\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"
Sep 10 20:58:30.043767 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:30.043649    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:30.043828 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:30.043817    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 20:58:30.043877 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:30.043833    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fb84588b-9vf44: secret "image-registry-tls" not found
Sep 10 20:58:30.043938 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:30.043895    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls podName:559d2df7-ee5d-48b6-98ad-22faaf8d2a23 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:34.043875785 +0000 UTC m=+41.617582159 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls") pod "image-registry-76fb84588b-9vf44" (UID: "559d2df7-ee5d-48b6-98ad-22faaf8d2a23") : secret "image-registry-tls" not found
Sep 10 20:58:30.044336 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:30.044312    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 20:58:30.044504 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:30.044488    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert podName:713c4120-1f4e-4ada-b6ed-58830761895e nodeName:}" failed. No retries permitted until 2026-09-10 20:58:34.04447149 +0000 UTC m=+41.618177855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-7wkln" (UID: "713c4120-1f4e-4ada-b6ed-58830761895e") : secret "networking-console-plugin-cert" not found
Sep 10 20:58:30.145956 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:30.144994    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:30.145956 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:30.145143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:30.145956 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:30.145181    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:30.145956 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:30.145320    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:58:30.145956 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:30.145378    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs podName:0d76ce81-20d8-49cb-bf21-f01ab5f63317 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:34.145361737 +0000 UTC m=+41.719068114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs") pod "router-default-84d6cf958b-xf674" (UID: "0d76ce81-20d8-49cb-bf21-f01ab5f63317") : secret "router-metrics-certs-default" not found
Sep 10 20:58:30.145956 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:30.145767    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle podName:0d76ce81-20d8-49cb-bf21-f01ab5f63317 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:34.145751719 +0000 UTC m=+41.719458088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle") pod "router-default-84d6cf958b-xf674" (UID: "0d76ce81-20d8-49cb-bf21-f01ab5f63317") : configmap references non-existent config key: service-ca.crt
Sep 10 20:58:30.145956 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:30.145842    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:30.145956 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:30.145874    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls podName:de7b33a4-bb24-4e27-a1c9-6eec4f07d263 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:34.14586321 +0000 UTC m=+41.719569577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls") pod "dns-default-h8z6q" (UID: "de7b33a4-bb24-4e27-a1c9-6eec4f07d263") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:30.175633 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:30.174811    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bs2jp" event={"ID":"d352d84c-ee74-469f-a98f-93ebff5effea","Type":"ContainerStarted","Data":"2e160ceaa6497815d6871f40b586bf6660986e642b4cbf02478d13436df7230a"}
Sep 10 20:58:30.226477 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:30.225919    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bs2jp" podStartSLOduration=8.044794299 podStartE2EDuration="37.225863479s" totalImagesPullingTime="29.18106918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:30.222430566 +0000 UTC m=+37.796136941" watchObservedRunningTime="2026-09-10 20:58:30.225863479 +0000 UTC m=+37.799569854"
Sep 10 20:58:30.246106 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:30.246060    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:30.246273 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:30.246197    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6kz5v\" (UID: \"b786dada-99f1-4c3b-8209-fb65c61e2ad7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"
Sep 10 20:58:30.246543 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:30.246371    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 20:58:30.246543 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:30.246435    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls podName:b786dada-99f1-4c3b-8209-fb65c61e2ad7 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:34.246417286 +0000 UTC m=+41.820123645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-6kz5v" (UID: "b786dada-99f1-4c3b-8209-fb65c61e2ad7") : secret "samples-operator-tls" not found
Sep 10 20:58:30.246543 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:30.246447    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 20:58:30.246543 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:30.246510    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls podName:a283a451-553e-4578-bc9c-643b9237e1d0 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:34.246493105 +0000 UTC m=+41.820199480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-9mmdw" (UID: "a283a451-553e-4578-bc9c-643b9237e1d0") : secret "cluster-monitoring-operator-tls" not found
Sep 10 20:58:34.079117 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:34.079075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-7wkln\" (UID: \"713c4120-1f4e-4ada-b6ed-58830761895e\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"
Sep 10 20:58:34.079733 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:34.079143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:34.079733 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:34.079238    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 20:58:34.079733 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:34.079274    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 20:58:34.079733 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:34.079288    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fb84588b-9vf44: secret "image-registry-tls" not found
Sep 10 20:58:34.079733 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:34.079332    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert podName:713c4120-1f4e-4ada-b6ed-58830761895e nodeName:}" failed. No retries permitted until 2026-09-10 20:58:42.079307796 +0000 UTC m=+49.653014162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-7wkln" (UID: "713c4120-1f4e-4ada-b6ed-58830761895e") : secret "networking-console-plugin-cert" not found
Sep 10 20:58:34.079733 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:34.079350    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls podName:559d2df7-ee5d-48b6-98ad-22faaf8d2a23 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:42.079342354 +0000 UTC m=+49.653048706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls") pod "image-registry-76fb84588b-9vf44" (UID: "559d2df7-ee5d-48b6-98ad-22faaf8d2a23") : secret "image-registry-tls" not found
Sep 10 20:58:34.180289 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:34.180252    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:34.180494 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:34.180355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:34.180494 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:34.180393    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:34.180494 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:34.180439    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle podName:0d76ce81-20d8-49cb-bf21-f01ab5f63317 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:42.180418848 +0000 UTC m=+49.754125205 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle") pod "router-default-84d6cf958b-xf674" (UID: "0d76ce81-20d8-49cb-bf21-f01ab5f63317") : configmap references non-existent config key: service-ca.crt
Sep 10 20:58:34.180663 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:34.180530    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:34.180663 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:34.180533    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:58:34.180663 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:34.180597    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls podName:de7b33a4-bb24-4e27-a1c9-6eec4f07d263 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:42.180580123 +0000 UTC m=+49.754286477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls") pod "dns-default-h8z6q" (UID: "de7b33a4-bb24-4e27-a1c9-6eec4f07d263") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:34.180663 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:34.180643    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs podName:0d76ce81-20d8-49cb-bf21-f01ab5f63317 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:42.180621056 +0000 UTC m=+49.754327412 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs") pod "router-default-84d6cf958b-xf674" (UID: "0d76ce81-20d8-49cb-bf21-f01ab5f63317") : secret "router-metrics-certs-default" not found
Sep 10 20:58:34.281400 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:34.281359    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:34.281598 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:34.281476    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 20:58:34.281598 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:34.281490    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6kz5v\" (UID: \"b786dada-99f1-4c3b-8209-fb65c61e2ad7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"
Sep 10 20:58:34.281598 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:34.281539    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls podName:a283a451-553e-4578-bc9c-643b9237e1d0 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:42.281524285 +0000 UTC m=+49.855230653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-9mmdw" (UID: "a283a451-553e-4578-bc9c-643b9237e1d0") : secret "cluster-monitoring-operator-tls" not found
Sep 10 20:58:34.281754 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:34.281600    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 20:58:34.281754 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:34.281654    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls podName:b786dada-99f1-4c3b-8209-fb65c61e2ad7 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:42.281638527 +0000 UTC m=+49.855344902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-6kz5v" (UID: "b786dada-99f1-4c3b-8209-fb65c61e2ad7") : secret "samples-operator-tls" not found
Sep 10 20:58:36.193294 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.193252    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-svh6n" event={"ID":"2cb1e53a-557c-4fcb-aba1-165d52863de8","Type":"ContainerStarted","Data":"c4d0c6c3af2bab9cf12752a5edda638235fc51ec2ac48a2b08f89125944a9b3d"}
Sep 10 20:58:36.195223 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.195191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wn27x" event={"ID":"91a65d43-13c4-4d6c-9690-fe7ab89554e5","Type":"ContainerStarted","Data":"9c0f0184bb88ae05609aa35b661f7d8745218eeb1bf137a47b10b51b8d54a40b"}
Sep 10 20:58:36.197458 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.197433    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7w8w9" event={"ID":"4fbaa2ca-55f1-45b4-8b64-6e31f788e200","Type":"ContainerStarted","Data":"f3a4cd3755b084c93abdce2c7eca3129a0e03797377e443896dd996f8b13f755"}
Sep 10 20:58:36.199269 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.199247    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/0.log"
Sep 10 20:58:36.199401 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.199290    2577 generic.go:356] "Generic (PLEG): container finished" podID="b58c2c3a-5930-45ab-83b7-f51b29b82a1f" containerID="e7ec08720ca1e3f25964a95d260c49b156ca8111429bf3dfdbd63ded9457b1c7" exitCode=255
Sep 10 20:58:36.199401 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.199359    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs" event={"ID":"b58c2c3a-5930-45ab-83b7-f51b29b82a1f","Type":"ContainerDied","Data":"e7ec08720ca1e3f25964a95d260c49b156ca8111429bf3dfdbd63ded9457b1c7"}
Sep 10 20:58:36.199567 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.199523    2577 scope.go:117] "RemoveContainer" containerID="e7ec08720ca1e3f25964a95d260c49b156ca8111429bf3dfdbd63ded9457b1c7"
Sep 10 20:58:36.203543 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.203508    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll" event={"ID":"3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a","Type":"ContainerStarted","Data":"5c1571150355fd1a3dd9723949e1230944746d497611d4c4723b82cc2ac43bee"}
Sep 10 20:58:36.205595 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.205570    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-w6jvn" event={"ID":"6e48c5c5-910e-4763-baf4-92ae5b7eb84b","Type":"ContainerStarted","Data":"e593e7f914aa7ef0a4d63a59fa4141bfe8213e7d07512eae909c68c310d0ebd7"}
Sep 10 20:58:36.207206 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.207181    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q27cq" event={"ID":"c6c63bba-eea7-4479-abbc-7084fb8c8f7b","Type":"ContainerStarted","Data":"a646a19e03fc6638ba7f5b1ae895b69f96fb1db97d9e5f2f5976c70a0d2e16c8"}
Sep 10 20:58:36.207323 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.207251    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:58:36.208647 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.208627    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb" event={"ID":"57ea0bf3-4ca1-484f-80f3-0f107c8895e7","Type":"ContainerStarted","Data":"64aa5f61ed53d09c006bc6e731846d2f93b2d65b6f350555e3db939267b15e48"}
Sep 10 20:58:36.212086 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.212018    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-svh6n" podStartSLOduration=13.132489034 podStartE2EDuration="21.211999305s" totalImagesPullingTime="8.079510271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:36.21067717 +0000 UTC m=+43.784383543" watchObservedRunningTime="2026-09-10 20:58:36.211999305 +0000 UTC m=+43.785705679"
Sep 10 20:58:36.226156 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.226108    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q27cq" podStartSLOduration=35.890538145 podStartE2EDuration="43.226079202s" totalImagesPullingTime="7.335541057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:36.22465335 +0000 UTC m=+43.798359724" watchObservedRunningTime="2026-09-10 20:58:36.226079202 +0000 UTC m=+43.799785577"
Sep 10 20:58:36.240192 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.240101    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7w8w9" podStartSLOduration=2.16768075 podStartE2EDuration="10.240082635s" totalImagesPullingTime="8.072401885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:36.239217408 +0000 UTC m=+43.812923783" watchObservedRunningTime="2026-09-10 20:58:36.240082635 +0000 UTC m=+43.813789010"
Sep 10 20:58:36.273552 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.273207    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll" podStartSLOduration=13.195605425 podStartE2EDuration="21.273187717s" totalImagesPullingTime="8.077582292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:36.270319563 +0000 UTC m=+43.844025938" watchObservedRunningTime="2026-09-10 20:58:36.273187717 +0000 UTC m=+43.846894094"
Sep 10 20:58:36.301692 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.301639    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wn27x" podStartSLOduration=13.682639656 podStartE2EDuration="21.301619795s" totalImagesPullingTime="7.618980139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:36.284808563 +0000 UTC m=+43.858514938" watchObservedRunningTime="2026-09-10 20:58:36.301619795 +0000 UTC m=+43.875326164"
Sep 10 20:58:36.315486 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.315438    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-w6jvn" podStartSLOduration=13.230294742 podStartE2EDuration="21.315420628s" totalImagesPullingTime="8.085125886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:36.313818505 +0000 UTC m=+43.887524877" watchObservedRunningTime="2026-09-10 20:58:36.315420628 +0000 UTC m=+43.889127004"
Sep 10 20:58:36.329208 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.328841    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb" podStartSLOduration=13.237266743 podStartE2EDuration="21.32882494s" totalImagesPullingTime="8.091558197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:36.328425716 +0000 UTC m=+43.902132091" watchObservedRunningTime="2026-09-10 20:58:36.32882494 +0000 UTC m=+43.902531306"
Sep 10 20:58:36.600396 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.600359    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:36.600629 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:36.600465    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:37.181626 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.181591    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kmnp2"]
Sep 10 20:58:37.202870 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.202835    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kmnp2"]
Sep 10 20:58:37.203264 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.202933    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.205241 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.205222    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 20:58:37.205397 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.205247    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 20:58:37.205397 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.205252    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x2prl\""
Sep 10 20:58:37.213453 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.213436    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/1.log"
Sep 10 20:58:37.213883 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.213867    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/0.log"
Sep 10 20:58:37.213963 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.213904    2577 generic.go:356] "Generic (PLEG): container finished" podID="b58c2c3a-5930-45ab-83b7-f51b29b82a1f" containerID="9fe0c371d94f48d1a54ee9e514b2ea1cdbc13ce97486d01146b507817c49ffe4" exitCode=255
Sep 10 20:58:37.214021 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.213996    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs" event={"ID":"b58c2c3a-5930-45ab-83b7-f51b29b82a1f","Type":"ContainerDied","Data":"9fe0c371d94f48d1a54ee9e514b2ea1cdbc13ce97486d01146b507817c49ffe4"}
Sep 10 20:58:37.214109 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.214069    2577 scope.go:117] "RemoveContainer" containerID="e7ec08720ca1e3f25964a95d260c49b156ca8111429bf3dfdbd63ded9457b1c7"
Sep 10 20:58:37.214204 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.214189    2577 scope.go:117] "RemoveContainer" containerID="9fe0c371d94f48d1a54ee9e514b2ea1cdbc13ce97486d01146b507817c49ffe4"
Sep 10 20:58:37.214543 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:37.214372    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-2mqjs_openshift-console-operator(b58c2c3a-5930-45ab-83b7-f51b29b82a1f)\"" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs" podUID="b58c2c3a-5930-45ab-83b7-f51b29b82a1f"
Sep 10 20:58:37.304464 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.304429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.304641 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.304568    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2fcf18f-8812-4837-9d60-49f2e76623bd-data-volume\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.304641 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.304604    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2fcf18f-8812-4837-9d60-49f2e76623bd-crio-socket\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.304876 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.304852    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.305110 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.305077    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vtm8\" (UniqueName: \"kubernetes.io/projected/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-api-access-2vtm8\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.405660 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.405623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.405851 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.405683    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vtm8\" (UniqueName: \"kubernetes.io/projected/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-api-access-2vtm8\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.405851 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.405701    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.405851 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.405734    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2fcf18f-8812-4837-9d60-49f2e76623bd-data-volume\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.405851 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:37.405753    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:58:37.405851 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:37.405824    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:37.405851 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:37.405831    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm podName:a2fcf18f-8812-4837-9d60-49f2e76623bd nodeName:}" failed. No retries permitted until 2026-09-10 20:58:37.905809806 +0000 UTC m=+45.479516161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kmnp2" (UID: "a2fcf18f-8812-4837-9d60-49f2e76623bd") : configmap "kube-rbac-proxy" not found
Sep 10 20:58:37.406126 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:37.405865    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls podName:a2fcf18f-8812-4837-9d60-49f2e76623bd nodeName:}" failed. No retries permitted until 2026-09-10 20:58:37.90585295 +0000 UTC m=+45.479559301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmnp2" (UID: "a2fcf18f-8812-4837-9d60-49f2e76623bd") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:37.406126 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.405757    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2fcf18f-8812-4837-9d60-49f2e76623bd-crio-socket\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.406126 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.405924    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2fcf18f-8812-4837-9d60-49f2e76623bd-crio-socket\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.406126 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.406081    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2fcf18f-8812-4837-9d60-49f2e76623bd-data-volume\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.415586 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.415569    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vtm8\" (UniqueName: \"kubernetes.io/projected/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-api-access-2vtm8\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.908952 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.908909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.909181 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:37.909060    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:37.909181 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:37.909069    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:37.909181 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:37.909130    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls podName:a2fcf18f-8812-4837-9d60-49f2e76623bd nodeName:}" failed. No retries permitted until 2026-09-10 20:58:38.909111043 +0000 UTC m=+46.482817396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmnp2" (UID: "a2fcf18f-8812-4837-9d60-49f2e76623bd") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:37.909181 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:37.909140    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:58:37.909181 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:37.909180    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm podName:a2fcf18f-8812-4837-9d60-49f2e76623bd nodeName:}" failed. No retries permitted until 2026-09-10 20:58:38.909169382 +0000 UTC m=+46.482875759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kmnp2" (UID: "a2fcf18f-8812-4837-9d60-49f2e76623bd") : configmap "kube-rbac-proxy" not found
Sep 10 20:58:38.218705 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:38.218632    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/1.log"
Sep 10 20:58:38.219078 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:38.218939    2577 scope.go:117] "RemoveContainer" containerID="9fe0c371d94f48d1a54ee9e514b2ea1cdbc13ce97486d01146b507817c49ffe4"
Sep 10 20:58:38.219127 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:38.219100    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-2mqjs_openshift-console-operator(b58c2c3a-5930-45ab-83b7-f51b29b82a1f)\"" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs" podUID="b58c2c3a-5930-45ab-83b7-f51b29b82a1f"
Sep 10 20:58:38.915278 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:38.915236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:38.915445 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:38.915306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:38.915445 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:38.915306    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:58:38.915445 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:38.915363    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:38.915445 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:38.915419    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm podName:a2fcf18f-8812-4837-9d60-49f2e76623bd nodeName:}" failed. No retries permitted until 2026-09-10 20:58:40.915403855 +0000 UTC m=+48.489110220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kmnp2" (UID: "a2fcf18f-8812-4837-9d60-49f2e76623bd") : configmap "kube-rbac-proxy" not found
Sep 10 20:58:38.915445 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:38.915435    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls podName:a2fcf18f-8812-4837-9d60-49f2e76623bd nodeName:}" failed. No retries permitted until 2026-09-10 20:58:40.915429221 +0000 UTC m=+48.489135573 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmnp2" (UID: "a2fcf18f-8812-4837-9d60-49f2e76623bd") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:40.129987 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:40.129960    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vrfnj_7b43f658-f338-479a-b979-4461acdc7696/dns-node-resolver/0.log"
Sep 10 20:58:40.930225 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:40.930195    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dhdcz_0a0a76c1-fac6-4c96-baf9-345e0fcf9d52/node-ca/0.log"
Sep 10 20:58:40.932436 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:40.932416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:40.932544 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:40.932530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:40.932599 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:40.932571    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:40.932652 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:40.932603    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:58:40.932652 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:40.932644    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls podName:a2fcf18f-8812-4837-9d60-49f2e76623bd nodeName:}" failed. No retries permitted until 2026-09-10 20:58:44.932625526 +0000 UTC m=+52.506331892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmnp2" (UID: "a2fcf18f-8812-4837-9d60-49f2e76623bd") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:40.932764 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:40.932666    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm podName:a2fcf18f-8812-4837-9d60-49f2e76623bd nodeName:}" failed. No retries permitted until 2026-09-10 20:58:44.932655755 +0000 UTC m=+52.506362111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kmnp2" (UID: "a2fcf18f-8812-4837-9d60-49f2e76623bd") : configmap "kube-rbac-proxy" not found
Sep 10 20:58:41.534729 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:41.534701    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7w8w9_4fbaa2ca-55f1-45b4-8b64-6e31f788e200/serve-healthcheck-canary/0.log"
Sep 10 20:58:42.141615 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:42.141580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-7wkln\" (UID: \"713c4120-1f4e-4ada-b6ed-58830761895e\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"
Sep 10 20:58:42.141769 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:42.141630    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:42.141769 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:42.141710    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 20:58:42.141769 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:42.141721    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fb84588b-9vf44: secret "image-registry-tls" not found
Sep 10 20:58:42.141769 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:42.141765    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls podName:559d2df7-ee5d-48b6-98ad-22faaf8d2a23 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:58.141752368 +0000 UTC m=+65.715458719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls") pod "image-registry-76fb84588b-9vf44" (UID: "559d2df7-ee5d-48b6-98ad-22faaf8d2a23") : secret "image-registry-tls" not found
Sep 10 20:58:42.141907 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:42.141709    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 20:58:42.141907 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:42.141838    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert podName:713c4120-1f4e-4ada-b6ed-58830761895e nodeName:}" failed. No retries permitted until 2026-09-10 20:58:58.141824962 +0000 UTC m=+65.715531320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-7wkln" (UID: "713c4120-1f4e-4ada-b6ed-58830761895e") : secret "networking-console-plugin-cert" not found
Sep 10 20:58:42.242356 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:42.242332    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:42.242356 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:42.242364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:42.242544 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:42.242473    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:58:42.242544 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:42.242508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:42.242544 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:42.242515    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs podName:0d76ce81-20d8-49cb-bf21-f01ab5f63317 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:58.242503767 +0000 UTC m=+65.816210133 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs") pod "router-default-84d6cf958b-xf674" (UID: "0d76ce81-20d8-49cb-bf21-f01ab5f63317") : secret "router-metrics-certs-default" not found
Sep 10 20:58:42.242639 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:42.242473    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:42.242639 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:42.242591    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls podName:de7b33a4-bb24-4e27-a1c9-6eec4f07d263 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:58.242577587 +0000 UTC m=+65.816283948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls") pod "dns-default-h8z6q" (UID: "de7b33a4-bb24-4e27-a1c9-6eec4f07d263") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:42.242639 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:42.242607    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle podName:0d76ce81-20d8-49cb-bf21-f01ab5f63317 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:58.242598174 +0000 UTC m=+65.816304533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle") pod "router-default-84d6cf958b-xf674" (UID: "0d76ce81-20d8-49cb-bf21-f01ab5f63317") : configmap references non-existent config key: service-ca.crt
Sep 10 20:58:42.343180 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:42.343146    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:42.343349 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:42.343242    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6kz5v\" (UID: \"b786dada-99f1-4c3b-8209-fb65c61e2ad7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"
Sep 10 20:58:42.343349 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:42.343303    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 20:58:42.343349 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:42.343328    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 20:58:42.343517 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:42.343375    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls podName:a283a451-553e-4578-bc9c-643b9237e1d0 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:58.343356657 +0000 UTC m=+65.917063023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-9mmdw" (UID: "a283a451-553e-4578-bc9c-643b9237e1d0") : secret "cluster-monitoring-operator-tls" not found
Sep 10 20:58:42.343517 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:42.343395    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls podName:b786dada-99f1-4c3b-8209-fb65c61e2ad7 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:58.343385022 +0000 UTC m=+65.917091376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-6kz5v" (UID: "b786dada-99f1-4c3b-8209-fb65c61e2ad7") : secret "samples-operator-tls" not found
Sep 10 20:58:42.530896 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:42.530796    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-7r9ll_3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a/kube-storage-version-migrator-operator/0.log"
Sep 10 20:58:44.963266 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:44.963230    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:44.963708 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:44.963298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:44.963708 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:44.963413    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:44.963708 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:44.963477    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls podName:a2fcf18f-8812-4837-9d60-49f2e76623bd nodeName:}" failed. No retries permitted until 2026-09-10 20:58:52.96346107 +0000 UTC m=+60.537167422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmnp2" (UID: "a2fcf18f-8812-4837-9d60-49f2e76623bd") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:44.963814 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:44.963755    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2fcf18f-8812-4837-9d60-49f2e76623bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:46.600953 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:46.600917    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:46.601354 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:46.600969    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:46.601354 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:46.601285    2577 scope.go:117] "RemoveContainer" containerID="9fe0c371d94f48d1a54ee9e514b2ea1cdbc13ce97486d01146b507817c49ffe4"
Sep 10 20:58:47.253302 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:47.253276    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 20:58:47.253729 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:47.253711    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/1.log"
Sep 10 20:58:47.253775 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:47.253746    2577 generic.go:356] "Generic (PLEG): container finished" podID="b58c2c3a-5930-45ab-83b7-f51b29b82a1f" containerID="26174a2d2a4c34e8365fa327b38dda376393d679e42d92ceabfc9be6abad7067" exitCode=255
Sep 10 20:58:47.253817 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:47.253804    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs" event={"ID":"b58c2c3a-5930-45ab-83b7-f51b29b82a1f","Type":"ContainerDied","Data":"26174a2d2a4c34e8365fa327b38dda376393d679e42d92ceabfc9be6abad7067"}
Sep 10 20:58:47.253876 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:47.253867    2577 scope.go:117] "RemoveContainer" containerID="9fe0c371d94f48d1a54ee9e514b2ea1cdbc13ce97486d01146b507817c49ffe4"
Sep 10 20:58:47.254216 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:47.254187    2577 scope.go:117] "RemoveContainer" containerID="26174a2d2a4c34e8365fa327b38dda376393d679e42d92ceabfc9be6abad7067"
Sep 10 20:58:47.254362 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:47.254343    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-2mqjs_openshift-console-operator(b58c2c3a-5930-45ab-83b7-f51b29b82a1f)\"" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs" podUID="b58c2c3a-5930-45ab-83b7-f51b29b82a1f"
Sep 10 20:58:48.258595 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:48.258570    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 20:58:51.104582 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:51.104552    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rz57"
Sep 10 20:58:53.031158 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:53.031128    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:53.033332 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:53.033307    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2fcf18f-8812-4837-9d60-49f2e76623bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmnp2\" (UID: \"a2fcf18f-8812-4837-9d60-49f2e76623bd\") " pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:53.114858 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:53.114833    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x2prl\""
Sep 10 20:58:53.122765 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:53.122744    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kmnp2"
Sep 10 20:58:53.388255 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:53.388186    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kmnp2"]
Sep 10 20:58:53.390571 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:58:53.390544    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2fcf18f_8812_4837_9d60_49f2e76623bd.slice/crio-f9323d13044fa02590d7810b62488b6cf18adc85818fd331a83d8e907bba6bdf WatchSource:0}: Error finding container f9323d13044fa02590d7810b62488b6cf18adc85818fd331a83d8e907bba6bdf: Status 404 returned error can't find the container with id f9323d13044fa02590d7810b62488b6cf18adc85818fd331a83d8e907bba6bdf
Sep 10 20:58:54.278539 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:54.278505    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kmnp2" event={"ID":"a2fcf18f-8812-4837-9d60-49f2e76623bd","Type":"ContainerStarted","Data":"d4d17c921ad6b6179a155dcbb4dbfeb1e2bbbeabb90a88accbf7d211271d3656"}
Sep 10 20:58:54.278900 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:54.278558    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kmnp2" event={"ID":"a2fcf18f-8812-4837-9d60-49f2e76623bd","Type":"ContainerStarted","Data":"d930ac10fbfc495eec287e20fcd7721480b43154b2023ddaa98174496f1658d4"}
Sep 10 20:58:54.278900 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:54.278576    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kmnp2" event={"ID":"a2fcf18f-8812-4837-9d60-49f2e76623bd","Type":"ContainerStarted","Data":"f9323d13044fa02590d7810b62488b6cf18adc85818fd331a83d8e907bba6bdf"}
Sep 10 20:58:56.290127 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:56.290088    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kmnp2" event={"ID":"a2fcf18f-8812-4837-9d60-49f2e76623bd","Type":"ContainerStarted","Data":"59823a1342156458ae0050b4a181159f15a36b499f3246a20c0321a082c08cab"}
Sep 10 20:58:56.600829 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:56.600791    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:56.600989 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:56.600873    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:58:56.601201 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:56.601189    2577 scope.go:117] "RemoveContainer" containerID="26174a2d2a4c34e8365fa327b38dda376393d679e42d92ceabfc9be6abad7067"
Sep 10 20:58:56.601352 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:58:56.601333    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-2mqjs_openshift-console-operator(b58c2c3a-5930-45ab-83b7-f51b29b82a1f)\"" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs" podUID="b58c2c3a-5930-45ab-83b7-f51b29b82a1f"
Sep 10 20:58:56.617353 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:56.617305    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kmnp2" podStartSLOduration=17.712077063 podStartE2EDuration="19.617290267s" totalImagesPullingTime="1.905213204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:58:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:56.306245175 +0000 UTC m=+63.879951550" watchObservedRunningTime="2026-09-10 20:58:56.617290267 +0000 UTC m=+64.190996641"
Sep 10 20:58:58.177298 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.177246    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-7wkln\" (UID: \"713c4120-1f4e-4ada-b6ed-58830761895e\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"
Sep 10 20:58:58.177298 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.177311    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:58.179659 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.179633    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/713c4120-1f4e-4ada-b6ed-58830761895e-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-7wkln\" (UID: \"713c4120-1f4e-4ada-b6ed-58830761895e\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"
Sep 10 20:58:58.179747 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.179716    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls\") pod \"image-registry-76fb84588b-9vf44\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") " pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:58.278258 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.278216    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:58.278258 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.278264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:58.278490 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.278411    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:58.278981 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.278959    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d76ce81-20d8-49cb-bf21-f01ab5f63317-service-ca-bundle\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:58.280415 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.280398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de7b33a4-bb24-4e27-a1c9-6eec4f07d263-metrics-tls\") pod \"dns-default-h8z6q\" (UID: \"de7b33a4-bb24-4e27-a1c9-6eec4f07d263\") " pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:58.280611 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.280593    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d76ce81-20d8-49cb-bf21-f01ab5f63317-metrics-certs\") pod \"router-default-84d6cf958b-xf674\" (UID: \"0d76ce81-20d8-49cb-bf21-f01ab5f63317\") " pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:58.360470 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.360436    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-88l8n\""
Sep 10 20:58:58.368274 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.368252    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:58.379125 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.379083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:58.379245 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.379193    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6kz5v\" (UID: \"b786dada-99f1-4c3b-8209-fb65c61e2ad7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"
Sep 10 20:58:58.381499 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.381473    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b786dada-99f1-4c3b-8209-fb65c61e2ad7-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6kz5v\" (UID: \"b786dada-99f1-4c3b-8209-fb65c61e2ad7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"
Sep 10 20:58:58.381788 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.381764    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a283a451-553e-4578-bc9c-643b9237e1d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-9mmdw\" (UID: \"a283a451-553e-4578-bc9c-643b9237e1d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:58.417631 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.417605    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dz6th\""
Sep 10 20:58:58.426480 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.426293    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"
Sep 10 20:58:58.474957 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.474718    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lc2fz\""
Sep 10 20:58:58.483102 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.483074    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:58.497449 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.497429    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-56bmz\""
Sep 10 20:58:58.506108 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.506086    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:58:58.552575 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.552551    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9m4tq\""
Sep 10 20:58:58.561551 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.561530    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"
Sep 10 20:58:58.574601 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.574576    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b6tx6\""
Sep 10 20:58:58.582641 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.582618    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"
Sep 10 20:58:58.638529 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.638456    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76fb84588b-9vf44"]
Sep 10 20:58:58.641964 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:58:58.641871    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559d2df7_ee5d_48b6_98ad_22faaf8d2a23.slice/crio-18082af209b607d20fbe521eab88d4e7dc8ea112c7d06a19805933928e4bea5b WatchSource:0}: Error finding container 18082af209b607d20fbe521eab88d4e7dc8ea112c7d06a19805933928e4bea5b: Status 404 returned error can't find the container with id 18082af209b607d20fbe521eab88d4e7dc8ea112c7d06a19805933928e4bea5b
Sep 10 20:58:58.681237 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.681169    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs\") pod \"network-metrics-daemon-5ll4j\" (UID: \"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda\") " pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:58.683285 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.683262    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 20:58:58.689279 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.689260    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln"]
Sep 10 20:58:58.692070 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:58:58.692042    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713c4120_1f4e_4ada_b6ed_58830761895e.slice/crio-74fd7417a351f69c23214538739063c97cdb7d44c5cc4be23d4317b43017b830 WatchSource:0}: Error finding container 74fd7417a351f69c23214538739063c97cdb7d44c5cc4be23d4317b43017b830: Status 404 returned error can't find the container with id 74fd7417a351f69c23214538739063c97cdb7d44c5cc4be23d4317b43017b830
Sep 10 20:58:58.693816 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.693739    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda-metrics-certs\") pod \"network-metrics-daemon-5ll4j\" (UID: \"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda\") " pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:58.751739 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.751709    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84d6cf958b-xf674"]
Sep 10 20:58:58.755466 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:58:58.755434    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d76ce81_20d8_49cb_bf21_f01ab5f63317.slice/crio-5a297b963888410e7b9fd88ef51c0b055914c6836b5a49bbcccad8b8ffa6c796 WatchSource:0}: Error finding container 5a297b963888410e7b9fd88ef51c0b055914c6836b5a49bbcccad8b8ffa6c796: Status 404 returned error can't find the container with id 5a297b963888410e7b9fd88ef51c0b055914c6836b5a49bbcccad8b8ffa6c796
Sep 10 20:58:58.781841 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.781814    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h8z6q"]
Sep 10 20:58:58.782004 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.781973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:58.784192 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.784172    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 20:58:58.785050 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:58:58.784999    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7b33a4_bb24_4e27_a1c9_6eec4f07d263.slice/crio-89b262f2c08563ffde9bc938588ac1782fbd129c3c6cf7395febde3a46164436 WatchSource:0}: Error finding container 89b262f2c08563ffde9bc938588ac1782fbd129c3c6cf7395febde3a46164436: Status 404 returned error can't find the container with id 89b262f2c08563ffde9bc938588ac1782fbd129c3c6cf7395febde3a46164436
Sep 10 20:58:58.794907 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.794882    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c136d4-6105-4707-add6-396ab1649cc2-original-pull-secret\") pod \"global-pull-secret-syncer-wdxkj\" (UID: \"f7c136d4-6105-4707-add6-396ab1649cc2\") " pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:58.834149 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.834069    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v"]
Sep 10 20:58:58.852696 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.852675    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdxkj"
Sep 10 20:58:58.858420 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.858332    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw"]
Sep 10 20:58:58.867144 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.867122    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g6p7f\""
Sep 10 20:58:58.870177 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:58:58.870154    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda283a451_553e_4578_bc9c_643b9237e1d0.slice/crio-f0b1214c9bbcd4f4585b4ca54917cfff513180ad743c2dd6541eec6cd4cfb73a WatchSource:0}: Error finding container f0b1214c9bbcd4f4585b4ca54917cfff513180ad743c2dd6541eec6cd4cfb73a: Status 404 returned error can't find the container with id f0b1214c9bbcd4f4585b4ca54917cfff513180ad743c2dd6541eec6cd4cfb73a
Sep 10 20:58:58.876174 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:58.876146    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ll4j"
Sep 10 20:58:59.129447 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.129419    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wdxkj"]
Sep 10 20:58:59.132510 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:58:59.132485    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c136d4_6105_4707_add6_396ab1649cc2.slice/crio-bbf3d0633f37720aeb9ffd0deabb4d371a40f82e569e2861ccd8bcc57aea0c9f WatchSource:0}: Error finding container bbf3d0633f37720aeb9ffd0deabb4d371a40f82e569e2861ccd8bcc57aea0c9f: Status 404 returned error can't find the container with id bbf3d0633f37720aeb9ffd0deabb4d371a40f82e569e2861ccd8bcc57aea0c9f
Sep 10 20:58:59.152599 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.152576    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5ll4j"]
Sep 10 20:58:59.155304 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:58:59.155284    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7509d9d_d9c8_4d6e_a4c8_b63b790f5dda.slice/crio-ea13de39e08c73f2f6d3facc5cfa0aabd774580d5321716e922b684252016bb8 WatchSource:0}: Error finding container ea13de39e08c73f2f6d3facc5cfa0aabd774580d5321716e922b684252016bb8: Status 404 returned error can't find the container with id ea13de39e08c73f2f6d3facc5cfa0aabd774580d5321716e922b684252016bb8
Sep 10 20:58:59.300429 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.300349    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wdxkj" event={"ID":"f7c136d4-6105-4707-add6-396ab1649cc2","Type":"ContainerStarted","Data":"bbf3d0633f37720aeb9ffd0deabb4d371a40f82e569e2861ccd8bcc57aea0c9f"}
Sep 10 20:58:59.302247 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.302217    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76fb84588b-9vf44" event={"ID":"559d2df7-ee5d-48b6-98ad-22faaf8d2a23","Type":"ContainerStarted","Data":"4d0c243aca1a62fcce68e4c0b8fb22022bdfeeafe547227cef0dfe2698397635"}
Sep 10 20:58:59.302371 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.302267    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76fb84588b-9vf44" event={"ID":"559d2df7-ee5d-48b6-98ad-22faaf8d2a23","Type":"ContainerStarted","Data":"18082af209b607d20fbe521eab88d4e7dc8ea112c7d06a19805933928e4bea5b"}
Sep 10 20:58:59.302371 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.302318    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:58:59.303652 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.303627    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw" event={"ID":"a283a451-553e-4578-bc9c-643b9237e1d0","Type":"ContainerStarted","Data":"f0b1214c9bbcd4f4585b4ca54917cfff513180ad743c2dd6541eec6cd4cfb73a"}
Sep 10 20:58:59.304815 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.304792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8z6q" event={"ID":"de7b33a4-bb24-4e27-a1c9-6eec4f07d263","Type":"ContainerStarted","Data":"89b262f2c08563ffde9bc938588ac1782fbd129c3c6cf7395febde3a46164436"}
Sep 10 20:58:59.306257 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.306229    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v" event={"ID":"b786dada-99f1-4c3b-8209-fb65c61e2ad7","Type":"ContainerStarted","Data":"462feb8c3b0fbf1df1d1e152dc5303190fad8978128173bf3724042c5654d041"}
Sep 10 20:58:59.308024 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.308001    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84d6cf958b-xf674" event={"ID":"0d76ce81-20d8-49cb-bf21-f01ab5f63317","Type":"ContainerStarted","Data":"16be2f3012a66892e39884c453fc384e3e1e5a4184829d677fc7738581371f35"}
Sep 10 20:58:59.308144 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.308064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84d6cf958b-xf674" event={"ID":"0d76ce81-20d8-49cb-bf21-f01ab5f63317","Type":"ContainerStarted","Data":"5a297b963888410e7b9fd88ef51c0b055914c6836b5a49bbcccad8b8ffa6c796"}
Sep 10 20:58:59.309391 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.309365    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5ll4j" event={"ID":"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda","Type":"ContainerStarted","Data":"ea13de39e08c73f2f6d3facc5cfa0aabd774580d5321716e922b684252016bb8"}
Sep 10 20:58:59.310658 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.310638    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln" event={"ID":"713c4120-1f4e-4ada-b6ed-58830761895e","Type":"ContainerStarted","Data":"74fd7417a351f69c23214538739063c97cdb7d44c5cc4be23d4317b43017b830"}
Sep 10 20:58:59.320449 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.320412    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76fb84588b-9vf44" podStartSLOduration=66.3203964 podStartE2EDuration="1m6.3203964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:59.31932013 +0000 UTC m=+66.893026527" watchObservedRunningTime="2026-09-10 20:58:59.3203964 +0000 UTC m=+66.894102774"
Sep 10 20:58:59.335750 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.335706    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-84d6cf958b-xf674" podStartSLOduration=44.335688965 podStartE2EDuration="44.335688965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:59.334434426 +0000 UTC m=+66.908140803" watchObservedRunningTime="2026-09-10 20:58:59.335688965 +0000 UTC m=+66.909395345"
Sep 10 20:58:59.484107 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.484070    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:58:59.487326 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:58:59.487072    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:59:00.321438 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:00.320727    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln" event={"ID":"713c4120-1f4e-4ada-b6ed-58830761895e","Type":"ContainerStarted","Data":"898a7f110ced1cc50523db5e75844941d4c121ee71c035397164fe3a20c595d6"}
Sep 10 20:59:00.321438 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:00.320823    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:59:00.321954 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:00.321742    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-84d6cf958b-xf674"
Sep 10 20:59:00.336385 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:00.336324    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-7wkln" podStartSLOduration=37.958928075 podStartE2EDuration="39.336303729s" totalImagesPullingTime="1.377375654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:00.335571869 +0000 UTC m=+67.909278244" watchObservedRunningTime="2026-09-10 20:59:00.336303729 +0000 UTC m=+67.910010105"
Sep 10 20:59:04.338573 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:04.338540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5ll4j" event={"ID":"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda","Type":"ContainerStarted","Data":"6c20eb6921dbc9163ebb5168aea202ba8762f9865ed3f285c27ef640acdc8324"}
Sep 10 20:59:04.338999 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:04.338632    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5ll4j" event={"ID":"c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda","Type":"ContainerStarted","Data":"520dcceda77b37b1181f8a1ea7a81f22a935982804af19b8c32b4cae2ac1e2f4"}
Sep 10 20:59:04.340676 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:04.340611    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw" event={"ID":"a283a451-553e-4578-bc9c-643b9237e1d0","Type":"ContainerStarted","Data":"e1fa60cdd558379398033452d79a8b5daf5ffcc5a503682b10ba73787bc61f42"}
Sep 10 20:59:04.342947 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:04.342923    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8z6q" event={"ID":"de7b33a4-bb24-4e27-a1c9-6eec4f07d263","Type":"ContainerStarted","Data":"2686d6c7a333c098137025c0da0517fedb4b967080f6c268fafbc3148d94df00"}
Sep 10 20:59:04.343084 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:04.342970    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8z6q" event={"ID":"de7b33a4-bb24-4e27-a1c9-6eec4f07d263","Type":"ContainerStarted","Data":"15dcd976ddd1e463a94ae278095fe4758847cb018f503803efe465639b567bf9"}
Sep 10 20:59:04.343084 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:04.343013    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:59:04.344680 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:04.344659    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v" event={"ID":"b786dada-99f1-4c3b-8209-fb65c61e2ad7","Type":"ContainerStarted","Data":"074d5507505ae46236a2dcb1bbaa647d92220e695aa4ef30dfb372f82c33e5a7"}
Sep 10 20:59:04.344764 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:04.344696    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v" event={"ID":"b786dada-99f1-4c3b-8209-fb65c61e2ad7","Type":"ContainerStarted","Data":"c7055b4ad7bfe67bb373da3ae4b4ac02bdb5b09999eaf62f405925db2391865c"}
Sep 10 20:59:04.353833 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:04.353770    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5ll4j" podStartSLOduration=66.687713551 podStartE2EDuration="1m11.353755889s" totalImagesPullingTime="4.666042338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:04.3532088 +0000 UTC m=+71.926915185" watchObservedRunningTime="2026-09-10 20:59:04.353755889 +0000 UTC m=+71.927462263"
Sep 10 20:59:04.370650 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:04.370182    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h8z6q" podStartSLOduration=33.334093123 podStartE2EDuration="38.370165089s" totalImagesPullingTime="5.036071966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:04.369016145 +0000 UTC m=+71.942722520" watchObservedRunningTime="2026-09-10 20:59:04.370165089 +0000 UTC m=+71.943871479"
Sep 10 20:59:04.386055 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:04.385800    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-9mmdw" podStartSLOduration=44.433841364 podStartE2EDuration="49.385778853s" totalImagesPullingTime="4.951937489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:04.385140022 +0000 UTC m=+71.958846397" watchObservedRunningTime="2026-09-10 20:59:04.385778853 +0000 UTC m=+71.959485228"
Sep 10 20:59:04.401259 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:04.401199    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6kz5v" podStartSLOduration=44.457557988 podStartE2EDuration="49.401186121s" totalImagesPullingTime="4.943628133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:04.40056068 +0000 UTC m=+71.974267059" watchObservedRunningTime="2026-09-10 20:59:04.401186121 +0000 UTC m=+71.974892494"
Sep 10 20:59:05.349447 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:05.349407    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wdxkj" event={"ID":"f7c136d4-6105-4707-add6-396ab1649cc2","Type":"ContainerStarted","Data":"0e0e2881673644978fa180502c978f96537867c61bc2e543296d5bc656a49273"}
Sep 10 20:59:05.365775 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:05.365713    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wdxkj" podStartSLOduration=67.355588989 podStartE2EDuration="1m12.365693404s" totalImagesPullingTime="5.010104415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:05.364443202 +0000 UTC m=+72.938149576" watchObservedRunningTime="2026-09-10 20:59:05.365693404 +0000 UTC m=+72.939399777"
Sep 10 20:59:07.217270 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:07.217237    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q27cq"
Sep 10 20:59:10.940818 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:10.940783    2577 scope.go:117] "RemoveContainer" containerID="26174a2d2a4c34e8365fa327b38dda376393d679e42d92ceabfc9be6abad7067"
Sep 10 20:59:11.372502 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:11.372475    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 20:59:11.372660 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:11.372556    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs" event={"ID":"b58c2c3a-5930-45ab-83b7-f51b29b82a1f","Type":"ContainerStarted","Data":"e069cdfdc336a945bbb463f6f42ae220b40a4828192fba3bafad26e6eb23b1d8"}
Sep 10 20:59:11.372844 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:11.372818    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:59:11.391981 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:11.391931    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs" podStartSLOduration=48.315176162 podStartE2EDuration="56.391911956s" totalImagesPullingTime="8.076735794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:11.391060335 +0000 UTC m=+78.964766707" watchObservedRunningTime="2026-09-10 20:59:11.391911956 +0000 UTC m=+78.965618332"
Sep 10 20:59:11.745105 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:11.745014    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-2mqjs"
Sep 10 20:59:14.351704 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:14.351669    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h8z6q"
Sep 10 20:59:15.935332 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:15.935191    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"]
Sep 10 20:59:15.938264 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:15.938242    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:15.940584 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:15.940561    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 10 20:59:15.941430 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:15.941410    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ftmnq\""
Sep 10 20:59:15.941532 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:15.941490    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 20:59:15.941532 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:15.941499    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 10 20:59:15.950261 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:15.950238    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"]
Sep 10 20:59:15.960669 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:15.960646    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qp985"]
Sep 10 20:59:15.962667 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:15.962651    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:15.964907 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:15.964885    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 20:59:15.965046 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:15.965012    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-46kj6\""
Sep 10 20:59:15.965110 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:15.965060    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 20:59:15.965159 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:15.965063    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 20:59:16.022966 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.022928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8ww2\" (UniqueName: \"kubernetes.io/projected/080c0e6b-ef9d-479c-a832-8e141b05a08a-kube-api-access-f8ww2\") pod \"openshift-state-metrics-67dcf8c979-5bt44\" (UID: \"080c0e6b-ef9d-479c-a832-8e141b05a08a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:16.023174 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.022991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/080c0e6b-ef9d-479c-a832-8e141b05a08a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-5bt44\" (UID: \"080c0e6b-ef9d-479c-a832-8e141b05a08a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:16.023174 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.023022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/080c0e6b-ef9d-479c-a832-8e141b05a08a-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-5bt44\" (UID: \"080c0e6b-ef9d-479c-a832-8e141b05a08a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:16.023174 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.023113    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/080c0e6b-ef9d-479c-a832-8e141b05a08a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-5bt44\" (UID: \"080c0e6b-ef9d-479c-a832-8e141b05a08a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:16.123982 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.123946    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-wtmp\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.124184 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.123990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-sys\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.124184 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.124015    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8ww2\" (UniqueName: \"kubernetes.io/projected/080c0e6b-ef9d-479c-a832-8e141b05a08a-kube-api-access-f8ww2\") pod \"openshift-state-metrics-67dcf8c979-5bt44\" (UID: \"080c0e6b-ef9d-479c-a832-8e141b05a08a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:16.124184 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.124055    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-root\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.124184 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.124075    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.124184 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.124100    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnmvj\" (UniqueName: \"kubernetes.io/projected/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-kube-api-access-fnmvj\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.124184 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.124122    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/080c0e6b-ef9d-479c-a832-8e141b05a08a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-5bt44\" (UID: \"080c0e6b-ef9d-479c-a832-8e141b05a08a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:16.124184 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.124158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/080c0e6b-ef9d-479c-a832-8e141b05a08a-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-5bt44\" (UID: \"080c0e6b-ef9d-479c-a832-8e141b05a08a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:16.124184 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.124177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/080c0e6b-ef9d-479c-a832-8e141b05a08a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-5bt44\" (UID: \"080c0e6b-ef9d-479c-a832-8e141b05a08a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:16.124513 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.124193    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-metrics-client-ca\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.124513 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.124216    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-textfile\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.124513 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:59:16.124240    2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 10 20:59:16.124513 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.124251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-accelerators-collector-config\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.124513 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.124276    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-tls\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.124513 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:59:16.124318    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/080c0e6b-ef9d-479c-a832-8e141b05a08a-openshift-state-metrics-tls podName:080c0e6b-ef9d-479c-a832-8e141b05a08a nodeName:}" failed. No retries permitted until 2026-09-10 20:59:16.624297802 +0000 UTC m=+84.198004168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/080c0e6b-ef9d-479c-a832-8e141b05a08a-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-5bt44" (UID: "080c0e6b-ef9d-479c-a832-8e141b05a08a") : secret "openshift-state-metrics-tls" not found
Sep 10 20:59:16.124802 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.124782    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/080c0e6b-ef9d-479c-a832-8e141b05a08a-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-5bt44\" (UID: \"080c0e6b-ef9d-479c-a832-8e141b05a08a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:16.126508 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.126492    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/080c0e6b-ef9d-479c-a832-8e141b05a08a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-5bt44\" (UID: \"080c0e6b-ef9d-479c-a832-8e141b05a08a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:16.131488 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.131462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8ww2\" (UniqueName: \"kubernetes.io/projected/080c0e6b-ef9d-479c-a832-8e141b05a08a-kube-api-access-f8ww2\") pod \"openshift-state-metrics-67dcf8c979-5bt44\" (UID: \"080c0e6b-ef9d-479c-a832-8e141b05a08a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:16.224788 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.224686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-sys\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.224788 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.224731    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-root\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.224788 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.224748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.225098 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.224804    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-sys\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.225098 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.224814    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-root\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.225098 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.224850    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnmvj\" (UniqueName: \"kubernetes.io/projected/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-kube-api-access-fnmvj\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.225098 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.224902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-metrics-client-ca\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.225098 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.224922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-textfile\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.225098 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.224948    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-accelerators-collector-config\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.225098 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.224969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-tls\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.225098 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.225017    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-wtmp\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.225444 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.225189    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-wtmp\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.225444 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.225290    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-textfile\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.225600 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.225577    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-metrics-client-ca\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.225647 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.225624    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-accelerators-collector-config\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.227248 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.227225    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.227317 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.227300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-node-exporter-tls\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.234897 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.234843    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnmvj\" (UniqueName: \"kubernetes.io/projected/e35d43dc-bfa4-4efa-9c60-7f64d6a2c850-kube-api-access-fnmvj\") pod \"node-exporter-qp985\" (UID: \"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850\") " pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.272093 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.272063    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qp985"
Sep 10 20:59:16.284522 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:59:16.284495    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35d43dc_bfa4_4efa_9c60_7f64d6a2c850.slice/crio-0810dd3dc8f27aa0ae6f131117c350bdbe478d96a4f35a03d2ad60f111028413 WatchSource:0}: Error finding container 0810dd3dc8f27aa0ae6f131117c350bdbe478d96a4f35a03d2ad60f111028413: Status 404 returned error can't find the container with id 0810dd3dc8f27aa0ae6f131117c350bdbe478d96a4f35a03d2ad60f111028413
Sep 10 20:59:16.395650 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.395606    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qp985" event={"ID":"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850","Type":"ContainerStarted","Data":"0810dd3dc8f27aa0ae6f131117c350bdbe478d96a4f35a03d2ad60f111028413"}
Sep 10 20:59:16.628384 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.628341    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/080c0e6b-ef9d-479c-a832-8e141b05a08a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-5bt44\" (UID: \"080c0e6b-ef9d-479c-a832-8e141b05a08a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:16.630708 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.630687    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/080c0e6b-ef9d-479c-a832-8e141b05a08a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-5bt44\" (UID: \"080c0e6b-ef9d-479c-a832-8e141b05a08a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:16.847347 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.847309    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"
Sep 10 20:59:16.980330 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.980236    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 20:59:16.983099 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.983078    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:16.985439 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.985414    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 20:59:16.985574 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.985505    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 20:59:16.985574 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.985516    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 20:59:16.986270 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.986251    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 20:59:16.986326 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.986308    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 20:59:16.986362 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.986338    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sstsj\""
Sep 10 20:59:16.986457 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.986442    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 20:59:16.986556 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.986543    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 20:59:16.987329 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.987276    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 20:59:16.987445 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.987364    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 20:59:17.000004 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:16.999982    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 20:59:17.131134 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.131022    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44"]
Sep 10 20:59:17.133017 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.132993    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.133112 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.133055    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.133175 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.133147    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l9rk\" (UniqueName: \"kubernetes.io/projected/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-kube-api-access-8l9rk\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.133284 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.133190    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-config-out\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.133284 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.133221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.133284 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.133278    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.133451 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.133308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.133451 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.133363    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-web-config\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.133451 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.133386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.133709 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.133465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.133709 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.133504    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.133709 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.133537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.133709 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.133567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.162173 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:59:17.162105    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080c0e6b_ef9d_479c_a832_8e141b05a08a.slice/crio-3908dff6ef5a067d4073425723d5f4a431fc8ca4b8d38fc42744976874eaa527 WatchSource:0}: Error finding container 3908dff6ef5a067d4073425723d5f4a431fc8ca4b8d38fc42744976874eaa527: Status 404 returned error can't find the container with id 3908dff6ef5a067d4073425723d5f4a431fc8ca4b8d38fc42744976874eaa527
Sep 10 20:59:17.235060 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.235010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l9rk\" (UniqueName: \"kubernetes.io/projected/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-kube-api-access-8l9rk\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.235178 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.235158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-config-out\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.235240 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.235192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.235240 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.235231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.235344 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.235263    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.235344 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.235307    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-web-config\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.235344 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.235330    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.235495 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.235391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.235495 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.235425    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.235495 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.235459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.235495 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.235490    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.235696 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.235519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.235696 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.235559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.239367 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.237496    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.239367 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.238952    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.239367 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.239330    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.239562 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:59:17.239452    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-trusted-ca-bundle podName:173d3257-9e76-4c6b-9a44-7c20fb5f00f0 nodeName:}" failed. No retries permitted until 2026-09-10 20:59:17.739433356 +0000 UTC m=+85.313139721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "173d3257-9e76-4c6b-9a44-7c20fb5f00f0") : configmap references non-existent config key: ca-bundle.crt
Sep 10 20:59:17.241415 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.240734    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.241415 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.240863    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.241415 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.240994    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.241415 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.241090    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-config-out\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.241956 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.241921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.242327 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.242304    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-web-config\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.242446 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.242422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.243681 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.243651    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.245170 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.245147    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l9rk\" (UniqueName: \"kubernetes.io/projected/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-kube-api-access-8l9rk\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.401253 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.401222    2577 generic.go:356] "Generic (PLEG): container finished" podID="e35d43dc-bfa4-4efa-9c60-7f64d6a2c850" containerID="aa002bc9401982efc7b5039e33596f2f0464b73af7160807ff23e02c122dae3e" exitCode=0
Sep 10 20:59:17.401414 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.401306    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qp985" event={"ID":"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850","Type":"ContainerDied","Data":"aa002bc9401982efc7b5039e33596f2f0464b73af7160807ff23e02c122dae3e"}
Sep 10 20:59:17.403321 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.403293    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44" event={"ID":"080c0e6b-ef9d-479c-a832-8e141b05a08a","Type":"ContainerStarted","Data":"f3e949472a347d0776de4b25dcb90ef7dc90ff79ca55683e2fa22502df98f2c3"}
Sep 10 20:59:17.403429 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.403350    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44" event={"ID":"080c0e6b-ef9d-479c-a832-8e141b05a08a","Type":"ContainerStarted","Data":"fe0311871b732c39aa5415a400cd7e7036c245375f2c67d94d3dc7c8739b3feb"}
Sep 10 20:59:17.403429 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.403373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44" event={"ID":"080c0e6b-ef9d-479c-a832-8e141b05a08a","Type":"ContainerStarted","Data":"3908dff6ef5a067d4073425723d5f4a431fc8ca4b8d38fc42744976874eaa527"}
Sep 10 20:59:17.739997 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.739888    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.740730 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.740701    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:17.894840 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:17.894811    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 20:59:18.338373 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.338349    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 20:59:18.339519 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:59:18.339488    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173d3257_9e76_4c6b_9a44_7c20fb5f00f0.slice/crio-9f5366844e21720f87f2651c42ccec4174400418f9d45324c8b7bc8731f56d36 WatchSource:0}: Error finding container 9f5366844e21720f87f2651c42ccec4174400418f9d45324c8b7bc8731f56d36: Status 404 returned error can't find the container with id 9f5366844e21720f87f2651c42ccec4174400418f9d45324c8b7bc8731f56d36
Sep 10 20:59:18.372485 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.372456    2577 patch_prober.go:28] interesting pod/image-registry-76fb84588b-9vf44 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 10 20:59:18.372582 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.372500    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76fb84588b-9vf44" podUID="559d2df7-ee5d-48b6-98ad-22faaf8d2a23" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 20:59:18.416529 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.416498    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44" event={"ID":"080c0e6b-ef9d-479c-a832-8e141b05a08a","Type":"ContainerStarted","Data":"edcbb72c1064c5308b74dd32dfa70775428e4464b1be7670648b189fcd839523"}
Sep 10 20:59:18.417736 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.417714    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerStarted","Data":"9f5366844e21720f87f2651c42ccec4174400418f9d45324c8b7bc8731f56d36"}
Sep 10 20:59:18.419610 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.419591    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qp985" event={"ID":"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850","Type":"ContainerStarted","Data":"a1023c08f0ca9f0a0847ed059674fa6f90b06fd202a4fb72624be44ae3e5a6d5"}
Sep 10 20:59:18.419680 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.419624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qp985" event={"ID":"e35d43dc-bfa4-4efa-9c60-7f64d6a2c850","Type":"ContainerStarted","Data":"8eae710729372e8b0a95291c942f7cc0cae8c29355123c50d3d9f18a96671f11"}
Sep 10 20:59:18.434576 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.434530    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5bt44" podStartSLOduration=2.623874526 podStartE2EDuration="3.434517864s" totalImagesPullingTime="810.643338ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:18.433229141 +0000 UTC m=+86.006935516" watchObservedRunningTime="2026-09-10 20:59:18.434517864 +0000 UTC m=+86.008224238"
Sep 10 20:59:18.451590 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.451549    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qp985" podStartSLOduration=2.481297942 podStartE2EDuration="3.451536114s" totalImagesPullingTime="901.041914ms" totalInitContainerRuntime="69.196258ms" isStatefulPod=true podCreationTimestamp="2026-09-10 20:59:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:18.450216938 +0000 UTC m=+86.023923315" watchObservedRunningTime="2026-09-10 20:59:18.451536114 +0000 UTC m=+86.025242515"
Sep 10 20:59:18.902828 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.902795    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f87df9b69-dhvfp"]
Sep 10 20:59:18.907007 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.906982    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:18.909384 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.909235    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 10 20:59:18.909384 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.909337    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 10 20:59:18.909605 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.909430    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 10 20:59:18.910048 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.909923    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-82u93a4n93dlb\""
Sep 10 20:59:18.910245 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.910226    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 10 20:59:18.910325 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.910283    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 10 20:59:18.910440 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.910421    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-c24sc\""
Sep 10 20:59:18.919089 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:18.919048    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f87df9b69-dhvfp"]
Sep 10 20:59:19.051301 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.051265    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqmf5\" (UniqueName: \"kubernetes.io/projected/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-kube-api-access-lqmf5\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.051301 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.051305    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-metrics-client-ca\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.051533 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.051343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.051533 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.051369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-grpc-tls\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.051533 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.051392    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.051533 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.051416    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.051740 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.051533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.051740 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.051574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-tls\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.153005 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.152923    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.153005 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.152972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-grpc-tls\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.153244 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.153014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.153244 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.153225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.153338 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.153313    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.153399 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.153343    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-tls\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.153399 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.153383    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqmf5\" (UniqueName: \"kubernetes.io/projected/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-kube-api-access-lqmf5\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.153504 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.153419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-metrics-client-ca\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.154246 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.154177    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-metrics-client-ca\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.156206 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.156178    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.156375 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.156351    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.156583 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.156555    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.156698 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.156648    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-tls\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.156966 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.156925    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.157237 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.157212    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-secret-grpc-tls\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.161606 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.161583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqmf5\" (UniqueName: \"kubernetes.io/projected/9c5a61cc-f796-4573-8cb3-b753ea12f5fe-kube-api-access-lqmf5\") pod \"thanos-querier-f87df9b69-dhvfp\" (UID: \"9c5a61cc-f796-4573-8cb3-b753ea12f5fe\") " pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.220390 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.220359    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:19.424840 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.424775    2577 generic.go:356] "Generic (PLEG): container finished" podID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerID="c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f" exitCode=0
Sep 10 20:59:19.425172 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.424864    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerDied","Data":"c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f"}
Sep 10 20:59:19.493534 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:19.493504    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f87df9b69-dhvfp"]
Sep 10 20:59:19.496533 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:59:19.496507    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5a61cc_f796_4573_8cb3_b753ea12f5fe.slice/crio-957aab9eb3c0bb454cf0330811f4bfbbbcf82d8b6cf264589087bd37b34b3a6b WatchSource:0}: Error finding container 957aab9eb3c0bb454cf0330811f4bfbbbcf82d8b6cf264589087bd37b34b3a6b: Status 404 returned error can't find the container with id 957aab9eb3c0bb454cf0330811f4bfbbbcf82d8b6cf264589087bd37b34b3a6b
Sep 10 20:59:20.326495 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:20.326461    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:59:20.431077 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:20.431024    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp" event={"ID":"9c5a61cc-f796-4573-8cb3-b753ea12f5fe","Type":"ContainerStarted","Data":"957aab9eb3c0bb454cf0330811f4bfbbbcf82d8b6cf264589087bd37b34b3a6b"}
Sep 10 20:59:22.134840 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.134803    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56d8bc9fcb-9m59s"]
Sep 10 20:59:22.138374 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.138342    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.140733 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.140711    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 20:59:22.140917 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.140852    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 20:59:22.141023 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.140980    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 20:59:22.141871 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.141851    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9msmf\""
Sep 10 20:59:22.142084 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.142068    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 20:59:22.142333 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.142304    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 20:59:22.143343 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.142463    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 20:59:22.143343 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.142683    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 20:59:22.146953 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.146935    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56d8bc9fcb-9m59s"]
Sep 10 20:59:22.284486 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.284446    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-config\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.284486 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.284491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wrrk\" (UniqueName: \"kubernetes.io/projected/87a5d215-6d22-48a9-9375-05fbeccadd4b-kube-api-access-8wrrk\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.284690 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.284568    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-oauth-serving-cert\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.284690 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.284663    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-serving-cert\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.284805 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.284699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-service-ca\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.284853 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.284804    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-oauth-config\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.385719 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.385675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-config\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.385719 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.385710    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wrrk\" (UniqueName: \"kubernetes.io/projected/87a5d215-6d22-48a9-9375-05fbeccadd4b-kube-api-access-8wrrk\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.385853 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.385737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-oauth-serving-cert\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.385853 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.385766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-serving-cert\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.385853 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.385782    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-service-ca\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.385853 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.385820    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-oauth-config\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.386489 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.386463    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-config\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.386594 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.386462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-service-ca\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.386594 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.386506    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-oauth-serving-cert\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.388223 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.388202    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-serving-cert\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.388223 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.388219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-oauth-config\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.393143 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.393124    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wrrk\" (UniqueName: \"kubernetes.io/projected/87a5d215-6d22-48a9-9375-05fbeccadd4b-kube-api-access-8wrrk\") pod \"console-56d8bc9fcb-9m59s\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") " pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.442162 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.442136    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp" event={"ID":"9c5a61cc-f796-4573-8cb3-b753ea12f5fe","Type":"ContainerStarted","Data":"fa766bcb68d8db0c39a7e036892be5975d4203c681fc7e4ef8b0bb5380a79913"}
Sep 10 20:59:22.442273 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.442203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp" event={"ID":"9c5a61cc-f796-4573-8cb3-b753ea12f5fe","Type":"ContainerStarted","Data":"8769faeb711b53928fc260e9dcfba11204fcc897ced757a473373342ff4c7c77"}
Sep 10 20:59:22.442273 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.442231    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp" event={"ID":"9c5a61cc-f796-4573-8cb3-b753ea12f5fe","Type":"ContainerStarted","Data":"b1a957cbcacc6233d8a83b4e6ea0c2e468986948dc9e687be04823cc4a6defd4"}
Sep 10 20:59:22.445900 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.445878    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerStarted","Data":"a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a"}
Sep 10 20:59:22.445968 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.445937    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerStarted","Data":"701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9"}
Sep 10 20:59:22.445968 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.445964    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerStarted","Data":"9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3"}
Sep 10 20:59:22.446051 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.445989    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerStarted","Data":"36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2"}
Sep 10 20:59:22.446051 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.446013    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerStarted","Data":"ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03"}
Sep 10 20:59:22.453478 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.453453    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:22.730635 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:22.730611    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56d8bc9fcb-9m59s"]
Sep 10 20:59:22.733160 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:59:22.733136    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a5d215_6d22_48a9_9375_05fbeccadd4b.slice/crio-498537d6d408db8ad13f7fc065037d86092ff68b955005564b248c29b88393f1 WatchSource:0}: Error finding container 498537d6d408db8ad13f7fc065037d86092ff68b955005564b248c29b88393f1: Status 404 returned error can't find the container with id 498537d6d408db8ad13f7fc065037d86092ff68b955005564b248c29b88393f1
Sep 10 20:59:23.454826 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:23.454769    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerStarted","Data":"081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994"}
Sep 10 20:59:23.456297 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:23.456263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d8bc9fcb-9m59s" event={"ID":"87a5d215-6d22-48a9-9375-05fbeccadd4b","Type":"ContainerStarted","Data":"498537d6d408db8ad13f7fc065037d86092ff68b955005564b248c29b88393f1"}
Sep 10 20:59:23.459713 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:23.459688    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp" event={"ID":"9c5a61cc-f796-4573-8cb3-b753ea12f5fe","Type":"ContainerStarted","Data":"32a7959123c2bfe22c957a1d52556864a6df3772edd293266080448bc2dd89bc"}
Sep 10 20:59:23.459860 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:23.459752    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp" event={"ID":"9c5a61cc-f796-4573-8cb3-b753ea12f5fe","Type":"ContainerStarted","Data":"15b84a6c1e3e898adee0a4a3ec4cfa691e560d207e2ec71281ea28aba700b78a"}
Sep 10 20:59:23.459860 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:23.459791    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp" event={"ID":"9c5a61cc-f796-4573-8cb3-b753ea12f5fe","Type":"ContainerStarted","Data":"8451d57e6bd60d6387c89d2a87328da3f14cd84f4ca79e52544c2b6da977dcef"}
Sep 10 20:59:23.459860 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:23.459843    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:23.481726 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:23.481677    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.877612441 podStartE2EDuration="7.481662385s" totalImagesPullingTime="3.586923572s" totalInitContainerRuntime="17.126372ms" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:23.480161041 +0000 UTC m=+91.053867426" watchObservedRunningTime="2026-09-10 20:59:23.481662385 +0000 UTC m=+91.055368759"
Sep 10 20:59:23.489130 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:23.489105    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76fb84588b-9vf44"]
Sep 10 20:59:23.505064 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:23.503302    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp" podStartSLOduration=2.809680175 podStartE2EDuration="5.50328103s" totalImagesPullingTime="2.693600855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:23.502179686 +0000 UTC m=+91.075886060" watchObservedRunningTime="2026-09-10 20:59:23.50328103 +0000 UTC m=+91.076987408"
Sep 10 20:59:25.470595 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:25.470553    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d8bc9fcb-9m59s" event={"ID":"87a5d215-6d22-48a9-9375-05fbeccadd4b","Type":"ContainerStarted","Data":"f50dc7e1632abb3ad531a942e4b41f07a5296015072a638d4d51cbbc708b5991"}
Sep 10 20:59:25.486209 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:25.486164    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56d8bc9fcb-9m59s" podStartSLOduration=0.909348675 podStartE2EDuration="3.486148782s" totalImagesPullingTime="2.576800107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:25.485154753 +0000 UTC m=+93.058861127" watchObservedRunningTime="2026-09-10 20:59:25.486148782 +0000 UTC m=+93.059855157"
Sep 10 20:59:29.470414 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:29.470385    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f87df9b69-dhvfp"
Sep 10 20:59:31.836719 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:31.836671    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78cd8648b5-5q55g"]
Sep 10 20:59:31.878020 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:31.877985    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78cd8648b5-5q55g"]
Sep 10 20:59:31.878180 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:31.878114    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:31.885723 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:31.885697    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 20:59:31.969931 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:31.969903    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-trusted-ca-bundle\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:31.970061 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:31.969934    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-console-config\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:31.970061 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:31.969953    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-service-ca\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:31.970141 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:31.970072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7dhz\" (UniqueName: \"kubernetes.io/projected/cdecaeea-ddbb-433e-bb45-773556e05088-kube-api-access-r7dhz\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:31.970141 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:31.970110    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdecaeea-ddbb-433e-bb45-773556e05088-console-oauth-config\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:31.970141 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:31.970138    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdecaeea-ddbb-433e-bb45-773556e05088-console-serving-cert\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:31.970231 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:31.970156    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-oauth-serving-cert\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.070914 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.070878    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-service-ca\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.071089 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.070933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dhz\" (UniqueName: \"kubernetes.io/projected/cdecaeea-ddbb-433e-bb45-773556e05088-kube-api-access-r7dhz\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.071089 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.070961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdecaeea-ddbb-433e-bb45-773556e05088-console-oauth-config\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.071089 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.070983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdecaeea-ddbb-433e-bb45-773556e05088-console-serving-cert\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.071089 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.070999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-oauth-serving-cert\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.071245 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.071164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-trusted-ca-bundle\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.071245 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.071209    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-console-config\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.071686 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.071662    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-service-ca\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.071818 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.071688    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-oauth-serving-cert\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.071895 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.071872    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-console-config\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.072095 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.072070    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-trusted-ca-bundle\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.073544 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.073520    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdecaeea-ddbb-433e-bb45-773556e05088-console-oauth-config\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.073622 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.073612    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdecaeea-ddbb-433e-bb45-773556e05088-console-serving-cert\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.078324 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.078306    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7dhz\" (UniqueName: \"kubernetes.io/projected/cdecaeea-ddbb-433e-bb45-773556e05088-kube-api-access-r7dhz\") pod \"console-78cd8648b5-5q55g\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") " pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.187507 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.187438    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:32.454319 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.454240    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:32.454460 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.454325    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:32.459204 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.459183    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:32.492213 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.492190    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78cd8648b5-5q55g"]
Sep 10 20:59:32.494452 ip-10-0-136-151 kubenswrapper[2577]: W0910 20:59:32.494430    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdecaeea_ddbb_433e_bb45_773556e05088.slice/crio-9636e80e6e980642dfc754ee4288ccc123de47ba98a98905d76ed247b7132ccc WatchSource:0}: Error finding container 9636e80e6e980642dfc754ee4288ccc123de47ba98a98905d76ed247b7132ccc: Status 404 returned error can't find the container with id 9636e80e6e980642dfc754ee4288ccc123de47ba98a98905d76ed247b7132ccc
Sep 10 20:59:32.501659 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.501633    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78cd8648b5-5q55g" event={"ID":"cdecaeea-ddbb-433e-bb45-773556e05088","Type":"ContainerStarted","Data":"9636e80e6e980642dfc754ee4288ccc123de47ba98a98905d76ed247b7132ccc"}
Sep 10 20:59:32.534169 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:32.534148    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 20:59:33.507250 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:33.507215    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78cd8648b5-5q55g" event={"ID":"cdecaeea-ddbb-433e-bb45-773556e05088","Type":"ContainerStarted","Data":"69db3aaacd6c26f049a3a5f25d01fd5f5e583387bf01119ea0b28481882885c2"}
Sep 10 20:59:33.524818 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:33.524774    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78cd8648b5-5q55g" podStartSLOduration=2.524757635 podStartE2EDuration="2.524757635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:33.523320355 +0000 UTC m=+101.097026753" watchObservedRunningTime="2026-09-10 20:59:33.524757635 +0000 UTC m=+101.098464063"
Sep 10 20:59:35.040243 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:35.040206    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78cd8648b5-5q55g"]
Sep 10 20:59:41.539566 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:41.539481    2577 generic.go:356] "Generic (PLEG): container finished" podID="57ea0bf3-4ca1-484f-80f3-0f107c8895e7" containerID="64aa5f61ed53d09c006bc6e731846d2f93b2d65b6f350555e3db939267b15e48" exitCode=0
Sep 10 20:59:41.539566 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:41.539554    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb" event={"ID":"57ea0bf3-4ca1-484f-80f3-0f107c8895e7","Type":"ContainerDied","Data":"64aa5f61ed53d09c006bc6e731846d2f93b2d65b6f350555e3db939267b15e48"}
Sep 10 20:59:41.539944 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:41.539869    2577 scope.go:117] "RemoveContainer" containerID="64aa5f61ed53d09c006bc6e731846d2f93b2d65b6f350555e3db939267b15e48"
Sep 10 20:59:42.188295 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:42.188266    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 20:59:42.545074 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:42.544971    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-54vqb" event={"ID":"57ea0bf3-4ca1-484f-80f3-0f107c8895e7","Type":"ContainerStarted","Data":"820256f23c6ab0e0cd1ab3211493609002b2133b5e9215b6d2c6c57bdab4ea32"}
Sep 10 20:59:46.242984 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:46.242953    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56d8bc9fcb-9m59s"]
Sep 10 20:59:47.566728 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:47.566693    2577 generic.go:356] "Generic (PLEG): container finished" podID="2cb1e53a-557c-4fcb-aba1-165d52863de8" containerID="c4d0c6c3af2bab9cf12752a5edda638235fc51ec2ac48a2b08f89125944a9b3d" exitCode=0
Sep 10 20:59:47.567143 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:47.566768    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-svh6n" event={"ID":"2cb1e53a-557c-4fcb-aba1-165d52863de8","Type":"ContainerDied","Data":"c4d0c6c3af2bab9cf12752a5edda638235fc51ec2ac48a2b08f89125944a9b3d"}
Sep 10 20:59:47.567189 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:47.567155    2577 scope.go:117] "RemoveContainer" containerID="c4d0c6c3af2bab9cf12752a5edda638235fc51ec2ac48a2b08f89125944a9b3d"
Sep 10 20:59:48.516053 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.515976    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76fb84588b-9vf44" podUID="559d2df7-ee5d-48b6-98ad-22faaf8d2a23" containerName="registry" containerID="cri-o://4d0c243aca1a62fcce68e4c0b8fb22022bdfeeafe547227cef0dfe2698397635" gracePeriod=30
Sep 10 20:59:48.572986 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.572958    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-svh6n" event={"ID":"2cb1e53a-557c-4fcb-aba1-165d52863de8","Type":"ContainerStarted","Data":"90962d3548fb45a9fd4485d88baa4f705dff936beb5615e56459ae55976f211a"}
Sep 10 20:59:48.765204 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.765181    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:59:48.815978 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.815952    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmz7b\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-kube-api-access-wmz7b\") pod \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") "
Sep 10 20:59:48.816138 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.815994    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-trusted-ca\") pod \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") "
Sep 10 20:59:48.816183 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.816162    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-bound-sa-token\") pod \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") "
Sep 10 20:59:48.816214 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.816181    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-installation-pull-secrets\") pod \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") "
Sep 10 20:59:48.816214 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.816199    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-ca-trust-extracted\") pod \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") "
Sep 10 20:59:48.816284 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.816230    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-image-registry-private-configuration\") pod \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") "
Sep 10 20:59:48.816284 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.816274    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls\") pod \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") "
Sep 10 20:59:48.816384 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.816318    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-certificates\") pod \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\" (UID: \"559d2df7-ee5d-48b6-98ad-22faaf8d2a23\") "
Sep 10 20:59:48.816434 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.816374    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "559d2df7-ee5d-48b6-98ad-22faaf8d2a23" (UID: "559d2df7-ee5d-48b6-98ad-22faaf8d2a23"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:59:48.816606 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.816582    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-trusted-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 20:59:48.816836 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.816806    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "559d2df7-ee5d-48b6-98ad-22faaf8d2a23" (UID: "559d2df7-ee5d-48b6-98ad-22faaf8d2a23"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:59:48.818727 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.818691    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "559d2df7-ee5d-48b6-98ad-22faaf8d2a23" (UID: "559d2df7-ee5d-48b6-98ad-22faaf8d2a23"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:59:48.818727 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.818714    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-kube-api-access-wmz7b" (OuterVolumeSpecName: "kube-api-access-wmz7b") pod "559d2df7-ee5d-48b6-98ad-22faaf8d2a23" (UID: "559d2df7-ee5d-48b6-98ad-22faaf8d2a23"). InnerVolumeSpecName "kube-api-access-wmz7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:59:48.818909 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.818873    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "559d2df7-ee5d-48b6-98ad-22faaf8d2a23" (UID: "559d2df7-ee5d-48b6-98ad-22faaf8d2a23"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:59:48.819018 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.818965    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "559d2df7-ee5d-48b6-98ad-22faaf8d2a23" (UID: "559d2df7-ee5d-48b6-98ad-22faaf8d2a23"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:59:48.819099 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.819061    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "559d2df7-ee5d-48b6-98ad-22faaf8d2a23" (UID: "559d2df7-ee5d-48b6-98ad-22faaf8d2a23"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:59:48.824701 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.824669    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "559d2df7-ee5d-48b6-98ad-22faaf8d2a23" (UID: "559d2df7-ee5d-48b6-98ad-22faaf8d2a23"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:59:48.917499 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.917463    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-bound-sa-token\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 20:59:48.917499 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.917492    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-installation-pull-secrets\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 20:59:48.917499 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.917503    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-ca-trust-extracted\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 20:59:48.917738 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.917514    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-image-registry-private-configuration\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 20:59:48.917738 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.917524    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-tls\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 20:59:48.917738 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.917534    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-registry-certificates\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 20:59:48.917738 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:48.917542    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmz7b\" (UniqueName: \"kubernetes.io/projected/559d2df7-ee5d-48b6-98ad-22faaf8d2a23-kube-api-access-wmz7b\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 20:59:49.578098 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:49.578064    2577 generic.go:356] "Generic (PLEG): container finished" podID="559d2df7-ee5d-48b6-98ad-22faaf8d2a23" containerID="4d0c243aca1a62fcce68e4c0b8fb22022bdfeeafe547227cef0dfe2698397635" exitCode=0
Sep 10 20:59:49.578487 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:49.578105    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76fb84588b-9vf44"
Sep 10 20:59:49.578487 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:49.578150    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76fb84588b-9vf44" event={"ID":"559d2df7-ee5d-48b6-98ad-22faaf8d2a23","Type":"ContainerDied","Data":"4d0c243aca1a62fcce68e4c0b8fb22022bdfeeafe547227cef0dfe2698397635"}
Sep 10 20:59:49.578487 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:49.578199    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76fb84588b-9vf44" event={"ID":"559d2df7-ee5d-48b6-98ad-22faaf8d2a23","Type":"ContainerDied","Data":"18082af209b607d20fbe521eab88d4e7dc8ea112c7d06a19805933928e4bea5b"}
Sep 10 20:59:49.578487 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:49.578219    2577 scope.go:117] "RemoveContainer" containerID="4d0c243aca1a62fcce68e4c0b8fb22022bdfeeafe547227cef0dfe2698397635"
Sep 10 20:59:49.586300 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:49.586285    2577 scope.go:117] "RemoveContainer" containerID="4d0c243aca1a62fcce68e4c0b8fb22022bdfeeafe547227cef0dfe2698397635"
Sep 10 20:59:49.586564 ip-10-0-136-151 kubenswrapper[2577]: E0910 20:59:49.586545    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d0c243aca1a62fcce68e4c0b8fb22022bdfeeafe547227cef0dfe2698397635\": container with ID starting with 4d0c243aca1a62fcce68e4c0b8fb22022bdfeeafe547227cef0dfe2698397635 not found: ID does not exist" containerID="4d0c243aca1a62fcce68e4c0b8fb22022bdfeeafe547227cef0dfe2698397635"
Sep 10 20:59:49.586614 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:49.586572    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d0c243aca1a62fcce68e4c0b8fb22022bdfeeafe547227cef0dfe2698397635"} err="failed to get container status \"4d0c243aca1a62fcce68e4c0b8fb22022bdfeeafe547227cef0dfe2698397635\": rpc error: code = NotFound desc = could not find container \"4d0c243aca1a62fcce68e4c0b8fb22022bdfeeafe547227cef0dfe2698397635\": container with ID starting with 4d0c243aca1a62fcce68e4c0b8fb22022bdfeeafe547227cef0dfe2698397635 not found: ID does not exist"
Sep 10 20:59:49.596373 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:49.596354    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76fb84588b-9vf44"]
Sep 10 20:59:49.598377 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:49.598355    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76fb84588b-9vf44"]
Sep 10 20:59:50.946440 ip-10-0-136-151 kubenswrapper[2577]: I0910 20:59:50.946407    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="559d2df7-ee5d-48b6-98ad-22faaf8d2a23" path="/var/lib/kubelet/pods/559d2df7-ee5d-48b6-98ad-22faaf8d2a23/volumes"
Sep 10 21:00:00.534429 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.534376    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78cd8648b5-5q55g" podUID="cdecaeea-ddbb-433e-bb45-773556e05088" containerName="console" containerID="cri-o://69db3aaacd6c26f049a3a5f25d01fd5f5e583387bf01119ea0b28481882885c2" gracePeriod=15
Sep 10 21:00:00.770696 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.770674    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 21:00:00.920384 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.920355    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-service-ca\") pod \"cdecaeea-ddbb-433e-bb45-773556e05088\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") "
Sep 10 21:00:00.920554 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.920391    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-oauth-serving-cert\") pod \"cdecaeea-ddbb-433e-bb45-773556e05088\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") "
Sep 10 21:00:00.920554 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.920410    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-trusted-ca-bundle\") pod \"cdecaeea-ddbb-433e-bb45-773556e05088\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") "
Sep 10 21:00:00.920554 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.920429    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7dhz\" (UniqueName: \"kubernetes.io/projected/cdecaeea-ddbb-433e-bb45-773556e05088-kube-api-access-r7dhz\") pod \"cdecaeea-ddbb-433e-bb45-773556e05088\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") "
Sep 10 21:00:00.920706 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.920556    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdecaeea-ddbb-433e-bb45-773556e05088-console-oauth-config\") pod \"cdecaeea-ddbb-433e-bb45-773556e05088\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") "
Sep 10 21:00:00.920706 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.920589    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdecaeea-ddbb-433e-bb45-773556e05088-console-serving-cert\") pod \"cdecaeea-ddbb-433e-bb45-773556e05088\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") "
Sep 10 21:00:00.920706 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.920653    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-console-config\") pod \"cdecaeea-ddbb-433e-bb45-773556e05088\" (UID: \"cdecaeea-ddbb-433e-bb45-773556e05088\") "
Sep 10 21:00:00.920855 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.920771    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-service-ca" (OuterVolumeSpecName: "service-ca") pod "cdecaeea-ddbb-433e-bb45-773556e05088" (UID: "cdecaeea-ddbb-433e-bb45-773556e05088"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:00.920918 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.920907    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:00.920969 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.920909    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cdecaeea-ddbb-433e-bb45-773556e05088" (UID: "cdecaeea-ddbb-433e-bb45-773556e05088"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:00.920969 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.920939    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cdecaeea-ddbb-433e-bb45-773556e05088" (UID: "cdecaeea-ddbb-433e-bb45-773556e05088"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:00.921172 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.921149    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-console-config" (OuterVolumeSpecName: "console-config") pod "cdecaeea-ddbb-433e-bb45-773556e05088" (UID: "cdecaeea-ddbb-433e-bb45-773556e05088"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:00.922701 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.922675    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdecaeea-ddbb-433e-bb45-773556e05088-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cdecaeea-ddbb-433e-bb45-773556e05088" (UID: "cdecaeea-ddbb-433e-bb45-773556e05088"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:00.922798 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.922708    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdecaeea-ddbb-433e-bb45-773556e05088-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cdecaeea-ddbb-433e-bb45-773556e05088" (UID: "cdecaeea-ddbb-433e-bb45-773556e05088"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:00.922798 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:00.922776    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdecaeea-ddbb-433e-bb45-773556e05088-kube-api-access-r7dhz" (OuterVolumeSpecName: "kube-api-access-r7dhz") pod "cdecaeea-ddbb-433e-bb45-773556e05088" (UID: "cdecaeea-ddbb-433e-bb45-773556e05088"). InnerVolumeSpecName "kube-api-access-r7dhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:00:01.022173 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.022142    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdecaeea-ddbb-433e-bb45-773556e05088-console-oauth-config\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:01.022173 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.022169    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdecaeea-ddbb-433e-bb45-773556e05088-console-serving-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:01.022173 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.022178    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-console-config\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:01.022371 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.022187    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-oauth-serving-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:01.022371 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.022196    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdecaeea-ddbb-433e-bb45-773556e05088-trusted-ca-bundle\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:01.022371 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.022204    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7dhz\" (UniqueName: \"kubernetes.io/projected/cdecaeea-ddbb-433e-bb45-773556e05088-kube-api-access-r7dhz\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:01.629297 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.629264    2577 generic.go:356] "Generic (PLEG): container finished" podID="cdecaeea-ddbb-433e-bb45-773556e05088" containerID="69db3aaacd6c26f049a3a5f25d01fd5f5e583387bf01119ea0b28481882885c2" exitCode=0
Sep 10 21:00:01.629754 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.629312    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78cd8648b5-5q55g"
Sep 10 21:00:01.629754 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.629343    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78cd8648b5-5q55g" event={"ID":"cdecaeea-ddbb-433e-bb45-773556e05088","Type":"ContainerDied","Data":"69db3aaacd6c26f049a3a5f25d01fd5f5e583387bf01119ea0b28481882885c2"}
Sep 10 21:00:01.629754 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.629403    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78cd8648b5-5q55g" event={"ID":"cdecaeea-ddbb-433e-bb45-773556e05088","Type":"ContainerDied","Data":"9636e80e6e980642dfc754ee4288ccc123de47ba98a98905d76ed247b7132ccc"}
Sep 10 21:00:01.629754 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.629434    2577 scope.go:117] "RemoveContainer" containerID="69db3aaacd6c26f049a3a5f25d01fd5f5e583387bf01119ea0b28481882885c2"
Sep 10 21:00:01.631079 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.631054    2577 generic.go:356] "Generic (PLEG): container finished" podID="3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a" containerID="5c1571150355fd1a3dd9723949e1230944746d497611d4c4723b82cc2ac43bee" exitCode=0
Sep 10 21:00:01.631170 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.631129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll" event={"ID":"3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a","Type":"ContainerDied","Data":"5c1571150355fd1a3dd9723949e1230944746d497611d4c4723b82cc2ac43bee"}
Sep 10 21:00:01.631460 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.631441    2577 scope.go:117] "RemoveContainer" containerID="5c1571150355fd1a3dd9723949e1230944746d497611d4c4723b82cc2ac43bee"
Sep 10 21:00:01.637975 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.637957    2577 scope.go:117] "RemoveContainer" containerID="69db3aaacd6c26f049a3a5f25d01fd5f5e583387bf01119ea0b28481882885c2"
Sep 10 21:00:01.638291 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:00:01.638274    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69db3aaacd6c26f049a3a5f25d01fd5f5e583387bf01119ea0b28481882885c2\": container with ID starting with 69db3aaacd6c26f049a3a5f25d01fd5f5e583387bf01119ea0b28481882885c2 not found: ID does not exist" containerID="69db3aaacd6c26f049a3a5f25d01fd5f5e583387bf01119ea0b28481882885c2"
Sep 10 21:00:01.638384 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.638303    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69db3aaacd6c26f049a3a5f25d01fd5f5e583387bf01119ea0b28481882885c2"} err="failed to get container status \"69db3aaacd6c26f049a3a5f25d01fd5f5e583387bf01119ea0b28481882885c2\": rpc error: code = NotFound desc = could not find container \"69db3aaacd6c26f049a3a5f25d01fd5f5e583387bf01119ea0b28481882885c2\": container with ID starting with 69db3aaacd6c26f049a3a5f25d01fd5f5e583387bf01119ea0b28481882885c2 not found: ID does not exist"
Sep 10 21:00:01.666223 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.666199    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78cd8648b5-5q55g"]
Sep 10 21:00:01.670793 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:01.670771    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78cd8648b5-5q55g"]
Sep 10 21:00:02.637815 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:02.637780    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7r9ll" event={"ID":"3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a","Type":"ContainerStarted","Data":"e3e536972361b6a23578f0f7dc681d3e91fd240f2fa6344b0d053f95b6b83510"}
Sep 10 21:00:02.945182 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:02.945109    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdecaeea-ddbb-433e-bb45-773556e05088" path="/var/lib/kubelet/pods/cdecaeea-ddbb-433e-bb45-773556e05088/volumes"
Sep 10 21:00:11.265156 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.265098    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56d8bc9fcb-9m59s" podUID="87a5d215-6d22-48a9-9375-05fbeccadd4b" containerName="console" containerID="cri-o://f50dc7e1632abb3ad531a942e4b41f07a5296015072a638d4d51cbbc708b5991" gracePeriod=15
Sep 10 21:00:11.508687 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.508658    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 21:00:11.602506 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.602472    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-oauth-serving-cert\") pod \"87a5d215-6d22-48a9-9375-05fbeccadd4b\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") "
Sep 10 21:00:11.602703 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.602512    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-config\") pod \"87a5d215-6d22-48a9-9375-05fbeccadd4b\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") "
Sep 10 21:00:11.602703 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.602556    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-service-ca\") pod \"87a5d215-6d22-48a9-9375-05fbeccadd4b\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") "
Sep 10 21:00:11.602703 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.602581    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-oauth-config\") pod \"87a5d215-6d22-48a9-9375-05fbeccadd4b\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") "
Sep 10 21:00:11.602703 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.602606    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-serving-cert\") pod \"87a5d215-6d22-48a9-9375-05fbeccadd4b\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") "
Sep 10 21:00:11.602703 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.602648    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wrrk\" (UniqueName: \"kubernetes.io/projected/87a5d215-6d22-48a9-9375-05fbeccadd4b-kube-api-access-8wrrk\") pod \"87a5d215-6d22-48a9-9375-05fbeccadd4b\" (UID: \"87a5d215-6d22-48a9-9375-05fbeccadd4b\") "
Sep 10 21:00:11.603051 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.602988    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "87a5d215-6d22-48a9-9375-05fbeccadd4b" (UID: "87a5d215-6d22-48a9-9375-05fbeccadd4b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:11.603192 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.602996    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-service-ca" (OuterVolumeSpecName: "service-ca") pod "87a5d215-6d22-48a9-9375-05fbeccadd4b" (UID: "87a5d215-6d22-48a9-9375-05fbeccadd4b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:11.603192 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.603011    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-config" (OuterVolumeSpecName: "console-config") pod "87a5d215-6d22-48a9-9375-05fbeccadd4b" (UID: "87a5d215-6d22-48a9-9375-05fbeccadd4b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:11.604694 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.604670    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "87a5d215-6d22-48a9-9375-05fbeccadd4b" (UID: "87a5d215-6d22-48a9-9375-05fbeccadd4b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:11.604842 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.604818    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "87a5d215-6d22-48a9-9375-05fbeccadd4b" (UID: "87a5d215-6d22-48a9-9375-05fbeccadd4b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:11.604903 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.604820    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87a5d215-6d22-48a9-9375-05fbeccadd4b-kube-api-access-8wrrk" (OuterVolumeSpecName: "kube-api-access-8wrrk") pod "87a5d215-6d22-48a9-9375-05fbeccadd4b" (UID: "87a5d215-6d22-48a9-9375-05fbeccadd4b"). InnerVolumeSpecName "kube-api-access-8wrrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:00:11.674334 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.674305    2577 generic.go:356] "Generic (PLEG): container finished" podID="87a5d215-6d22-48a9-9375-05fbeccadd4b" containerID="f50dc7e1632abb3ad531a942e4b41f07a5296015072a638d4d51cbbc708b5991" exitCode=0
Sep 10 21:00:11.674458 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.674347    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d8bc9fcb-9m59s" event={"ID":"87a5d215-6d22-48a9-9375-05fbeccadd4b","Type":"ContainerDied","Data":"f50dc7e1632abb3ad531a942e4b41f07a5296015072a638d4d51cbbc708b5991"}
Sep 10 21:00:11.674458 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.674407    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d8bc9fcb-9m59s" event={"ID":"87a5d215-6d22-48a9-9375-05fbeccadd4b","Type":"ContainerDied","Data":"498537d6d408db8ad13f7fc065037d86092ff68b955005564b248c29b88393f1"}
Sep 10 21:00:11.674458 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.674425    2577 scope.go:117] "RemoveContainer" containerID="f50dc7e1632abb3ad531a942e4b41f07a5296015072a638d4d51cbbc708b5991"
Sep 10 21:00:11.674458 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.674349    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d8bc9fcb-9m59s"
Sep 10 21:00:11.683670 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.683246    2577 scope.go:117] "RemoveContainer" containerID="f50dc7e1632abb3ad531a942e4b41f07a5296015072a638d4d51cbbc708b5991"
Sep 10 21:00:11.684003 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:00:11.683939    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f50dc7e1632abb3ad531a942e4b41f07a5296015072a638d4d51cbbc708b5991\": container with ID starting with f50dc7e1632abb3ad531a942e4b41f07a5296015072a638d4d51cbbc708b5991 not found: ID does not exist" containerID="f50dc7e1632abb3ad531a942e4b41f07a5296015072a638d4d51cbbc708b5991"
Sep 10 21:00:11.684003 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.683972    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f50dc7e1632abb3ad531a942e4b41f07a5296015072a638d4d51cbbc708b5991"} err="failed to get container status \"f50dc7e1632abb3ad531a942e4b41f07a5296015072a638d4d51cbbc708b5991\": rpc error: code = NotFound desc = could not find container \"f50dc7e1632abb3ad531a942e4b41f07a5296015072a638d4d51cbbc708b5991\": container with ID starting with f50dc7e1632abb3ad531a942e4b41f07a5296015072a638d4d51cbbc708b5991 not found: ID does not exist"
Sep 10 21:00:11.695295 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.695244    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56d8bc9fcb-9m59s"]
Sep 10 21:00:11.696799 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.696781    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56d8bc9fcb-9m59s"]
Sep 10 21:00:11.703748 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.703729    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-oauth-config\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:11.703837 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.703752    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-serving-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:11.703837 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.703768    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wrrk\" (UniqueName: \"kubernetes.io/projected/87a5d215-6d22-48a9-9375-05fbeccadd4b-kube-api-access-8wrrk\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:11.703837 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.703781    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-oauth-serving-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:11.703837 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.703794    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-console-config\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:11.703837 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:11.703807    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87a5d215-6d22-48a9-9375-05fbeccadd4b-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:12.945952 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:12.945917    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87a5d215-6d22-48a9-9375-05fbeccadd4b" path="/var/lib/kubelet/pods/87a5d215-6d22-48a9-9375-05fbeccadd4b/volumes"
Sep 10 21:00:36.251302 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.251267    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:00:36.251765 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.251550    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="alertmanager" containerID="cri-o://ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03" gracePeriod=120
Sep 10 21:00:36.251765 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.251616    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="kube-rbac-proxy-metric" containerID="cri-o://a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a" gracePeriod=120
Sep 10 21:00:36.251765 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.251633    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="kube-rbac-proxy-web" containerID="cri-o://9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3" gracePeriod=120
Sep 10 21:00:36.251765 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.251680    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="kube-rbac-proxy" containerID="cri-o://701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9" gracePeriod=120
Sep 10 21:00:36.251765 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.251683    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="prom-label-proxy" containerID="cri-o://081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994" gracePeriod=120
Sep 10 21:00:36.251765 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.251721    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="config-reloader" containerID="cri-o://36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2" gracePeriod=120
Sep 10 21:00:36.775673 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.775641    2577 generic.go:356] "Generic (PLEG): container finished" podID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerID="081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994" exitCode=0
Sep 10 21:00:36.775673 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.775666    2577 generic.go:356] "Generic (PLEG): container finished" podID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerID="701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9" exitCode=0
Sep 10 21:00:36.775673 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.775673    2577 generic.go:356] "Generic (PLEG): container finished" podID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerID="36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2" exitCode=0
Sep 10 21:00:36.775673 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.775679    2577 generic.go:356] "Generic (PLEG): container finished" podID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerID="ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03" exitCode=0
Sep 10 21:00:36.775924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.775715    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerDied","Data":"081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994"}
Sep 10 21:00:36.775924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.775783    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerDied","Data":"701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9"}
Sep 10 21:00:36.775924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.775810    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerDied","Data":"36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2"}
Sep 10 21:00:36.775924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:36.775833    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerDied","Data":"ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03"}
Sep 10 21:00:37.497161 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.497131    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.601172 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601087    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-config-volume\") pod \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") "
Sep 10 21:00:37.601172 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601126    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8l9rk\" (UniqueName: \"kubernetes.io/projected/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-kube-api-access-8l9rk\") pod \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") "
Sep 10 21:00:37.601172 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601142    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-web-config\") pod \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") "
Sep 10 21:00:37.601172 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601171    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-main-db\") pod \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") "
Sep 10 21:00:37.601560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601200    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-main-tls\") pod \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") "
Sep 10 21:00:37.601560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601219    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy\") pod \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") "
Sep 10 21:00:37.601560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601263    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-metrics-client-ca\") pod \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") "
Sep 10 21:00:37.601560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601287    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-config-out\") pod \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") "
Sep 10 21:00:37.601560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601468    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "173d3257-9e76-4c6b-9a44-7c20fb5f00f0" (UID: "173d3257-9e76-4c6b-9a44-7c20fb5f00f0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:00:37.601808 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601647    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-tls-assets\") pod \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") "
Sep 10 21:00:37.601808 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601700    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-trusted-ca-bundle\") pod \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") "
Sep 10 21:00:37.601808 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601736    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") "
Sep 10 21:00:37.601808 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601764    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") "
Sep 10 21:00:37.601808 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601794    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-cluster-tls-config\") pod \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\" (UID: \"173d3257-9e76-4c6b-9a44-7c20fb5f00f0\") "
Sep 10 21:00:37.602337 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.602102    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-main-db\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:37.603127 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.601644    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "173d3257-9e76-4c6b-9a44-7c20fb5f00f0" (UID: "173d3257-9e76-4c6b-9a44-7c20fb5f00f0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:37.603491 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.603418    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "173d3257-9e76-4c6b-9a44-7c20fb5f00f0" (UID: "173d3257-9e76-4c6b-9a44-7c20fb5f00f0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:37.603927 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.603900    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "173d3257-9e76-4c6b-9a44-7c20fb5f00f0" (UID: "173d3257-9e76-4c6b-9a44-7c20fb5f00f0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:37.604380 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.604356    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-config-out" (OuterVolumeSpecName: "config-out") pod "173d3257-9e76-4c6b-9a44-7c20fb5f00f0" (UID: "173d3257-9e76-4c6b-9a44-7c20fb5f00f0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:00:37.604478 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.604398    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-kube-api-access-8l9rk" (OuterVolumeSpecName: "kube-api-access-8l9rk") pod "173d3257-9e76-4c6b-9a44-7c20fb5f00f0" (UID: "173d3257-9e76-4c6b-9a44-7c20fb5f00f0"). InnerVolumeSpecName "kube-api-access-8l9rk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:00:37.604478 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.604432    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-config-volume" (OuterVolumeSpecName: "config-volume") pod "173d3257-9e76-4c6b-9a44-7c20fb5f00f0" (UID: "173d3257-9e76-4c6b-9a44-7c20fb5f00f0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:37.604775 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.604749    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "173d3257-9e76-4c6b-9a44-7c20fb5f00f0" (UID: "173d3257-9e76-4c6b-9a44-7c20fb5f00f0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:37.605746 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.605710    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "173d3257-9e76-4c6b-9a44-7c20fb5f00f0" (UID: "173d3257-9e76-4c6b-9a44-7c20fb5f00f0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:37.605822 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.605786    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "173d3257-9e76-4c6b-9a44-7c20fb5f00f0" (UID: "173d3257-9e76-4c6b-9a44-7c20fb5f00f0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:00:37.605822 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.605787    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "173d3257-9e76-4c6b-9a44-7c20fb5f00f0" (UID: "173d3257-9e76-4c6b-9a44-7c20fb5f00f0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:37.609518 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.609493    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "173d3257-9e76-4c6b-9a44-7c20fb5f00f0" (UID: "173d3257-9e76-4c6b-9a44-7c20fb5f00f0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:37.615009 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.614985    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-web-config" (OuterVolumeSpecName: "web-config") pod "173d3257-9e76-4c6b-9a44-7c20fb5f00f0" (UID: "173d3257-9e76-4c6b-9a44-7c20fb5f00f0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:37.702590 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.702551    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-metrics-client-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:37.702590 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.702584    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-config-out\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:37.702590 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.702595    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-tls-assets\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:37.702826 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.702605    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:37.702826 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.702616    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:37.702826 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.702627    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:37.702826 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.702636    2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-cluster-tls-config\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:37.702826 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.702651    2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:37.702826 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.702661    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l9rk\" (UniqueName: \"kubernetes.io/projected/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-kube-api-access-8l9rk\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:37.702826 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.702669    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-web-config\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:37.702826 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.702679    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-main-tls\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:37.702826 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.702687    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/173d3257-9e76-4c6b-9a44-7c20fb5f00f0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:00:37.783930 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.783892    2577 generic.go:356] "Generic (PLEG): container finished" podID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerID="a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a" exitCode=0
Sep 10 21:00:37.783930 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.783927    2577 generic.go:356] "Generic (PLEG): container finished" podID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerID="9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3" exitCode=0
Sep 10 21:00:37.784187 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.783984    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.784187 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.783979    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerDied","Data":"a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a"}
Sep 10 21:00:37.784187 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.784087    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerDied","Data":"9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3"}
Sep 10 21:00:37.784187 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.784130    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"173d3257-9e76-4c6b-9a44-7c20fb5f00f0","Type":"ContainerDied","Data":"9f5366844e21720f87f2651c42ccec4174400418f9d45324c8b7bc8731f56d36"}
Sep 10 21:00:37.784187 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.784155    2577 scope.go:117] "RemoveContainer" containerID="081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994"
Sep 10 21:00:37.792350 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.792330    2577 scope.go:117] "RemoveContainer" containerID="a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a"
Sep 10 21:00:37.801577 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.801558    2577 scope.go:117] "RemoveContainer" containerID="701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9"
Sep 10 21:00:37.808829 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.808803    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:00:37.809413 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.809401    2577 scope.go:117] "RemoveContainer" containerID="9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3"
Sep 10 21:00:37.816041 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.816006    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:00:37.820802 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.820777    2577 scope.go:117] "RemoveContainer" containerID="36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2"
Sep 10 21:00:37.827809 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.827786    2577 scope.go:117] "RemoveContainer" containerID="ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03"
Sep 10 21:00:37.834804 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.834786    2577 scope.go:117] "RemoveContainer" containerID="c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f"
Sep 10 21:00:37.836999 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.836981    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:00:37.837388 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837372    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="prom-label-proxy"
Sep 10 21:00:37.837436 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837390    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="prom-label-proxy"
Sep 10 21:00:37.837436 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837402    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="init-config-reloader"
Sep 10 21:00:37.837436 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837408    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="init-config-reloader"
Sep 10 21:00:37.837436 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837416    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="kube-rbac-proxy"
Sep 10 21:00:37.837436 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837421    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="kube-rbac-proxy"
Sep 10 21:00:37.837436 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837427    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="kube-rbac-proxy-metric"
Sep 10 21:00:37.837436 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837432    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="kube-rbac-proxy-metric"
Sep 10 21:00:37.837436 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837438    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdecaeea-ddbb-433e-bb45-773556e05088" containerName="console"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837443    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdecaeea-ddbb-433e-bb45-773556e05088" containerName="console"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837450    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="559d2df7-ee5d-48b6-98ad-22faaf8d2a23" containerName="registry"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837456    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="559d2df7-ee5d-48b6-98ad-22faaf8d2a23" containerName="registry"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837464    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="kube-rbac-proxy-web"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837469    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="kube-rbac-proxy-web"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837475    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="alertmanager"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837480    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="alertmanager"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837489    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="config-reloader"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837495    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="config-reloader"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837506    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a5d215-6d22-48a9-9375-05fbeccadd4b" containerName="console"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837511    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a5d215-6d22-48a9-9375-05fbeccadd4b" containerName="console"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837558    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="alertmanager"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837565    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="config-reloader"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837571    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="kube-rbac-proxy-web"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837576    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="kube-rbac-proxy"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837581    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="87a5d215-6d22-48a9-9375-05fbeccadd4b" containerName="console"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837586    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="559d2df7-ee5d-48b6-98ad-22faaf8d2a23" containerName="registry"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837592    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="kube-rbac-proxy-metric"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837599    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdecaeea-ddbb-433e-bb45-773556e05088" containerName="console"
Sep 10 21:00:37.837658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.837604    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" containerName="prom-label-proxy"
Sep 10 21:00:37.842260 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.842241    2577 scope.go:117] "RemoveContainer" containerID="081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994"
Sep 10 21:00:37.842538 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:00:37.842520    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994\": container with ID starting with 081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994 not found: ID does not exist" containerID="081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994"
Sep 10 21:00:37.842581 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.842548    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994"} err="failed to get container status \"081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994\": rpc error: code = NotFound desc = could not find container \"081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994\": container with ID starting with 081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994 not found: ID does not exist"
Sep 10 21:00:37.842581 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.842566    2577 scope.go:117] "RemoveContainer" containerID="a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a"
Sep 10 21:00:37.842865 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:00:37.842842    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a\": container with ID starting with a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a not found: ID does not exist" containerID="a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a"
Sep 10 21:00:37.842919 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.842864    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.842919 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.842874    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a"} err="failed to get container status \"a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a\": rpc error: code = NotFound desc = could not find container \"a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a\": container with ID starting with a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a not found: ID does not exist"
Sep 10 21:00:37.842919 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.842895    2577 scope.go:117] "RemoveContainer" containerID="701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9"
Sep 10 21:00:37.843238 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:00:37.843215    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9\": container with ID starting with 701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9 not found: ID does not exist" containerID="701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9"
Sep 10 21:00:37.843319 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.843247    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9"} err="failed to get container status \"701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9\": rpc error: code = NotFound desc = could not find container \"701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9\": container with ID starting with 701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9 not found: ID does not exist"
Sep 10 21:00:37.843319 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.843267    2577 scope.go:117] "RemoveContainer" containerID="9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3"
Sep 10 21:00:37.843565 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:00:37.843543    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3\": container with ID starting with 9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3 not found: ID does not exist" containerID="9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3"
Sep 10 21:00:37.843629 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.843570    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3"} err="failed to get container status \"9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3\": rpc error: code = NotFound desc = could not find container \"9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3\": container with ID starting with 9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3 not found: ID does not exist"
Sep 10 21:00:37.843629 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.843589    2577 scope.go:117] "RemoveContainer" containerID="36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2"
Sep 10 21:00:37.843878 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:00:37.843850    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2\": container with ID starting with 36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2 not found: ID does not exist" containerID="36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2"
Sep 10 21:00:37.843990 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.843883    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2"} err="failed to get container status \"36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2\": rpc error: code = NotFound desc = could not find container \"36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2\": container with ID starting with 36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2 not found: ID does not exist"
Sep 10 21:00:37.843990 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.843899    2577 scope.go:117] "RemoveContainer" containerID="ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03"
Sep 10 21:00:37.844208 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:00:37.844191    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03\": container with ID starting with ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03 not found: ID does not exist" containerID="ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03"
Sep 10 21:00:37.844256 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.844211    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03"} err="failed to get container status \"ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03\": rpc error: code = NotFound desc = could not find container \"ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03\": container with ID starting with ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03 not found: ID does not exist"
Sep 10 21:00:37.844256 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.844224    2577 scope.go:117] "RemoveContainer" containerID="c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f"
Sep 10 21:00:37.844470 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:00:37.844455    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f\": container with ID starting with c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f not found: ID does not exist" containerID="c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f"
Sep 10 21:00:37.844515 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.844474    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f"} err="failed to get container status \"c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f\": rpc error: code = NotFound desc = could not find container \"c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f\": container with ID starting with c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f not found: ID does not exist"
Sep 10 21:00:37.844515 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.844487    2577 scope.go:117] "RemoveContainer" containerID="081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994"
Sep 10 21:00:37.844779 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.844759    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994"} err="failed to get container status \"081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994\": rpc error: code = NotFound desc = could not find container \"081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994\": container with ID starting with 081028ce16d9ba352fad2f744d2eb9eff61cea4b2b33ad44850b907069cfb994 not found: ID does not exist"
Sep 10 21:00:37.844851 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.844782    2577 scope.go:117] "RemoveContainer" containerID="a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a"
Sep 10 21:00:37.845075 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.845048    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a"} err="failed to get container status \"a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a\": rpc error: code = NotFound desc = could not find container \"a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a\": container with ID starting with a5a836983c4aeed45289da8daf7b449423acc26b8f710941aaa0a75f8459f67a not found: ID does not exist"
Sep 10 21:00:37.845144 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.845077    2577 scope.go:117] "RemoveContainer" containerID="701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9"
Sep 10 21:00:37.845192 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.845176    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 21:00:37.845267 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.845234    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 21:00:37.845425 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.845405    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 21:00:37.845425 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.845408    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9"} err="failed to get container status \"701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9\": rpc error: code = NotFound desc = could not find container \"701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9\": container with ID starting with 701b76ad513d18e76d79bf1af5fb2d9ce80337d3bf922d9b90bbee93e9bd63a9 not found: ID does not exist"
Sep 10 21:00:37.845534 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.845434    2577 scope.go:117] "RemoveContainer" containerID="9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3"
Sep 10 21:00:37.845534 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.845442    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 21:00:37.845534 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.845491    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 21:00:37.845534 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.845521    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 21:00:37.845766 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.845744    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3"} err="failed to get container status \"9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3\": rpc error: code = NotFound desc = could not find container \"9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3\": container with ID starting with 9795f9b7e6f5cc2036a056084a8307d0ba82e7f71dfa774d8e8bde328be2cdb3 not found: ID does not exist"
Sep 10 21:00:37.845828 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.845768    2577 scope.go:117] "RemoveContainer" containerID="36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2"
Sep 10 21:00:37.845900 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.845883    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 21:00:37.846001 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.845916    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 21:00:37.846129 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.846105    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2"} err="failed to get container status \"36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2\": rpc error: code = NotFound desc = could not find container \"36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2\": container with ID starting with 36c9e0c6561ce0837f5cfe8842a2b5cad6ac99800f8b8df2de0a4e7ae2efe1b2 not found: ID does not exist"
Sep 10 21:00:37.846198 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.846130    2577 scope.go:117] "RemoveContainer" containerID="ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03"
Sep 10 21:00:37.846254 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.846231    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sstsj\""
Sep 10 21:00:37.846437 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.846416    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03"} err="failed to get container status \"ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03\": rpc error: code = NotFound desc = could not find container \"ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03\": container with ID starting with ad277620667545e572adab3611b115518c9d716d86a60555ed5da4d397aa8a03 not found: ID does not exist"
Sep 10 21:00:37.846518 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.846440    2577 scope.go:117] "RemoveContainer" containerID="c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f"
Sep 10 21:00:37.846732 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.846714    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f"} err="failed to get container status \"c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f\": rpc error: code = NotFound desc = could not find container \"c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f\": container with ID starting with c88e91009c395e9e8a52b8e919748a224280226bfca7adfcaf9aea679d993d0f not found: ID does not exist"
Sep 10 21:00:37.850687 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.850668    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 21:00:37.860203 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.860156    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:00:37.904847 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.904821    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/003afeb0-2bc2-4e10-808e-418ad2408eae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.904953 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.904856    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-web-config\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.904953 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.904889    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.905022 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.904954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.905022 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.904995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.905022 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.905020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.905141 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.905062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/003afeb0-2bc2-4e10-808e-418ad2408eae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.905141 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.905082    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcs28\" (UniqueName: \"kubernetes.io/projected/003afeb0-2bc2-4e10-808e-418ad2408eae-kube-api-access-qcs28\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.905141 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.905109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.905141 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.905129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/003afeb0-2bc2-4e10-808e-418ad2408eae-config-out\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.905260 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.905193    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-config-volume\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.905260 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.905207    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/003afeb0-2bc2-4e10-808e-418ad2408eae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:37.905260 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:37.905224    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/003afeb0-2bc2-4e10-808e-418ad2408eae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.005822 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.005800    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-config-volume\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.005989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.005826    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/003afeb0-2bc2-4e10-808e-418ad2408eae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.005989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.005843    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/003afeb0-2bc2-4e10-808e-418ad2408eae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.005989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.005860    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/003afeb0-2bc2-4e10-808e-418ad2408eae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.005989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.005883    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-web-config\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.005989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.005907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.006266 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.006113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.006266 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.006167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.006266 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.006205    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.006266 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.006236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/003afeb0-2bc2-4e10-808e-418ad2408eae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.006266 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.006240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/003afeb0-2bc2-4e10-808e-418ad2408eae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.006647 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.006614    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/003afeb0-2bc2-4e10-808e-418ad2408eae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.007450 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.007422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/003afeb0-2bc2-4e10-808e-418ad2408eae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.007536 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.007479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcs28\" (UniqueName: \"kubernetes.io/projected/003afeb0-2bc2-4e10-808e-418ad2408eae-kube-api-access-qcs28\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.007536 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.007528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.007650 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.007556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/003afeb0-2bc2-4e10-808e-418ad2408eae-config-out\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.009049 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.008993    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-config-volume\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.009158 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.009134    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.009158 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.009145    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-web-config\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.009158 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.009153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/003afeb0-2bc2-4e10-808e-418ad2408eae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.009319 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.009164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.009319 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.009216    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.009646 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.009626    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.009713 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.009697    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/003afeb0-2bc2-4e10-808e-418ad2408eae-config-out\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.010963 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.010947    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/003afeb0-2bc2-4e10-808e-418ad2408eae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.016465 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.016447    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcs28\" (UniqueName: \"kubernetes.io/projected/003afeb0-2bc2-4e10-808e-418ad2408eae-kube-api-access-qcs28\") pod \"alertmanager-main-0\" (UID: \"003afeb0-2bc2-4e10-808e-418ad2408eae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.152749 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.152674    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:00:38.427984 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.427956    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:00:38.430435 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:00:38.430407    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod003afeb0_2bc2_4e10_808e_418ad2408eae.slice/crio-517a770d395d45ea1a77065d0f82d35b6b95d4bcaea95ab6f52dd71e355be3b6 WatchSource:0}: Error finding container 517a770d395d45ea1a77065d0f82d35b6b95d4bcaea95ab6f52dd71e355be3b6: Status 404 returned error can't find the container with id 517a770d395d45ea1a77065d0f82d35b6b95d4bcaea95ab6f52dd71e355be3b6
Sep 10 21:00:38.790045 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.789942    2577 generic.go:356] "Generic (PLEG): container finished" podID="003afeb0-2bc2-4e10-808e-418ad2408eae" containerID="f4c5e7bd7433f9fa1004508c65551c424a1d3b44d79e54d57ffbf897313abedd" exitCode=0
Sep 10 21:00:38.790441 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.790024    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"003afeb0-2bc2-4e10-808e-418ad2408eae","Type":"ContainerDied","Data":"f4c5e7bd7433f9fa1004508c65551c424a1d3b44d79e54d57ffbf897313abedd"}
Sep 10 21:00:38.790441 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.790116    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"003afeb0-2bc2-4e10-808e-418ad2408eae","Type":"ContainerStarted","Data":"517a770d395d45ea1a77065d0f82d35b6b95d4bcaea95ab6f52dd71e355be3b6"}
Sep 10 21:00:38.946458 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:38.946403    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="173d3257-9e76-4c6b-9a44-7c20fb5f00f0" path="/var/lib/kubelet/pods/173d3257-9e76-4c6b-9a44-7c20fb5f00f0/volumes"
Sep 10 21:00:39.797887 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:39.797799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"003afeb0-2bc2-4e10-808e-418ad2408eae","Type":"ContainerStarted","Data":"2faaea5bdc8696582e846542ce6a8965e9f58fe9135ac070e3521f9494723178"}
Sep 10 21:00:39.797887 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:39.797859    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"003afeb0-2bc2-4e10-808e-418ad2408eae","Type":"ContainerStarted","Data":"e0998df4778f4f1dca780cbd7a8bbd490b050357044410ea7dae9d702b0fed76"}
Sep 10 21:00:39.797887 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:39.797885    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"003afeb0-2bc2-4e10-808e-418ad2408eae","Type":"ContainerStarted","Data":"cecf9f24f6b25a80237095cffafc0737dd3ea2bd5427195e67b123f2e94508c6"}
Sep 10 21:00:39.798346 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:39.797910    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"003afeb0-2bc2-4e10-808e-418ad2408eae","Type":"ContainerStarted","Data":"b18a2cf32fcebf9710f4131e6614ab64f46d1857f69c45afdde079f226936e22"}
Sep 10 21:00:39.798346 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:39.797932    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"003afeb0-2bc2-4e10-808e-418ad2408eae","Type":"ContainerStarted","Data":"a57581f46482cfb947b78e304268f030164b13e96a7bd432155d50410a4fd23a"}
Sep 10 21:00:39.798346 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:39.797952    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"003afeb0-2bc2-4e10-808e-418ad2408eae","Type":"ContainerStarted","Data":"c54936d018d11cd75c5a3cf3e318384c3321a044c8591ca4e02424ec0be6a8e2"}
Sep 10 21:00:39.851715 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:39.848636    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.833258088 podStartE2EDuration="2.84861522s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.357132ms" isStatefulPod=false podCreationTimestamp="2026-09-10 21:00:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:00:39.845547219 +0000 UTC m=+167.419253591" watchObservedRunningTime="2026-09-10 21:00:39.84861522 +0000 UTC m=+167.422321596"
Sep 10 21:00:40.770513 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.770475    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bd674fd88-8284t"]
Sep 10 21:00:40.773991 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.773953    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.778533 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.778511    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 21:00:40.778771 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.778752    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 21:00:40.779595 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.779572    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 21:00:40.779742 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.779576    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 21:00:40.779947 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.779908    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 21:00:40.780072 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.780001    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9msmf\""
Sep 10 21:00:40.780345 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.780321    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 21:00:40.780550 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.780321    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 21:00:40.784773 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.784755    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 21:00:40.789864 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.789840    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd674fd88-8284t"]
Sep 10 21:00:40.829802 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.829773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-oauth-config\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.829802 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.829800    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-config\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.830297 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.829819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-trusted-ca-bundle\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.830297 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.829961    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-service-ca\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.830297 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.829999    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-serving-cert\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.830297 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.830131    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-oauth-serving-cert\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.830297 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.830193    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmhdq\" (UniqueName: \"kubernetes.io/projected/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-kube-api-access-pmhdq\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.930812 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.930772    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-oauth-config\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.930812 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.930814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-config\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.931015 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.930836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-trusted-ca-bundle\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.931015 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.930864    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-service-ca\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.931015 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.930880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-serving-cert\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.931015 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.930906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-oauth-serving-cert\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.931015 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.930926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmhdq\" (UniqueName: \"kubernetes.io/projected/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-kube-api-access-pmhdq\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.931595 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.931570    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-config\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.931691 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.931671    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-oauth-serving-cert\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.931779 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.931706    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-service-ca\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.931815 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.931781    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-trusted-ca-bundle\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.933386 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.933369    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-oauth-config\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.933445 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.933424    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-serving-cert\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:40.938362 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:40.938341    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmhdq\" (UniqueName: \"kubernetes.io/projected/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-kube-api-access-pmhdq\") pod \"console-5bd674fd88-8284t\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") " pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:41.084629 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:41.084604    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:41.356456 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:41.356295    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd674fd88-8284t"]
Sep 10 21:00:41.358817 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:00:41.358790    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c93f2a3_8042_4ad4_92c6_c37331c4de0f.slice/crio-03401c980dcb8e97b8e97666955cc0d8b8711c1be8ee24ff15566070beb59b1a WatchSource:0}: Error finding container 03401c980dcb8e97b8e97666955cc0d8b8711c1be8ee24ff15566070beb59b1a: Status 404 returned error can't find the container with id 03401c980dcb8e97b8e97666955cc0d8b8711c1be8ee24ff15566070beb59b1a
Sep 10 21:00:41.809335 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:41.809242    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd674fd88-8284t" event={"ID":"7c93f2a3-8042-4ad4-92c6-c37331c4de0f","Type":"ContainerStarted","Data":"529e69b9e890d42c8e32718d4c2d341f4152e4717c07f937b183c754a22c136c"}
Sep 10 21:00:41.809335 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:41.809292    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd674fd88-8284t" event={"ID":"7c93f2a3-8042-4ad4-92c6-c37331c4de0f","Type":"ContainerStarted","Data":"03401c980dcb8e97b8e97666955cc0d8b8711c1be8ee24ff15566070beb59b1a"}
Sep 10 21:00:41.830957 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:41.830908    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bd674fd88-8284t" podStartSLOduration=1.830892529 podStartE2EDuration="1.830892529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:00:41.829240273 +0000 UTC m=+169.402946650" watchObservedRunningTime="2026-09-10 21:00:41.830892529 +0000 UTC m=+169.404598903"
Sep 10 21:00:51.085007 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:51.084920    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:51.085007 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:51.084986    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:51.089699 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:51.089676    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:00:51.856547 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:00:51.856514    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:01:18.477071 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.477017    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"]
Sep 10 21:01:18.479613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.479595    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"
Sep 10 21:01:18.482136 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.482111    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:01:18.482265 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.482119    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:01:18.483015 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.482994    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w64cv\""
Sep 10 21:01:18.486446 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.486417    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"]
Sep 10 21:01:18.655972 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.655934    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa2a7985-b4e4-4819-8d72-1f594baa25cb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb\" (UID: \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"
Sep 10 21:01:18.655972 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.655983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47pcv\" (UniqueName: \"kubernetes.io/projected/aa2a7985-b4e4-4819-8d72-1f594baa25cb-kube-api-access-47pcv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb\" (UID: \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"
Sep 10 21:01:18.656214 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.656111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa2a7985-b4e4-4819-8d72-1f594baa25cb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb\" (UID: \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"
Sep 10 21:01:18.757368 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.757288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa2a7985-b4e4-4819-8d72-1f594baa25cb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb\" (UID: \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"
Sep 10 21:01:18.757494 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.757358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa2a7985-b4e4-4819-8d72-1f594baa25cb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb\" (UID: \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"
Sep 10 21:01:18.757494 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.757396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47pcv\" (UniqueName: \"kubernetes.io/projected/aa2a7985-b4e4-4819-8d72-1f594baa25cb-kube-api-access-47pcv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb\" (UID: \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"
Sep 10 21:01:18.757701 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.757680    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa2a7985-b4e4-4819-8d72-1f594baa25cb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb\" (UID: \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"
Sep 10 21:01:18.757753 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.757705    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa2a7985-b4e4-4819-8d72-1f594baa25cb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb\" (UID: \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"
Sep 10 21:01:18.766938 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.766906    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47pcv\" (UniqueName: \"kubernetes.io/projected/aa2a7985-b4e4-4819-8d72-1f594baa25cb-kube-api-access-47pcv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb\" (UID: \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"
Sep 10 21:01:18.789867 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:18.789831    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"
Sep 10 21:01:19.056495 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:19.056455    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"]
Sep 10 21:01:19.058753 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:01:19.058721    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa2a7985_b4e4_4819_8d72_1f594baa25cb.slice/crio-02f68768988ed179c266bad06d5aae32342a8b5172529c7dd1f4a56d085c968d WatchSource:0}: Error finding container 02f68768988ed179c266bad06d5aae32342a8b5172529c7dd1f4a56d085c968d: Status 404 returned error can't find the container with id 02f68768988ed179c266bad06d5aae32342a8b5172529c7dd1f4a56d085c968d
Sep 10 21:01:19.971293 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:19.971254    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb" event={"ID":"aa2a7985-b4e4-4819-8d72-1f594baa25cb","Type":"ContainerStarted","Data":"02f68768988ed179c266bad06d5aae32342a8b5172529c7dd1f4a56d085c968d"}
Sep 10 21:01:24.999296 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:24.999257    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa2a7985-b4e4-4819-8d72-1f594baa25cb" containerID="526dadc1a71795fb0436673f8ce343ef516fb15ab0117ea40532c7e73d9ad94f" exitCode=0
Sep 10 21:01:24.999702 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:24.999332    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb" event={"ID":"aa2a7985-b4e4-4819-8d72-1f594baa25cb","Type":"ContainerDied","Data":"526dadc1a71795fb0436673f8ce343ef516fb15ab0117ea40532c7e73d9ad94f"}
Sep 10 21:01:28.015451 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:28.015416    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa2a7985-b4e4-4819-8d72-1f594baa25cb" containerID="fb880629ea7c972f5f528900b75386c0eb3357e59de2061651ff0a4d63f214cf" exitCode=0
Sep 10 21:01:28.015831 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:28.015466    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb" event={"ID":"aa2a7985-b4e4-4819-8d72-1f594baa25cb","Type":"ContainerDied","Data":"fb880629ea7c972f5f528900b75386c0eb3357e59de2061651ff0a4d63f214cf"}
Sep 10 21:01:36.053870 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:36.053834    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa2a7985-b4e4-4819-8d72-1f594baa25cb" containerID="a8e0470ab7dae0d96113e60e2ca3dd1ecaa7fba124e8df9d3e804552c6d004a7" exitCode=0
Sep 10 21:01:36.054274 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:36.053920    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb" event={"ID":"aa2a7985-b4e4-4819-8d72-1f594baa25cb","Type":"ContainerDied","Data":"a8e0470ab7dae0d96113e60e2ca3dd1ecaa7fba124e8df9d3e804552c6d004a7"}
Sep 10 21:01:37.192764 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:37.192733    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"
Sep 10 21:01:37.327234 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:37.327203    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47pcv\" (UniqueName: \"kubernetes.io/projected/aa2a7985-b4e4-4819-8d72-1f594baa25cb-kube-api-access-47pcv\") pod \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\" (UID: \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\") "
Sep 10 21:01:37.327401 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:37.327279    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa2a7985-b4e4-4819-8d72-1f594baa25cb-util\") pod \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\" (UID: \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\") "
Sep 10 21:01:37.327401 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:37.327339    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa2a7985-b4e4-4819-8d72-1f594baa25cb-bundle\") pod \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\" (UID: \"aa2a7985-b4e4-4819-8d72-1f594baa25cb\") "
Sep 10 21:01:37.327980 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:37.327951    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa2a7985-b4e4-4819-8d72-1f594baa25cb-bundle" (OuterVolumeSpecName: "bundle") pod "aa2a7985-b4e4-4819-8d72-1f594baa25cb" (UID: "aa2a7985-b4e4-4819-8d72-1f594baa25cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:01:37.329488 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:37.329465    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa2a7985-b4e4-4819-8d72-1f594baa25cb-kube-api-access-47pcv" (OuterVolumeSpecName: "kube-api-access-47pcv") pod "aa2a7985-b4e4-4819-8d72-1f594baa25cb" (UID: "aa2a7985-b4e4-4819-8d72-1f594baa25cb"). InnerVolumeSpecName "kube-api-access-47pcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:01:37.333201 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:37.333172    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa2a7985-b4e4-4819-8d72-1f594baa25cb-util" (OuterVolumeSpecName: "util") pod "aa2a7985-b4e4-4819-8d72-1f594baa25cb" (UID: "aa2a7985-b4e4-4819-8d72-1f594baa25cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:01:37.428105 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:37.428059    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47pcv\" (UniqueName: \"kubernetes.io/projected/aa2a7985-b4e4-4819-8d72-1f594baa25cb-kube-api-access-47pcv\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:01:37.428105 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:37.428095    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa2a7985-b4e4-4819-8d72-1f594baa25cb-util\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:01:37.428105 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:37.428106    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa2a7985-b4e4-4819-8d72-1f594baa25cb-bundle\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:01:38.063946 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:38.063906    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb" event={"ID":"aa2a7985-b4e4-4819-8d72-1f594baa25cb","Type":"ContainerDied","Data":"02f68768988ed179c266bad06d5aae32342a8b5172529c7dd1f4a56d085c968d"}
Sep 10 21:01:38.064112 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:38.063964    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02f68768988ed179c266bad06d5aae32342a8b5172529c7dd1f4a56d085c968d"
Sep 10 21:01:38.064112 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:38.063920    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhtwb"
Sep 10 21:01:46.035729 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.035691    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"]
Sep 10 21:01:46.036212 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.036012    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa2a7985-b4e4-4819-8d72-1f594baa25cb" containerName="pull"
Sep 10 21:01:46.036212 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.036024    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa2a7985-b4e4-4819-8d72-1f594baa25cb" containerName="pull"
Sep 10 21:01:46.036212 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.036066    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa2a7985-b4e4-4819-8d72-1f594baa25cb" containerName="util"
Sep 10 21:01:46.036212 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.036071    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa2a7985-b4e4-4819-8d72-1f594baa25cb" containerName="util"
Sep 10 21:01:46.036212 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.036077    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa2a7985-b4e4-4819-8d72-1f594baa25cb" containerName="extract"
Sep 10 21:01:46.036212 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.036082    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa2a7985-b4e4-4819-8d72-1f594baa25cb" containerName="extract"
Sep 10 21:01:46.036212 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.036134    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa2a7985-b4e4-4819-8d72-1f594baa25cb" containerName="extract"
Sep 10 21:01:46.038368 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.038345    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"
Sep 10 21:01:46.040868 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.040846    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w64cv\""
Sep 10 21:01:46.040995 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.040847    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:01:46.041561 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.041542    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:01:46.051890 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.051859    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"]
Sep 10 21:01:46.102403 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.102362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f17e364f-6704-40ae-a4f4-d99050774243-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv\" (UID: \"f17e364f-6704-40ae-a4f4-d99050774243\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"
Sep 10 21:01:46.102605 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.102449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f17e364f-6704-40ae-a4f4-d99050774243-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv\" (UID: \"f17e364f-6704-40ae-a4f4-d99050774243\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"
Sep 10 21:01:46.102605 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.102477    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6dfp\" (UniqueName: \"kubernetes.io/projected/f17e364f-6704-40ae-a4f4-d99050774243-kube-api-access-d6dfp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv\" (UID: \"f17e364f-6704-40ae-a4f4-d99050774243\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"
Sep 10 21:01:46.203725 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.203688    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f17e364f-6704-40ae-a4f4-d99050774243-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv\" (UID: \"f17e364f-6704-40ae-a4f4-d99050774243\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"
Sep 10 21:01:46.203865 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.203762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f17e364f-6704-40ae-a4f4-d99050774243-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv\" (UID: \"f17e364f-6704-40ae-a4f4-d99050774243\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"
Sep 10 21:01:46.203865 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.203786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6dfp\" (UniqueName: \"kubernetes.io/projected/f17e364f-6704-40ae-a4f4-d99050774243-kube-api-access-d6dfp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv\" (UID: \"f17e364f-6704-40ae-a4f4-d99050774243\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"
Sep 10 21:01:46.204217 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.204195    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f17e364f-6704-40ae-a4f4-d99050774243-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv\" (UID: \"f17e364f-6704-40ae-a4f4-d99050774243\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"
Sep 10 21:01:46.204217 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.204210    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f17e364f-6704-40ae-a4f4-d99050774243-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv\" (UID: \"f17e364f-6704-40ae-a4f4-d99050774243\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"
Sep 10 21:01:46.212636 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.212603    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6dfp\" (UniqueName: \"kubernetes.io/projected/f17e364f-6704-40ae-a4f4-d99050774243-kube-api-access-d6dfp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv\" (UID: \"f17e364f-6704-40ae-a4f4-d99050774243\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"
Sep 10 21:01:46.348320 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.348285    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"
Sep 10 21:01:46.619527 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:46.619452    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"]
Sep 10 21:01:46.621802 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:01:46.621775    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf17e364f_6704_40ae_a4f4_d99050774243.slice/crio-eef32d644c865aac25cd6b379bb4b78c84eb2e848122dccf57607cab25f964ef WatchSource:0}: Error finding container eef32d644c865aac25cd6b379bb4b78c84eb2e848122dccf57607cab25f964ef: Status 404 returned error can't find the container with id eef32d644c865aac25cd6b379bb4b78c84eb2e848122dccf57607cab25f964ef
Sep 10 21:01:47.104489 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.104451    2577 generic.go:356] "Generic (PLEG): container finished" podID="f17e364f-6704-40ae-a4f4-d99050774243" containerID="7eceedff1ebc1c3e52ad446f8aa8f62c7d5979fd5e290ffb6766d07a89c512c0" exitCode=0
Sep 10 21:01:47.104973 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.104504    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv" event={"ID":"f17e364f-6704-40ae-a4f4-d99050774243","Type":"ContainerDied","Data":"7eceedff1ebc1c3e52ad446f8aa8f62c7d5979fd5e290ffb6766d07a89c512c0"}
Sep 10 21:01:47.104973 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.104558    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv" event={"ID":"f17e364f-6704-40ae-a4f4-d99050774243","Type":"ContainerStarted","Data":"eef32d644c865aac25cd6b379bb4b78c84eb2e848122dccf57607cab25f964ef"}
Sep 10 21:01:47.405757 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.405668    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wjvkz"]
Sep 10 21:01:47.408072 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.408054    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wjvkz"
Sep 10 21:01:47.410548 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.410525    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 21:01:47.410821 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.410804    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 21:01:47.411059 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.411044    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-f58wt\""
Sep 10 21:01:47.418924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.418898    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wjvkz"]
Sep 10 21:01:47.513137 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.513098    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd2c8\" (UniqueName: \"kubernetes.io/projected/deb7b789-f22d-494f-bd0a-42d3b49b9252-kube-api-access-zd2c8\") pod \"cert-manager-cainjector-559cdd8c87-wjvkz\" (UID: \"deb7b789-f22d-494f-bd0a-42d3b49b9252\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wjvkz"
Sep 10 21:01:47.513314 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.513195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deb7b789-f22d-494f-bd0a-42d3b49b9252-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wjvkz\" (UID: \"deb7b789-f22d-494f-bd0a-42d3b49b9252\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wjvkz"
Sep 10 21:01:47.614662 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.614620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deb7b789-f22d-494f-bd0a-42d3b49b9252-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wjvkz\" (UID: \"deb7b789-f22d-494f-bd0a-42d3b49b9252\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wjvkz"
Sep 10 21:01:47.614844 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.614676    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd2c8\" (UniqueName: \"kubernetes.io/projected/deb7b789-f22d-494f-bd0a-42d3b49b9252-kube-api-access-zd2c8\") pod \"cert-manager-cainjector-559cdd8c87-wjvkz\" (UID: \"deb7b789-f22d-494f-bd0a-42d3b49b9252\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wjvkz"
Sep 10 21:01:47.623614 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.623580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd2c8\" (UniqueName: \"kubernetes.io/projected/deb7b789-f22d-494f-bd0a-42d3b49b9252-kube-api-access-zd2c8\") pod \"cert-manager-cainjector-559cdd8c87-wjvkz\" (UID: \"deb7b789-f22d-494f-bd0a-42d3b49b9252\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wjvkz"
Sep 10 21:01:47.623877 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.623853    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deb7b789-f22d-494f-bd0a-42d3b49b9252-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wjvkz\" (UID: \"deb7b789-f22d-494f-bd0a-42d3b49b9252\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wjvkz"
Sep 10 21:01:47.728798 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.728711    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wjvkz"
Sep 10 21:01:47.995762 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:47.995658    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wjvkz"]
Sep 10 21:01:47.998341 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:01:47.998314    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddeb7b789_f22d_494f_bd0a_42d3b49b9252.slice/crio-da36e2a298662ad096f301332c46b67b059f9b7519c54b0f44466e6319523883 WatchSource:0}: Error finding container da36e2a298662ad096f301332c46b67b059f9b7519c54b0f44466e6319523883: Status 404 returned error can't find the container with id da36e2a298662ad096f301332c46b67b059f9b7519c54b0f44466e6319523883
Sep 10 21:01:48.110328 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:48.110291    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wjvkz" event={"ID":"deb7b789-f22d-494f-bd0a-42d3b49b9252","Type":"ContainerStarted","Data":"da36e2a298662ad096f301332c46b67b059f9b7519c54b0f44466e6319523883"}
Sep 10 21:01:50.122563 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:50.122506    2577 generic.go:356] "Generic (PLEG): container finished" podID="f17e364f-6704-40ae-a4f4-d99050774243" containerID="65dfbfe147cb881b56b8bc52ffb1bffeecbdeecba1f9a4b6523576d6cf30354f" exitCode=0
Sep 10 21:01:50.122975 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:50.122589    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv" event={"ID":"f17e364f-6704-40ae-a4f4-d99050774243","Type":"ContainerDied","Data":"65dfbfe147cb881b56b8bc52ffb1bffeecbdeecba1f9a4b6523576d6cf30354f"}
Sep 10 21:01:51.129530 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:51.129488    2577 generic.go:356] "Generic (PLEG): container finished" podID="f17e364f-6704-40ae-a4f4-d99050774243" containerID="81fa050fcea21b25eed6fad4376277d8c3b0e3bb7c12a3ba50838ca607a1a6a0" exitCode=0
Sep 10 21:01:51.129956 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:51.129528    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv" event={"ID":"f17e364f-6704-40ae-a4f4-d99050774243","Type":"ContainerDied","Data":"81fa050fcea21b25eed6fad4376277d8c3b0e3bb7c12a3ba50838ca607a1a6a0"}
Sep 10 21:01:52.135482 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.135431    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wjvkz" event={"ID":"deb7b789-f22d-494f-bd0a-42d3b49b9252","Type":"ContainerStarted","Data":"344217ca6556837d4bf6361f0618a1a2d527f5eadf21a897452e217088c23036"}
Sep 10 21:01:52.140981 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.140954    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2v7mf"]
Sep 10 21:01:52.143555 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.143535    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2v7mf"
Sep 10 21:01:52.145818 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.145797    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6r672\""
Sep 10 21:01:52.153080 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.153023    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2v7mf"]
Sep 10 21:01:52.154411 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.154365    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wjvkz" podStartSLOduration=1.705166715 podStartE2EDuration="5.154349954s" totalImagesPullingTime="3.449183239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:01:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:01:52.152290069 +0000 UTC m=+239.725996457" watchObservedRunningTime="2026-09-10 21:01:52.154349954 +0000 UTC m=+239.728056328"
Sep 10 21:01:52.259353 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.259316    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f765e81-f957-48eb-890c-68e32090d367-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2v7mf\" (UID: \"4f765e81-f957-48eb-890c-68e32090d367\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2v7mf"
Sep 10 21:01:52.259524 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.259421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtv9s\" (UniqueName: \"kubernetes.io/projected/4f765e81-f957-48eb-890c-68e32090d367-kube-api-access-xtv9s\") pod \"cert-manager-webhook-6486ffd997-2v7mf\" (UID: \"4f765e81-f957-48eb-890c-68e32090d367\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2v7mf"
Sep 10 21:01:52.282286 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.282259    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"
Sep 10 21:01:52.359816 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.359781    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f17e364f-6704-40ae-a4f4-d99050774243-util\") pod \"f17e364f-6704-40ae-a4f4-d99050774243\" (UID: \"f17e364f-6704-40ae-a4f4-d99050774243\") "
Sep 10 21:01:52.360057 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.359840    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6dfp\" (UniqueName: \"kubernetes.io/projected/f17e364f-6704-40ae-a4f4-d99050774243-kube-api-access-d6dfp\") pod \"f17e364f-6704-40ae-a4f4-d99050774243\" (UID: \"f17e364f-6704-40ae-a4f4-d99050774243\") "
Sep 10 21:01:52.360057 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.359868    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f17e364f-6704-40ae-a4f4-d99050774243-bundle\") pod \"f17e364f-6704-40ae-a4f4-d99050774243\" (UID: \"f17e364f-6704-40ae-a4f4-d99050774243\") "
Sep 10 21:01:52.360057 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.360006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f765e81-f957-48eb-890c-68e32090d367-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2v7mf\" (UID: \"4f765e81-f957-48eb-890c-68e32090d367\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2v7mf"
Sep 10 21:01:52.360211 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.360132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtv9s\" (UniqueName: \"kubernetes.io/projected/4f765e81-f957-48eb-890c-68e32090d367-kube-api-access-xtv9s\") pod \"cert-manager-webhook-6486ffd997-2v7mf\" (UID: \"4f765e81-f957-48eb-890c-68e32090d367\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2v7mf"
Sep 10 21:01:52.360375 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.360344    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f17e364f-6704-40ae-a4f4-d99050774243-bundle" (OuterVolumeSpecName: "bundle") pod "f17e364f-6704-40ae-a4f4-d99050774243" (UID: "f17e364f-6704-40ae-a4f4-d99050774243"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:01:52.362101 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.362070    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f17e364f-6704-40ae-a4f4-d99050774243-kube-api-access-d6dfp" (OuterVolumeSpecName: "kube-api-access-d6dfp") pod "f17e364f-6704-40ae-a4f4-d99050774243" (UID: "f17e364f-6704-40ae-a4f4-d99050774243"). InnerVolumeSpecName "kube-api-access-d6dfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:01:52.364615 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.364594    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f17e364f-6704-40ae-a4f4-d99050774243-util" (OuterVolumeSpecName: "util") pod "f17e364f-6704-40ae-a4f4-d99050774243" (UID: "f17e364f-6704-40ae-a4f4-d99050774243"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:01:52.367802 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.367777    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f765e81-f957-48eb-890c-68e32090d367-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2v7mf\" (UID: \"4f765e81-f957-48eb-890c-68e32090d367\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2v7mf"
Sep 10 21:01:52.368076 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.368053    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtv9s\" (UniqueName: \"kubernetes.io/projected/4f765e81-f957-48eb-890c-68e32090d367-kube-api-access-xtv9s\") pod \"cert-manager-webhook-6486ffd997-2v7mf\" (UID: \"4f765e81-f957-48eb-890c-68e32090d367\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2v7mf"
Sep 10 21:01:52.454706 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.454611    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2v7mf"
Sep 10 21:01:52.461342 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.461316    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f17e364f-6704-40ae-a4f4-d99050774243-util\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:01:52.461411 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.461351    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6dfp\" (UniqueName: \"kubernetes.io/projected/f17e364f-6704-40ae-a4f4-d99050774243-kube-api-access-d6dfp\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:01:52.461411 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.461365    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f17e364f-6704-40ae-a4f4-d99050774243-bundle\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:01:52.720797 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:52.720771    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2v7mf"]
Sep 10 21:01:52.722826 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:01:52.722801    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f765e81_f957_48eb_890c_68e32090d367.slice/crio-011d4a0d93aa7fdf2c9fcbba2cf7df92bd783436146b9a84a3f7862f91f6fc3c WatchSource:0}: Error finding container 011d4a0d93aa7fdf2c9fcbba2cf7df92bd783436146b9a84a3f7862f91f6fc3c: Status 404 returned error can't find the container with id 011d4a0d93aa7fdf2c9fcbba2cf7df92bd783436146b9a84a3f7862f91f6fc3c
Sep 10 21:01:53.142382 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:53.142331    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv" event={"ID":"f17e364f-6704-40ae-a4f4-d99050774243","Type":"ContainerDied","Data":"eef32d644c865aac25cd6b379bb4b78c84eb2e848122dccf57607cab25f964ef"}
Sep 10 21:01:53.142382 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:53.142355    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frl8nv"
Sep 10 21:01:53.142382 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:53.142386    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eef32d644c865aac25cd6b379bb4b78c84eb2e848122dccf57607cab25f964ef"
Sep 10 21:01:53.146227 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:53.146138    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2v7mf" event={"ID":"4f765e81-f957-48eb-890c-68e32090d367","Type":"ContainerStarted","Data":"6812787338b98e6f8142e59d28294c4d82b902a4d3548306f47a0367e3384ce3"}
Sep 10 21:01:53.146227 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:53.146191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2v7mf" event={"ID":"4f765e81-f957-48eb-890c-68e32090d367","Type":"ContainerStarted","Data":"011d4a0d93aa7fdf2c9fcbba2cf7df92bd783436146b9a84a3f7862f91f6fc3c"}
Sep 10 21:01:53.146521 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:53.146468    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2v7mf"
Sep 10 21:01:53.162399 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:53.162348    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2v7mf" podStartSLOduration=1.1623300269999999 podStartE2EDuration="1.162330027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:01:53.161984477 +0000 UTC m=+240.735690851" watchObservedRunningTime="2026-09-10 21:01:53.162330027 +0000 UTC m=+240.736036404"
Sep 10 21:01:59.153191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:01:59.153156    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2v7mf"
Sep 10 21:02:06.471814 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.471778    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"]
Sep 10 21:02:06.472222 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.472119    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f17e364f-6704-40ae-a4f4-d99050774243" containerName="extract"
Sep 10 21:02:06.472222 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.472131    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f17e364f-6704-40ae-a4f4-d99050774243" containerName="extract"
Sep 10 21:02:06.472222 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.472142    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f17e364f-6704-40ae-a4f4-d99050774243" containerName="util"
Sep 10 21:02:06.472222 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.472149    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f17e364f-6704-40ae-a4f4-d99050774243" containerName="util"
Sep 10 21:02:06.472222 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.472160    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f17e364f-6704-40ae-a4f4-d99050774243" containerName="pull"
Sep 10 21:02:06.472222 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.472165    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f17e364f-6704-40ae-a4f4-d99050774243" containerName="pull"
Sep 10 21:02:06.472222 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.472226    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f17e364f-6704-40ae-a4f4-d99050774243" containerName="extract"
Sep 10 21:02:06.481413 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.481379    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"
Sep 10 21:02:06.481833 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.481807    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"]
Sep 10 21:02:06.483418 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.483387    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbg6r\" (UniqueName: \"kubernetes.io/projected/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-kube-api-access-cbg6r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9\" (UID: \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"
Sep 10 21:02:06.483556 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.483462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9\" (UID: \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"
Sep 10 21:02:06.483556 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.483498    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9\" (UID: \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"
Sep 10 21:02:06.483842 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.483814    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:02:06.483945 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.483845    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:02:06.484707 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.484687    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w64cv\""
Sep 10 21:02:06.584566 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.584524    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9\" (UID: \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"
Sep 10 21:02:06.584566 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.584569    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9\" (UID: \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"
Sep 10 21:02:06.584832 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.584624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbg6r\" (UniqueName: \"kubernetes.io/projected/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-kube-api-access-cbg6r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9\" (UID: \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"
Sep 10 21:02:06.584921 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.584900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9\" (UID: \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"
Sep 10 21:02:06.584996 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.584963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9\" (UID: \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"
Sep 10 21:02:06.592424 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.592396    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbg6r\" (UniqueName: \"kubernetes.io/projected/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-kube-api-access-cbg6r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9\" (UID: \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"
Sep 10 21:02:06.791816 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:06.791723    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"
Sep 10 21:02:07.065661 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:07.065636    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"]
Sep 10 21:02:07.069153 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:02:07.069124    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280e481b_71f0_4eee_b8f5_7d6e4aea44ee.slice/crio-2a34907cde61023440744100ac2ee010e57e67d2ac129dfd46f71234d9f34469 WatchSource:0}: Error finding container 2a34907cde61023440744100ac2ee010e57e67d2ac129dfd46f71234d9f34469: Status 404 returned error can't find the container with id 2a34907cde61023440744100ac2ee010e57e67d2ac129dfd46f71234d9f34469
Sep 10 21:02:07.213104 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:07.213071    2577 generic.go:356] "Generic (PLEG): container finished" podID="280e481b-71f0-4eee-b8f5-7d6e4aea44ee" containerID="e14df3824a7ea2507d562946dad16ad0c48a09cbd6a0a317bf725ced194076c5" exitCode=0
Sep 10 21:02:07.213317 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:07.213129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9" event={"ID":"280e481b-71f0-4eee-b8f5-7d6e4aea44ee","Type":"ContainerDied","Data":"e14df3824a7ea2507d562946dad16ad0c48a09cbd6a0a317bf725ced194076c5"}
Sep 10 21:02:07.213317 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:07.213166    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9" event={"ID":"280e481b-71f0-4eee-b8f5-7d6e4aea44ee","Type":"ContainerStarted","Data":"2a34907cde61023440744100ac2ee010e57e67d2ac129dfd46f71234d9f34469"}
Sep 10 21:02:08.219403 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:08.219366    2577 generic.go:356] "Generic (PLEG): container finished" podID="280e481b-71f0-4eee-b8f5-7d6e4aea44ee" containerID="abb32e0efa655700c5d76460e9e133235062c0fa2448106b1f3c718142f34aca" exitCode=0
Sep 10 21:02:08.219857 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:08.219457    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9" event={"ID":"280e481b-71f0-4eee-b8f5-7d6e4aea44ee","Type":"ContainerDied","Data":"abb32e0efa655700c5d76460e9e133235062c0fa2448106b1f3c718142f34aca"}
Sep 10 21:02:09.226253 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:09.226221    2577 generic.go:356] "Generic (PLEG): container finished" podID="280e481b-71f0-4eee-b8f5-7d6e4aea44ee" containerID="a127580c046545c1603b9d418db1f0cf79d944801b372bc132bf9220990184c9" exitCode=0
Sep 10 21:02:09.226672 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:09.226267    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9" event={"ID":"280e481b-71f0-4eee-b8f5-7d6e4aea44ee","Type":"ContainerDied","Data":"a127580c046545c1603b9d418db1f0cf79d944801b372bc132bf9220990184c9"}
Sep 10 21:02:10.361162 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:10.361130    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"
Sep 10 21:02:10.413620 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:10.413583    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-bundle\") pod \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\" (UID: \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\") "
Sep 10 21:02:10.413791 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:10.413636    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbg6r\" (UniqueName: \"kubernetes.io/projected/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-kube-api-access-cbg6r\") pod \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\" (UID: \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\") "
Sep 10 21:02:10.413791 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:10.413668    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-util\") pod \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\" (UID: \"280e481b-71f0-4eee-b8f5-7d6e4aea44ee\") "
Sep 10 21:02:10.414402 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:10.414373    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-bundle" (OuterVolumeSpecName: "bundle") pod "280e481b-71f0-4eee-b8f5-7d6e4aea44ee" (UID: "280e481b-71f0-4eee-b8f5-7d6e4aea44ee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:10.415896 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:10.415874    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-kube-api-access-cbg6r" (OuterVolumeSpecName: "kube-api-access-cbg6r") pod "280e481b-71f0-4eee-b8f5-7d6e4aea44ee" (UID: "280e481b-71f0-4eee-b8f5-7d6e4aea44ee"). InnerVolumeSpecName "kube-api-access-cbg6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:02:10.419291 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:10.419266    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-util" (OuterVolumeSpecName: "util") pod "280e481b-71f0-4eee-b8f5-7d6e4aea44ee" (UID: "280e481b-71f0-4eee-b8f5-7d6e4aea44ee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:10.514307 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:10.514222    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-bundle\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:02:10.514307 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:10.514251    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbg6r\" (UniqueName: \"kubernetes.io/projected/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-kube-api-access-cbg6r\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:02:10.514307 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:10.514261    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/280e481b-71f0-4eee-b8f5-7d6e4aea44ee-util\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:02:11.237740 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:11.237657    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9"
Sep 10 21:02:11.237886 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:11.237655    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvzrn9" event={"ID":"280e481b-71f0-4eee-b8f5-7d6e4aea44ee","Type":"ContainerDied","Data":"2a34907cde61023440744100ac2ee010e57e67d2ac129dfd46f71234d9f34469"}
Sep 10 21:02:11.237886 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:11.237780    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a34907cde61023440744100ac2ee010e57e67d2ac129dfd46f71234d9f34469"
Sep 10 21:02:16.295570 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.295486    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"]
Sep 10 21:02:16.295924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.295839    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280e481b-71f0-4eee-b8f5-7d6e4aea44ee" containerName="extract"
Sep 10 21:02:16.295924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.295851    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="280e481b-71f0-4eee-b8f5-7d6e4aea44ee" containerName="extract"
Sep 10 21:02:16.295924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.295873    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280e481b-71f0-4eee-b8f5-7d6e4aea44ee" containerName="pull"
Sep 10 21:02:16.295924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.295879    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="280e481b-71f0-4eee-b8f5-7d6e4aea44ee" containerName="pull"
Sep 10 21:02:16.295924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.295888    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280e481b-71f0-4eee-b8f5-7d6e4aea44ee" containerName="util"
Sep 10 21:02:16.295924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.295897    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="280e481b-71f0-4eee-b8f5-7d6e4aea44ee" containerName="util"
Sep 10 21:02:16.296138 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.295952    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="280e481b-71f0-4eee-b8f5-7d6e4aea44ee" containerName="extract"
Sep 10 21:02:16.298185 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.298166    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"
Sep 10 21:02:16.300384 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.300356    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:02:16.300490 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.300386    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:02:16.301170 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.301149    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w64cv\""
Sep 10 21:02:16.307637 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.307610    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"]
Sep 10 21:02:16.367977 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.367937    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afa75064-8abf-4b2a-aebb-b9f5e55a7920-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk\" (UID: \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"
Sep 10 21:02:16.367977 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.367980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdc64\" (UniqueName: \"kubernetes.io/projected/afa75064-8abf-4b2a-aebb-b9f5e55a7920-kube-api-access-vdc64\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk\" (UID: \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"
Sep 10 21:02:16.368235 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.368057    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afa75064-8abf-4b2a-aebb-b9f5e55a7920-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk\" (UID: \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"
Sep 10 21:02:16.469377 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.469339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afa75064-8abf-4b2a-aebb-b9f5e55a7920-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk\" (UID: \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"
Sep 10 21:02:16.469377 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.469379    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdc64\" (UniqueName: \"kubernetes.io/projected/afa75064-8abf-4b2a-aebb-b9f5e55a7920-kube-api-access-vdc64\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk\" (UID: \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"
Sep 10 21:02:16.469592 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.469400    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afa75064-8abf-4b2a-aebb-b9f5e55a7920-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk\" (UID: \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"
Sep 10 21:02:16.469736 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.469719    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afa75064-8abf-4b2a-aebb-b9f5e55a7920-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk\" (UID: \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"
Sep 10 21:02:16.469797 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.469772    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afa75064-8abf-4b2a-aebb-b9f5e55a7920-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk\" (UID: \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"
Sep 10 21:02:16.477195 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.477170    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdc64\" (UniqueName: \"kubernetes.io/projected/afa75064-8abf-4b2a-aebb-b9f5e55a7920-kube-api-access-vdc64\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk\" (UID: \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"
Sep 10 21:02:16.608241 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.608213    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"
Sep 10 21:02:16.877370 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:16.877344    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"]
Sep 10 21:02:16.879704 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:02:16.879674    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa75064_8abf_4b2a_aebb_b9f5e55a7920.slice/crio-223db621b2687ecbd40b4c773b13d55a93418fe262482b7489267f02bba22044 WatchSource:0}: Error finding container 223db621b2687ecbd40b4c773b13d55a93418fe262482b7489267f02bba22044: Status 404 returned error can't find the container with id 223db621b2687ecbd40b4c773b13d55a93418fe262482b7489267f02bba22044
Sep 10 21:02:17.267882 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:17.267798    2577 generic.go:356] "Generic (PLEG): container finished" podID="afa75064-8abf-4b2a-aebb-b9f5e55a7920" containerID="69c2d18cfce5fcbc20a2363f3ead02da80e2bd0991e8fdc7e7629df1f9ad9885" exitCode=0
Sep 10 21:02:17.267882 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:17.267856    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk" event={"ID":"afa75064-8abf-4b2a-aebb-b9f5e55a7920","Type":"ContainerDied","Data":"69c2d18cfce5fcbc20a2363f3ead02da80e2bd0991e8fdc7e7629df1f9ad9885"}
Sep 10 21:02:17.268097 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:17.267893    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk" event={"ID":"afa75064-8abf-4b2a-aebb-b9f5e55a7920","Type":"ContainerStarted","Data":"223db621b2687ecbd40b4c773b13d55a93418fe262482b7489267f02bba22044"}
Sep 10 21:02:18.274366 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.274271    2577 generic.go:356] "Generic (PLEG): container finished" podID="afa75064-8abf-4b2a-aebb-b9f5e55a7920" containerID="6a303e184901cdbf48b88574430797bf39ad93501af454f6dd28517962c02583" exitCode=0
Sep 10 21:02:18.274788 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.274357    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk" event={"ID":"afa75064-8abf-4b2a-aebb-b9f5e55a7920","Type":"ContainerDied","Data":"6a303e184901cdbf48b88574430797bf39ad93501af454f6dd28517962c02583"}
Sep 10 21:02:18.595930 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.595899    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"]
Sep 10 21:02:18.598244 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.598227    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.601547 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.601523    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 21:02:18.601676 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.601645    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pmkvq\""
Sep 10 21:02:18.601676 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.601663    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 21:02:18.601788 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.601691    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 21:02:18.601788 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.601769    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 21:02:18.613265 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.613238    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"]
Sep 10 21:02:18.690430 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.690392    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9gb7\" (UniqueName: \"kubernetes.io/projected/49c678b2-0b7b-4aa1-8113-5c90517538b6-kube-api-access-m9gb7\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.690612 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.690495    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49c678b2-0b7b-4aa1-8113-5c90517538b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.690612 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.690543    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/49c678b2-0b7b-4aa1-8113-5c90517538b6-manifests\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.690612 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.690585    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49c678b2-0b7b-4aa1-8113-5c90517538b6-tmp\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.690718 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.690630    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/49c678b2-0b7b-4aa1-8113-5c90517538b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.791783 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.791743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/49c678b2-0b7b-4aa1-8113-5c90517538b6-manifests\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.791783 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.791787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49c678b2-0b7b-4aa1-8113-5c90517538b6-tmp\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.792009 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.791807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/49c678b2-0b7b-4aa1-8113-5c90517538b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.792009 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.791926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9gb7\" (UniqueName: \"kubernetes.io/projected/49c678b2-0b7b-4aa1-8113-5c90517538b6-kube-api-access-m9gb7\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.792149 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.792066    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49c678b2-0b7b-4aa1-8113-5c90517538b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.792200 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.792166    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/49c678b2-0b7b-4aa1-8113-5c90517538b6-manifests\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.794100 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.794068    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49c678b2-0b7b-4aa1-8113-5c90517538b6-tmp\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.794363 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.794344    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49c678b2-0b7b-4aa1-8113-5c90517538b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.794445 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.794423    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/49c678b2-0b7b-4aa1-8113-5c90517538b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.806190 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.806166    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9gb7\" (UniqueName: \"kubernetes.io/projected/49c678b2-0b7b-4aa1-8113-5c90517538b6-kube-api-access-m9gb7\") pod \"opendatahub-operator-controller-manager-d855cccc6-lm4ft\" (UID: \"49c678b2-0b7b-4aa1-8113-5c90517538b6\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:18.909432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:18.909330    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:19.187379 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:19.187355    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"]
Sep 10 21:02:19.189482 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:02:19.189453    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c678b2_0b7b_4aa1_8113_5c90517538b6.slice/crio-314911a9bdca99040b94dcfb7ee5aa55ae972614587983716537312f936e070c WatchSource:0}: Error finding container 314911a9bdca99040b94dcfb7ee5aa55ae972614587983716537312f936e070c: Status 404 returned error can't find the container with id 314911a9bdca99040b94dcfb7ee5aa55ae972614587983716537312f936e070c
Sep 10 21:02:19.281329 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:19.281296    2577 generic.go:356] "Generic (PLEG): container finished" podID="afa75064-8abf-4b2a-aebb-b9f5e55a7920" containerID="ee529b859b0cf8ea41c0e973810254fb4efde5988d5769e08fd81f015eb5510a" exitCode=0
Sep 10 21:02:19.281772 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:19.281390    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk" event={"ID":"afa75064-8abf-4b2a-aebb-b9f5e55a7920","Type":"ContainerDied","Data":"ee529b859b0cf8ea41c0e973810254fb4efde5988d5769e08fd81f015eb5510a"}
Sep 10 21:02:19.282797 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:19.282777    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft" event={"ID":"49c678b2-0b7b-4aa1-8113-5c90517538b6","Type":"ContainerStarted","Data":"314911a9bdca99040b94dcfb7ee5aa55ae972614587983716537312f936e070c"}
Sep 10 21:02:20.449520 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:20.449488    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"
Sep 10 21:02:20.509342 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:20.509306    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afa75064-8abf-4b2a-aebb-b9f5e55a7920-bundle\") pod \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\" (UID: \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\") "
Sep 10 21:02:20.509529 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:20.509401    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afa75064-8abf-4b2a-aebb-b9f5e55a7920-util\") pod \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\" (UID: \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\") "
Sep 10 21:02:20.509529 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:20.509446    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdc64\" (UniqueName: \"kubernetes.io/projected/afa75064-8abf-4b2a-aebb-b9f5e55a7920-kube-api-access-vdc64\") pod \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\" (UID: \"afa75064-8abf-4b2a-aebb-b9f5e55a7920\") "
Sep 10 21:02:20.510429 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:20.510393    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afa75064-8abf-4b2a-aebb-b9f5e55a7920-bundle" (OuterVolumeSpecName: "bundle") pod "afa75064-8abf-4b2a-aebb-b9f5e55a7920" (UID: "afa75064-8abf-4b2a-aebb-b9f5e55a7920"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:20.512442 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:20.512397    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afa75064-8abf-4b2a-aebb-b9f5e55a7920-kube-api-access-vdc64" (OuterVolumeSpecName: "kube-api-access-vdc64") pod "afa75064-8abf-4b2a-aebb-b9f5e55a7920" (UID: "afa75064-8abf-4b2a-aebb-b9f5e55a7920"). InnerVolumeSpecName "kube-api-access-vdc64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:02:20.518145 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:20.518113    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afa75064-8abf-4b2a-aebb-b9f5e55a7920-util" (OuterVolumeSpecName: "util") pod "afa75064-8abf-4b2a-aebb-b9f5e55a7920" (UID: "afa75064-8abf-4b2a-aebb-b9f5e55a7920"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:20.610897 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:20.610856    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afa75064-8abf-4b2a-aebb-b9f5e55a7920-util\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:02:20.610897 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:20.610898    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdc64\" (UniqueName: \"kubernetes.io/projected/afa75064-8abf-4b2a-aebb-b9f5e55a7920-kube-api-access-vdc64\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:02:20.611194 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:20.610915    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afa75064-8abf-4b2a-aebb-b9f5e55a7920-bundle\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:02:21.296814 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:21.296729    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk" event={"ID":"afa75064-8abf-4b2a-aebb-b9f5e55a7920","Type":"ContainerDied","Data":"223db621b2687ecbd40b4c773b13d55a93418fe262482b7489267f02bba22044"}
Sep 10 21:02:21.296814 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:21.296782    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="223db621b2687ecbd40b4c773b13d55a93418fe262482b7489267f02bba22044"
Sep 10 21:02:21.296814 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:21.296782    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dclpk"
Sep 10 21:02:23.308369 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:23.308332    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft" event={"ID":"49c678b2-0b7b-4aa1-8113-5c90517538b6","Type":"ContainerStarted","Data":"2ba2f7de0b682f1de855ec40d4be84551fb7607435684e49d636cf0664d1b625"}
Sep 10 21:02:24.314355 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:24.314318    2577 generic.go:356] "Generic (PLEG): container finished" podID="49c678b2-0b7b-4aa1-8113-5c90517538b6" containerID="2ba2f7de0b682f1de855ec40d4be84551fb7607435684e49d636cf0664d1b625" exitCode=0
Sep 10 21:02:24.314752 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:24.314384    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft" event={"ID":"49c678b2-0b7b-4aa1-8113-5c90517538b6","Type":"ContainerDied","Data":"2ba2f7de0b682f1de855ec40d4be84551fb7607435684e49d636cf0664d1b625"}
Sep 10 21:02:25.320953 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:25.320921    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft" event={"ID":"49c678b2-0b7b-4aa1-8113-5c90517538b6","Type":"ContainerStarted","Data":"f3be9e011281bff93b1fbc6349ba1f45a32030013011c2f2d5d7ef20a46fcb6f"}
Sep 10 21:02:25.321355 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:25.321059    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:25.350325 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:25.350271    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft" podStartSLOduration=2.878316785 podStartE2EDuration="7.350253131s" totalImagesPullingTime="3.380859552s" totalInitContainerRuntime="1.091076794s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:25.348693205 +0000 UTC m=+272.922399580" watchObservedRunningTime="2026-09-10 21:02:25.350253131 +0000 UTC m=+272.923959506"
Sep 10 21:02:36.328298 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:36.328258    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-lm4ft"
Sep 10 21:02:38.206447 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.206394    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"]
Sep 10 21:02:38.206921 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.206906    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa75064-8abf-4b2a-aebb-b9f5e55a7920" containerName="pull"
Sep 10 21:02:38.206964 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.206925    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa75064-8abf-4b2a-aebb-b9f5e55a7920" containerName="pull"
Sep 10 21:02:38.206964 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.206954    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa75064-8abf-4b2a-aebb-b9f5e55a7920" containerName="util"
Sep 10 21:02:38.207058 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.206963    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa75064-8abf-4b2a-aebb-b9f5e55a7920" containerName="util"
Sep 10 21:02:38.207058 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.206981    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa75064-8abf-4b2a-aebb-b9f5e55a7920" containerName="extract"
Sep 10 21:02:38.207058 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.206991    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa75064-8abf-4b2a-aebb-b9f5e55a7920" containerName="extract"
Sep 10 21:02:38.207194 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.207102    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa75064-8abf-4b2a-aebb-b9f5e55a7920" containerName="extract"
Sep 10 21:02:38.215576 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.215554    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:38.218425 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.218284    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 21:02:38.218660 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.218640    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 21:02:38.219075 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.219053    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hv8md\""
Sep 10 21:02:38.219336 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.219313    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 21:02:38.219425 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.219347    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 21:02:38.219425 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.219314    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 21:02:38.220195 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.220172    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"]
Sep 10 21:02:38.369988 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.369947    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/929e72ad-7b47-4404-a781-1b7b8935d01d-cert\") pod \"lws-controller-manager-6f8c8876d7-db8x6\" (UID: \"929e72ad-7b47-4404-a781-1b7b8935d01d\") " pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:38.369988 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.369986    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j97l\" (UniqueName: \"kubernetes.io/projected/929e72ad-7b47-4404-a781-1b7b8935d01d-kube-api-access-5j97l\") pod \"lws-controller-manager-6f8c8876d7-db8x6\" (UID: \"929e72ad-7b47-4404-a781-1b7b8935d01d\") " pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:38.370262 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.370166    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/929e72ad-7b47-4404-a781-1b7b8935d01d-manager-config\") pod \"lws-controller-manager-6f8c8876d7-db8x6\" (UID: \"929e72ad-7b47-4404-a781-1b7b8935d01d\") " pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:38.370262 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.370203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/929e72ad-7b47-4404-a781-1b7b8935d01d-metrics-cert\") pod \"lws-controller-manager-6f8c8876d7-db8x6\" (UID: \"929e72ad-7b47-4404-a781-1b7b8935d01d\") " pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:38.470750 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.470657    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/929e72ad-7b47-4404-a781-1b7b8935d01d-manager-config\") pod \"lws-controller-manager-6f8c8876d7-db8x6\" (UID: \"929e72ad-7b47-4404-a781-1b7b8935d01d\") " pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:38.470750 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.470700    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/929e72ad-7b47-4404-a781-1b7b8935d01d-metrics-cert\") pod \"lws-controller-manager-6f8c8876d7-db8x6\" (UID: \"929e72ad-7b47-4404-a781-1b7b8935d01d\") " pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:38.470750 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.470737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/929e72ad-7b47-4404-a781-1b7b8935d01d-cert\") pod \"lws-controller-manager-6f8c8876d7-db8x6\" (UID: \"929e72ad-7b47-4404-a781-1b7b8935d01d\") " pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:38.470750 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.470754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j97l\" (UniqueName: \"kubernetes.io/projected/929e72ad-7b47-4404-a781-1b7b8935d01d-kube-api-access-5j97l\") pod \"lws-controller-manager-6f8c8876d7-db8x6\" (UID: \"929e72ad-7b47-4404-a781-1b7b8935d01d\") " pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:38.471361 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.471340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/929e72ad-7b47-4404-a781-1b7b8935d01d-manager-config\") pod \"lws-controller-manager-6f8c8876d7-db8x6\" (UID: \"929e72ad-7b47-4404-a781-1b7b8935d01d\") " pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:38.473296 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.473273    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/929e72ad-7b47-4404-a781-1b7b8935d01d-metrics-cert\") pod \"lws-controller-manager-6f8c8876d7-db8x6\" (UID: \"929e72ad-7b47-4404-a781-1b7b8935d01d\") " pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:38.473381 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.473340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/929e72ad-7b47-4404-a781-1b7b8935d01d-cert\") pod \"lws-controller-manager-6f8c8876d7-db8x6\" (UID: \"929e72ad-7b47-4404-a781-1b7b8935d01d\") " pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:38.478264 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.478240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j97l\" (UniqueName: \"kubernetes.io/projected/929e72ad-7b47-4404-a781-1b7b8935d01d-kube-api-access-5j97l\") pod \"lws-controller-manager-6f8c8876d7-db8x6\" (UID: \"929e72ad-7b47-4404-a781-1b7b8935d01d\") " pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:38.526450 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.526412    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:38.801121 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:38.801077    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"]
Sep 10 21:02:38.803982 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:02:38.803950    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod929e72ad_7b47_4404_a781_1b7b8935d01d.slice/crio-a9a948497274dfbd5d67f93ca8ba01aaf488c60e7ac5fd9804b226140eec694c WatchSource:0}: Error finding container a9a948497274dfbd5d67f93ca8ba01aaf488c60e7ac5fd9804b226140eec694c: Status 404 returned error can't find the container with id a9a948497274dfbd5d67f93ca8ba01aaf488c60e7ac5fd9804b226140eec694c
Sep 10 21:02:39.384840 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:39.384804    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6" event={"ID":"929e72ad-7b47-4404-a781-1b7b8935d01d","Type":"ContainerStarted","Data":"a9a948497274dfbd5d67f93ca8ba01aaf488c60e7ac5fd9804b226140eec694c"}
Sep 10 21:02:40.391082 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:40.391047    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6" event={"ID":"929e72ad-7b47-4404-a781-1b7b8935d01d","Type":"ContainerStarted","Data":"3af53a4e757d7ec76cf221e827cc172390f2cde477e2aa2c662719ba10b22451"}
Sep 10 21:02:40.391447 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:40.391187    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:40.408871 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:40.408746    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6" podStartSLOduration=1.036971901 podStartE2EDuration="2.408725863s" totalImagesPullingTime="1.371753962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:40.407578557 +0000 UTC m=+287.981284931" watchObservedRunningTime="2026-09-10 21:02:40.408725863 +0000 UTC m=+287.982432238"
Sep 10 21:02:45.532463 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.532430    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"]
Sep 10 21:02:45.535643 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.535626    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.537939 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.537908    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 21:02:45.538059 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.537945    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-t4x6c\""
Sep 10 21:02:45.545622 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.545591    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"]
Sep 10 21:02:45.630987 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.630952    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.630987 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.630988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.631216 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.631107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32013db8-bc81-4371-9805-dce0f91ec710-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.631216 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.631150    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.631216 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.631169    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32013db8-bc81-4371-9805-dce0f91ec710-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.631216 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.631187    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32013db8-bc81-4371-9805-dce0f91ec710-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.631348 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.631286    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.631348 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.631310    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.631348 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.631329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w2jh\" (UniqueName: \"kubernetes.io/projected/32013db8-bc81-4371-9805-dce0f91ec710-kube-api-access-4w2jh\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.732716 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.732678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.732716 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.732715    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.732968 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.732735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w2jh\" (UniqueName: \"kubernetes.io/projected/32013db8-bc81-4371-9805-dce0f91ec710-kube-api-access-4w2jh\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.732968 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.732773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.732968 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.732792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.732968 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.732843    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32013db8-bc81-4371-9805-dce0f91ec710-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.732968 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.732874    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.732968 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.732898    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32013db8-bc81-4371-9805-dce0f91ec710-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.732968 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.732926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32013db8-bc81-4371-9805-dce0f91ec710-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.733359 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.733261    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.733359 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.733302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.733480 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.733459    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.733613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.733563    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.733723 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.733612    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32013db8-bc81-4371-9805-dce0f91ec710-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.735581 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.735556    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32013db8-bc81-4371-9805-dce0f91ec710-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.735823 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.735806    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32013db8-bc81-4371-9805-dce0f91ec710-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.742745 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.742706    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w2jh\" (UniqueName: \"kubernetes.io/projected/32013db8-bc81-4371-9805-dce0f91ec710-kube-api-access-4w2jh\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.743482 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.743459    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32013db8-bc81-4371-9805-dce0f91ec710-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg\" (UID: \"32013db8-bc81-4371-9805-dce0f91ec710\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:45.848170 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:45.848136    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:46.125460 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:46.125430    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"]
Sep 10 21:02:46.127269 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:02:46.127236    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32013db8_bc81_4371_9805_dce0f91ec710.slice/crio-9f1a5314e5ed059fbbdf636c5ffd8de37b010ac6412fa597340b685adaf06941 WatchSource:0}: Error finding container 9f1a5314e5ed059fbbdf636c5ffd8de37b010ac6412fa597340b685adaf06941: Status 404 returned error can't find the container with id 9f1a5314e5ed059fbbdf636c5ffd8de37b010ac6412fa597340b685adaf06941
Sep 10 21:02:46.422094 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:46.422003    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg" event={"ID":"32013db8-bc81-4371-9805-dce0f91ec710","Type":"ContainerStarted","Data":"9f1a5314e5ed059fbbdf636c5ffd8de37b010ac6412fa597340b685adaf06941"}
Sep 10 21:02:48.909264 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:48.909226    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6hq44"]
Sep 10 21:02:48.912265 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:48.912245    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6hq44"
Sep 10 21:02:48.914634 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:48.914614    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 21:02:48.914711 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:48.914656    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ktftj\""
Sep 10 21:02:48.923218 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:48.923194    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6hq44"]
Sep 10 21:02:48.962093 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:48.962021    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:02:48.962212 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:48.962143    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:02:48.962212 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:48.962181    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:02:49.068762 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.067864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkr56\" (UniqueName: \"kubernetes.io/projected/7d550f5b-60e8-4061-93e1-31554eeca51a-kube-api-access-qkr56\") pod \"odh-model-controller-7998c67dc4-6hq44\" (UID: \"7d550f5b-60e8-4061-93e1-31554eeca51a\") " pod="opendatahub/odh-model-controller-7998c67dc4-6hq44"
Sep 10 21:02:49.068762 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.067939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d550f5b-60e8-4061-93e1-31554eeca51a-cert\") pod \"odh-model-controller-7998c67dc4-6hq44\" (UID: \"7d550f5b-60e8-4061-93e1-31554eeca51a\") " pod="opendatahub/odh-model-controller-7998c67dc4-6hq44"
Sep 10 21:02:49.169198 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.169104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkr56\" (UniqueName: \"kubernetes.io/projected/7d550f5b-60e8-4061-93e1-31554eeca51a-kube-api-access-qkr56\") pod \"odh-model-controller-7998c67dc4-6hq44\" (UID: \"7d550f5b-60e8-4061-93e1-31554eeca51a\") " pod="opendatahub/odh-model-controller-7998c67dc4-6hq44"
Sep 10 21:02:49.169198 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.169164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d550f5b-60e8-4061-93e1-31554eeca51a-cert\") pod \"odh-model-controller-7998c67dc4-6hq44\" (UID: \"7d550f5b-60e8-4061-93e1-31554eeca51a\") " pod="opendatahub/odh-model-controller-7998c67dc4-6hq44"
Sep 10 21:02:49.169375 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:02:49.169282    2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 10 21:02:49.169375 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:02:49.169349    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d550f5b-60e8-4061-93e1-31554eeca51a-cert podName:7d550f5b-60e8-4061-93e1-31554eeca51a nodeName:}" failed. No retries permitted until 2026-09-10 21:02:49.669327847 +0000 UTC m=+297.243034202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d550f5b-60e8-4061-93e1-31554eeca51a-cert") pod "odh-model-controller-7998c67dc4-6hq44" (UID: "7d550f5b-60e8-4061-93e1-31554eeca51a") : secret "odh-model-controller-webhook-cert" not found
Sep 10 21:02:49.189969 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.189937    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkr56\" (UniqueName: \"kubernetes.io/projected/7d550f5b-60e8-4061-93e1-31554eeca51a-kube-api-access-qkr56\") pod \"odh-model-controller-7998c67dc4-6hq44\" (UID: \"7d550f5b-60e8-4061-93e1-31554eeca51a\") " pod="opendatahub/odh-model-controller-7998c67dc4-6hq44"
Sep 10 21:02:49.440533 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.440441    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg" event={"ID":"32013db8-bc81-4371-9805-dce0f91ec710","Type":"ContainerStarted","Data":"fc5b601f2f092d1b4bc278ab46d0d159c12f9cc84884f64e1c0fd62af4bb588b"}
Sep 10 21:02:49.464333 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.464284    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg" podStartSLOduration=1.631902317 podStartE2EDuration="4.464266097s" totalImagesPullingTime="2.83236378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:49.462867277 +0000 UTC m=+297.036573657" watchObservedRunningTime="2026-09-10 21:02:49.464266097 +0000 UTC m=+297.037972471"
Sep 10 21:02:49.471223 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.471195    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n7v68"]
Sep 10 21:02:49.474640 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.474621    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-n7v68"
Sep 10 21:02:49.477045 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.477014    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 10 21:02:49.477150 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.477132    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8jc7m\""
Sep 10 21:02:49.485514 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.485491    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n7v68"]
Sep 10 21:02:49.573925 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.573888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7x8m\" (UniqueName: \"kubernetes.io/projected/c03f6a36-58f1-4148-bb58-fc5b7059f210-kube-api-access-r7x8m\") pod \"model-serving-api-54d89bd5fc-n7v68\" (UID: \"c03f6a36-58f1-4148-bb58-fc5b7059f210\") " pod="opendatahub/model-serving-api-54d89bd5fc-n7v68"
Sep 10 21:02:49.574155 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.573934    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03f6a36-58f1-4148-bb58-fc5b7059f210-tls-certs\") pod \"model-serving-api-54d89bd5fc-n7v68\" (UID: \"c03f6a36-58f1-4148-bb58-fc5b7059f210\") " pod="opendatahub/model-serving-api-54d89bd5fc-n7v68"
Sep 10 21:02:49.675369 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.675331    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7x8m\" (UniqueName: \"kubernetes.io/projected/c03f6a36-58f1-4148-bb58-fc5b7059f210-kube-api-access-r7x8m\") pod \"model-serving-api-54d89bd5fc-n7v68\" (UID: \"c03f6a36-58f1-4148-bb58-fc5b7059f210\") " pod="opendatahub/model-serving-api-54d89bd5fc-n7v68"
Sep 10 21:02:49.675369 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.675375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03f6a36-58f1-4148-bb58-fc5b7059f210-tls-certs\") pod \"model-serving-api-54d89bd5fc-n7v68\" (UID: \"c03f6a36-58f1-4148-bb58-fc5b7059f210\") " pod="opendatahub/model-serving-api-54d89bd5fc-n7v68"
Sep 10 21:02:49.675594 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.675475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d550f5b-60e8-4061-93e1-31554eeca51a-cert\") pod \"odh-model-controller-7998c67dc4-6hq44\" (UID: \"7d550f5b-60e8-4061-93e1-31554eeca51a\") " pod="opendatahub/odh-model-controller-7998c67dc4-6hq44"
Sep 10 21:02:49.677965 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.677938    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03f6a36-58f1-4148-bb58-fc5b7059f210-tls-certs\") pod \"model-serving-api-54d89bd5fc-n7v68\" (UID: \"c03f6a36-58f1-4148-bb58-fc5b7059f210\") " pod="opendatahub/model-serving-api-54d89bd5fc-n7v68"
Sep 10 21:02:49.677965 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.677961    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d550f5b-60e8-4061-93e1-31554eeca51a-cert\") pod \"odh-model-controller-7998c67dc4-6hq44\" (UID: \"7d550f5b-60e8-4061-93e1-31554eeca51a\") " pod="opendatahub/odh-model-controller-7998c67dc4-6hq44"
Sep 10 21:02:49.685589 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.685559    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7x8m\" (UniqueName: \"kubernetes.io/projected/c03f6a36-58f1-4148-bb58-fc5b7059f210-kube-api-access-r7x8m\") pod \"model-serving-api-54d89bd5fc-n7v68\" (UID: \"c03f6a36-58f1-4148-bb58-fc5b7059f210\") " pod="opendatahub/model-serving-api-54d89bd5fc-n7v68"
Sep 10 21:02:49.785727 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.785619    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-n7v68"
Sep 10 21:02:49.824746 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.824491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6hq44"
Sep 10 21:02:49.848463 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:49.848379    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:50.062384 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:50.062358    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n7v68"]
Sep 10 21:02:50.064394 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:02:50.064369    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc03f6a36_58f1_4148_bb58_fc5b7059f210.slice/crio-fd5afb1a378ac80ddae00dac440c5a4fab393304977bf2abd03a681bb80f071e WatchSource:0}: Error finding container fd5afb1a378ac80ddae00dac440c5a4fab393304977bf2abd03a681bb80f071e: Status 404 returned error can't find the container with id fd5afb1a378ac80ddae00dac440c5a4fab393304977bf2abd03a681bb80f071e
Sep 10 21:02:50.108673 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:50.108649    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6hq44"]
Sep 10 21:02:50.110861 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:02:50.110831    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d550f5b_60e8_4061_93e1_31554eeca51a.slice/crio-7d3ded7b2dfc68f05adfce8be440c8acb3f600822ee3b50cfc92211e9adadb3b WatchSource:0}: Error finding container 7d3ded7b2dfc68f05adfce8be440c8acb3f600822ee3b50cfc92211e9adadb3b: Status 404 returned error can't find the container with id 7d3ded7b2dfc68f05adfce8be440c8acb3f600822ee3b50cfc92211e9adadb3b
Sep 10 21:02:50.446350 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:50.446307    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6hq44" event={"ID":"7d550f5b-60e8-4061-93e1-31554eeca51a","Type":"ContainerStarted","Data":"7d3ded7b2dfc68f05adfce8be440c8acb3f600822ee3b50cfc92211e9adadb3b"}
Sep 10 21:02:50.447519 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:50.447492    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-n7v68" event={"ID":"c03f6a36-58f1-4148-bb58-fc5b7059f210","Type":"ContainerStarted","Data":"fd5afb1a378ac80ddae00dac440c5a4fab393304977bf2abd03a681bb80f071e"}
Sep 10 21:02:50.855214 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:50.855183    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:51.399334 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:51.398455    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f8c8876d7-db8x6"
Sep 10 21:02:51.466642 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:51.466612    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:51.469006 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:51.468978    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg"
Sep 10 21:02:54.090373 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:54.090351    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:02:54.091279 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:54.091201    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:02:54.103600 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:54.103585    2577 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 21:02:54.482495 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:54.482454    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-n7v68" event={"ID":"c03f6a36-58f1-4148-bb58-fc5b7059f210","Type":"ContainerStarted","Data":"0144fbfdaa7391f4d6fea3e93d097e9bc653458acc06328d8ef5f76f1462844d"}
Sep 10 21:02:54.482696 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:54.482681    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-n7v68"
Sep 10 21:02:54.483947 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:54.483921    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6hq44" event={"ID":"7d550f5b-60e8-4061-93e1-31554eeca51a","Type":"ContainerStarted","Data":"477fca03f5d48d6490c0ad758e8ed90c54124a84cec688ba40841e6f1cc2ca8d"}
Sep 10 21:02:54.484089 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:54.484075    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-6hq44"
Sep 10 21:02:54.512258 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:54.512208    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-n7v68" podStartSLOduration=1.512638558 podStartE2EDuration="5.512194177s" totalImagesPullingTime="3.999555619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:54.509618057 +0000 UTC m=+302.083324432" watchObservedRunningTime="2026-09-10 21:02:54.512194177 +0000 UTC m=+302.085900597"
Sep 10 21:02:54.535787 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:54.535748    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-6hq44" podStartSLOduration=2.574843138 podStartE2EDuration="6.535735437s" totalImagesPullingTime="3.960892299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:54.533549846 +0000 UTC m=+302.107256219" watchObservedRunningTime="2026-09-10 21:02:54.535735437 +0000 UTC m=+302.109441810"
Sep 10 21:02:55.363045 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.363002    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"]
Sep 10 21:02:55.395469 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.395443    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"]
Sep 10 21:02:55.395621 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.395531    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.398224 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.398201    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 21:02:55.398224 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.398211    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 21:02:55.398426 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.398204    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 21:02:55.398507 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.398429    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dh2tc\""
Sep 10 21:02:55.426866 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.426844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a095b41a-44b8-4831-910d-d7d314cc6c80-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.426999 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.426880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a095b41a-44b8-4831-910d-d7d314cc6c80-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.426999 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.426913    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a095b41a-44b8-4831-910d-d7d314cc6c80-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.426999 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.426957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a095b41a-44b8-4831-910d-d7d314cc6c80-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.427224 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.426994    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbtmn\" (UniqueName: \"kubernetes.io/projected/a095b41a-44b8-4831-910d-d7d314cc6c80-kube-api-access-xbtmn\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.427224 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.427080    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a095b41a-44b8-4831-910d-d7d314cc6c80-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.427224 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.427128    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a095b41a-44b8-4831-910d-d7d314cc6c80-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.527724 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.527693    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a095b41a-44b8-4831-910d-d7d314cc6c80-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.527860 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.527767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a095b41a-44b8-4831-910d-d7d314cc6c80-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.527928 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.527906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a095b41a-44b8-4831-910d-d7d314cc6c80-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.528066 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.528018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a095b41a-44b8-4831-910d-d7d314cc6c80-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.528211 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.528148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a095b41a-44b8-4831-910d-d7d314cc6c80-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.528211 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.528178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a095b41a-44b8-4831-910d-d7d314cc6c80-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.528331 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.528209    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbtmn\" (UniqueName: \"kubernetes.io/projected/a095b41a-44b8-4831-910d-d7d314cc6c80-kube-api-access-xbtmn\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.528587 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.528531    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a095b41a-44b8-4831-910d-d7d314cc6c80-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.530204 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.530178    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a095b41a-44b8-4831-910d-d7d314cc6c80-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.530292 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.530182    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a095b41a-44b8-4831-910d-d7d314cc6c80-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.530292 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.530284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a095b41a-44b8-4831-910d-d7d314cc6c80-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.530422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.530406    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a095b41a-44b8-4831-910d-d7d314cc6c80-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.535944 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.535926    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbtmn\" (UniqueName: \"kubernetes.io/projected/a095b41a-44b8-4831-910d-d7d314cc6c80-kube-api-access-xbtmn\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.536475 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.536455    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a095b41a-44b8-4831-910d-d7d314cc6c80-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2krmt\" (UID: \"a095b41a-44b8-4831-910d-d7d314cc6c80\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:55.705098 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:55.705016    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:56.031907 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:56.031873    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"]
Sep 10 21:02:56.032346 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:02:56.032320    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda095b41a_44b8_4831_910d_d7d314cc6c80.slice/crio-cdb488e6e332e1a0658cdb2695a5f60e124e586c2fb920bd37e6220f1b90a097 WatchSource:0}: Error finding container cdb488e6e332e1a0658cdb2695a5f60e124e586c2fb920bd37e6220f1b90a097: Status 404 returned error can't find the container with id cdb488e6e332e1a0658cdb2695a5f60e124e586c2fb920bd37e6220f1b90a097
Sep 10 21:02:56.034410 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:56.034389    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:02:56.494919 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:56.494874    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt" event={"ID":"a095b41a-44b8-4831-910d-d7d314cc6c80","Type":"ContainerStarted","Data":"cdb488e6e332e1a0658cdb2695a5f60e124e586c2fb920bd37e6220f1b90a097"}
Sep 10 21:02:58.472080 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:58.472043    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:02:58.472318 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:58.472115    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:02:59.514253 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:59.514217    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt" event={"ID":"a095b41a-44b8-4831-910d-d7d314cc6c80","Type":"ContainerStarted","Data":"6cdfaf2c2e7b2a9081d367f798481ce4ea1a5f229810d579583b862464c48a4c"}
Sep 10 21:02:59.514680 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:59.514268    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:59.516014 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:59.515989    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt"
Sep 10 21:02:59.537690 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:02:59.537631    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt" podStartSLOduration=2.100341302 podStartE2EDuration="4.537613124s" totalImagesPullingTime="2.437271822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:59.53660792 +0000 UTC m=+307.110314297" watchObservedRunningTime="2026-09-10 21:02:59.537613124 +0000 UTC m=+307.111319500"
Sep 10 21:03:05.491564 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:05.491537    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-6hq44"
Sep 10 21:03:05.493552 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:05.493531    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-n7v68"
Sep 10 21:03:53.449517 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.449443    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"]
Sep 10 21:03:53.452076 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.452059    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"
Sep 10 21:03:53.454252 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.454229    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:03:53.454252 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.454247    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:03:53.454921 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.454904    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w64cv\""
Sep 10 21:03:53.460754 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.460733    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"]
Sep 10 21:03:53.555997 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.555964    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"]
Sep 10 21:03:53.558546 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.558531    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"
Sep 10 21:03:53.567590 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.567564    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"]
Sep 10 21:03:53.607353 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.607329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/058ff96a-db51-41d8-bbd9-614301d74bec-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57\" (UID: \"058ff96a-db51-41d8-bbd9-614301d74bec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"
Sep 10 21:03:53.607464 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.607372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/058ff96a-db51-41d8-bbd9-614301d74bec-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57\" (UID: \"058ff96a-db51-41d8-bbd9-614301d74bec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"
Sep 10 21:03:53.607509 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.607465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgs95\" (UniqueName: \"kubernetes.io/projected/058ff96a-db51-41d8-bbd9-614301d74bec-kube-api-access-cgs95\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57\" (UID: \"058ff96a-db51-41d8-bbd9-614301d74bec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"
Sep 10 21:03:53.654900 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.654869    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"]
Sep 10 21:03:53.663560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.663538    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"
Sep 10 21:03:53.665765 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.665745    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"]
Sep 10 21:03:53.708085 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.708000    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgs95\" (UniqueName: \"kubernetes.io/projected/058ff96a-db51-41d8-bbd9-614301d74bec-kube-api-access-cgs95\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57\" (UID: \"058ff96a-db51-41d8-bbd9-614301d74bec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"
Sep 10 21:03:53.708178 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.708083    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49c4ba51-fca5-4c89-98f2-3befcccc382d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76\" (UID: \"49c4ba51-fca5-4c89-98f2-3befcccc382d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"
Sep 10 21:03:53.708178 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.708137    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzmhc\" (UniqueName: \"kubernetes.io/projected/49c4ba51-fca5-4c89-98f2-3befcccc382d-kube-api-access-tzmhc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76\" (UID: \"49c4ba51-fca5-4c89-98f2-3befcccc382d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"
Sep 10 21:03:53.708253 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.708210    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/058ff96a-db51-41d8-bbd9-614301d74bec-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57\" (UID: \"058ff96a-db51-41d8-bbd9-614301d74bec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"
Sep 10 21:03:53.708288 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.708249    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/058ff96a-db51-41d8-bbd9-614301d74bec-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57\" (UID: \"058ff96a-db51-41d8-bbd9-614301d74bec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"
Sep 10 21:03:53.708288 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.708274    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49c4ba51-fca5-4c89-98f2-3befcccc382d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76\" (UID: \"49c4ba51-fca5-4c89-98f2-3befcccc382d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"
Sep 10 21:03:53.708635 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.708617    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/058ff96a-db51-41d8-bbd9-614301d74bec-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57\" (UID: \"058ff96a-db51-41d8-bbd9-614301d74bec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"
Sep 10 21:03:53.708671 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.708631    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/058ff96a-db51-41d8-bbd9-614301d74bec-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57\" (UID: \"058ff96a-db51-41d8-bbd9-614301d74bec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"
Sep 10 21:03:53.715610 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.715592    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgs95\" (UniqueName: \"kubernetes.io/projected/058ff96a-db51-41d8-bbd9-614301d74bec-kube-api-access-cgs95\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57\" (UID: \"058ff96a-db51-41d8-bbd9-614301d74bec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"
Sep 10 21:03:53.749478 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.749456    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"]
Sep 10 21:03:53.752269 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.752255    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"
Sep 10 21:03:53.760947 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.760918    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"]
Sep 10 21:03:53.761750 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.761734    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"
Sep 10 21:03:53.808932 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.808897    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw\" (UID: \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"
Sep 10 21:03:53.809071 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.808984    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49c4ba51-fca5-4c89-98f2-3befcccc382d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76\" (UID: \"49c4ba51-fca5-4c89-98f2-3befcccc382d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"
Sep 10 21:03:53.809157 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.809087    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzccm\" (UniqueName: \"kubernetes.io/projected/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-kube-api-access-qzccm\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw\" (UID: \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"
Sep 10 21:03:53.809157 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.809124    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzmhc\" (UniqueName: \"kubernetes.io/projected/49c4ba51-fca5-4c89-98f2-3befcccc382d-kube-api-access-tzmhc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76\" (UID: \"49c4ba51-fca5-4c89-98f2-3befcccc382d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"
Sep 10 21:03:53.809269 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.809179    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw\" (UID: \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"
Sep 10 21:03:53.809269 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.809219    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49c4ba51-fca5-4c89-98f2-3befcccc382d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76\" (UID: \"49c4ba51-fca5-4c89-98f2-3befcccc382d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"
Sep 10 21:03:53.810440 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.810417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49c4ba51-fca5-4c89-98f2-3befcccc382d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76\" (UID: \"49c4ba51-fca5-4c89-98f2-3befcccc382d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"
Sep 10 21:03:53.810533 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.810463    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49c4ba51-fca5-4c89-98f2-3befcccc382d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76\" (UID: \"49c4ba51-fca5-4c89-98f2-3befcccc382d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"
Sep 10 21:03:53.821378 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.821350    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzmhc\" (UniqueName: \"kubernetes.io/projected/49c4ba51-fca5-4c89-98f2-3befcccc382d-kube-api-access-tzmhc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76\" (UID: \"49c4ba51-fca5-4c89-98f2-3befcccc382d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"
Sep 10 21:03:53.867815 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.867785    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"
Sep 10 21:03:53.910577 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.910540    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/994c11a1-4f0a-40d5-b155-b57abb08a74e-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8\" (UID: \"994c11a1-4f0a-40d5-b155-b57abb08a74e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"
Sep 10 21:03:53.910727 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.910590    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzccm\" (UniqueName: \"kubernetes.io/projected/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-kube-api-access-qzccm\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw\" (UID: \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"
Sep 10 21:03:53.910727 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.910615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxb8z\" (UniqueName: \"kubernetes.io/projected/994c11a1-4f0a-40d5-b155-b57abb08a74e-kube-api-access-zxb8z\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8\" (UID: \"994c11a1-4f0a-40d5-b155-b57abb08a74e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"
Sep 10 21:03:53.910727 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.910699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw\" (UID: \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"
Sep 10 21:03:53.910887 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.910844    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw\" (UID: \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"
Sep 10 21:03:53.910940 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.910885    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/994c11a1-4f0a-40d5-b155-b57abb08a74e-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8\" (UID: \"994c11a1-4f0a-40d5-b155-b57abb08a74e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"
Sep 10 21:03:53.911056 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.911024    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw\" (UID: \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"
Sep 10 21:03:53.911163 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.911150    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw\" (UID: \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"
Sep 10 21:03:53.924191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.924164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzccm\" (UniqueName: \"kubernetes.io/projected/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-kube-api-access-qzccm\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw\" (UID: \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"
Sep 10 21:03:53.972738 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:53.972672    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"
Sep 10 21:03:54.012412 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.012374    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/994c11a1-4f0a-40d5-b155-b57abb08a74e-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8\" (UID: \"994c11a1-4f0a-40d5-b155-b57abb08a74e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"
Sep 10 21:03:54.012634 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.012487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/994c11a1-4f0a-40d5-b155-b57abb08a74e-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8\" (UID: \"994c11a1-4f0a-40d5-b155-b57abb08a74e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"
Sep 10 21:03:54.012634 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.012527    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxb8z\" (UniqueName: \"kubernetes.io/projected/994c11a1-4f0a-40d5-b155-b57abb08a74e-kube-api-access-zxb8z\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8\" (UID: \"994c11a1-4f0a-40d5-b155-b57abb08a74e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"
Sep 10 21:03:54.012835 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.012816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/994c11a1-4f0a-40d5-b155-b57abb08a74e-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8\" (UID: \"994c11a1-4f0a-40d5-b155-b57abb08a74e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"
Sep 10 21:03:54.012894 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.012844    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/994c11a1-4f0a-40d5-b155-b57abb08a74e-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8\" (UID: \"994c11a1-4f0a-40d5-b155-b57abb08a74e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"
Sep 10 21:03:54.021518 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.021492    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxb8z\" (UniqueName: \"kubernetes.io/projected/994c11a1-4f0a-40d5-b155-b57abb08a74e-kube-api-access-zxb8z\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8\" (UID: \"994c11a1-4f0a-40d5-b155-b57abb08a74e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"
Sep 10 21:03:54.031695 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.031672    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"]
Sep 10 21:03:54.033708 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:03:54.033682    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058ff96a_db51_41d8_bbd9_614301d74bec.slice/crio-0b58f84eec5ad24371fc5c9c0f1d07017556174378fb027c6e1422516d524ae1 WatchSource:0}: Error finding container 0b58f84eec5ad24371fc5c9c0f1d07017556174378fb027c6e1422516d524ae1: Status 404 returned error can't find the container with id 0b58f84eec5ad24371fc5c9c0f1d07017556174378fb027c6e1422516d524ae1
Sep 10 21:03:54.063014 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.062991    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"
Sep 10 21:03:54.141109 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.141077    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"]
Sep 10 21:03:54.142984 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:03:54.142960    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c4ba51_fca5_4c89_98f2_3befcccc382d.slice/crio-932dd14ea2661fb50669839cefaa5ce1c9b1d0388560d48c683cdeff20f515c5 WatchSource:0}: Error finding container 932dd14ea2661fb50669839cefaa5ce1c9b1d0388560d48c683cdeff20f515c5: Status 404 returned error can't find the container with id 932dd14ea2661fb50669839cefaa5ce1c9b1d0388560d48c683cdeff20f515c5
Sep 10 21:03:54.246240 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.246213    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"]
Sep 10 21:03:54.247523 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:03:54.247499    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod052231a1_8c4d_4c60_8b53_6ec72d47a6c2.slice/crio-9ce9f3338815db557e017829023004366de609450c62300a8e879e38a5d24959 WatchSource:0}: Error finding container 9ce9f3338815db557e017829023004366de609450c62300a8e879e38a5d24959: Status 404 returned error can't find the container with id 9ce9f3338815db557e017829023004366de609450c62300a8e879e38a5d24959
Sep 10 21:03:54.334429 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.334406    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"]
Sep 10 21:03:54.342606 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:03:54.342582    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994c11a1_4f0a_40d5_b155_b57abb08a74e.slice/crio-dc1e08c4735279a1b70474460156c2e88ef87e98df4df51c6a4953cbf9743148 WatchSource:0}: Error finding container dc1e08c4735279a1b70474460156c2e88ef87e98df4df51c6a4953cbf9743148: Status 404 returned error can't find the container with id dc1e08c4735279a1b70474460156c2e88ef87e98df4df51c6a4953cbf9743148
Sep 10 21:03:54.799042 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.798995    2577 generic.go:356] "Generic (PLEG): container finished" podID="058ff96a-db51-41d8-bbd9-614301d74bec" containerID="4272528740ebd90d5803d89ed300d272f3cfe8a7cc548f16dd7a27a295d308e8" exitCode=0
Sep 10 21:03:54.799491 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.799061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57" event={"ID":"058ff96a-db51-41d8-bbd9-614301d74bec","Type":"ContainerDied","Data":"4272528740ebd90d5803d89ed300d272f3cfe8a7cc548f16dd7a27a295d308e8"}
Sep 10 21:03:54.799491 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.799124    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57" event={"ID":"058ff96a-db51-41d8-bbd9-614301d74bec","Type":"ContainerStarted","Data":"0b58f84eec5ad24371fc5c9c0f1d07017556174378fb027c6e1422516d524ae1"}
Sep 10 21:03:54.800686 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.800645    2577 generic.go:356] "Generic (PLEG): container finished" podID="49c4ba51-fca5-4c89-98f2-3befcccc382d" containerID="ce81f8781d040f50532271867bcb60a48bcc735e8f77dc386d62c6f4216af380" exitCode=0
Sep 10 21:03:54.800743 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.800726    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76" event={"ID":"49c4ba51-fca5-4c89-98f2-3befcccc382d","Type":"ContainerDied","Data":"ce81f8781d040f50532271867bcb60a48bcc735e8f77dc386d62c6f4216af380"}
Sep 10 21:03:54.800801 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.800770    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76" event={"ID":"49c4ba51-fca5-4c89-98f2-3befcccc382d","Type":"ContainerStarted","Data":"932dd14ea2661fb50669839cefaa5ce1c9b1d0388560d48c683cdeff20f515c5"}
Sep 10 21:03:54.802331 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.802311    2577 generic.go:356] "Generic (PLEG): container finished" podID="994c11a1-4f0a-40d5-b155-b57abb08a74e" containerID="dc13421e1f2be7fe94a48c7fa35fa329f42b97b512b4388feb34a037bd984dc0" exitCode=0
Sep 10 21:03:54.802416 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.802393    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8" event={"ID":"994c11a1-4f0a-40d5-b155-b57abb08a74e","Type":"ContainerDied","Data":"dc13421e1f2be7fe94a48c7fa35fa329f42b97b512b4388feb34a037bd984dc0"}
Sep 10 21:03:54.802466 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.802429    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8" event={"ID":"994c11a1-4f0a-40d5-b155-b57abb08a74e","Type":"ContainerStarted","Data":"dc1e08c4735279a1b70474460156c2e88ef87e98df4df51c6a4953cbf9743148"}
Sep 10 21:03:54.804114 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.804095    2577 generic.go:356] "Generic (PLEG): container finished" podID="052231a1-8c4d-4c60-8b53-6ec72d47a6c2" containerID="90a6d2d75672240ab7e512c3efc9f4055b6968fe201494650044de169ad86d92" exitCode=0
Sep 10 21:03:54.804192 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.804138    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw" event={"ID":"052231a1-8c4d-4c60-8b53-6ec72d47a6c2","Type":"ContainerDied","Data":"90a6d2d75672240ab7e512c3efc9f4055b6968fe201494650044de169ad86d92"}
Sep 10 21:03:54.804192 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:54.804169    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw" event={"ID":"052231a1-8c4d-4c60-8b53-6ec72d47a6c2","Type":"ContainerStarted","Data":"9ce9f3338815db557e017829023004366de609450c62300a8e879e38a5d24959"}
Sep 10 21:03:55.810897 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:55.810853    2577 generic.go:356] "Generic (PLEG): container finished" podID="49c4ba51-fca5-4c89-98f2-3befcccc382d" containerID="bb8624e87a6b618d59f9a98900eccf806fe0c9f1472a6693e21a2a5967fe81ac" exitCode=0
Sep 10 21:03:55.811268 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:55.810905    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76" event={"ID":"49c4ba51-fca5-4c89-98f2-3befcccc382d","Type":"ContainerDied","Data":"bb8624e87a6b618d59f9a98900eccf806fe0c9f1472a6693e21a2a5967fe81ac"}
Sep 10 21:03:56.818760 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:56.818727    2577 generic.go:356] "Generic (PLEG): container finished" podID="49c4ba51-fca5-4c89-98f2-3befcccc382d" containerID="11edc8036b058f10f5cd574f8570c86f7f0973f467090b2807deb65da8777e84" exitCode=0
Sep 10 21:03:56.819185 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:56.818812    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76" event={"ID":"49c4ba51-fca5-4c89-98f2-3befcccc382d","Type":"ContainerDied","Data":"11edc8036b058f10f5cd574f8570c86f7f0973f467090b2807deb65da8777e84"}
Sep 10 21:03:56.820685 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:56.820663    2577 generic.go:356] "Generic (PLEG): container finished" podID="994c11a1-4f0a-40d5-b155-b57abb08a74e" containerID="cf94ae9165a7afa41b614df94bbe04fd650597b9e04383ba265267db43db1c8b" exitCode=0
Sep 10 21:03:56.820817 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:56.820722    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8" event={"ID":"994c11a1-4f0a-40d5-b155-b57abb08a74e","Type":"ContainerDied","Data":"cf94ae9165a7afa41b614df94bbe04fd650597b9e04383ba265267db43db1c8b"}
Sep 10 21:03:56.822646 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:56.822617    2577 generic.go:356] "Generic (PLEG): container finished" podID="052231a1-8c4d-4c60-8b53-6ec72d47a6c2" containerID="76a66ed86027bb1b953a05b14360fd56fcab6e3ebf616d1a038683c48755903c" exitCode=0
Sep 10 21:03:56.822722 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:56.822700    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw" event={"ID":"052231a1-8c4d-4c60-8b53-6ec72d47a6c2","Type":"ContainerDied","Data":"76a66ed86027bb1b953a05b14360fd56fcab6e3ebf616d1a038683c48755903c"}
Sep 10 21:03:56.824703 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:56.824679    2577 generic.go:356] "Generic (PLEG): container finished" podID="058ff96a-db51-41d8-bbd9-614301d74bec" containerID="41ec991cc584b4d1de482930b9d92635573e5dd75812acde75f3de5075ca2d8d" exitCode=0
Sep 10 21:03:56.824785 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:56.824734    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57" event={"ID":"058ff96a-db51-41d8-bbd9-614301d74bec","Type":"ContainerDied","Data":"41ec991cc584b4d1de482930b9d92635573e5dd75812acde75f3de5075ca2d8d"}
Sep 10 21:03:57.832397 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:57.832365    2577 generic.go:356] "Generic (PLEG): container finished" podID="994c11a1-4f0a-40d5-b155-b57abb08a74e" containerID="d2481e1372422c82c47e9dd7f78702be31c1164c3ea67cd8a38fdb4c6f58b5c2" exitCode=0
Sep 10 21:03:57.832792 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:57.832440    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8" event={"ID":"994c11a1-4f0a-40d5-b155-b57abb08a74e","Type":"ContainerDied","Data":"d2481e1372422c82c47e9dd7f78702be31c1164c3ea67cd8a38fdb4c6f58b5c2"}
Sep 10 21:03:57.834573 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:57.834546    2577 generic.go:356] "Generic (PLEG): container finished" podID="052231a1-8c4d-4c60-8b53-6ec72d47a6c2" containerID="51689b808cde4aadac86a2b07e438248386a38422d5be5ec16748b969d97b13a" exitCode=0
Sep 10 21:03:57.834680 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:57.834629    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw" event={"ID":"052231a1-8c4d-4c60-8b53-6ec72d47a6c2","Type":"ContainerDied","Data":"51689b808cde4aadac86a2b07e438248386a38422d5be5ec16748b969d97b13a"}
Sep 10 21:03:57.836741 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:57.836722    2577 generic.go:356] "Generic (PLEG): container finished" podID="058ff96a-db51-41d8-bbd9-614301d74bec" containerID="6f468a5af1d67a8e935607ad261f6a0b7a869c1c28d84a031c7493371396bbe4" exitCode=0
Sep 10 21:03:57.836828 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:57.836780    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57" event={"ID":"058ff96a-db51-41d8-bbd9-614301d74bec","Type":"ContainerDied","Data":"6f468a5af1d67a8e935607ad261f6a0b7a869c1c28d84a031c7493371396bbe4"}
Sep 10 21:03:57.965653 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:57.965630    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"
Sep 10 21:03:58.050963 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:58.050935    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49c4ba51-fca5-4c89-98f2-3befcccc382d-util\") pod \"49c4ba51-fca5-4c89-98f2-3befcccc382d\" (UID: \"49c4ba51-fca5-4c89-98f2-3befcccc382d\") "
Sep 10 21:03:58.050963 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:58.050966    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzmhc\" (UniqueName: \"kubernetes.io/projected/49c4ba51-fca5-4c89-98f2-3befcccc382d-kube-api-access-tzmhc\") pod \"49c4ba51-fca5-4c89-98f2-3befcccc382d\" (UID: \"49c4ba51-fca5-4c89-98f2-3befcccc382d\") "
Sep 10 21:03:58.051180 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:58.050997    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49c4ba51-fca5-4c89-98f2-3befcccc382d-bundle\") pod \"49c4ba51-fca5-4c89-98f2-3befcccc382d\" (UID: \"49c4ba51-fca5-4c89-98f2-3befcccc382d\") "
Sep 10 21:03:58.051457 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:58.051427    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49c4ba51-fca5-4c89-98f2-3befcccc382d-bundle" (OuterVolumeSpecName: "bundle") pod "49c4ba51-fca5-4c89-98f2-3befcccc382d" (UID: "49c4ba51-fca5-4c89-98f2-3befcccc382d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:03:58.053007 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:58.052977    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49c4ba51-fca5-4c89-98f2-3befcccc382d-kube-api-access-tzmhc" (OuterVolumeSpecName: "kube-api-access-tzmhc") pod "49c4ba51-fca5-4c89-98f2-3befcccc382d" (UID: "49c4ba51-fca5-4c89-98f2-3befcccc382d"). InnerVolumeSpecName "kube-api-access-tzmhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:03:58.056280 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:58.056252    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49c4ba51-fca5-4c89-98f2-3befcccc382d-util" (OuterVolumeSpecName: "util") pod "49c4ba51-fca5-4c89-98f2-3befcccc382d" (UID: "49c4ba51-fca5-4c89-98f2-3befcccc382d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:03:58.152077 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:58.151991    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49c4ba51-fca5-4c89-98f2-3befcccc382d-util\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:03:58.152077 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:58.152013    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzmhc\" (UniqueName: \"kubernetes.io/projected/49c4ba51-fca5-4c89-98f2-3befcccc382d-kube-api-access-tzmhc\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:03:58.152077 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:58.152021    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49c4ba51-fca5-4c89-98f2-3befcccc382d-bundle\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:03:58.844369 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:58.844337    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76"
Sep 10 21:03:58.844742 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:58.844378    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhx76" event={"ID":"49c4ba51-fca5-4c89-98f2-3befcccc382d","Type":"ContainerDied","Data":"932dd14ea2661fb50669839cefaa5ce1c9b1d0388560d48c683cdeff20f515c5"}
Sep 10 21:03:58.844742 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:58.844458    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="932dd14ea2661fb50669839cefaa5ce1c9b1d0388560d48c683cdeff20f515c5"
Sep 10 21:03:58.997595 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:58.997570    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"
Sep 10 21:03:59.027701 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.027675    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"
Sep 10 21:03:59.030631 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.030611    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"
Sep 10 21:03:59.057583 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.057556    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/994c11a1-4f0a-40d5-b155-b57abb08a74e-bundle\") pod \"994c11a1-4f0a-40d5-b155-b57abb08a74e\" (UID: \"994c11a1-4f0a-40d5-b155-b57abb08a74e\") "
Sep 10 21:03:59.057675 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.057599    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/994c11a1-4f0a-40d5-b155-b57abb08a74e-util\") pod \"994c11a1-4f0a-40d5-b155-b57abb08a74e\" (UID: \"994c11a1-4f0a-40d5-b155-b57abb08a74e\") "
Sep 10 21:03:59.057675 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.057638    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/058ff96a-db51-41d8-bbd9-614301d74bec-bundle\") pod \"058ff96a-db51-41d8-bbd9-614301d74bec\" (UID: \"058ff96a-db51-41d8-bbd9-614301d74bec\") "
Sep 10 21:03:59.057675 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.057664    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzccm\" (UniqueName: \"kubernetes.io/projected/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-kube-api-access-qzccm\") pod \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\" (UID: \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\") "
Sep 10 21:03:59.057797 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.057717    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/058ff96a-db51-41d8-bbd9-614301d74bec-util\") pod \"058ff96a-db51-41d8-bbd9-614301d74bec\" (UID: \"058ff96a-db51-41d8-bbd9-614301d74bec\") "
Sep 10 21:03:59.057797 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.057745    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgs95\" (UniqueName: \"kubernetes.io/projected/058ff96a-db51-41d8-bbd9-614301d74bec-kube-api-access-cgs95\") pod \"058ff96a-db51-41d8-bbd9-614301d74bec\" (UID: \"058ff96a-db51-41d8-bbd9-614301d74bec\") "
Sep 10 21:03:59.057797 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.057775    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-util\") pod \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\" (UID: \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\") "
Sep 10 21:03:59.057949 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.057801    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxb8z\" (UniqueName: \"kubernetes.io/projected/994c11a1-4f0a-40d5-b155-b57abb08a74e-kube-api-access-zxb8z\") pod \"994c11a1-4f0a-40d5-b155-b57abb08a74e\" (UID: \"994c11a1-4f0a-40d5-b155-b57abb08a74e\") "
Sep 10 21:03:59.057949 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.057864    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-bundle\") pod \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\" (UID: \"052231a1-8c4d-4c60-8b53-6ec72d47a6c2\") "
Sep 10 21:03:59.062306 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.058485    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058ff96a-db51-41d8-bbd9-614301d74bec-bundle" (OuterVolumeSpecName: "bundle") pod "058ff96a-db51-41d8-bbd9-614301d74bec" (UID: "058ff96a-db51-41d8-bbd9-614301d74bec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:03:59.062306 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.059004    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/058ff96a-db51-41d8-bbd9-614301d74bec-bundle\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:03:59.062306 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.059719    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-bundle" (OuterVolumeSpecName: "bundle") pod "052231a1-8c4d-4c60-8b53-6ec72d47a6c2" (UID: "052231a1-8c4d-4c60-8b53-6ec72d47a6c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:03:59.062306 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.060472    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/994c11a1-4f0a-40d5-b155-b57abb08a74e-bundle" (OuterVolumeSpecName: "bundle") pod "994c11a1-4f0a-40d5-b155-b57abb08a74e" (UID: "994c11a1-4f0a-40d5-b155-b57abb08a74e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:03:59.064955 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.064074    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-kube-api-access-qzccm" (OuterVolumeSpecName: "kube-api-access-qzccm") pod "052231a1-8c4d-4c60-8b53-6ec72d47a6c2" (UID: "052231a1-8c4d-4c60-8b53-6ec72d47a6c2"). InnerVolumeSpecName "kube-api-access-qzccm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:03:59.064955 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.064148    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/994c11a1-4f0a-40d5-b155-b57abb08a74e-kube-api-access-zxb8z" (OuterVolumeSpecName: "kube-api-access-zxb8z") pod "994c11a1-4f0a-40d5-b155-b57abb08a74e" (UID: "994c11a1-4f0a-40d5-b155-b57abb08a74e"). InnerVolumeSpecName "kube-api-access-zxb8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:03:59.065934 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.065845    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/058ff96a-db51-41d8-bbd9-614301d74bec-kube-api-access-cgs95" (OuterVolumeSpecName: "kube-api-access-cgs95") pod "058ff96a-db51-41d8-bbd9-614301d74bec" (UID: "058ff96a-db51-41d8-bbd9-614301d74bec"). InnerVolumeSpecName "kube-api-access-cgs95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:03:59.066968 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.066945    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/994c11a1-4f0a-40d5-b155-b57abb08a74e-util" (OuterVolumeSpecName: "util") pod "994c11a1-4f0a-40d5-b155-b57abb08a74e" (UID: "994c11a1-4f0a-40d5-b155-b57abb08a74e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:03:59.067082 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.066969    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058ff96a-db51-41d8-bbd9-614301d74bec-util" (OuterVolumeSpecName: "util") pod "058ff96a-db51-41d8-bbd9-614301d74bec" (UID: "058ff96a-db51-41d8-bbd9-614301d74bec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:03:59.068576 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.068550    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-util" (OuterVolumeSpecName: "util") pod "052231a1-8c4d-4c60-8b53-6ec72d47a6c2" (UID: "052231a1-8c4d-4c60-8b53-6ec72d47a6c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:03:59.159983 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.159916    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/994c11a1-4f0a-40d5-b155-b57abb08a74e-bundle\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:03:59.159983 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.159941    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/994c11a1-4f0a-40d5-b155-b57abb08a74e-util\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:03:59.159983 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.159951    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzccm\" (UniqueName: \"kubernetes.io/projected/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-kube-api-access-qzccm\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:03:59.159983 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.159960    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/058ff96a-db51-41d8-bbd9-614301d74bec-util\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:03:59.159983 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.159969    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgs95\" (UniqueName: \"kubernetes.io/projected/058ff96a-db51-41d8-bbd9-614301d74bec-kube-api-access-cgs95\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:03:59.159983 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.159977    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-util\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:03:59.159983 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.159986    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxb8z\" (UniqueName: \"kubernetes.io/projected/994c11a1-4f0a-40d5-b155-b57abb08a74e-kube-api-access-zxb8z\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:03:59.160297 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.159994    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/052231a1-8c4d-4c60-8b53-6ec72d47a6c2-bundle\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:03:59.851069 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.851023    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57"
Sep 10 21:03:59.851069 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.851053    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxzv57" event={"ID":"058ff96a-db51-41d8-bbd9-614301d74bec","Type":"ContainerDied","Data":"0b58f84eec5ad24371fc5c9c0f1d07017556174378fb027c6e1422516d524ae1"}
Sep 10 21:03:59.851527 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.851106    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b58f84eec5ad24371fc5c9c0f1d07017556174378fb027c6e1422516d524ae1"
Sep 10 21:03:59.853012 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.852990    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8" event={"ID":"994c11a1-4f0a-40d5-b155-b57abb08a74e","Type":"ContainerDied","Data":"dc1e08c4735279a1b70474460156c2e88ef87e98df4df51c6a4953cbf9743148"}
Sep 10 21:03:59.853012 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.853003    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6sgx8"
Sep 10 21:03:59.853159 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.853043    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc1e08c4735279a1b70474460156c2e88ef87e98df4df51c6a4953cbf9743148"
Sep 10 21:03:59.854862 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.854843    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw" event={"ID":"052231a1-8c4d-4c60-8b53-6ec72d47a6c2","Type":"ContainerDied","Data":"9ce9f3338815db557e017829023004366de609450c62300a8e879e38a5d24959"}
Sep 10 21:03:59.854862 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.854857    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b7clw"
Sep 10 21:03:59.854986 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:03:59.854875    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ce9f3338815db557e017829023004366de609450c62300a8e879e38a5d24959"
Sep 10 21:04:47.333641 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:04:47.333608    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bd674fd88-8284t"]
Sep 10 21:05:12.355280 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.355236    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bd674fd88-8284t" podUID="7c93f2a3-8042-4ad4-92c6-c37331c4de0f" containerName="console" containerID="cri-o://529e69b9e890d42c8e32718d4c2d341f4152e4717c07f937b183c754a22c136c" gracePeriod=15
Sep 10 21:05:12.599808 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.599781    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:05:12.669893 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.669821    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-oauth-config\") pod \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") "
Sep 10 21:05:12.669893 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.669856    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-serving-cert\") pod \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") "
Sep 10 21:05:12.669893 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.669879    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-config\") pod \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") "
Sep 10 21:05:12.670185 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.669959    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-trusted-ca-bundle\") pod \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") "
Sep 10 21:05:12.670185 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.669981    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-service-ca\") pod \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") "
Sep 10 21:05:12.670185 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.670073    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-oauth-serving-cert\") pod \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") "
Sep 10 21:05:12.670185 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.670100    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmhdq\" (UniqueName: \"kubernetes.io/projected/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-kube-api-access-pmhdq\") pod \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\" (UID: \"7c93f2a3-8042-4ad4-92c6-c37331c4de0f\") "
Sep 10 21:05:12.670411 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.670387    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7c93f2a3-8042-4ad4-92c6-c37331c4de0f" (UID: "7c93f2a3-8042-4ad4-92c6-c37331c4de0f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:05:12.670483 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.670447    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-service-ca" (OuterVolumeSpecName: "service-ca") pod "7c93f2a3-8042-4ad4-92c6-c37331c4de0f" (UID: "7c93f2a3-8042-4ad4-92c6-c37331c4de0f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:05:12.670551 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.670449    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7c93f2a3-8042-4ad4-92c6-c37331c4de0f" (UID: "7c93f2a3-8042-4ad4-92c6-c37331c4de0f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:05:12.670697 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.670672    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-config" (OuterVolumeSpecName: "console-config") pod "7c93f2a3-8042-4ad4-92c6-c37331c4de0f" (UID: "7c93f2a3-8042-4ad4-92c6-c37331c4de0f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:05:12.672013 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.671983    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7c93f2a3-8042-4ad4-92c6-c37331c4de0f" (UID: "7c93f2a3-8042-4ad4-92c6-c37331c4de0f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:05:12.672194 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.672172    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-kube-api-access-pmhdq" (OuterVolumeSpecName: "kube-api-access-pmhdq") pod "7c93f2a3-8042-4ad4-92c6-c37331c4de0f" (UID: "7c93f2a3-8042-4ad4-92c6-c37331c4de0f"). InnerVolumeSpecName "kube-api-access-pmhdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:05:12.672296 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.672271    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7c93f2a3-8042-4ad4-92c6-c37331c4de0f" (UID: "7c93f2a3-8042-4ad4-92c6-c37331c4de0f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:05:12.771350 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.771316    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-trusted-ca-bundle\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:05:12.771350 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.771344    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:05:12.771350 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.771354    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-oauth-serving-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:05:12.771579 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.771363    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmhdq\" (UniqueName: \"kubernetes.io/projected/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-kube-api-access-pmhdq\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:05:12.771579 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.771372    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-oauth-config\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:05:12.771579 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.771380    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-serving-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:05:12.771579 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:12.771387    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c93f2a3-8042-4ad4-92c6-c37331c4de0f-console-config\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:05:13.233963 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.233879    2577 generic.go:356] "Generic (PLEG): container finished" podID="7c93f2a3-8042-4ad4-92c6-c37331c4de0f" containerID="529e69b9e890d42c8e32718d4c2d341f4152e4717c07f937b183c754a22c136c" exitCode=0
Sep 10 21:05:13.233963 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.233919    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd674fd88-8284t"
Sep 10 21:05:13.234158 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.233971    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd674fd88-8284t" event={"ID":"7c93f2a3-8042-4ad4-92c6-c37331c4de0f","Type":"ContainerDied","Data":"529e69b9e890d42c8e32718d4c2d341f4152e4717c07f937b183c754a22c136c"}
Sep 10 21:05:13.234158 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.234017    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd674fd88-8284t" event={"ID":"7c93f2a3-8042-4ad4-92c6-c37331c4de0f","Type":"ContainerDied","Data":"03401c980dcb8e97b8e97666955cc0d8b8711c1be8ee24ff15566070beb59b1a"}
Sep 10 21:05:13.234158 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.234061    2577 scope.go:117] "RemoveContainer" containerID="529e69b9e890d42c8e32718d4c2d341f4152e4717c07f937b183c754a22c136c"
Sep 10 21:05:13.244911 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.244893    2577 scope.go:117] "RemoveContainer" containerID="529e69b9e890d42c8e32718d4c2d341f4152e4717c07f937b183c754a22c136c"
Sep 10 21:05:13.245336 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:05:13.245318    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"529e69b9e890d42c8e32718d4c2d341f4152e4717c07f937b183c754a22c136c\": container with ID starting with 529e69b9e890d42c8e32718d4c2d341f4152e4717c07f937b183c754a22c136c not found: ID does not exist" containerID="529e69b9e890d42c8e32718d4c2d341f4152e4717c07f937b183c754a22c136c"
Sep 10 21:05:13.245402 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.245344    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"529e69b9e890d42c8e32718d4c2d341f4152e4717c07f937b183c754a22c136c"} err="failed to get container status \"529e69b9e890d42c8e32718d4c2d341f4152e4717c07f937b183c754a22c136c\": rpc error: code = NotFound desc = could not find container \"529e69b9e890d42c8e32718d4c2d341f4152e4717c07f937b183c754a22c136c\": container with ID starting with 529e69b9e890d42c8e32718d4c2d341f4152e4717c07f937b183c754a22c136c not found: ID does not exist"
Sep 10 21:05:13.252483 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.252462    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bd674fd88-8284t"]
Sep 10 21:05:13.256452 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.256431    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bd674fd88-8284t"]
Sep 10 21:05:13.742600 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.742569    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:05:13.742967 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.742928    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="994c11a1-4f0a-40d5-b155-b57abb08a74e" containerName="extract"
Sep 10 21:05:13.742967 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.742939    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="994c11a1-4f0a-40d5-b155-b57abb08a74e" containerName="extract"
Sep 10 21:05:13.742967 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.742948    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="058ff96a-db51-41d8-bbd9-614301d74bec" containerName="extract"
Sep 10 21:05:13.742967 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.742954    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="058ff96a-db51-41d8-bbd9-614301d74bec" containerName="extract"
Sep 10 21:05:13.742967 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.742964    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c93f2a3-8042-4ad4-92c6-c37331c4de0f" containerName="console"
Sep 10 21:05:13.742967 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.742969    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c93f2a3-8042-4ad4-92c6-c37331c4de0f" containerName="console"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.742978    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="058ff96a-db51-41d8-bbd9-614301d74bec" containerName="util"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.742983    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="058ff96a-db51-41d8-bbd9-614301d74bec" containerName="util"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.742995    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c4ba51-fca5-4c89-98f2-3befcccc382d" containerName="pull"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743000    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c4ba51-fca5-4c89-98f2-3befcccc382d" containerName="pull"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743009    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c4ba51-fca5-4c89-98f2-3befcccc382d" containerName="util"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743013    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c4ba51-fca5-4c89-98f2-3befcccc382d" containerName="util"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743018    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c4ba51-fca5-4c89-98f2-3befcccc382d" containerName="extract"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743024    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c4ba51-fca5-4c89-98f2-3befcccc382d" containerName="extract"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743047    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="058ff96a-db51-41d8-bbd9-614301d74bec" containerName="pull"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743052    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="058ff96a-db51-41d8-bbd9-614301d74bec" containerName="pull"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743058    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="994c11a1-4f0a-40d5-b155-b57abb08a74e" containerName="pull"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743062    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="994c11a1-4f0a-40d5-b155-b57abb08a74e" containerName="pull"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743068    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="994c11a1-4f0a-40d5-b155-b57abb08a74e" containerName="util"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743073    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="994c11a1-4f0a-40d5-b155-b57abb08a74e" containerName="util"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743079    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="052231a1-8c4d-4c60-8b53-6ec72d47a6c2" containerName="extract"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743084    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="052231a1-8c4d-4c60-8b53-6ec72d47a6c2" containerName="extract"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743091    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="052231a1-8c4d-4c60-8b53-6ec72d47a6c2" containerName="pull"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743095    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="052231a1-8c4d-4c60-8b53-6ec72d47a6c2" containerName="pull"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743102    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="052231a1-8c4d-4c60-8b53-6ec72d47a6c2" containerName="util"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743106    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="052231a1-8c4d-4c60-8b53-6ec72d47a6c2" containerName="util"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743160    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="052231a1-8c4d-4c60-8b53-6ec72d47a6c2" containerName="extract"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743166    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="058ff96a-db51-41d8-bbd9-614301d74bec" containerName="extract"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743173    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c93f2a3-8042-4ad4-92c6-c37331c4de0f" containerName="console"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743180    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="994c11a1-4f0a-40d5-b155-b57abb08a74e" containerName="extract"
Sep 10 21:05:13.743191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.743187    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="49c4ba51-fca5-4c89-98f2-3befcccc382d" containerName="extract"
Sep 10 21:05:13.747722 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.747705    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"
Sep 10 21:05:13.750119 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.750096    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 21:05:13.750255 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.750148    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-45qt5\""
Sep 10 21:05:13.750255 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.750153    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 21:05:13.750255 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.750155    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 21:05:13.757653 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.757631    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:05:13.769709 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.769684    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:05:13.779426 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.779396    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st968\" (UniqueName: \"kubernetes.io/projected/d02c1cda-bf71-43b9-b2b3-2ccec0e292d1-kube-api-access-st968\") pod \"limitador-limitador-84994f7ffc-fxcd4\" (UID: \"d02c1cda-bf71-43b9-b2b3-2ccec0e292d1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"
Sep 10 21:05:13.779518 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.779454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d02c1cda-bf71-43b9-b2b3-2ccec0e292d1-config-file\") pod \"limitador-limitador-84994f7ffc-fxcd4\" (UID: \"d02c1cda-bf71-43b9-b2b3-2ccec0e292d1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"
Sep 10 21:05:13.880604 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.880569    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st968\" (UniqueName: \"kubernetes.io/projected/d02c1cda-bf71-43b9-b2b3-2ccec0e292d1-kube-api-access-st968\") pod \"limitador-limitador-84994f7ffc-fxcd4\" (UID: \"d02c1cda-bf71-43b9-b2b3-2ccec0e292d1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"
Sep 10 21:05:13.880729 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.880616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d02c1cda-bf71-43b9-b2b3-2ccec0e292d1-config-file\") pod \"limitador-limitador-84994f7ffc-fxcd4\" (UID: \"d02c1cda-bf71-43b9-b2b3-2ccec0e292d1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"
Sep 10 21:05:13.881237 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.881220    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d02c1cda-bf71-43b9-b2b3-2ccec0e292d1-config-file\") pod \"limitador-limitador-84994f7ffc-fxcd4\" (UID: \"d02c1cda-bf71-43b9-b2b3-2ccec0e292d1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"
Sep 10 21:05:13.888132 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:13.888113    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st968\" (UniqueName: \"kubernetes.io/projected/d02c1cda-bf71-43b9-b2b3-2ccec0e292d1-kube-api-access-st968\") pod \"limitador-limitador-84994f7ffc-fxcd4\" (UID: \"d02c1cda-bf71-43b9-b2b3-2ccec0e292d1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"
Sep 10 21:05:14.059168 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:14.059084    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"
Sep 10 21:05:14.326103 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:14.326077    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:05:14.327945 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:05:14.327921    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02c1cda_bf71_43b9_b2b3_2ccec0e292d1.slice/crio-ea5c097d0794e087043e310b9bee50ca1fb4cf2925bb43326cdeb63cfae3b30e WatchSource:0}: Error finding container ea5c097d0794e087043e310b9bee50ca1fb4cf2925bb43326cdeb63cfae3b30e: Status 404 returned error can't find the container with id ea5c097d0794e087043e310b9bee50ca1fb4cf2925bb43326cdeb63cfae3b30e
Sep 10 21:05:14.946621 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:14.946587    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c93f2a3-8042-4ad4-92c6-c37331c4de0f" path="/var/lib/kubelet/pods/7c93f2a3-8042-4ad4-92c6-c37331c4de0f/volumes"
Sep 10 21:05:15.249007 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:15.248850    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fxcd4" event={"ID":"d02c1cda-bf71-43b9-b2b3-2ccec0e292d1","Type":"ContainerStarted","Data":"ea5c097d0794e087043e310b9bee50ca1fb4cf2925bb43326cdeb63cfae3b30e"}
Sep 10 21:05:17.262123 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:17.262091    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fxcd4" event={"ID":"d02c1cda-bf71-43b9-b2b3-2ccec0e292d1","Type":"ContainerStarted","Data":"a19dcad64d40444c59cb2edfd68337953c25997532e68f9271a2d5365f304e53"}
Sep 10 21:05:17.262508 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:17.262223    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"
Sep 10 21:05:17.278340 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:17.278296    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-fxcd4" podStartSLOduration=1.931827525 podStartE2EDuration="4.278282993s" totalImagesPullingTime="2.346455468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:17.276892654 +0000 UTC m=+444.850599040" watchObservedRunningTime="2026-09-10 21:05:17.278282993 +0000 UTC m=+444.851989367"
Sep 10 21:05:28.268868 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:05:28.268833    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"
Sep 10 21:06:25.378287 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:06:25.378252    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:06:52.959133 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:06:52.959065    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:06:59.564131 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:06:59.564093    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:07:10.057733 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:10.057698    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:07:18.554404 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:18.554364    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:07:25.156370 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.156328    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"]
Sep 10 21:07:25.159798 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.159777    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.162129 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.162101    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 21:07:25.162319 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.162147    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 21:07:25.162319 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.162105    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 21:07:25.162319 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.162225    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mtwrf\""
Sep 10 21:07:25.170432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.170392    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"]
Sep 10 21:07:25.282343 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.282305    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ce864a0-5584-45dd-bab5-19367a78a44a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.282568 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.282361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ce864a0-5584-45dd-bab5-19367a78a44a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.282568 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.282427    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7qhq\" (UniqueName: \"kubernetes.io/projected/6ce864a0-5584-45dd-bab5-19367a78a44a-kube-api-access-j7qhq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.282568 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.282488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ce864a0-5584-45dd-bab5-19367a78a44a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.282568 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.282528    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ce864a0-5584-45dd-bab5-19367a78a44a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.282568 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.282565    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ce864a0-5584-45dd-bab5-19367a78a44a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.383364 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.383319    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7qhq\" (UniqueName: \"kubernetes.io/projected/6ce864a0-5584-45dd-bab5-19367a78a44a-kube-api-access-j7qhq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.383558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.383378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ce864a0-5584-45dd-bab5-19367a78a44a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.383558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.383408    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ce864a0-5584-45dd-bab5-19367a78a44a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.383558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.383435    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ce864a0-5584-45dd-bab5-19367a78a44a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.383558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.383474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ce864a0-5584-45dd-bab5-19367a78a44a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.383558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.383531    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ce864a0-5584-45dd-bab5-19367a78a44a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.383896 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.383863    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ce864a0-5584-45dd-bab5-19367a78a44a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.383896 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.383889    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ce864a0-5584-45dd-bab5-19367a78a44a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.384128 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.383965    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ce864a0-5584-45dd-bab5-19367a78a44a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.385829 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.385809    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ce864a0-5584-45dd-bab5-19367a78a44a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.386154 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.386134    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ce864a0-5584-45dd-bab5-19367a78a44a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.391209 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.391175    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7qhq\" (UniqueName: \"kubernetes.io/projected/6ce864a0-5584-45dd-bab5-19367a78a44a-kube-api-access-j7qhq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t\" (UID: \"6ce864a0-5584-45dd-bab5-19367a78a44a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.472562 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.472462    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:25.743313 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.743286    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"]
Sep 10 21:07:25.745060 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:07:25.745014    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce864a0_5584_45dd_bab5_19367a78a44a.slice/crio-2e3dfebd25a179917179efa358dbc06f714e013124cfafbada9a03dac103747b WatchSource:0}: Error finding container 2e3dfebd25a179917179efa358dbc06f714e013124cfafbada9a03dac103747b: Status 404 returned error can't find the container with id 2e3dfebd25a179917179efa358dbc06f714e013124cfafbada9a03dac103747b
Sep 10 21:07:25.950958 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:25.950913    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t" event={"ID":"6ce864a0-5584-45dd-bab5-19367a78a44a","Type":"ContainerStarted","Data":"2e3dfebd25a179917179efa358dbc06f714e013124cfafbada9a03dac103747b"}
Sep 10 21:07:26.961324 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:26.961229    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:07:26.961324 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:26.961295    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t" event={"ID":"6ce864a0-5584-45dd-bab5-19367a78a44a","Type":"ContainerStarted","Data":"4aa0ea837613fb250c2ceafb3a2939f09cf59d43b6b686a02fc1029f065b5c60"}
Sep 10 21:07:26.978929 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:26.978872    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t" podStartSLOduration=1.029693391 podStartE2EDuration="1.978852751s" totalImagesPullingTime="949.15936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:07:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:07:26.976486694 +0000 UTC m=+574.550193067" watchObservedRunningTime="2026-09-10 21:07:26.978852751 +0000 UTC m=+574.552559124"
Sep 10 21:07:35.472913 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:35.472870    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:35.473434 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:35.472933    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:35.485482 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:35.485449    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:36.020928 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:36.020897    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t"
Sep 10 21:07:45.368210 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:45.368170    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:07:54.131110 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:54.131083    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:07:54.133460 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:54.131334    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:07:59.467338 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:07:59.467306    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:09:19.059611 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:19.059572    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:09:25.185481 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.185450    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"]
Sep 10 21:09:25.189105 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.189084    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.191298 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.191278    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0827ee43-openshift-default-dockercfg-kw4ml\""
Sep 10 21:09:25.200180 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.200158    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"]
Sep 10 21:09:25.349182 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.349146    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-credential-socket\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.349182 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.349192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-podinfo\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.349398 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.349213    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-token\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.349398 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.349295    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-data\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.349398 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.349343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-envoy\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.349398 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.349378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istiod-ca-cert\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.349577 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.349402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-workload-socket\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.349577 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.349517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-workload-certs\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.349577 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.349539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55f7v\" (UniqueName: \"kubernetes.io/projected/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-kube-api-access-55f7v\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.450510 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.450401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-workload-certs\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.450510 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.450443    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55f7v\" (UniqueName: \"kubernetes.io/projected/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-kube-api-access-55f7v\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.450746 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.450577    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-credential-socket\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.450746 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.450630    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-podinfo\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.450746 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.450654    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-token\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.450746 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.450677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-data\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.450746 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.450706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-envoy\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.450746 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.450747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istiod-ca-cert\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.450998 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.450781    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-workload-socket\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.453269 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.451473    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-data\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.453269 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.452005    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-workload-socket\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.461596 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.454535    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-podinfo\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.461596 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.459044    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-token\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.461596 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.459243    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55f7v\" (UniqueName: \"kubernetes.io/projected/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-kube-api-access-55f7v\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.462383 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.462340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istiod-ca-cert\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.462853 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.462749    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-workload-certs\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.462934 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.462827    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-credential-socket\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.464737 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.464677    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-envoy\") pod \"e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") " pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.500349 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.500323    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:25.781861 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.781835    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"]
Sep 10 21:09:25.783858 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:09:25.783830    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb0eb13_46f2_4235_9f4b_f124e77c4d66.slice/crio-e1e5743570619411e8fdfb7440f95879e4587fc366218b41e155e426ff9d0b2c WatchSource:0}: Error finding container e1e5743570619411e8fdfb7440f95879e4587fc366218b41e155e426ff9d0b2c: Status 404 returned error can't find the container with id e1e5743570619411e8fdfb7440f95879e4587fc366218b41e155e426ff9d0b2c
Sep 10 21:09:25.786091 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.786002    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:09:25.786157 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.786130    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:09:25.786201 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.786166    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:09:25.819276 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.819242    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"]
Sep 10 21:09:25.824210 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.824191    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.826522 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.826503    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-94604f-openshift-default-dockercfg-xqvtp\""
Sep 10 21:09:25.836546 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.836516    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"]
Sep 10 21:09:25.866109 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.866073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-envoy\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.866253 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.866112    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-data\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.866253 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.866142    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbc2j\" (UniqueName: \"kubernetes.io/projected/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-kube-api-access-rbc2j\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.866253 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.866201    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-token\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.866395 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.866255    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-workload-certs\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.866395 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.866308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-credential-socket\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.866395 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.866323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-podinfo\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.866395 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.866337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istiod-ca-cert\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.866395 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.866367    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-workload-socket\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.967217 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.967183    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-envoy\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.967217 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.967224    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-data\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.967470 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.967246    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbc2j\" (UniqueName: \"kubernetes.io/projected/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-kube-api-access-rbc2j\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.967470 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.967272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-token\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.967470 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.967300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-workload-certs\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.967470 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.967356    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-credential-socket\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.967470 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.967378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-podinfo\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.967470 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.967405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istiod-ca-cert\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.967470 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.967439    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-workload-socket\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.967825 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.967695    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-data\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.967825 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.967727    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-workload-socket\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.967993 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.967954    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-credential-socket\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.968473 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.968426    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-workload-certs\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.968659 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.968630    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istiod-ca-cert\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.970134 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.970111    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-envoy\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.970410 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.970387    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-podinfo\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.975069 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.975022    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-token\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:25.975244 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:25.975225    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbc2j\" (UniqueName: \"kubernetes.io/projected/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-kube-api-access-rbc2j\") pod \"e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") " pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:26.144141 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:26.144102    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:26.419621 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:26.419592    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"]
Sep 10 21:09:26.420818 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:09:26.420791    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c6c3c50_82c1_4a8f_b95f_ebca8e3a2099.slice/crio-010e1bff935a4483a7860e856a3ee90bc0f87b7cfa930aeb7401feb7ca9a5c9e WatchSource:0}: Error finding container 010e1bff935a4483a7860e856a3ee90bc0f87b7cfa930aeb7401feb7ca9a5c9e: Status 404 returned error can't find the container with id 010e1bff935a4483a7860e856a3ee90bc0f87b7cfa930aeb7401feb7ca9a5c9e
Sep 10 21:09:26.423096 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:26.423061    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:09:26.423194 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:26.423147    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:09:26.423273 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:26.423194    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:09:26.600862 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:26.600590    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" event={"ID":"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099","Type":"ContainerStarted","Data":"d8ea4a8ea7e96fc9f4ef1978142c4e7ffa01193f56e0bfc844f1963731798df4"}
Sep 10 21:09:26.600862 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:26.600669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" event={"ID":"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099","Type":"ContainerStarted","Data":"010e1bff935a4483a7860e856a3ee90bc0f87b7cfa930aeb7401feb7ca9a5c9e"}
Sep 10 21:09:26.602548 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:26.602522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz" event={"ID":"3eb0eb13-46f2-4235-9f4b-f124e77c4d66","Type":"ContainerStarted","Data":"91c28e27c33c8dc8230cab6c78eda51466195af9384f3e96d0eaafea5d7ca745"}
Sep 10 21:09:26.602688 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:26.602574    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz" event={"ID":"3eb0eb13-46f2-4235-9f4b-f124e77c4d66","Type":"ContainerStarted","Data":"e1e5743570619411e8fdfb7440f95879e4587fc366218b41e155e426ff9d0b2c"}
Sep 10 21:09:26.621561 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:26.621505    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" podStartSLOduration=1.621457116 podStartE2EDuration="1.621457116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:26.618728347 +0000 UTC m=+694.192434722" watchObservedRunningTime="2026-09-10 21:09:26.621457116 +0000 UTC m=+694.195163480"
Sep 10 21:09:26.639852 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:26.639792    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz" podStartSLOduration=1.6397713999999999 podStartE2EDuration="1.6397714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:26.635882952 +0000 UTC m=+694.209589327" watchObservedRunningTime="2026-09-10 21:09:26.6397714 +0000 UTC m=+694.213477777"
Sep 10 21:09:27.144899 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:27.144868    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:27.146568 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:27.146538    2577 patch_prober.go:28] interesting pod/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 21:09:27.146698 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:27.146615    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 21:09:27.500713 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:27.500626    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:27.505787 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:27.505764    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:27.608495 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:27.608454    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:27.609383 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:27.609365    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:28.148576 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:28.148542    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:28.614568 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:28.614533    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:28.615347 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:28.615327    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:30.673930 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:30.673896    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:09:40.274166 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.274130    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"]
Sep 10 21:09:40.277939 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.277921    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.280350 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.280328    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-267aa8ed-kserve-self-signed-certs\""
Sep 10 21:09:40.285742 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.285721    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"]
Sep 10 21:09:40.401236 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.401202    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-dshm\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.401236 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.401241    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-home\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.401473 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.401258    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-tmp-dir\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.401473 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.401376    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-model-cache\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.401473 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.401406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68075ec7-cf6c-43fd-9741-c7dfda3202e8-tls-certs\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.401473 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.401437    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd25p\" (UniqueName: \"kubernetes.io/projected/68075ec7-cf6c-43fd-9741-c7dfda3202e8-kube-api-access-gd25p\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.502782 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.502750    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-dshm\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.502782 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.502788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-home\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.503013 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.502807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-tmp-dir\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.503013 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.502850    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-model-cache\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.503013 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.502870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68075ec7-cf6c-43fd-9741-c7dfda3202e8-tls-certs\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.503013 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.502902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd25p\" (UniqueName: \"kubernetes.io/projected/68075ec7-cf6c-43fd-9741-c7dfda3202e8-kube-api-access-gd25p\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.503305 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.503263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-home\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.503305 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.503303    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-model-cache\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.503452 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.503379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-tmp-dir\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.505196 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.505174    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-dshm\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.505404 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.505387    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68075ec7-cf6c-43fd-9741-c7dfda3202e8-tls-certs\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.511790 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.511758    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd25p\" (UniqueName: \"kubernetes.io/projected/68075ec7-cf6c-43fd-9741-c7dfda3202e8-kube-api-access-gd25p\") pod \"e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") " pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.587603 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.587573    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:40.899737 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:40.899709    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"]
Sep 10 21:09:40.901156 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:09:40.901130    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68075ec7_cf6c_43fd_9741_c7dfda3202e8.slice/crio-15a8e9483000044746afcdfab45783a43f6323f7038b9bc342d57dab4b78a8b4 WatchSource:0}: Error finding container 15a8e9483000044746afcdfab45783a43f6323f7038b9bc342d57dab4b78a8b4: Status 404 returned error can't find the container with id 15a8e9483000044746afcdfab45783a43f6323f7038b9bc342d57dab4b78a8b4
Sep 10 21:09:41.693515 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:41.693477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8" event={"ID":"68075ec7-cf6c-43fd-9741-c7dfda3202e8","Type":"ContainerStarted","Data":"5317d4c31c18d8fc647db0d5e1a955156cb1da67ce6e5b2884c42cefce669c2a"}
Sep 10 21:09:41.693907 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:41.693524    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8" event={"ID":"68075ec7-cf6c-43fd-9741-c7dfda3202e8","Type":"ContainerStarted","Data":"15a8e9483000044746afcdfab45783a43f6323f7038b9bc342d57dab4b78a8b4"}
Sep 10 21:09:41.714431 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:41.714370    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8" podStartSLOduration=1.714350131 podStartE2EDuration="1.714350131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:41.710412925 +0000 UTC m=+709.284119294" watchObservedRunningTime="2026-09-10 21:09:41.714350131 +0000 UTC m=+709.288056508"
Sep 10 21:09:48.273363 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:48.273318    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:09:49.753637 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:49.753600    2577 generic.go:356] "Generic (PLEG): container finished" podID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerID="91c28e27c33c8dc8230cab6c78eda51466195af9384f3e96d0eaafea5d7ca745" exitCode=0
Sep 10 21:09:49.754166 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:49.753677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz" event={"ID":"3eb0eb13-46f2-4235-9f4b-f124e77c4d66","Type":"ContainerDied","Data":"91c28e27c33c8dc8230cab6c78eda51466195af9384f3e96d0eaafea5d7ca745"}
Sep 10 21:09:49.754280 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:49.754262    2577 scope.go:117] "RemoveContainer" containerID="91c28e27c33c8dc8230cab6c78eda51466195af9384f3e96d0eaafea5d7ca745"
Sep 10 21:09:49.755412 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:49.755392    2577 generic.go:356] "Generic (PLEG): container finished" podID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerID="d8ea4a8ea7e96fc9f4ef1978142c4e7ffa01193f56e0bfc844f1963731798df4" exitCode=0
Sep 10 21:09:49.755528 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:49.755403    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:09:49.755528 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:49.755490    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:09:49.755528 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:49.755420    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" event={"ID":"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099","Type":"ContainerDied","Data":"d8ea4a8ea7e96fc9f4ef1978142c4e7ffa01193f56e0bfc844f1963731798df4"}
Sep 10 21:09:49.755696 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:49.755537    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:09:49.755858 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:49.755843    2577 scope.go:117] "RemoveContainer" containerID="d8ea4a8ea7e96fc9f4ef1978142c4e7ffa01193f56e0bfc844f1963731798df4"
Sep 10 21:09:49.756898 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:49.756872    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:09:49.756998 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:49.756946    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:09:49.757084 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:49.756993    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:09:50.588036 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.587995    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:50.588268 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.588085    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:50.601156 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.601127    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:50.601295 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.601176    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"]
Sep 10 21:09:50.603578 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.603563    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"
Sep 10 21:09:50.605804 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.605790    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-69dcc8-dockercfg-c8vmw\""
Sep 10 21:09:50.605858 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.605790    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-69dcc8\""
Sep 10 21:09:50.631201 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.631167    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"]
Sep 10 21:09:50.733762 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.733725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdgjq\" (UniqueName: \"kubernetes.io/projected/85593305-ebbc-481c-ac0d-e7a1de2c75f9-kube-api-access-pdgjq\") pod \"payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6\" (UID: \"85593305-ebbc-481c-ac0d-e7a1de2c75f9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"
Sep 10 21:09:50.734826 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.734795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85593305-ebbc-481c-ac0d-e7a1de2c75f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6\" (UID: \"85593305-ebbc-481c-ac0d-e7a1de2c75f9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"
Sep 10 21:09:50.770008 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.769971    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" event={"ID":"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099","Type":"ContainerStarted","Data":"a35fe760d3af60aa3f6b2ef9b8ab6a4c8f79fe7eb7add801032f30672778657c"}
Sep 10 21:09:50.772199 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.772176    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz" event={"ID":"3eb0eb13-46f2-4235-9f4b-f124e77c4d66","Type":"ContainerStarted","Data":"52dbfcde199f727c93cce214be89942545559e8f4230a6a661dca7883022ff94"}
Sep 10 21:09:50.783842 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.783817    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:09:50.836053 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.835762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdgjq\" (UniqueName: \"kubernetes.io/projected/85593305-ebbc-481c-ac0d-e7a1de2c75f9-kube-api-access-pdgjq\") pod \"payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6\" (UID: \"85593305-ebbc-481c-ac0d-e7a1de2c75f9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"
Sep 10 21:09:50.836053 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.835888    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85593305-ebbc-481c-ac0d-e7a1de2c75f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6\" (UID: \"85593305-ebbc-481c-ac0d-e7a1de2c75f9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"
Sep 10 21:09:50.840094 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.839856    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85593305-ebbc-481c-ac0d-e7a1de2c75f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6\" (UID: \"85593305-ebbc-481c-ac0d-e7a1de2c75f9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"
Sep 10 21:09:50.861097 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.860888    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdgjq\" (UniqueName: \"kubernetes.io/projected/85593305-ebbc-481c-ac0d-e7a1de2c75f9-kube-api-access-pdgjq\") pod \"payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6\" (UID: \"85593305-ebbc-481c-ac0d-e7a1de2c75f9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"
Sep 10 21:09:50.930998 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:50.929180    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"
Sep 10 21:09:51.146115 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:51.145465    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:51.146115 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:51.145597    2577 patch_prober.go:28] interesting pod/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 21:09:51.146115 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:51.145642    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 21:09:51.241051 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:51.240809    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"]
Sep 10 21:09:51.261242 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:51.261214    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:09:51.500901 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:51.500781    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:51.501070 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:51.500947    2577 patch_prober.go:28] interesting pod/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 10 21:09:51.501070 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:51.500991    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz" podUID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 10 21:09:51.781291 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:51.781206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6" event={"ID":"85593305-ebbc-481c-ac0d-e7a1de2c75f9","Type":"ContainerStarted","Data":"c66b5e88d0d8ced9b69bf9f8cc374c9873c0bd349f2be24e69e09a246764f364"}
Sep 10 21:09:52.145358 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:52.144875    2577 patch_prober.go:28] interesting pod/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 21:09:52.145358 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:52.144940    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 21:09:52.501704 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:52.501615    2577 patch_prober.go:28] interesting pod/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 10 21:09:52.501704 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:52.501685    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz" podUID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 10 21:09:53.148063 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:53.145448    2577 patch_prober.go:28] interesting pod/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 21:09:53.148063 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:53.145526    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 21:09:53.394917 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:53.394878    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks"]
Sep 10 21:09:53.397509 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:53.397492    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks"
Sep 10 21:09:53.399714 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:53.399648    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:09:53.400270 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:53.400157    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:09:53.414539 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:53.414514    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks"]
Sep 10 21:09:53.475897 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:53.475852    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/230f69a8-29e8-4214-b7a9-0a7c8edf9f30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks\" (UID: \"230f69a8-29e8-4214-b7a9-0a7c8edf9f30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks"
Sep 10 21:09:53.501187 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:53.501144    2577 patch_prober.go:28] interesting pod/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 10 21:09:53.501355 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:53.501205    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz" podUID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 10 21:09:53.576623 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:53.576586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/230f69a8-29e8-4214-b7a9-0a7c8edf9f30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks\" (UID: \"230f69a8-29e8-4214-b7a9-0a7c8edf9f30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks"
Sep 10 21:09:53.577248 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:53.577228    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/230f69a8-29e8-4214-b7a9-0a7c8edf9f30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks\" (UID: \"230f69a8-29e8-4214-b7a9-0a7c8edf9f30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks"
Sep 10 21:09:53.728528 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:53.728188    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks"
Sep 10 21:09:54.161055 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:54.147414    2577 patch_prober.go:28] interesting pod/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 21:09:54.161055 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:54.147502    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 21:09:54.280195 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:54.280171    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks"]
Sep 10 21:09:54.282671 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:09:54.282448    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230f69a8_29e8_4214_b7a9_0a7c8edf9f30.slice/crio-fd4028a7fd8bea1bce475b621c6e259863002789a611a79f2ba495784ac0dcbc WatchSource:0}: Error finding container fd4028a7fd8bea1bce475b621c6e259863002789a611a79f2ba495784ac0dcbc: Status 404 returned error can't find the container with id fd4028a7fd8bea1bce475b621c6e259863002789a611a79f2ba495784ac0dcbc
Sep 10 21:09:54.501393 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:54.501361    2577 patch_prober.go:28] interesting pod/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 10 21:09:54.501563 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:54.501418    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz" podUID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 10 21:09:54.803753 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:54.803713    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks" event={"ID":"230f69a8-29e8-4214-b7a9-0a7c8edf9f30","Type":"ContainerStarted","Data":"fd4028a7fd8bea1bce475b621c6e259863002789a611a79f2ba495784ac0dcbc"}
Sep 10 21:09:54.805335 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:54.805307    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6" event={"ID":"85593305-ebbc-481c-ac0d-e7a1de2c75f9","Type":"ContainerStarted","Data":"bbb90408c8f0bbb2d91f2267cf2cf29916daa0d1ad7f163d53d19559a92bcebe"}
Sep 10 21:09:54.805495 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:54.805473    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"
Sep 10 21:09:54.822717 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:54.822650    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6" podStartSLOduration=2.082314584 podStartE2EDuration="4.822628907s" totalImagesPullingTime="2.740314323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:54.820799989 +0000 UTC m=+722.394506364" watchObservedRunningTime="2026-09-10 21:09:54.822628907 +0000 UTC m=+722.396335282"
Sep 10 21:09:55.147053 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:55.146432    2577 patch_prober.go:28] interesting pod/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 21:09:55.147053 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:55.146517    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 21:09:55.500890 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:55.500806    2577 patch_prober.go:28] interesting pod/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 10 21:09:55.500890 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:55.500869    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz" podUID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 10 21:09:56.348115 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:56.348080    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:56.349058 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:56.349000    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:56.354771 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:56.354744    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:09:56.505779 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:56.505755    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:56.506230 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:56.506214    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:56.507107 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:56.507082    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:09:57.843088 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:57.843061    2577 generic.go:356] "Generic (PLEG): container finished" podID="230f69a8-29e8-4214-b7a9-0a7c8edf9f30" containerID="4fa9dc5d64dec33ae523b0543868e3ef782111723f7f76d1c923bcab8103f975" exitCode=0
Sep 10 21:09:57.843467 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:57.843144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks" event={"ID":"230f69a8-29e8-4214-b7a9-0a7c8edf9f30","Type":"ContainerDied","Data":"4fa9dc5d64dec33ae523b0543868e3ef782111723f7f76d1c923bcab8103f975"}
Sep 10 21:09:58.983419 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:58.983395    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks"
Sep 10 21:09:59.132367 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:59.132289    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/230f69a8-29e8-4214-b7a9-0a7c8edf9f30-maas-api-service-ca\") pod \"230f69a8-29e8-4214-b7a9-0a7c8edf9f30\" (UID: \"230f69a8-29e8-4214-b7a9-0a7c8edf9f30\") "
Sep 10 21:09:59.132611 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:59.132589    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/230f69a8-29e8-4214-b7a9-0a7c8edf9f30-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "230f69a8-29e8-4214-b7a9-0a7c8edf9f30" (UID: "230f69a8-29e8-4214-b7a9-0a7c8edf9f30"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:09:59.233170 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:59.233138    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/230f69a8-29e8-4214-b7a9-0a7c8edf9f30-maas-api-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:09:59.856370 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:59.856338    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks"
Sep 10 21:09:59.856370 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:59.856345    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks" event={"ID":"230f69a8-29e8-4214-b7a9-0a7c8edf9f30","Type":"ContainerDied","Data":"fd4028a7fd8bea1bce475b621c6e259863002789a611a79f2ba495784ac0dcbc"}
Sep 10 21:09:59.856633 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:09:59.856391    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd4028a7fd8bea1bce475b621c6e259863002789a611a79f2ba495784ac0dcbc"
Sep 10 21:10:03.368116 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:03.368076    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:10:05.832200 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:05.832166    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"
Sep 10 21:10:10.285249 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:10.285209    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks"]
Sep 10 21:10:10.290636 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:10.290610    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0827ee43-6s4ks"]
Sep 10 21:10:10.404402 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:10.404368    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"]
Sep 10 21:10:10.404656 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:10.404602    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz" podUID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerName="istio-proxy" containerID="cri-o://52dbfcde199f727c93cce214be89942545559e8f4230a6a661dca7883022ff94" gracePeriod=30
Sep 10 21:10:10.946991 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:10.946956    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="230f69a8-29e8-4214-b7a9-0a7c8edf9f30" path="/var/lib/kubelet/pods/230f69a8-29e8-4214-b7a9-0a7c8edf9f30/volumes"
Sep 10 21:10:11.362069 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.362011    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"]
Sep 10 21:10:11.362461 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.362445    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="230f69a8-29e8-4214-b7a9-0a7c8edf9f30" containerName="revoke-keys"
Sep 10 21:10:11.362461 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.362459    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="230f69a8-29e8-4214-b7a9-0a7c8edf9f30" containerName="revoke-keys"
Sep 10 21:10:11.362556 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.362549    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="230f69a8-29e8-4214-b7a9-0a7c8edf9f30" containerName="revoke-keys"
Sep 10 21:10:11.365511 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.365491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.367606 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.367588    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c2ec79e5-gw-openshift-default-dockercfg-7c968\""
Sep 10 21:10:11.380210 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.380182    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"]
Sep 10 21:10:11.450246 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.450209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-workload-certs\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.450422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.450253    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-credential-socket\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.450422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.450332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-podinfo\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.450422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.450365    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-workload-socket\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.450422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.450387    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q526\" (UniqueName: \"kubernetes.io/projected/1a0b4309-4f60-42e3-ae48-b30242cff085-kube-api-access-4q526\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.450422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.450417    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0b4309-4f60-42e3-ae48-b30242cff085-istiod-ca-cert\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.450725 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.450441    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-data\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.450725 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.450456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-token\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.450725 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.450486    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-envoy\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.508131 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.508094    2577 patch_prober.go:28] interesting pod/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:10:11.508267 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.508165    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz" podUID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:10:11.551441 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.551412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-podinfo\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.551610 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.551453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-workload-socket\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.551610 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.551478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q526\" (UniqueName: \"kubernetes.io/projected/1a0b4309-4f60-42e3-ae48-b30242cff085-kube-api-access-4q526\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.551610 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.551518    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0b4309-4f60-42e3-ae48-b30242cff085-istiod-ca-cert\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.551610 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.551545    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-data\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.551610 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.551567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-token\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.551610 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.551600    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-envoy\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.551930 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.551652    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-workload-certs\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.551930 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.551699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-credential-socket\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.552069 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.551958    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-data\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.552131 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.552064    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-credential-socket\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.552196 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.552154    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-workload-socket\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.552253 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.552221    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-workload-certs\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.552389 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.552364    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0b4309-4f60-42e3-ae48-b30242cff085-istiod-ca-cert\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.554019 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.553995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-envoy\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.554130 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.554115    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-podinfo\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.561697 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.561672    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-token\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.561830 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.561808    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q526\" (UniqueName: \"kubernetes.io/projected/1a0b4309-4f60-42e3-ae48-b30242cff085-kube-api-access-4q526\") pod \"e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") " pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.675975 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.675889    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:11.956148 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.956120    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"]
Sep 10 21:10:11.957519 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:10:11.957482    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a0b4309_4f60_42e3_ae48_b30242cff085.slice/crio-c1c7087786f5b902031d529773589d56d432910ac4e1be4e979d052308db6c68 WatchSource:0}: Error finding container c1c7087786f5b902031d529773589d56d432910ac4e1be4e979d052308db6c68: Status 404 returned error can't find the container with id c1c7087786f5b902031d529773589d56d432910ac4e1be4e979d052308db6c68
Sep 10 21:10:11.959686 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.959650    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:10:11.959788 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.959719    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:10:11.959788 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:11.959746    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:10:12.939382 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:12.939345    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69" event={"ID":"1a0b4309-4f60-42e3-ae48-b30242cff085","Type":"ContainerStarted","Data":"56c1f2ab58350364b8ca723100f4af0cb92538ee187c7933ec9d24a84a248160"}
Sep 10 21:10:12.939749 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:12.939404    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69" event={"ID":"1a0b4309-4f60-42e3-ae48-b30242cff085","Type":"ContainerStarted","Data":"c1c7087786f5b902031d529773589d56d432910ac4e1be4e979d052308db6c68"}
Sep 10 21:10:12.961149 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:12.961097    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69" podStartSLOduration=1.961081845 podStartE2EDuration="1.961081845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:10:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:10:12.958536961 +0000 UTC m=+740.532243337" watchObservedRunningTime="2026-09-10 21:10:12.961081845 +0000 UTC m=+740.534788218"
Sep 10 21:10:13.676538 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:13.676495    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:13.681985 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:13.681955    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:13.944869 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:13.944794    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:13.945738 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:13.945716    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:15.275325 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.275286    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"]
Sep 10 21:10:15.277814 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.277797    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"
Sep 10 21:10:15.280083 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.280060    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-c2ec79e5\""
Sep 10 21:10:15.280305 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.280288    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-c2ec79e5-dockercfg-gsmgw\""
Sep 10 21:10:15.287353 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.287323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcpdc\" (UniqueName: \"kubernetes.io/projected/2d23c043-714b-4e8b-b51c-a95b97660919-kube-api-access-wcpdc\") pod \"payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk\" (UID: \"2d23c043-714b-4e8b-b51c-a95b97660919\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"
Sep 10 21:10:15.287540 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.287517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d23c043-714b-4e8b-b51c-a95b97660919-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk\" (UID: \"2d23c043-714b-4e8b-b51c-a95b97660919\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"
Sep 10 21:10:15.288918 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.288895    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"]
Sep 10 21:10:15.388158 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.388116    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d23c043-714b-4e8b-b51c-a95b97660919-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk\" (UID: \"2d23c043-714b-4e8b-b51c-a95b97660919\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"
Sep 10 21:10:15.388342 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.388182    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcpdc\" (UniqueName: \"kubernetes.io/projected/2d23c043-714b-4e8b-b51c-a95b97660919-kube-api-access-wcpdc\") pod \"payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk\" (UID: \"2d23c043-714b-4e8b-b51c-a95b97660919\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"
Sep 10 21:10:15.388819 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.388795    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d23c043-714b-4e8b-b51c-a95b97660919-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk\" (UID: \"2d23c043-714b-4e8b-b51c-a95b97660919\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"
Sep 10 21:10:15.396014 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.395982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcpdc\" (UniqueName: \"kubernetes.io/projected/2d23c043-714b-4e8b-b51c-a95b97660919-kube-api-access-wcpdc\") pod \"payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk\" (UID: \"2d23c043-714b-4e8b-b51c-a95b97660919\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"
Sep 10 21:10:15.590610 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.590560    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"
Sep 10 21:10:15.657187 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.657161    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:10:15.691328 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.691305    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-workload-certs\") pod \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") "
Sep 10 21:10:15.691462 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.691347    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55f7v\" (UniqueName: \"kubernetes.io/projected/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-kube-api-access-55f7v\") pod \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") "
Sep 10 21:10:15.691462 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.691375    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-workload-socket\") pod \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") "
Sep 10 21:10:15.691462 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.691409    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-token\") pod \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") "
Sep 10 21:10:15.691462 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.691450    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-data\") pod \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") "
Sep 10 21:10:15.691596 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.691465    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-credential-socket\") pod \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") "
Sep 10 21:10:15.691596 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.691484    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-podinfo\") pod \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") "
Sep 10 21:10:15.691596 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.691508    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-envoy\") pod \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") "
Sep 10 21:10:15.691596 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.691536    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istiod-ca-cert\") pod \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\" (UID: \"3eb0eb13-46f2-4235-9f4b-f124e77c4d66\") "
Sep 10 21:10:15.691596 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.691552    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3eb0eb13-46f2-4235-9f4b-f124e77c4d66" (UID: "3eb0eb13-46f2-4235-9f4b-f124e77c4d66"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:15.692017 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.691683    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-data" (OuterVolumeSpecName: "istio-data") pod "3eb0eb13-46f2-4235-9f4b-f124e77c4d66" (UID: "3eb0eb13-46f2-4235-9f4b-f124e77c4d66"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:15.692017 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.691749    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-workload-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:15.692017 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.691761    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-data\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:15.692317 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.692288    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3eb0eb13-46f2-4235-9f4b-f124e77c4d66" (UID: "3eb0eb13-46f2-4235-9f4b-f124e77c4d66"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:15.692455 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.692432    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3eb0eb13-46f2-4235-9f4b-f124e77c4d66" (UID: "3eb0eb13-46f2-4235-9f4b-f124e77c4d66"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:15.692526 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.692495    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3eb0eb13-46f2-4235-9f4b-f124e77c4d66" (UID: "3eb0eb13-46f2-4235-9f4b-f124e77c4d66"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:10:15.694253 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.694224    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3eb0eb13-46f2-4235-9f4b-f124e77c4d66" (UID: "3eb0eb13-46f2-4235-9f4b-f124e77c4d66"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:15.694253 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.694235    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-token" (OuterVolumeSpecName: "istio-token") pod "3eb0eb13-46f2-4235-9f4b-f124e77c4d66" (UID: "3eb0eb13-46f2-4235-9f4b-f124e77c4d66"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:10:15.694371 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.694318    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-kube-api-access-55f7v" (OuterVolumeSpecName: "kube-api-access-55f7v") pod "3eb0eb13-46f2-4235-9f4b-f124e77c4d66" (UID: "3eb0eb13-46f2-4235-9f4b-f124e77c4d66"). InnerVolumeSpecName "kube-api-access-55f7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:10:15.694550 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.694527    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3eb0eb13-46f2-4235-9f4b-f124e77c4d66" (UID: "3eb0eb13-46f2-4235-9f4b-f124e77c4d66"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:10:15.792721 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.792693    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55f7v\" (UniqueName: \"kubernetes.io/projected/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-kube-api-access-55f7v\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:15.792721 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.792717    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-workload-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:15.792865 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.792728    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-token\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:15.792865 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.792737    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-credential-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:15.792865 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.792745    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-podinfo\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:15.792865 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.792755    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istio-envoy\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:15.792865 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.792763    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0eb13-46f2-4235-9f4b-f124e77c4d66-istiod-ca-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:15.879886 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.879864    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"]
Sep 10 21:10:15.880838 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:10:15.880817    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d23c043_714b_4e8b_b51c_a95b97660919.slice/crio-691310a32bab15d4384e9cbbebb03d0d7cd8a80a1da5d72cb9c9fce684a7fe9a WatchSource:0}: Error finding container 691310a32bab15d4384e9cbbebb03d0d7cd8a80a1da5d72cb9c9fce684a7fe9a: Status 404 returned error can't find the container with id 691310a32bab15d4384e9cbbebb03d0d7cd8a80a1da5d72cb9c9fce684a7fe9a
Sep 10 21:10:15.956899 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.956870    2577 generic.go:356] "Generic (PLEG): container finished" podID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerID="52dbfcde199f727c93cce214be89942545559e8f4230a6a661dca7883022ff94" exitCode=0
Sep 10 21:10:15.957055 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.956917    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"
Sep 10 21:10:15.957055 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.956947    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz" event={"ID":"3eb0eb13-46f2-4235-9f4b-f124e77c4d66","Type":"ContainerDied","Data":"52dbfcde199f727c93cce214be89942545559e8f4230a6a661dca7883022ff94"}
Sep 10 21:10:15.957055 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.956991    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz" event={"ID":"3eb0eb13-46f2-4235-9f4b-f124e77c4d66","Type":"ContainerDied","Data":"e1e5743570619411e8fdfb7440f95879e4587fc366218b41e155e426ff9d0b2c"}
Sep 10 21:10:15.957055 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.957014    2577 scope.go:117] "RemoveContainer" containerID="52dbfcde199f727c93cce214be89942545559e8f4230a6a661dca7883022ff94"
Sep 10 21:10:15.958992 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.958965    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk" event={"ID":"2d23c043-714b-4e8b-b51c-a95b97660919","Type":"ContainerStarted","Data":"ea6bb34c03245876709a76b101a83b2f7ecaa5be3b4d268d902dcbb07b32dd96"}
Sep 10 21:10:15.959133 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.959053    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"
Sep 10 21:10:15.959133 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.959098    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk" event={"ID":"2d23c043-714b-4e8b-b51c-a95b97660919","Type":"ContainerStarted","Data":"691310a32bab15d4384e9cbbebb03d0d7cd8a80a1da5d72cb9c9fce684a7fe9a"}
Sep 10 21:10:15.966638 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.966619    2577 scope.go:117] "RemoveContainer" containerID="91c28e27c33c8dc8230cab6c78eda51466195af9384f3e96d0eaafea5d7ca745"
Sep 10 21:10:15.974527 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.974398    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk" podStartSLOduration=0.974380235 podStartE2EDuration="974.380235ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:10:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:10:15.974261843 +0000 UTC m=+743.547968218" watchObservedRunningTime="2026-09-10 21:10:15.974380235 +0000 UTC m=+743.548086612"
Sep 10 21:10:15.975158 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.975118    2577 scope.go:117] "RemoveContainer" containerID="52dbfcde199f727c93cce214be89942545559e8f4230a6a661dca7883022ff94"
Sep 10 21:10:15.975414 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:10:15.975395    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52dbfcde199f727c93cce214be89942545559e8f4230a6a661dca7883022ff94\": container with ID starting with 52dbfcde199f727c93cce214be89942545559e8f4230a6a661dca7883022ff94 not found: ID does not exist" containerID="52dbfcde199f727c93cce214be89942545559e8f4230a6a661dca7883022ff94"
Sep 10 21:10:15.975503 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.975427    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52dbfcde199f727c93cce214be89942545559e8f4230a6a661dca7883022ff94"} err="failed to get container status \"52dbfcde199f727c93cce214be89942545559e8f4230a6a661dca7883022ff94\": rpc error: code = NotFound desc = could not find container \"52dbfcde199f727c93cce214be89942545559e8f4230a6a661dca7883022ff94\": container with ID starting with 52dbfcde199f727c93cce214be89942545559e8f4230a6a661dca7883022ff94 not found: ID does not exist"
Sep 10 21:10:15.975503 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.975450    2577 scope.go:117] "RemoveContainer" containerID="91c28e27c33c8dc8230cab6c78eda51466195af9384f3e96d0eaafea5d7ca745"
Sep 10 21:10:15.975723 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:10:15.975708    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91c28e27c33c8dc8230cab6c78eda51466195af9384f3e96d0eaafea5d7ca745\": container with ID starting with 91c28e27c33c8dc8230cab6c78eda51466195af9384f3e96d0eaafea5d7ca745 not found: ID does not exist" containerID="91c28e27c33c8dc8230cab6c78eda51466195af9384f3e96d0eaafea5d7ca745"
Sep 10 21:10:15.975774 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.975730    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91c28e27c33c8dc8230cab6c78eda51466195af9384f3e96d0eaafea5d7ca745"} err="failed to get container status \"91c28e27c33c8dc8230cab6c78eda51466195af9384f3e96d0eaafea5d7ca745\": rpc error: code = NotFound desc = could not find container \"91c28e27c33c8dc8230cab6c78eda51466195af9384f3e96d0eaafea5d7ca745\": container with ID starting with 91c28e27c33c8dc8230cab6c78eda51466195af9384f3e96d0eaafea5d7ca745 not found: ID does not exist"
Sep 10 21:10:15.988325 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.988294    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"]
Sep 10 21:10:15.991658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:15.991638    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz"]
Sep 10 21:10:16.947225 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:16.947187    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" path="/var/lib/kubelet/pods/3eb0eb13-46f2-4235-9f4b-f124e77c4d66/volumes"
Sep 10 21:10:22.964175 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:22.964140    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:10:26.973495 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:26.973464    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"
Sep 10 21:10:30.144303 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.144213    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"]
Sep 10 21:10:30.144720 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.144702    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerName="istio-proxy"
Sep 10 21:10:30.144764 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.144722    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerName="istio-proxy"
Sep 10 21:10:30.144764 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.144731    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerName="istio-proxy"
Sep 10 21:10:30.144764 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.144736    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerName="istio-proxy"
Sep 10 21:10:30.144904 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.144830    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerName="istio-proxy"
Sep 10 21:10:30.144904 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.144838    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb0eb13-46f2-4235-9f4b-f124e77c4d66" containerName="istio-proxy"
Sep 10 21:10:30.157180 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.157154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.157565 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.157534    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"]
Sep 10 21:10:30.159569 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.159544    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-94604f\"/\"default-dockercfg-v6x92\""
Sep 10 21:10:30.159672 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.159544    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-94604f\"/\"openshift-service-ca.crt\""
Sep 10 21:10:30.159752 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.159729    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-94604f\"/\"autores-model-94604f-kserve-self-signed-certs\""
Sep 10 21:10:30.160336 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.160316    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-94604f\"/\"kube-root-ca.crt\""
Sep 10 21:10:30.223549 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.223509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-home\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.223714 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.223569    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc1c56c9-d194-4693-8410-9ac46b4de2de-tls-certs\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.223714 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.223652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6h8p\" (UniqueName: \"kubernetes.io/projected/cc1c56c9-d194-4693-8410-9ac46b4de2de-kube-api-access-t6h8p\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.223714 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.223699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-dshm\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.223908 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.223807    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-model-cache\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.223908 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.223857    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-tmp-dir\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.324516 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.324475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6h8p\" (UniqueName: \"kubernetes.io/projected/cc1c56c9-d194-4693-8410-9ac46b4de2de-kube-api-access-t6h8p\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.324695 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.324534    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-dshm\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.324695 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.324629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-model-cache\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.324695 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.324677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-tmp-dir\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.324880 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.324732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-home\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.324880 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.324768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc1c56c9-d194-4693-8410-9ac46b4de2de-tls-certs\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.325812 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.325790    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-tmp-dir\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.325968 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.325806    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-home\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.326097 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.326020    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-model-cache\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.329159 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.329135    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc1c56c9-d194-4693-8410-9ac46b4de2de-tls-certs\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.329497 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.329481    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-dshm\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.334564 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.334542    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6h8p\" (UniqueName: \"kubernetes.io/projected/cc1c56c9-d194-4693-8410-9ac46b4de2de-kube-api-access-t6h8p\") pod \"autores-model-94604f-kserve-5965997575-7h66v\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") " pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.467486 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.467400    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:30.739254 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:30.739221    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"]
Sep 10 21:10:30.740820 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:10:30.740796    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc1c56c9_d194_4693_8410_9ac46b4de2de.slice/crio-de67b04e5774236f6a27cd7ae0df90ec85e340aeea9a186a9217888151e54173 WatchSource:0}: Error finding container de67b04e5774236f6a27cd7ae0df90ec85e340aeea9a186a9217888151e54173: Status 404 returned error can't find the container with id de67b04e5774236f6a27cd7ae0df90ec85e340aeea9a186a9217888151e54173
Sep 10 21:10:31.064365 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:31.064279    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v" event={"ID":"cc1c56c9-d194-4693-8410-9ac46b4de2de","Type":"ContainerStarted","Data":"119920213f39f7b2ae7592dbdfa36a47abcca6d0aed4a1346f5dd2a2791e2246"}
Sep 10 21:10:31.064365 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:31.064332    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v" event={"ID":"cc1c56c9-d194-4693-8410-9ac46b4de2de","Type":"ContainerStarted","Data":"de67b04e5774236f6a27cd7ae0df90ec85e340aeea9a186a9217888151e54173"}
Sep 10 21:10:31.080162 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:31.080116    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v" podStartSLOduration=1.080100222 podStartE2EDuration="1.080100222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:10:31.079229132 +0000 UTC m=+758.652935509" watchObservedRunningTime="2026-09-10 21:10:31.080100222 +0000 UTC m=+758.653806579"
Sep 10 21:10:34.090681 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:34.090648    2577 generic.go:356] "Generic (PLEG): container finished" podID="1a0b4309-4f60-42e3-ae48-b30242cff085" containerID="56c1f2ab58350364b8ca723100f4af0cb92538ee187c7933ec9d24a84a248160" exitCode=0
Sep 10 21:10:34.091193 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:34.090729    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69" event={"ID":"1a0b4309-4f60-42e3-ae48-b30242cff085","Type":"ContainerDied","Data":"56c1f2ab58350364b8ca723100f4af0cb92538ee187c7933ec9d24a84a248160"}
Sep 10 21:10:34.091193 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:34.091147    2577 scope.go:117] "RemoveContainer" containerID="56c1f2ab58350364b8ca723100f4af0cb92538ee187c7933ec9d24a84a248160"
Sep 10 21:10:34.092273 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:34.092241    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:10:34.092334 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:34.092322    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:10:34.092370 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:34.092361    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:10:35.098410 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:35.098378    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69" event={"ID":"1a0b4309-4f60-42e3-ae48-b30242cff085","Type":"ContainerStarted","Data":"575614d89968217ebdfd2bcd25bf7259c74c91a7becea4b7a816f3022931bf19"}
Sep 10 21:10:35.677082 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:35.677044    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:35.677253 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:35.677231    2577 patch_prober.go:28] interesting pod/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:35.677299 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:35.677281    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69" podUID="1a0b4309-4f60-42e3-ae48-b30242cff085" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 21:10:36.676425 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:36.676388    2577 patch_prober.go:28] interesting pod/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:36.676886 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:36.676461    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69" podUID="1a0b4309-4f60-42e3-ae48-b30242cff085" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 21:10:37.676806 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:37.676772    2577 patch_prober.go:28] interesting pod/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:37.677234 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:37.676827    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69" podUID="1a0b4309-4f60-42e3-ae48-b30242cff085" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 21:10:38.677180 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:38.677147    2577 patch_prober.go:28] interesting pod/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:38.677559 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:38.677202    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69" podUID="1a0b4309-4f60-42e3-ae48-b30242cff085" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 21:10:39.330582 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:39.330531    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p"]
Sep 10 21:10:39.334895 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:39.334871    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p"
Sep 10 21:10:39.337205 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:39.337183    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:10:39.337296 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:39.337262    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:10:39.341697 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:39.341648    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p"]
Sep 10 21:10:39.416254 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:39.416222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37926412-74b6-47b0-95d1-4b09adebc1be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p\" (UID: \"37926412-74b6-47b0-95d1-4b09adebc1be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p"
Sep 10 21:10:39.518329 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:39.517437    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37926412-74b6-47b0-95d1-4b09adebc1be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p\" (UID: \"37926412-74b6-47b0-95d1-4b09adebc1be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p"
Sep 10 21:10:39.518329 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:39.518281    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37926412-74b6-47b0-95d1-4b09adebc1be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p\" (UID: \"37926412-74b6-47b0-95d1-4b09adebc1be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p"
Sep 10 21:10:39.647153 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:39.647057    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p"
Sep 10 21:10:39.676295 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:39.676262    2577 patch_prober.go:28] interesting pod/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:39.676437 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:39.676328    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69" podUID="1a0b4309-4f60-42e3-ae48-b30242cff085" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 21:10:39.927330 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:39.927288    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p"]
Sep 10 21:10:40.139426 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:40.139389    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p" event={"ID":"37926412-74b6-47b0-95d1-4b09adebc1be","Type":"ContainerStarted","Data":"ca3b512e1b34ae6c35ef86357e9a8037642cb00f051d4537d5c7b27c8c039a4b"}
Sep 10 21:10:40.468104 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:40.467994    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:40.468280 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:40.468263    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:40.480241 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:40.480218    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:40.680652 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:40.680628    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:40.681079 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:40.681060    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:40.681683 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:40.681667    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:41.147475 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:41.147445    2577 generic.go:356] "Generic (PLEG): container finished" podID="37926412-74b6-47b0-95d1-4b09adebc1be" containerID="327b927957ec3b8937ae22364f0e2cf670d8b8372ecfba3654782b6bf5f3d9d5" exitCode=0
Sep 10 21:10:41.147856 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:41.147527    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p" event={"ID":"37926412-74b6-47b0-95d1-4b09adebc1be","Type":"ContainerDied","Data":"327b927957ec3b8937ae22364f0e2cf670d8b8372ecfba3654782b6bf5f3d9d5"}
Sep 10 21:10:41.158806 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:41.158784    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:10:42.290280 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:42.290256    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p"
Sep 10 21:10:42.449368 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:42.449281    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37926412-74b6-47b0-95d1-4b09adebc1be-maas-api-service-ca\") pod \"37926412-74b6-47b0-95d1-4b09adebc1be\" (UID: \"37926412-74b6-47b0-95d1-4b09adebc1be\") "
Sep 10 21:10:42.449629 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:42.449606    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37926412-74b6-47b0-95d1-4b09adebc1be-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "37926412-74b6-47b0-95d1-4b09adebc1be" (UID: "37926412-74b6-47b0-95d1-4b09adebc1be"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:10:42.550543 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:42.550499    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37926412-74b6-47b0-95d1-4b09adebc1be-maas-api-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:43.160015 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:43.159988    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p"
Sep 10 21:10:43.160175 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:43.160049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p" event={"ID":"37926412-74b6-47b0-95d1-4b09adebc1be","Type":"ContainerDied","Data":"ca3b512e1b34ae6c35ef86357e9a8037642cb00f051d4537d5c7b27c8c039a4b"}
Sep 10 21:10:43.160175 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:43.160094    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca3b512e1b34ae6c35ef86357e9a8037642cb00f051d4537d5c7b27c8c039a4b"
Sep 10 21:10:43.360996 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:43.360963    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:10:46.160453 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:46.160417    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"]
Sep 10 21:10:46.160906 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:46.160703    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk" podUID="2d23c043-714b-4e8b-b51c-a95b97660919" containerName="payload-pre-processing" containerID="cri-o://ea6bb34c03245876709a76b101a83b2f7ecaa5be3b4d268d902dcbb07b32dd96" gracePeriod=30
Sep 10 21:10:46.307687 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:46.307657    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p"]
Sep 10 21:10:46.311522 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:46.311498    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c2ec79e5-bqw5p"]
Sep 10 21:10:46.438747 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:46.438722    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"
Sep 10 21:10:46.442698 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:46.442671    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"]
Sep 10 21:10:46.443108 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:46.443076    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69" podUID="1a0b4309-4f60-42e3-ae48-b30242cff085" containerName="istio-proxy" containerID="cri-o://575614d89968217ebdfd2bcd25bf7259c74c91a7becea4b7a816f3022931bf19" gracePeriod=30
Sep 10 21:10:46.586348 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:46.586323    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d23c043-714b-4e8b-b51c-a95b97660919-plugins-config-volume\") pod \"2d23c043-714b-4e8b-b51c-a95b97660919\" (UID: \"2d23c043-714b-4e8b-b51c-a95b97660919\") "
Sep 10 21:10:46.586529 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:46.586368    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcpdc\" (UniqueName: \"kubernetes.io/projected/2d23c043-714b-4e8b-b51c-a95b97660919-kube-api-access-wcpdc\") pod \"2d23c043-714b-4e8b-b51c-a95b97660919\" (UID: \"2d23c043-714b-4e8b-b51c-a95b97660919\") "
Sep 10 21:10:46.586677 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:46.586652    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d23c043-714b-4e8b-b51c-a95b97660919-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d23c043-714b-4e8b-b51c-a95b97660919" (UID: "2d23c043-714b-4e8b-b51c-a95b97660919"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:10:46.588537 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:46.588514    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d23c043-714b-4e8b-b51c-a95b97660919-kube-api-access-wcpdc" (OuterVolumeSpecName: "kube-api-access-wcpdc") pod "2d23c043-714b-4e8b-b51c-a95b97660919" (UID: "2d23c043-714b-4e8b-b51c-a95b97660919"). InnerVolumeSpecName "kube-api-access-wcpdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:10:46.688252 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:46.688190    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d23c043-714b-4e8b-b51c-a95b97660919-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:46.688252 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:46.688210    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcpdc\" (UniqueName: \"kubernetes.io/projected/2d23c043-714b-4e8b-b51c-a95b97660919-kube-api-access-wcpdc\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:46.947147 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:46.947058    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37926412-74b6-47b0-95d1-4b09adebc1be" path="/var/lib/kubelet/pods/37926412-74b6-47b0-95d1-4b09adebc1be/volumes"
Sep 10 21:10:47.149557 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.149523    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"]
Sep 10 21:10:47.149928 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.149916    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d23c043-714b-4e8b-b51c-a95b97660919" containerName="payload-pre-processing"
Sep 10 21:10:47.149928 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.149929    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d23c043-714b-4e8b-b51c-a95b97660919" containerName="payload-pre-processing"
Sep 10 21:10:47.150017 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.149943    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37926412-74b6-47b0-95d1-4b09adebc1be" containerName="revoke-keys"
Sep 10 21:10:47.150017 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.149949    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="37926412-74b6-47b0-95d1-4b09adebc1be" containerName="revoke-keys"
Sep 10 21:10:47.150113 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.150043    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="37926412-74b6-47b0-95d1-4b09adebc1be" containerName="revoke-keys"
Sep 10 21:10:47.150113 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.150053    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d23c043-714b-4e8b-b51c-a95b97660919" containerName="payload-pre-processing"
Sep 10 21:10:47.153644 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.153627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.155948 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.155929    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1992fc41-openshift-default-dockercfg-pmsbv\""
Sep 10 21:10:47.163127 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.163105    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"]
Sep 10 21:10:47.186295 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.186266    2577 generic.go:356] "Generic (PLEG): container finished" podID="2d23c043-714b-4e8b-b51c-a95b97660919" containerID="ea6bb34c03245876709a76b101a83b2f7ecaa5be3b4d268d902dcbb07b32dd96" exitCode=0
Sep 10 21:10:47.186422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.186319    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"
Sep 10 21:10:47.186422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.186342    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk" event={"ID":"2d23c043-714b-4e8b-b51c-a95b97660919","Type":"ContainerDied","Data":"ea6bb34c03245876709a76b101a83b2f7ecaa5be3b4d268d902dcbb07b32dd96"}
Sep 10 21:10:47.186422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.186394    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk" event={"ID":"2d23c043-714b-4e8b-b51c-a95b97660919","Type":"ContainerDied","Data":"691310a32bab15d4384e9cbbebb03d0d7cd8a80a1da5d72cb9c9fce684a7fe9a"}
Sep 10 21:10:47.186422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.186418    2577 scope.go:117] "RemoveContainer" containerID="ea6bb34c03245876709a76b101a83b2f7ecaa5be3b4d268d902dcbb07b32dd96"
Sep 10 21:10:47.197221 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.197110    2577 scope.go:117] "RemoveContainer" containerID="ea6bb34c03245876709a76b101a83b2f7ecaa5be3b4d268d902dcbb07b32dd96"
Sep 10 21:10:47.197533 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:10:47.197471    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea6bb34c03245876709a76b101a83b2f7ecaa5be3b4d268d902dcbb07b32dd96\": container with ID starting with ea6bb34c03245876709a76b101a83b2f7ecaa5be3b4d268d902dcbb07b32dd96 not found: ID does not exist" containerID="ea6bb34c03245876709a76b101a83b2f7ecaa5be3b4d268d902dcbb07b32dd96"
Sep 10 21:10:47.197533 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.197503    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6bb34c03245876709a76b101a83b2f7ecaa5be3b4d268d902dcbb07b32dd96"} err="failed to get container status \"ea6bb34c03245876709a76b101a83b2f7ecaa5be3b4d268d902dcbb07b32dd96\": rpc error: code = NotFound desc = could not find container \"ea6bb34c03245876709a76b101a83b2f7ecaa5be3b4d268d902dcbb07b32dd96\": container with ID starting with ea6bb34c03245876709a76b101a83b2f7ecaa5be3b4d268d902dcbb07b32dd96 not found: ID does not exist"
Sep 10 21:10:47.204473 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.204445    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"]
Sep 10 21:10:47.209889 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.209868    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk"]
Sep 10 21:10:47.293426 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.293399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-credential-socket\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.293524 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.293439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8451595c-d2d3-44dc-8272-6d5057b97d72-istiod-ca-cert\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.293524 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.293488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-workload-certs\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.293600 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.293523    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8974c\" (UniqueName: \"kubernetes.io/projected/8451595c-d2d3-44dc-8272-6d5057b97d72-kube-api-access-8974c\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.293600 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.293565    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-token\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.293666 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.293606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-podinfo\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.293666 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.293637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-workload-socket\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.293746 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.293688    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-envoy\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.293746 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.293719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-data\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.395217 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.395183    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-data\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.395390 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.395240    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-credential-socket\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.395390 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.395268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8451595c-d2d3-44dc-8272-6d5057b97d72-istiod-ca-cert\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.395390 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.395294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-workload-certs\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.395390 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.395317    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8974c\" (UniqueName: \"kubernetes.io/projected/8451595c-d2d3-44dc-8272-6d5057b97d72-kube-api-access-8974c\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.395550 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.395448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-token\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.395550 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.395518    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-podinfo\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.395653 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.395568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-workload-socket\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.395653 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.395579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-data\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.395653 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.395639    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-envoy\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.395798 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.395736    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-credential-socket\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.395905 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.395882    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-workload-socket\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.396012 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.395988    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-workload-certs\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.396143 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.396071    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8451595c-d2d3-44dc-8272-6d5057b97d72-istiod-ca-cert\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.397819 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.397789    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-envoy\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.398047 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.398006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-podinfo\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.403471 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.403451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8974c\" (UniqueName: \"kubernetes.io/projected/8451595c-d2d3-44dc-8272-6d5057b97d72-kube-api-access-8974c\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.403565 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.403542    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-token\") pod \"e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") " pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.465954 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.465904    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:47.742583 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.742559    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"]
Sep 10 21:10:47.744494 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:10:47.744468    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8451595c_d2d3_44dc_8272_6d5057b97d72.slice/crio-a520233ac4eabd6963d6213f340f6146d90bccc095623858b80f50de1e53bcb8 WatchSource:0}: Error finding container a520233ac4eabd6963d6213f340f6146d90bccc095623858b80f50de1e53bcb8: Status 404 returned error can't find the container with id a520233ac4eabd6963d6213f340f6146d90bccc095623858b80f50de1e53bcb8
Sep 10 21:10:47.746838 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.746808    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:10:47.746912 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.746876    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:10:47.746952 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:47.746910    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:10:48.194707 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:48.194668    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" event={"ID":"8451595c-d2d3-44dc-8272-6d5057b97d72","Type":"ContainerStarted","Data":"d659037cb09a1d150c695ba74bd052b1202ca6f2f582be4e9147c2273311864d"}
Sep 10 21:10:48.195107 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:48.194722    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" event={"ID":"8451595c-d2d3-44dc-8272-6d5057b97d72","Type":"ContainerStarted","Data":"a520233ac4eabd6963d6213f340f6146d90bccc095623858b80f50de1e53bcb8"}
Sep 10 21:10:48.214013 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:48.213963    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" podStartSLOduration=1.213949982 podStartE2EDuration="1.213949982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:10:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:10:48.212250378 +0000 UTC m=+775.785956756" watchObservedRunningTime="2026-09-10 21:10:48.213949982 +0000 UTC m=+775.787656357"
Sep 10 21:10:48.466566 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:48.466483    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:48.471856 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:48.471830    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:48.946954 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:48.946920    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d23c043-714b-4e8b-b51c-a95b97660919" path="/var/lib/kubelet/pods/2d23c043-714b-4e8b-b51c-a95b97660919/volumes"
Sep 10 21:10:49.200626 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:49.200543    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:49.201365 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:49.201343    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:10:51.550607 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.550579    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"]
Sep 10 21:10:51.554164 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.554142    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"
Sep 10 21:10:51.556377 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.556354    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-1992fc41-dockercfg-6vnkv\""
Sep 10 21:10:51.556476 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.556360    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1992fc41\""
Sep 10 21:10:51.563989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.563961    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"]
Sep 10 21:10:51.592841 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.592814    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"]
Sep 10 21:10:51.596356 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.596341    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"
Sep 10 21:10:51.606743 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.606717    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"]
Sep 10 21:10:51.641357 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.640582    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqtvt\" (UniqueName: \"kubernetes.io/projected/0934ac16-e348-4f89-af5f-7cf88924a6c9-kube-api-access-wqtvt\") pod \"payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm\" (UID: \"0934ac16-e348-4f89-af5f-7cf88924a6c9\") " pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"
Sep 10 21:10:51.641357 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.640712    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0934ac16-e348-4f89-af5f-7cf88924a6c9-plugins-config-volume\") pod \"payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm\" (UID: \"0934ac16-e348-4f89-af5f-7cf88924a6c9\") " pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"
Sep 10 21:10:51.664412 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.664320    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"]
Sep 10 21:10:51.735362 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.735337    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:51.745638 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.741843    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0934ac16-e348-4f89-af5f-7cf88924a6c9-plugins-config-volume\") pod \"payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm\" (UID: \"0934ac16-e348-4f89-af5f-7cf88924a6c9\") " pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"
Sep 10 21:10:51.745638 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.741931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zsmh\" (UniqueName: \"kubernetes.io/projected/26e08c77-e4a4-41ba-8d5a-dfc16390fdd0-kube-api-access-8zsmh\") pod \"payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b\" (UID: \"26e08c77-e4a4-41ba-8d5a-dfc16390fdd0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"
Sep 10 21:10:51.745638 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.741993    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26e08c77-e4a4-41ba-8d5a-dfc16390fdd0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b\" (UID: \"26e08c77-e4a4-41ba-8d5a-dfc16390fdd0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"
Sep 10 21:10:51.745638 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.742648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqtvt\" (UniqueName: \"kubernetes.io/projected/0934ac16-e348-4f89-af5f-7cf88924a6c9-kube-api-access-wqtvt\") pod \"payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm\" (UID: \"0934ac16-e348-4f89-af5f-7cf88924a6c9\") " pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"
Sep 10 21:10:51.745638 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.742959    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0934ac16-e348-4f89-af5f-7cf88924a6c9-plugins-config-volume\") pod \"payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm\" (UID: \"0934ac16-e348-4f89-af5f-7cf88924a6c9\") " pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"
Sep 10 21:10:51.771447 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.771413    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqtvt\" (UniqueName: \"kubernetes.io/projected/0934ac16-e348-4f89-af5f-7cf88924a6c9-kube-api-access-wqtvt\") pod \"payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm\" (UID: \"0934ac16-e348-4f89-af5f-7cf88924a6c9\") " pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"
Sep 10 21:10:51.794176 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.794145    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985"]
Sep 10 21:10:51.794638 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.794623    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a0b4309-4f60-42e3-ae48-b30242cff085" containerName="istio-proxy"
Sep 10 21:10:51.794689 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.794639    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a0b4309-4f60-42e3-ae48-b30242cff085" containerName="istio-proxy"
Sep 10 21:10:51.794745 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.794734    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a0b4309-4f60-42e3-ae48-b30242cff085" containerName="istio-proxy"
Sep 10 21:10:51.797889 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.797874    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985"
Sep 10 21:10:51.800453 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.800438    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:10:51.800533 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.800440    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:10:51.807639 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.807616    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985"]
Sep 10 21:10:51.843478 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.843452    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-envoy\") pod \"1a0b4309-4f60-42e3-ae48-b30242cff085\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") "
Sep 10 21:10:51.843621 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.843485    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-credential-socket\") pod \"1a0b4309-4f60-42e3-ae48-b30242cff085\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") "
Sep 10 21:10:51.843621 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.843512    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0b4309-4f60-42e3-ae48-b30242cff085-istiod-ca-cert\") pod \"1a0b4309-4f60-42e3-ae48-b30242cff085\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") "
Sep 10 21:10:51.843621 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.843551    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-workload-socket\") pod \"1a0b4309-4f60-42e3-ae48-b30242cff085\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") "
Sep 10 21:10:51.843621 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.843611    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-workload-certs\") pod \"1a0b4309-4f60-42e3-ae48-b30242cff085\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") "
Sep 10 21:10:51.843832 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.843627    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-token\") pod \"1a0b4309-4f60-42e3-ae48-b30242cff085\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") "
Sep 10 21:10:51.843832 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.843652    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-data\") pod \"1a0b4309-4f60-42e3-ae48-b30242cff085\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") "
Sep 10 21:10:51.843832 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.843680    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q526\" (UniqueName: \"kubernetes.io/projected/1a0b4309-4f60-42e3-ae48-b30242cff085-kube-api-access-4q526\") pod \"1a0b4309-4f60-42e3-ae48-b30242cff085\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") "
Sep 10 21:10:51.843832 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.843705    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-podinfo\") pod \"1a0b4309-4f60-42e3-ae48-b30242cff085\" (UID: \"1a0b4309-4f60-42e3-ae48-b30242cff085\") "
Sep 10 21:10:51.843832 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.843781    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1a0b4309-4f60-42e3-ae48-b30242cff085" (UID: "1a0b4309-4f60-42e3-ae48-b30242cff085"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:51.844109 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.843874    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1a0b4309-4f60-42e3-ae48-b30242cff085" (UID: "1a0b4309-4f60-42e3-ae48-b30242cff085"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:51.844109 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.843957    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a0b4309-4f60-42e3-ae48-b30242cff085-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1a0b4309-4f60-42e3-ae48-b30242cff085" (UID: "1a0b4309-4f60-42e3-ae48-b30242cff085"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:10:51.844109 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.844055    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1a0b4309-4f60-42e3-ae48-b30242cff085" (UID: "1a0b4309-4f60-42e3-ae48-b30242cff085"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:51.844109 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.843998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zsmh\" (UniqueName: \"kubernetes.io/projected/26e08c77-e4a4-41ba-8d5a-dfc16390fdd0-kube-api-access-8zsmh\") pod \"payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b\" (UID: \"26e08c77-e4a4-41ba-8d5a-dfc16390fdd0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"
Sep 10 21:10:51.844327 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.844170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26e08c77-e4a4-41ba-8d5a-dfc16390fdd0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b\" (UID: \"26e08c77-e4a4-41ba-8d5a-dfc16390fdd0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"
Sep 10 21:10:51.844327 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.844279    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-credential-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:51.844327 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.844284    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-data" (OuterVolumeSpecName: "istio-data") pod "1a0b4309-4f60-42e3-ae48-b30242cff085" (UID: "1a0b4309-4f60-42e3-ae48-b30242cff085"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:51.844327 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.844294    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0b4309-4f60-42e3-ae48-b30242cff085-istiod-ca-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:51.844531 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.844328    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-workload-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:51.844531 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.844346    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-workload-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:51.845107 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.845082    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26e08c77-e4a4-41ba-8d5a-dfc16390fdd0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b\" (UID: \"26e08c77-e4a4-41ba-8d5a-dfc16390fdd0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"
Sep 10 21:10:51.845852 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.845795    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1a0b4309-4f60-42e3-ae48-b30242cff085" (UID: "1a0b4309-4f60-42e3-ae48-b30242cff085"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:51.845926 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.845903    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a0b4309-4f60-42e3-ae48-b30242cff085" (UID: "1a0b4309-4f60-42e3-ae48-b30242cff085"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:10:51.845926 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.845913    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1a0b4309-4f60-42e3-ae48-b30242cff085" (UID: "1a0b4309-4f60-42e3-ae48-b30242cff085"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:10:51.846071 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.846056    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a0b4309-4f60-42e3-ae48-b30242cff085-kube-api-access-4q526" (OuterVolumeSpecName: "kube-api-access-4q526") pod "1a0b4309-4f60-42e3-ae48-b30242cff085" (UID: "1a0b4309-4f60-42e3-ae48-b30242cff085"). InnerVolumeSpecName "kube-api-access-4q526". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:10:51.851723 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.851703    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zsmh\" (UniqueName: \"kubernetes.io/projected/26e08c77-e4a4-41ba-8d5a-dfc16390fdd0-kube-api-access-8zsmh\") pod \"payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b\" (UID: \"26e08c77-e4a4-41ba-8d5a-dfc16390fdd0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"
Sep 10 21:10:51.866166 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.866143    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"
Sep 10 21:10:51.908102 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.908071    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"
Sep 10 21:10:51.945271 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.945238    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278e2686-95b4-457e-b7b9-fd01fc10ccb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-94604f-d2985\" (UID: \"278e2686-95b4-457e-b7b9-fd01fc10ccb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985"
Sep 10 21:10:51.945392 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.945313    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-envoy\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:51.945392 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.945324    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-token\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:51.945392 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.945332    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-data\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:51.945392 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.945340    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q526\" (UniqueName: \"kubernetes.io/projected/1a0b4309-4f60-42e3-ae48-b30242cff085-kube-api-access-4q526\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:51.945392 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:51.945348    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0b4309-4f60-42e3-ae48-b30242cff085-istio-podinfo\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:52.045814 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.045786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278e2686-95b4-457e-b7b9-fd01fc10ccb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-94604f-d2985\" (UID: \"278e2686-95b4-457e-b7b9-fd01fc10ccb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985"
Sep 10 21:10:52.046454 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.046429    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278e2686-95b4-457e-b7b9-fd01fc10ccb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-94604f-d2985\" (UID: \"278e2686-95b4-457e-b7b9-fd01fc10ccb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985"
Sep 10 21:10:52.109690 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.109670    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985"
Sep 10 21:10:52.137237 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.137211    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"]
Sep 10 21:10:52.138615 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:10:52.138586    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0934ac16_e348_4f89_af5f_7cf88924a6c9.slice/crio-f49d97ef506667f2ea19a57f08f273d08814b042f6152fd90bf3c557263b1c4d WatchSource:0}: Error finding container f49d97ef506667f2ea19a57f08f273d08814b042f6152fd90bf3c557263b1c4d: Status 404 returned error can't find the container with id f49d97ef506667f2ea19a57f08f273d08814b042f6152fd90bf3c557263b1c4d
Sep 10 21:10:52.191047 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.191011    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"]
Sep 10 21:10:52.193436 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:10:52.193403    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e08c77_e4a4_41ba_8d5a_dfc16390fdd0.slice/crio-d1a3e627727554672615d993883127db2e3d50644de1f0f6d676f6d8fe5bfff4 WatchSource:0}: Error finding container d1a3e627727554672615d993883127db2e3d50644de1f0f6d676f6d8fe5bfff4: Status 404 returned error can't find the container with id d1a3e627727554672615d993883127db2e3d50644de1f0f6d676f6d8fe5bfff4
Sep 10 21:10:52.221105 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.221000    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm" event={"ID":"0934ac16-e348-4f89-af5f-7cf88924a6c9","Type":"ContainerStarted","Data":"a1d753068ac1538ac55667b1c6bc1534b332878a70db14d663435308bc1dd737"}
Sep 10 21:10:52.221105 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.221063    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm" event={"ID":"0934ac16-e348-4f89-af5f-7cf88924a6c9","Type":"ContainerStarted","Data":"f49d97ef506667f2ea19a57f08f273d08814b042f6152fd90bf3c557263b1c4d"}
Sep 10 21:10:52.221105 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.221093    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"
Sep 10 21:10:52.222267 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.222243    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b" event={"ID":"26e08c77-e4a4-41ba-8d5a-dfc16390fdd0","Type":"ContainerStarted","Data":"d1a3e627727554672615d993883127db2e3d50644de1f0f6d676f6d8fe5bfff4"}
Sep 10 21:10:52.223912 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.223891    2577 generic.go:356] "Generic (PLEG): container finished" podID="1a0b4309-4f60-42e3-ae48-b30242cff085" containerID="575614d89968217ebdfd2bcd25bf7259c74c91a7becea4b7a816f3022931bf19" exitCode=0
Sep 10 21:10:52.224017 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.223958    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"
Sep 10 21:10:52.224017 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.223972    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69" event={"ID":"1a0b4309-4f60-42e3-ae48-b30242cff085","Type":"ContainerDied","Data":"575614d89968217ebdfd2bcd25bf7259c74c91a7becea4b7a816f3022931bf19"}
Sep 10 21:10:52.224017 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.224011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69" event={"ID":"1a0b4309-4f60-42e3-ae48-b30242cff085","Type":"ContainerDied","Data":"c1c7087786f5b902031d529773589d56d432910ac4e1be4e979d052308db6c68"}
Sep 10 21:10:52.224206 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.224057    2577 scope.go:117] "RemoveContainer" containerID="575614d89968217ebdfd2bcd25bf7259c74c91a7becea4b7a816f3022931bf19"
Sep 10 21:10:52.237925 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.237906    2577 scope.go:117] "RemoveContainer" containerID="56c1f2ab58350364b8ca723100f4af0cb92538ee187c7933ec9d24a84a248160"
Sep 10 21:10:52.239728 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.239683    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm" podStartSLOduration=1.239662822 podStartE2EDuration="1.239662822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:10:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:10:52.238634618 +0000 UTC m=+779.812340993" watchObservedRunningTime="2026-09-10 21:10:52.239662822 +0000 UTC m=+779.813369197"
Sep 10 21:10:52.250346 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.250324    2577 scope.go:117] "RemoveContainer" containerID="575614d89968217ebdfd2bcd25bf7259c74c91a7becea4b7a816f3022931bf19"
Sep 10 21:10:52.250655 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:10:52.250628    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"575614d89968217ebdfd2bcd25bf7259c74c91a7becea4b7a816f3022931bf19\": container with ID starting with 575614d89968217ebdfd2bcd25bf7259c74c91a7becea4b7a816f3022931bf19 not found: ID does not exist" containerID="575614d89968217ebdfd2bcd25bf7259c74c91a7becea4b7a816f3022931bf19"
Sep 10 21:10:52.250737 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.250666    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"575614d89968217ebdfd2bcd25bf7259c74c91a7becea4b7a816f3022931bf19"} err="failed to get container status \"575614d89968217ebdfd2bcd25bf7259c74c91a7becea4b7a816f3022931bf19\": rpc error: code = NotFound desc = could not find container \"575614d89968217ebdfd2bcd25bf7259c74c91a7becea4b7a816f3022931bf19\": container with ID starting with 575614d89968217ebdfd2bcd25bf7259c74c91a7becea4b7a816f3022931bf19 not found: ID does not exist"
Sep 10 21:10:52.250737 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.250694    2577 scope.go:117] "RemoveContainer" containerID="56c1f2ab58350364b8ca723100f4af0cb92538ee187c7933ec9d24a84a248160"
Sep 10 21:10:52.251004 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:10:52.250986    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56c1f2ab58350364b8ca723100f4af0cb92538ee187c7933ec9d24a84a248160\": container with ID starting with 56c1f2ab58350364b8ca723100f4af0cb92538ee187c7933ec9d24a84a248160 not found: ID does not exist" containerID="56c1f2ab58350364b8ca723100f4af0cb92538ee187c7933ec9d24a84a248160"
Sep 10 21:10:52.251079 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.251010    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56c1f2ab58350364b8ca723100f4af0cb92538ee187c7933ec9d24a84a248160"} err="failed to get container status \"56c1f2ab58350364b8ca723100f4af0cb92538ee187c7933ec9d24a84a248160\": rpc error: code = NotFound desc = could not find container \"56c1f2ab58350364b8ca723100f4af0cb92538ee187c7933ec9d24a84a248160\": container with ID starting with 56c1f2ab58350364b8ca723100f4af0cb92538ee187c7933ec9d24a84a248160 not found: ID does not exist"
Sep 10 21:10:52.256327 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.256302    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"]
Sep 10 21:10:52.261688 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.261665    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69"]
Sep 10 21:10:52.388202 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.388167    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985"]
Sep 10 21:10:52.388862 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:10:52.388836    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278e2686_95b4_457e_b7b9_fd01fc10ccb0.slice/crio-3fe8adc5f8c7ae12cf0de46ac32c8e7b9eb9680dffb2a8567e77855d94462c8c WatchSource:0}: Error finding container 3fe8adc5f8c7ae12cf0de46ac32c8e7b9eb9680dffb2a8567e77855d94462c8c: Status 404 returned error can't find the container with id 3fe8adc5f8c7ae12cf0de46ac32c8e7b9eb9680dffb2a8567e77855d94462c8c
Sep 10 21:10:52.949927 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:52.949853    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a0b4309-4f60-42e3-ae48-b30242cff085" path="/var/lib/kubelet/pods/1a0b4309-4f60-42e3-ae48-b30242cff085/volumes"
Sep 10 21:10:53.232401 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:53.232370    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b" event={"ID":"26e08c77-e4a4-41ba-8d5a-dfc16390fdd0","Type":"ContainerStarted","Data":"d732500d5b019469d6990c96642e6ecc5131c77cbfdd6d838c1d7cbdbe97df40"}
Sep 10 21:10:53.232540 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:53.232457    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"
Sep 10 21:10:53.234078 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:53.234051    2577 generic.go:356] "Generic (PLEG): container finished" podID="278e2686-95b4-457e-b7b9-fd01fc10ccb0" containerID="8f5226a6f9ae3589629ceeec6d734b315bd4b52220d9486a9ba5a7fdc7d2564b" exitCode=0
Sep 10 21:10:53.234176 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:53.234125    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985" event={"ID":"278e2686-95b4-457e-b7b9-fd01fc10ccb0","Type":"ContainerDied","Data":"8f5226a6f9ae3589629ceeec6d734b315bd4b52220d9486a9ba5a7fdc7d2564b"}
Sep 10 21:10:53.234176 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:53.234166    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985" event={"ID":"278e2686-95b4-457e-b7b9-fd01fc10ccb0","Type":"ContainerStarted","Data":"3fe8adc5f8c7ae12cf0de46ac32c8e7b9eb9680dffb2a8567e77855d94462c8c"}
Sep 10 21:10:53.248346 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:53.248291    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b" podStartSLOduration=2.248272082 podStartE2EDuration="2.248272082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:10:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:10:53.247450694 +0000 UTC m=+780.821157092" watchObservedRunningTime="2026-09-10 21:10:53.248272082 +0000 UTC m=+780.821978458"
Sep 10 21:10:54.372740 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:54.372715    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985"
Sep 10 21:10:54.469200 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:54.469173    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278e2686-95b4-457e-b7b9-fd01fc10ccb0-maas-api-service-ca\") pod \"278e2686-95b4-457e-b7b9-fd01fc10ccb0\" (UID: \"278e2686-95b4-457e-b7b9-fd01fc10ccb0\") "
Sep 10 21:10:54.469518 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:54.469492    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/278e2686-95b4-457e-b7b9-fd01fc10ccb0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "278e2686-95b4-457e-b7b9-fd01fc10ccb0" (UID: "278e2686-95b4-457e-b7b9-fd01fc10ccb0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:10:54.570732 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:54.570701    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278e2686-95b4-457e-b7b9-fd01fc10ccb0-maas-api-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:10:55.248298 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:55.248201    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985" event={"ID":"278e2686-95b4-457e-b7b9-fd01fc10ccb0","Type":"ContainerDied","Data":"3fe8adc5f8c7ae12cf0de46ac32c8e7b9eb9680dffb2a8567e77855d94462c8c"}
Sep 10 21:10:55.248298 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:55.248257    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fe8adc5f8c7ae12cf0de46ac32c8e7b9eb9680dffb2a8567e77855d94462c8c"
Sep 10 21:10:55.248298 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:10:55.248217    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985"
Sep 10 21:11:02.704024 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:02.703986    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985"]
Sep 10 21:11:02.710293 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:02.710264    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-94604f-d2985"]
Sep 10 21:11:02.946854 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:02.946820    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="278e2686-95b4-457e-b7b9-fd01fc10ccb0" path="/var/lib/kubelet/pods/278e2686-95b4-457e-b7b9-fd01fc10ccb0/volumes"
Sep 10 21:11:03.237200 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:03.237172    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"
Sep 10 21:11:04.242712 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:04.242680    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"
Sep 10 21:11:04.469823 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:04.469784    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:11:06.688199 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:06.688140    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v" podUID="cc1c56c9-d194-4693-8410-9ac46b4de2de" containerName="main" containerID="cri-o://119920213f39f7b2ae7592dbdfa36a47abcca6d0aed4a1346f5dd2a2791e2246" gracePeriod=45
Sep 10 21:11:06.982526 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:06.982497    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:11:07.086604 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.086570    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-dshm\") pod \"cc1c56c9-d194-4693-8410-9ac46b4de2de\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") "
Sep 10 21:11:07.086786 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.086630    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc1c56c9-d194-4693-8410-9ac46b4de2de-tls-certs\") pod \"cc1c56c9-d194-4693-8410-9ac46b4de2de\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") "
Sep 10 21:11:07.086786 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.086671    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6h8p\" (UniqueName: \"kubernetes.io/projected/cc1c56c9-d194-4693-8410-9ac46b4de2de-kube-api-access-t6h8p\") pod \"cc1c56c9-d194-4693-8410-9ac46b4de2de\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") "
Sep 10 21:11:07.086786 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.086699    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-tmp-dir\") pod \"cc1c56c9-d194-4693-8410-9ac46b4de2de\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") "
Sep 10 21:11:07.086786 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.086754    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-home\") pod \"cc1c56c9-d194-4693-8410-9ac46b4de2de\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") "
Sep 10 21:11:07.087011 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.086821    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-model-cache\") pod \"cc1c56c9-d194-4693-8410-9ac46b4de2de\" (UID: \"cc1c56c9-d194-4693-8410-9ac46b4de2de\") "
Sep 10 21:11:07.087078 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.087040    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cc1c56c9-d194-4693-8410-9ac46b4de2de" (UID: "cc1c56c9-d194-4693-8410-9ac46b4de2de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:07.087078 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.087056    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-home" (OuterVolumeSpecName: "home") pod "cc1c56c9-d194-4693-8410-9ac46b4de2de" (UID: "cc1c56c9-d194-4693-8410-9ac46b4de2de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:07.087275 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.087222    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-tmp-dir\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:07.087275 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.087245    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-home\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:07.087275 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.087254    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-model-cache" (OuterVolumeSpecName: "model-cache") pod "cc1c56c9-d194-4693-8410-9ac46b4de2de" (UID: "cc1c56c9-d194-4693-8410-9ac46b4de2de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:07.089147 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.089110    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc1c56c9-d194-4693-8410-9ac46b4de2de-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cc1c56c9-d194-4693-8410-9ac46b4de2de" (UID: "cc1c56c9-d194-4693-8410-9ac46b4de2de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:11:07.089552 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.089527    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1c56c9-d194-4693-8410-9ac46b4de2de-kube-api-access-t6h8p" (OuterVolumeSpecName: "kube-api-access-t6h8p") pod "cc1c56c9-d194-4693-8410-9ac46b4de2de" (UID: "cc1c56c9-d194-4693-8410-9ac46b4de2de"). InnerVolumeSpecName "kube-api-access-t6h8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:07.089957 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.089937    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-dshm" (OuterVolumeSpecName: "dshm") pod "cc1c56c9-d194-4693-8410-9ac46b4de2de" (UID: "cc1c56c9-d194-4693-8410-9ac46b4de2de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:07.187844 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.187806    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6h8p\" (UniqueName: \"kubernetes.io/projected/cc1c56c9-d194-4693-8410-9ac46b4de2de-kube-api-access-t6h8p\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:07.187844 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.187839    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-model-cache\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:07.187844 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.187848    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc1c56c9-d194-4693-8410-9ac46b4de2de-dshm\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:07.187844 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.187856    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc1c56c9-d194-4693-8410-9ac46b4de2de-tls-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:07.323605 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.323566    2577 generic.go:356] "Generic (PLEG): container finished" podID="cc1c56c9-d194-4693-8410-9ac46b4de2de" containerID="119920213f39f7b2ae7592dbdfa36a47abcca6d0aed4a1346f5dd2a2791e2246" exitCode=0
Sep 10 21:11:07.323809 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.323621    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"
Sep 10 21:11:07.323809 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.323708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v" event={"ID":"cc1c56c9-d194-4693-8410-9ac46b4de2de","Type":"ContainerDied","Data":"119920213f39f7b2ae7592dbdfa36a47abcca6d0aed4a1346f5dd2a2791e2246"}
Sep 10 21:11:07.323809 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.323747    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v" event={"ID":"cc1c56c9-d194-4693-8410-9ac46b4de2de","Type":"ContainerDied","Data":"de67b04e5774236f6a27cd7ae0df90ec85e340aeea9a186a9217888151e54173"}
Sep 10 21:11:07.323809 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.323770    2577 scope.go:117] "RemoveContainer" containerID="119920213f39f7b2ae7592dbdfa36a47abcca6d0aed4a1346f5dd2a2791e2246"
Sep 10 21:11:07.343113 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.343096    2577 scope.go:117] "RemoveContainer" containerID="119920213f39f7b2ae7592dbdfa36a47abcca6d0aed4a1346f5dd2a2791e2246"
Sep 10 21:11:07.343385 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:11:07.343367    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"119920213f39f7b2ae7592dbdfa36a47abcca6d0aed4a1346f5dd2a2791e2246\": container with ID starting with 119920213f39f7b2ae7592dbdfa36a47abcca6d0aed4a1346f5dd2a2791e2246 not found: ID does not exist" containerID="119920213f39f7b2ae7592dbdfa36a47abcca6d0aed4a1346f5dd2a2791e2246"
Sep 10 21:11:07.343428 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.343395    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"119920213f39f7b2ae7592dbdfa36a47abcca6d0aed4a1346f5dd2a2791e2246"} err="failed to get container status \"119920213f39f7b2ae7592dbdfa36a47abcca6d0aed4a1346f5dd2a2791e2246\": rpc error: code = NotFound desc = could not find container \"119920213f39f7b2ae7592dbdfa36a47abcca6d0aed4a1346f5dd2a2791e2246\": container with ID starting with 119920213f39f7b2ae7592dbdfa36a47abcca6d0aed4a1346f5dd2a2791e2246 not found: ID does not exist"
Sep 10 21:11:07.351520 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.351491    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"]
Sep 10 21:11:07.354206 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:07.354188    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-94604f/autores-model-94604f-kserve-5965997575-7h66v"]
Sep 10 21:11:08.947636 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:08.947600    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc1c56c9-d194-4693-8410-9ac46b4de2de" path="/var/lib/kubelet/pods/cc1c56c9-d194-4693-8410-9ac46b4de2de/volumes"
Sep 10 21:11:09.269677 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:09.269587    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"]
Sep 10 21:11:09.269889 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:09.269835    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerName="istio-proxy" containerID="cri-o://a35fe760d3af60aa3f6b2ef9b8ab6a4c8f79fe7eb7add801032f30672778657c" gracePeriod=30
Sep 10 21:11:11.351625 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:11.351587    2577 patch_prober.go:28] interesting pod/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:11:11.352015 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:11.351655    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:11:14.518286 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.518256    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:11:14.571570 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.571545    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbc2j\" (UniqueName: \"kubernetes.io/projected/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-kube-api-access-rbc2j\") pod \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") "
Sep 10 21:11:14.571724 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.571619    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-credential-socket\") pod \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") "
Sep 10 21:11:14.571775 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.571742    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-podinfo\") pod \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") "
Sep 10 21:11:14.571825 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.571789    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-token\") pod \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") "
Sep 10 21:11:14.571882 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.571829    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-workload-socket\") pod \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") "
Sep 10 21:11:14.571882 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.571858    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-workload-certs\") pod \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") "
Sep 10 21:11:14.571994 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.571887    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-envoy\") pod \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") "
Sep 10 21:11:14.571994 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.571943    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-data\") pod \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") "
Sep 10 21:11:14.572122 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.571999    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istiod-ca-cert\") pod \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\" (UID: \"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099\") "
Sep 10 21:11:14.572122 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.571884    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" (UID: "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:14.572240 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.572144    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" (UID: "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:14.572323 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.572301    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" (UID: "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:14.572393 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.572352    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" (UID: "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:14.572559 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.572541    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-credential-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:14.572638 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.572566    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-workload-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:14.572638 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.572581    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-workload-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:14.572638 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.572583    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" (UID: "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:14.572638 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.572594    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-data\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:14.574406 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.574370    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" (UID: "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:14.574524 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.574445    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" (UID: "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:11:14.574719 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.574694    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" (UID: "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:14.574959 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.574937    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-kube-api-access-rbc2j" (OuterVolumeSpecName: "kube-api-access-rbc2j") pod "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" (UID: "0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099"). InnerVolumeSpecName "kube-api-access-rbc2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:14.673312 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.673282    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istiod-ca-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:14.673312 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.673305    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbc2j\" (UniqueName: \"kubernetes.io/projected/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-kube-api-access-rbc2j\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:14.673312 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.673314    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-podinfo\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:14.673312 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.673323    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-token\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:14.673562 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:14.673333    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099-istio-envoy\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:15.095858 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.095822    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"]
Sep 10 21:11:15.096260 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096247    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a0b4309-4f60-42e3-ae48-b30242cff085" containerName="istio-proxy"
Sep 10 21:11:15.096314 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096262    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a0b4309-4f60-42e3-ae48-b30242cff085" containerName="istio-proxy"
Sep 10 21:11:15.096314 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096271    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="278e2686-95b4-457e-b7b9-fd01fc10ccb0" containerName="revoke-keys"
Sep 10 21:11:15.096314 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096278    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="278e2686-95b4-457e-b7b9-fd01fc10ccb0" containerName="revoke-keys"
Sep 10 21:11:15.096314 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096289    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerName="istio-proxy"
Sep 10 21:11:15.096314 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096294    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerName="istio-proxy"
Sep 10 21:11:15.096314 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096301    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1c56c9-d194-4693-8410-9ac46b4de2de" containerName="main"
Sep 10 21:11:15.096314 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096306    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1c56c9-d194-4693-8410-9ac46b4de2de" containerName="main"
Sep 10 21:11:15.096314 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096313    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerName="istio-proxy"
Sep 10 21:11:15.096314 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096318    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerName="istio-proxy"
Sep 10 21:11:15.096605 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096390    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="278e2686-95b4-457e-b7b9-fd01fc10ccb0" containerName="revoke-keys"
Sep 10 21:11:15.096605 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096401    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerName="istio-proxy"
Sep 10 21:11:15.096605 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096409    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerName="istio-proxy"
Sep 10 21:11:15.096605 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096416    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a0b4309-4f60-42e3-ae48-b30242cff085" containerName="istio-proxy"
Sep 10 21:11:15.096605 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.096422    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1c56c9-d194-4693-8410-9ac46b4de2de" containerName="main"
Sep 10 21:11:15.111940 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.111906    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"]
Sep 10 21:11:15.112094 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.112018    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"
Sep 10 21:11:15.114439 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.114419    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-50ba47\""
Sep 10 21:11:15.179023 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.178940    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776e1a33-f171-4334-935c-f2c5736f4b0a-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst\" (UID: \"776e1a33-f171-4334-935c-f2c5736f4b0a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"
Sep 10 21:11:15.179023 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.178980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frm8t\" (UniqueName: \"kubernetes.io/projected/776e1a33-f171-4334-935c-f2c5736f4b0a-kube-api-access-frm8t\") pod \"payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst\" (UID: \"776e1a33-f171-4334-935c-f2c5736f4b0a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"
Sep 10 21:11:15.206536 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.206500    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2"]
Sep 10 21:11:15.209302 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.209275    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2"
Sep 10 21:11:15.214718 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.214649    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:11:15.215333 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.215311    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:11:15.217510 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.217480    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2"]
Sep 10 21:11:15.280626 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.280593    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28298499-4b13-426a-a35e-79b228cbee2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2\" (UID: \"28298499-4b13-426a-a35e-79b228cbee2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2"
Sep 10 21:11:15.280794 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.280679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776e1a33-f171-4334-935c-f2c5736f4b0a-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst\" (UID: \"776e1a33-f171-4334-935c-f2c5736f4b0a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"
Sep 10 21:11:15.280794 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.280708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frm8t\" (UniqueName: \"kubernetes.io/projected/776e1a33-f171-4334-935c-f2c5736f4b0a-kube-api-access-frm8t\") pod \"payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst\" (UID: \"776e1a33-f171-4334-935c-f2c5736f4b0a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"
Sep 10 21:11:15.281440 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.281420    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776e1a33-f171-4334-935c-f2c5736f4b0a-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst\" (UID: \"776e1a33-f171-4334-935c-f2c5736f4b0a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"
Sep 10 21:11:15.288134 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.288105    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frm8t\" (UniqueName: \"kubernetes.io/projected/776e1a33-f171-4334-935c-f2c5736f4b0a-kube-api-access-frm8t\") pod \"payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst\" (UID: \"776e1a33-f171-4334-935c-f2c5736f4b0a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"
Sep 10 21:11:15.376273 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.376237    2577 generic.go:356] "Generic (PLEG): container finished" podID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerID="d659037cb09a1d150c695ba74bd052b1202ca6f2f582be4e9147c2273311864d" exitCode=0
Sep 10 21:11:15.376425 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.376272    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" event={"ID":"8451595c-d2d3-44dc-8272-6d5057b97d72","Type":"ContainerDied","Data":"d659037cb09a1d150c695ba74bd052b1202ca6f2f582be4e9147c2273311864d"}
Sep 10 21:11:15.376709 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.376692    2577 scope.go:117] "RemoveContainer" containerID="d659037cb09a1d150c695ba74bd052b1202ca6f2f582be4e9147c2273311864d"
Sep 10 21:11:15.377861 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.377829    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:11:15.377955 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.377899    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:11:15.377955 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.377936    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:11:15.378146 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.378127    2577 generic.go:356] "Generic (PLEG): container finished" podID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" containerID="a35fe760d3af60aa3f6b2ef9b8ab6a4c8f79fe7eb7add801032f30672778657c" exitCode=0
Sep 10 21:11:15.378203 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.378185    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"
Sep 10 21:11:15.378243 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.378208    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" event={"ID":"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099","Type":"ContainerDied","Data":"a35fe760d3af60aa3f6b2ef9b8ab6a4c8f79fe7eb7add801032f30672778657c"}
Sep 10 21:11:15.378277 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.378254    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9" event={"ID":"0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099","Type":"ContainerDied","Data":"010e1bff935a4483a7860e856a3ee90bc0f87b7cfa930aeb7401feb7ca9a5c9e"}
Sep 10 21:11:15.378311 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.378277    2577 scope.go:117] "RemoveContainer" containerID="a35fe760d3af60aa3f6b2ef9b8ab6a4c8f79fe7eb7add801032f30672778657c"
Sep 10 21:11:15.381503 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.381482    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28298499-4b13-426a-a35e-79b228cbee2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2\" (UID: \"28298499-4b13-426a-a35e-79b228cbee2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2"
Sep 10 21:11:15.382413 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.381990    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28298499-4b13-426a-a35e-79b228cbee2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2\" (UID: \"28298499-4b13-426a-a35e-79b228cbee2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2"
Sep 10 21:11:15.393317 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.393296    2577 scope.go:117] "RemoveContainer" containerID="d8ea4a8ea7e96fc9f4ef1978142c4e7ffa01193f56e0bfc844f1963731798df4"
Sep 10 21:11:15.412222 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.412198    2577 scope.go:117] "RemoveContainer" containerID="a35fe760d3af60aa3f6b2ef9b8ab6a4c8f79fe7eb7add801032f30672778657c"
Sep 10 21:11:15.412592 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:11:15.412569    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a35fe760d3af60aa3f6b2ef9b8ab6a4c8f79fe7eb7add801032f30672778657c\": container with ID starting with a35fe760d3af60aa3f6b2ef9b8ab6a4c8f79fe7eb7add801032f30672778657c not found: ID does not exist" containerID="a35fe760d3af60aa3f6b2ef9b8ab6a4c8f79fe7eb7add801032f30672778657c"
Sep 10 21:11:15.412692 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.412605    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a35fe760d3af60aa3f6b2ef9b8ab6a4c8f79fe7eb7add801032f30672778657c"} err="failed to get container status \"a35fe760d3af60aa3f6b2ef9b8ab6a4c8f79fe7eb7add801032f30672778657c\": rpc error: code = NotFound desc = could not find container \"a35fe760d3af60aa3f6b2ef9b8ab6a4c8f79fe7eb7add801032f30672778657c\": container with ID starting with a35fe760d3af60aa3f6b2ef9b8ab6a4c8f79fe7eb7add801032f30672778657c not found: ID does not exist"
Sep 10 21:11:15.412692 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.412631    2577 scope.go:117] "RemoveContainer" containerID="d8ea4a8ea7e96fc9f4ef1978142c4e7ffa01193f56e0bfc844f1963731798df4"
Sep 10 21:11:15.412990 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:11:15.412954    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8ea4a8ea7e96fc9f4ef1978142c4e7ffa01193f56e0bfc844f1963731798df4\": container with ID starting with d8ea4a8ea7e96fc9f4ef1978142c4e7ffa01193f56e0bfc844f1963731798df4 not found: ID does not exist" containerID="d8ea4a8ea7e96fc9f4ef1978142c4e7ffa01193f56e0bfc844f1963731798df4"
Sep 10 21:11:15.413084 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.413002    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8ea4a8ea7e96fc9f4ef1978142c4e7ffa01193f56e0bfc844f1963731798df4"} err="failed to get container status \"d8ea4a8ea7e96fc9f4ef1978142c4e7ffa01193f56e0bfc844f1963731798df4\": rpc error: code = NotFound desc = could not find container \"d8ea4a8ea7e96fc9f4ef1978142c4e7ffa01193f56e0bfc844f1963731798df4\": container with ID starting with d8ea4a8ea7e96fc9f4ef1978142c4e7ffa01193f56e0bfc844f1963731798df4 not found: ID does not exist"
Sep 10 21:11:15.414295 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.414273    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"]
Sep 10 21:11:15.421144 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.421123    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9"]
Sep 10 21:11:15.423255 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.423233    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"
Sep 10 21:11:15.532202 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.532175    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2"
Sep 10 21:11:15.701297 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.701266    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"]
Sep 10 21:11:15.703289 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:11:15.703259    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod776e1a33_f171_4334_935c_f2c5736f4b0a.slice/crio-5d46b8240e4559abd31888ef8ce362d0ef1346ed26640bea37690e3f8192a2bd WatchSource:0}: Error finding container 5d46b8240e4559abd31888ef8ce362d0ef1346ed26640bea37690e3f8192a2bd: Status 404 returned error can't find the container with id 5d46b8240e4559abd31888ef8ce362d0ef1346ed26640bea37690e3f8192a2bd
Sep 10 21:11:15.815552 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:15.815519    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2"]
Sep 10 21:11:15.815879 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:11:15.815855    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28298499_4b13_426a_a35e_79b228cbee2b.slice/crio-f15376cbb512140b99bcefd1db08b2a35716421b4f693b1f968dc3b5152ffa7f WatchSource:0}: Error finding container f15376cbb512140b99bcefd1db08b2a35716421b4f693b1f968dc3b5152ffa7f: Status 404 returned error can't find the container with id f15376cbb512140b99bcefd1db08b2a35716421b4f693b1f968dc3b5152ffa7f
Sep 10 21:11:16.387373 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:16.387335    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst" event={"ID":"776e1a33-f171-4334-935c-f2c5736f4b0a","Type":"ContainerStarted","Data":"ae256a3892dc02e09975a67b4469ba1c9489246ef25839bac73e2892dcf79f61"}
Sep 10 21:11:16.387551 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:16.387390    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst" event={"ID":"776e1a33-f171-4334-935c-f2c5736f4b0a","Type":"ContainerStarted","Data":"5d46b8240e4559abd31888ef8ce362d0ef1346ed26640bea37690e3f8192a2bd"}
Sep 10 21:11:16.387551 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:16.387420    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"
Sep 10 21:11:16.388969 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:16.388942    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2" event={"ID":"28298499-4b13-426a-a35e-79b228cbee2b","Type":"ContainerStarted","Data":"0a4b3dd19690a7b575f4b874af6e113c37cc34f230b4fa62067d02fc1bd83295"}
Sep 10 21:11:16.389119 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:16.388983    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2" event={"ID":"28298499-4b13-426a-a35e-79b228cbee2b","Type":"ContainerStarted","Data":"f15376cbb512140b99bcefd1db08b2a35716421b4f693b1f968dc3b5152ffa7f"}
Sep 10 21:11:16.391003 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:16.390969    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" event={"ID":"8451595c-d2d3-44dc-8272-6d5057b97d72","Type":"ContainerStarted","Data":"149bdf7aa4706ab30df4069f30673418a0b52206e13f4b583eee85e4e5727a0e"}
Sep 10 21:11:16.405516 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:16.405471    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst" podStartSLOduration=1.405454918 podStartE2EDuration="1.405454918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:16.403505587 +0000 UTC m=+803.977211973" watchObservedRunningTime="2026-09-10 21:11:16.405454918 +0000 UTC m=+803.979161331"
Sep 10 21:11:16.418858 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:16.418818    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2" podStartSLOduration=1.418806396 podStartE2EDuration="1.418806396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:16.416694627 +0000 UTC m=+803.990401000" watchObservedRunningTime="2026-09-10 21:11:16.418806396 +0000 UTC m=+803.992512770"
Sep 10 21:11:16.466810 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:16.466784    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:11:16.467929 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:16.467910    2577 patch_prober.go:28] interesting pod/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:16.467980 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:16.467951    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 21:11:16.947381 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:16.947342    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099" path="/var/lib/kubelet/pods/0c6c3c50-82c1-4a8f-b95f-ebca8e3a2099/volumes"
Sep 10 21:11:17.398294 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:17.398258    2577 generic.go:356] "Generic (PLEG): container finished" podID="28298499-4b13-426a-a35e-79b228cbee2b" containerID="0a4b3dd19690a7b575f4b874af6e113c37cc34f230b4fa62067d02fc1bd83295" exitCode=0
Sep 10 21:11:17.398467 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:17.398340    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2" event={"ID":"28298499-4b13-426a-a35e-79b228cbee2b","Type":"ContainerDied","Data":"0a4b3dd19690a7b575f4b874af6e113c37cc34f230b4fa62067d02fc1bd83295"}
Sep 10 21:11:17.466913 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:17.466878    2577 patch_prober.go:28] interesting pod/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:17.467071 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:17.466934    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 21:11:18.466270 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:18.466237    2577 patch_prober.go:28] interesting pod/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:18.466668 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:18.466289    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 21:11:18.574639 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:18.574611    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2"
Sep 10 21:11:18.727417 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:18.727322    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28298499-4b13-426a-a35e-79b228cbee2b-maas-api-service-ca\") pod \"28298499-4b13-426a-a35e-79b228cbee2b\" (UID: \"28298499-4b13-426a-a35e-79b228cbee2b\") "
Sep 10 21:11:18.728307 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:18.728278    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28298499-4b13-426a-a35e-79b228cbee2b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "28298499-4b13-426a-a35e-79b228cbee2b" (UID: "28298499-4b13-426a-a35e-79b228cbee2b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:18.829617 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:18.829566    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28298499-4b13-426a-a35e-79b228cbee2b-maas-api-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:19.201007 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:19.200974    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:11:19.413921 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:19.413879    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2" event={"ID":"28298499-4b13-426a-a35e-79b228cbee2b","Type":"ContainerDied","Data":"f15376cbb512140b99bcefd1db08b2a35716421b4f693b1f968dc3b5152ffa7f"}
Sep 10 21:11:19.414137 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:19.413945    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f15376cbb512140b99bcefd1db08b2a35716421b4f693b1f968dc3b5152ffa7f"
Sep 10 21:11:19.414137 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:19.414013    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2"
Sep 10 21:11:19.466496 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:19.466424    2577 patch_prober.go:28] interesting pod/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:19.466496 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:19.466487    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 21:11:20.466818 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:20.466780    2577 patch_prober.go:28] interesting pod/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:20.467227 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:20.466835    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 21:11:21.466845 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:21.466814    2577 patch_prober.go:28] interesting pod/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:21.467215 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:21.466869    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 21:11:21.561823 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:21.561788    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"]
Sep 10 21:11:21.562013 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:21.561979    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm" podUID="0934ac16-e348-4f89-af5f-7cf88924a6c9" containerName="payload-processing" containerID="cri-o://a1d753068ac1538ac55667b1c6bc1534b332878a70db14d663435308bc1dd737" gracePeriod=30
Sep 10 21:11:21.568721 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:21.568623    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"]
Sep 10 21:11:21.568957 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:21.568928    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b" podUID="26e08c77-e4a4-41ba-8d5a-dfc16390fdd0" containerName="payload-pre-processing" containerID="cri-o://d732500d5b019469d6990c96642e6ecc5131c77cbfdd6d838c1d7cbdbe97df40" gracePeriod=30
Sep 10 21:11:21.843240 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:21.842681    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2"]
Sep 10 21:11:21.846164 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:21.846138    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1992fc41-kpsk2"]
Sep 10 21:11:21.868304 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:21.868274    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"
Sep 10 21:11:21.896096 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:21.896067    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"
Sep 10 21:11:21.962648 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:21.962618    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqtvt\" (UniqueName: \"kubernetes.io/projected/0934ac16-e348-4f89-af5f-7cf88924a6c9-kube-api-access-wqtvt\") pod \"0934ac16-e348-4f89-af5f-7cf88924a6c9\" (UID: \"0934ac16-e348-4f89-af5f-7cf88924a6c9\") "
Sep 10 21:11:21.962824 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:21.962667    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0934ac16-e348-4f89-af5f-7cf88924a6c9-plugins-config-volume\") pod \"0934ac16-e348-4f89-af5f-7cf88924a6c9\" (UID: \"0934ac16-e348-4f89-af5f-7cf88924a6c9\") "
Sep 10 21:11:21.963081 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:21.963054    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0934ac16-e348-4f89-af5f-7cf88924a6c9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0934ac16-e348-4f89-af5f-7cf88924a6c9" (UID: "0934ac16-e348-4f89-af5f-7cf88924a6c9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:21.964659 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:21.964638    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0934ac16-e348-4f89-af5f-7cf88924a6c9-kube-api-access-wqtvt" (OuterVolumeSpecName: "kube-api-access-wqtvt") pod "0934ac16-e348-4f89-af5f-7cf88924a6c9" (UID: "0934ac16-e348-4f89-af5f-7cf88924a6c9"). InnerVolumeSpecName "kube-api-access-wqtvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:22.064210 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.064132    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26e08c77-e4a4-41ba-8d5a-dfc16390fdd0-plugins-config-volume\") pod \"26e08c77-e4a4-41ba-8d5a-dfc16390fdd0\" (UID: \"26e08c77-e4a4-41ba-8d5a-dfc16390fdd0\") "
Sep 10 21:11:22.064373 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.064250    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zsmh\" (UniqueName: \"kubernetes.io/projected/26e08c77-e4a4-41ba-8d5a-dfc16390fdd0-kube-api-access-8zsmh\") pod \"26e08c77-e4a4-41ba-8d5a-dfc16390fdd0\" (UID: \"26e08c77-e4a4-41ba-8d5a-dfc16390fdd0\") "
Sep 10 21:11:22.064455 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.064432    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqtvt\" (UniqueName: \"kubernetes.io/projected/0934ac16-e348-4f89-af5f-7cf88924a6c9-kube-api-access-wqtvt\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:22.064455 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.064446    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0934ac16-e348-4f89-af5f-7cf88924a6c9-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:22.064572 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.064468    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26e08c77-e4a4-41ba-8d5a-dfc16390fdd0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "26e08c77-e4a4-41ba-8d5a-dfc16390fdd0" (UID: "26e08c77-e4a4-41ba-8d5a-dfc16390fdd0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:22.066392 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.066366    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26e08c77-e4a4-41ba-8d5a-dfc16390fdd0-kube-api-access-8zsmh" (OuterVolumeSpecName: "kube-api-access-8zsmh") pod "26e08c77-e4a4-41ba-8d5a-dfc16390fdd0" (UID: "26e08c77-e4a4-41ba-8d5a-dfc16390fdd0"). InnerVolumeSpecName "kube-api-access-8zsmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:22.164942 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.164903    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zsmh\" (UniqueName: \"kubernetes.io/projected/26e08c77-e4a4-41ba-8d5a-dfc16390fdd0-kube-api-access-8zsmh\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:22.164942 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.164934    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26e08c77-e4a4-41ba-8d5a-dfc16390fdd0-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:22.440752 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.440714    2577 generic.go:356] "Generic (PLEG): container finished" podID="0934ac16-e348-4f89-af5f-7cf88924a6c9" containerID="a1d753068ac1538ac55667b1c6bc1534b332878a70db14d663435308bc1dd737" exitCode=0
Sep 10 21:11:22.440958 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.440773    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"
Sep 10 21:11:22.440958 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.440795    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm" event={"ID":"0934ac16-e348-4f89-af5f-7cf88924a6c9","Type":"ContainerDied","Data":"a1d753068ac1538ac55667b1c6bc1534b332878a70db14d663435308bc1dd737"}
Sep 10 21:11:22.440958 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.440882    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm" event={"ID":"0934ac16-e348-4f89-af5f-7cf88924a6c9","Type":"ContainerDied","Data":"f49d97ef506667f2ea19a57f08f273d08814b042f6152fd90bf3c557263b1c4d"}
Sep 10 21:11:22.440958 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.440913    2577 scope.go:117] "RemoveContainer" containerID="a1d753068ac1538ac55667b1c6bc1534b332878a70db14d663435308bc1dd737"
Sep 10 21:11:22.442699 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.442547    2577 generic.go:356] "Generic (PLEG): container finished" podID="26e08c77-e4a4-41ba-8d5a-dfc16390fdd0" containerID="d732500d5b019469d6990c96642e6ecc5131c77cbfdd6d838c1d7cbdbe97df40" exitCode=0
Sep 10 21:11:22.442699 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.442624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b" event={"ID":"26e08c77-e4a4-41ba-8d5a-dfc16390fdd0","Type":"ContainerDied","Data":"d732500d5b019469d6990c96642e6ecc5131c77cbfdd6d838c1d7cbdbe97df40"}
Sep 10 21:11:22.442699 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.442668    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b" event={"ID":"26e08c77-e4a4-41ba-8d5a-dfc16390fdd0","Type":"ContainerDied","Data":"d1a3e627727554672615d993883127db2e3d50644de1f0f6d676f6d8fe5bfff4"}
Sep 10 21:11:22.442912 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.442703    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"
Sep 10 21:11:22.452683 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.452665    2577 scope.go:117] "RemoveContainer" containerID="a1d753068ac1538ac55667b1c6bc1534b332878a70db14d663435308bc1dd737"
Sep 10 21:11:22.453080 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:11:22.453053    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1d753068ac1538ac55667b1c6bc1534b332878a70db14d663435308bc1dd737\": container with ID starting with a1d753068ac1538ac55667b1c6bc1534b332878a70db14d663435308bc1dd737 not found: ID does not exist" containerID="a1d753068ac1538ac55667b1c6bc1534b332878a70db14d663435308bc1dd737"
Sep 10 21:11:22.453177 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.453092    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d753068ac1538ac55667b1c6bc1534b332878a70db14d663435308bc1dd737"} err="failed to get container status \"a1d753068ac1538ac55667b1c6bc1534b332878a70db14d663435308bc1dd737\": rpc error: code = NotFound desc = could not find container \"a1d753068ac1538ac55667b1c6bc1534b332878a70db14d663435308bc1dd737\": container with ID starting with a1d753068ac1538ac55667b1c6bc1534b332878a70db14d663435308bc1dd737 not found: ID does not exist"
Sep 10 21:11:22.453177 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.453114    2577 scope.go:117] "RemoveContainer" containerID="d732500d5b019469d6990c96642e6ecc5131c77cbfdd6d838c1d7cbdbe97df40"
Sep 10 21:11:22.462389 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.462370    2577 scope.go:117] "RemoveContainer" containerID="d732500d5b019469d6990c96642e6ecc5131c77cbfdd6d838c1d7cbdbe97df40"
Sep 10 21:11:22.462692 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:11:22.462669    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d732500d5b019469d6990c96642e6ecc5131c77cbfdd6d838c1d7cbdbe97df40\": container with ID starting with d732500d5b019469d6990c96642e6ecc5131c77cbfdd6d838c1d7cbdbe97df40 not found: ID does not exist" containerID="d732500d5b019469d6990c96642e6ecc5131c77cbfdd6d838c1d7cbdbe97df40"
Sep 10 21:11:22.462765 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.462706    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d732500d5b019469d6990c96642e6ecc5131c77cbfdd6d838c1d7cbdbe97df40"} err="failed to get container status \"d732500d5b019469d6990c96642e6ecc5131c77cbfdd6d838c1d7cbdbe97df40\": rpc error: code = NotFound desc = could not find container \"d732500d5b019469d6990c96642e6ecc5131c77cbfdd6d838c1d7cbdbe97df40\": container with ID starting with d732500d5b019469d6990c96642e6ecc5131c77cbfdd6d838c1d7cbdbe97df40 not found: ID does not exist"
Sep 10 21:11:22.466276 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.466245    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"]
Sep 10 21:11:22.466638 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.466612    2577 patch_prober.go:28] interesting pod/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:22.466696 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.466675    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 21:11:22.472011 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.471988    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm"]
Sep 10 21:11:22.481969 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.481948    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"]
Sep 10 21:11:22.485725 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.485692    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b"]
Sep 10 21:11:22.887544 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.887514    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"]
Sep 10 21:11:22.887758 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.887723    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerName="istio-proxy" containerID="cri-o://149bdf7aa4706ab30df4069f30673418a0b52206e13f4b583eee85e4e5727a0e" gracePeriod=30
Sep 10 21:11:22.946596 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.946561    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0934ac16-e348-4f89-af5f-7cf88924a6c9" path="/var/lib/kubelet/pods/0934ac16-e348-4f89-af5f-7cf88924a6c9/volumes"
Sep 10 21:11:22.946947 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.946935    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26e08c77-e4a4-41ba-8d5a-dfc16390fdd0" path="/var/lib/kubelet/pods/26e08c77-e4a4-41ba-8d5a-dfc16390fdd0/volumes"
Sep 10 21:11:22.947286 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:22.947273    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28298499-4b13-426a-a35e-79b228cbee2b" path="/var/lib/kubelet/pods/28298499-4b13-426a-a35e-79b228cbee2b/volumes"
Sep 10 21:11:23.578955 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.578913    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"]
Sep 10 21:11:23.579450 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.579338    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28298499-4b13-426a-a35e-79b228cbee2b" containerName="revoke-keys"
Sep 10 21:11:23.579450 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.579352    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="28298499-4b13-426a-a35e-79b228cbee2b" containerName="revoke-keys"
Sep 10 21:11:23.579450 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.579361    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0934ac16-e348-4f89-af5f-7cf88924a6c9" containerName="payload-processing"
Sep 10 21:11:23.579450 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.579367    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0934ac16-e348-4f89-af5f-7cf88924a6c9" containerName="payload-processing"
Sep 10 21:11:23.579450 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.579374    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e08c77-e4a4-41ba-8d5a-dfc16390fdd0" containerName="payload-pre-processing"
Sep 10 21:11:23.579450 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.579379    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e08c77-e4a4-41ba-8d5a-dfc16390fdd0" containerName="payload-pre-processing"
Sep 10 21:11:23.579450 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.579449    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0934ac16-e348-4f89-af5f-7cf88924a6c9" containerName="payload-processing"
Sep 10 21:11:23.579807 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.579459    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="26e08c77-e4a4-41ba-8d5a-dfc16390fdd0" containerName="payload-pre-processing"
Sep 10 21:11:23.579807 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.579466    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="28298499-4b13-426a-a35e-79b228cbee2b" containerName="revoke-keys"
Sep 10 21:11:23.584113 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.584092    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.586222 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.586199    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f68becc7-openshift-default-dockercfg-rkxmg\""
Sep 10 21:11:23.596388 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.596366    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"]
Sep 10 21:11:23.673925 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.673895    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:11:23.678632 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.678611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9dj2\" (UniqueName: \"kubernetes.io/projected/1c48d251-2940-49e8-96a0-e97434fbf79b-kube-api-access-s9dj2\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.678706 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.678650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-credential-socket\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.678706 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.678676    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-podinfo\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.678792 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.678732    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-envoy\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.678792 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.678762    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-workload-certs\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.678792 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.678783    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c48d251-2940-49e8-96a0-e97434fbf79b-istiod-ca-cert\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.678937 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.678802    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-token\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.678937 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.678818    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-data\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.678937 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.678902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-workload-socket\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.779678 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.779650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-credential-socket\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.779790 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.779685    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-podinfo\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.779790 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.779708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-envoy\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.779790 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.779735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-workload-certs\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.779790 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.779761    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c48d251-2940-49e8-96a0-e97434fbf79b-istiod-ca-cert\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.780052 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.779894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-token\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.780052 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.779944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-data\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.780052 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.779984    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-workload-socket\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.780217 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.780088    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9dj2\" (UniqueName: \"kubernetes.io/projected/1c48d251-2940-49e8-96a0-e97434fbf79b-kube-api-access-s9dj2\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.780217 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.780136    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-credential-socket\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.780217 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.780172    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-workload-certs\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.780419 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.780393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-workload-socket\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.780477 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.780417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-data\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.780593 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.780548    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c48d251-2940-49e8-96a0-e97434fbf79b-istiod-ca-cert\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.782196 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.782169    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-envoy\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.782388 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.782370    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-podinfo\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.790948 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.790920    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-token\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.791150 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.791131    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9dj2\" (UniqueName: \"kubernetes.io/projected/1c48d251-2940-49e8-96a0-e97434fbf79b-kube-api-access-s9dj2\") pod \"e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") " pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:23.895281 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:23.895208    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:24.168443 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:24.168413    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"]
Sep 10 21:11:24.169637 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:11:24.169612    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c48d251_2940_49e8_96a0_e97434fbf79b.slice/crio-eb5ea8a9d1029e747ceed47d21db84aa3eec55b45fe445acb6bf52d834f478da WatchSource:0}: Error finding container eb5ea8a9d1029e747ceed47d21db84aa3eec55b45fe445acb6bf52d834f478da: Status 404 returned error can't find the container with id eb5ea8a9d1029e747ceed47d21db84aa3eec55b45fe445acb6bf52d834f478da
Sep 10 21:11:24.171764 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:24.171732    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:11:24.171862 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:24.171808    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:11:24.171862 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:24.171854    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:11:24.458287 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:24.458193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" event={"ID":"1c48d251-2940-49e8-96a0-e97434fbf79b","Type":"ContainerStarted","Data":"cc0f3c27fbda2b5f06b62aa922882156f5b18afceb32c4a66a8f46749cbfe0a5"}
Sep 10 21:11:24.458287 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:24.458260    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" event={"ID":"1c48d251-2940-49e8-96a0-e97434fbf79b","Type":"ContainerStarted","Data":"eb5ea8a9d1029e747ceed47d21db84aa3eec55b45fe445acb6bf52d834f478da"}
Sep 10 21:11:24.478864 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:24.478781    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" podStartSLOduration=1.478759666 podStartE2EDuration="1.478759666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:24.475995764 +0000 UTC m=+812.049702138" watchObservedRunningTime="2026-09-10 21:11:24.478759666 +0000 UTC m=+812.052466042"
Sep 10 21:11:24.895984 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:24.895949    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:25.902250 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:25.902219    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:26.470150 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:26.470119    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:26.471134 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:26.471113    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:27.400452 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:27.400420    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"
Sep 10 21:11:28.049383 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.049349    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"]
Sep 10 21:11:28.053058 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.053015    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"
Sep 10 21:11:28.055367 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.055326    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-f68becc7-dockercfg-8gqtv\""
Sep 10 21:11:28.055489 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.055397    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-f68becc7\""
Sep 10 21:11:28.061743 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.061678    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"]
Sep 10 21:11:28.137383 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.137360    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"]
Sep 10 21:11:28.141243 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.141227    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"
Sep 10 21:11:28.150846 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.150779    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:11:28.151272 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.151252    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"]
Sep 10 21:11:28.227933 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.227897    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30c416c3-b463-421e-8ddb-ec6f2042c807-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf\" (UID: \"30c416c3-b463-421e-8ddb-ec6f2042c807\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"
Sep 10 21:11:28.228120 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.228008    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94vd9\" (UniqueName: \"kubernetes.io/projected/30c416c3-b463-421e-8ddb-ec6f2042c807-kube-api-access-94vd9\") pod \"payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf\" (UID: \"30c416c3-b463-421e-8ddb-ec6f2042c807\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"
Sep 10 21:11:28.328597 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.328570    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-token\") pod \"8451595c-d2d3-44dc-8272-6d5057b97d72\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") "
Sep 10 21:11:28.328742 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.328604    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8974c\" (UniqueName: \"kubernetes.io/projected/8451595c-d2d3-44dc-8272-6d5057b97d72-kube-api-access-8974c\") pod \"8451595c-d2d3-44dc-8272-6d5057b97d72\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") "
Sep 10 21:11:28.328742 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.328650    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-workload-socket\") pod \"8451595c-d2d3-44dc-8272-6d5057b97d72\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") "
Sep 10 21:11:28.328742 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.328679    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-credential-socket\") pod \"8451595c-d2d3-44dc-8272-6d5057b97d72\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") "
Sep 10 21:11:28.328742 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.328706    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-data\") pod \"8451595c-d2d3-44dc-8272-6d5057b97d72\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") "
Sep 10 21:11:28.328742 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.328733    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-envoy\") pod \"8451595c-d2d3-44dc-8272-6d5057b97d72\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") "
Sep 10 21:11:28.329016 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.328797    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-podinfo\") pod \"8451595c-d2d3-44dc-8272-6d5057b97d72\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") "
Sep 10 21:11:28.329016 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.328836    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-workload-certs\") pod \"8451595c-d2d3-44dc-8272-6d5057b97d72\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") "
Sep 10 21:11:28.329016 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.328880    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8451595c-d2d3-44dc-8272-6d5057b97d72-istiod-ca-cert\") pod \"8451595c-d2d3-44dc-8272-6d5057b97d72\" (UID: \"8451595c-d2d3-44dc-8272-6d5057b97d72\") "
Sep 10 21:11:28.329016 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.328965    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8451595c-d2d3-44dc-8272-6d5057b97d72" (UID: "8451595c-d2d3-44dc-8272-6d5057b97d72"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:28.329016 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.328982    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8451595c-d2d3-44dc-8272-6d5057b97d72" (UID: "8451595c-d2d3-44dc-8272-6d5057b97d72"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:28.329321 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.329009    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30c416c3-b463-421e-8ddb-ec6f2042c807-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf\" (UID: \"30c416c3-b463-421e-8ddb-ec6f2042c807\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"
Sep 10 21:11:28.329321 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.329160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94vd9\" (UniqueName: \"kubernetes.io/projected/30c416c3-b463-421e-8ddb-ec6f2042c807-kube-api-access-94vd9\") pod \"payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf\" (UID: \"30c416c3-b463-421e-8ddb-ec6f2042c807\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"
Sep 10 21:11:28.329321 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.329208    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8451595c-d2d3-44dc-8272-6d5057b97d72" (UID: "8451595c-d2d3-44dc-8272-6d5057b97d72"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:28.329321 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.329258    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ksjp\" (UniqueName: \"kubernetes.io/projected/564e9739-0c7c-4abc-8f23-46671ce0ebdf-kube-api-access-5ksjp\") pod \"payload-processing-e2e-derive-f68becc7-645886497-2htnv\" (UID: \"564e9739-0c7c-4abc-8f23-46671ce0ebdf\") " pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"
Sep 10 21:11:28.329321 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.329306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/564e9739-0c7c-4abc-8f23-46671ce0ebdf-plugins-config-volume\") pod \"payload-processing-e2e-derive-f68becc7-645886497-2htnv\" (UID: \"564e9739-0c7c-4abc-8f23-46671ce0ebdf\") " pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"
Sep 10 21:11:28.329573 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.329324    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8451595c-d2d3-44dc-8272-6d5057b97d72-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8451595c-d2d3-44dc-8272-6d5057b97d72" (UID: "8451595c-d2d3-44dc-8272-6d5057b97d72"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:28.329573 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.329361    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-workload-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:28.329573 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.329376    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-credential-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:28.329573 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.329389    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-workload-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:28.329573 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.329452    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-data" (OuterVolumeSpecName: "istio-data") pod "8451595c-d2d3-44dc-8272-6d5057b97d72" (UID: "8451595c-d2d3-44dc-8272-6d5057b97d72"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:28.330070 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.330046    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30c416c3-b463-421e-8ddb-ec6f2042c807-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf\" (UID: \"30c416c3-b463-421e-8ddb-ec6f2042c807\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"
Sep 10 21:11:28.330942 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.330916    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8451595c-d2d3-44dc-8272-6d5057b97d72" (UID: "8451595c-d2d3-44dc-8272-6d5057b97d72"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:11:28.331065 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.331016    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8451595c-d2d3-44dc-8272-6d5057b97d72-kube-api-access-8974c" (OuterVolumeSpecName: "kube-api-access-8974c") pod "8451595c-d2d3-44dc-8272-6d5057b97d72" (UID: "8451595c-d2d3-44dc-8272-6d5057b97d72"). InnerVolumeSpecName "kube-api-access-8974c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:28.331250 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.331232    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-token" (OuterVolumeSpecName: "istio-token") pod "8451595c-d2d3-44dc-8272-6d5057b97d72" (UID: "8451595c-d2d3-44dc-8272-6d5057b97d72"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:28.331338 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.331325    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8451595c-d2d3-44dc-8272-6d5057b97d72" (UID: "8451595c-d2d3-44dc-8272-6d5057b97d72"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:28.336476 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.336455    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94vd9\" (UniqueName: \"kubernetes.io/projected/30c416c3-b463-421e-8ddb-ec6f2042c807-kube-api-access-94vd9\") pod \"payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf\" (UID: \"30c416c3-b463-421e-8ddb-ec6f2042c807\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"
Sep 10 21:11:28.366598 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.366571    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"
Sep 10 21:11:28.430678 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.430643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ksjp\" (UniqueName: \"kubernetes.io/projected/564e9739-0c7c-4abc-8f23-46671ce0ebdf-kube-api-access-5ksjp\") pod \"payload-processing-e2e-derive-f68becc7-645886497-2htnv\" (UID: \"564e9739-0c7c-4abc-8f23-46671ce0ebdf\") " pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"
Sep 10 21:11:28.431098 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.430696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/564e9739-0c7c-4abc-8f23-46671ce0ebdf-plugins-config-volume\") pod \"payload-processing-e2e-derive-f68becc7-645886497-2htnv\" (UID: \"564e9739-0c7c-4abc-8f23-46671ce0ebdf\") " pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"
Sep 10 21:11:28.431098 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.430751    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-podinfo\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:28.431098 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.430768    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8451595c-d2d3-44dc-8272-6d5057b97d72-istiod-ca-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:28.431098 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.430781    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-token\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:28.431098 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.430793    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8974c\" (UniqueName: \"kubernetes.io/projected/8451595c-d2d3-44dc-8272-6d5057b97d72-kube-api-access-8974c\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:28.431098 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.430805    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-data\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:28.431098 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.430818    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8451595c-d2d3-44dc-8272-6d5057b97d72-istio-envoy\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:28.431664 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.431637    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/564e9739-0c7c-4abc-8f23-46671ce0ebdf-plugins-config-volume\") pod \"payload-processing-e2e-derive-f68becc7-645886497-2htnv\" (UID: \"564e9739-0c7c-4abc-8f23-46671ce0ebdf\") " pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"
Sep 10 21:11:28.438100 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.438077    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ksjp\" (UniqueName: \"kubernetes.io/projected/564e9739-0c7c-4abc-8f23-46671ce0ebdf-kube-api-access-5ksjp\") pod \"payload-processing-e2e-derive-f68becc7-645886497-2htnv\" (UID: \"564e9739-0c7c-4abc-8f23-46671ce0ebdf\") " pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"
Sep 10 21:11:28.458134 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.458110    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"
Sep 10 21:11:28.483398 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.483369    2577 generic.go:356] "Generic (PLEG): container finished" podID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerID="149bdf7aa4706ab30df4069f30673418a0b52206e13f4b583eee85e4e5727a0e" exitCode=0
Sep 10 21:11:28.483513 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.483422    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"
Sep 10 21:11:28.483513 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.483452    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" event={"ID":"8451595c-d2d3-44dc-8272-6d5057b97d72","Type":"ContainerDied","Data":"149bdf7aa4706ab30df4069f30673418a0b52206e13f4b583eee85e4e5727a0e"}
Sep 10 21:11:28.483513 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.483509    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j" event={"ID":"8451595c-d2d3-44dc-8272-6d5057b97d72","Type":"ContainerDied","Data":"a520233ac4eabd6963d6213f340f6146d90bccc095623858b80f50de1e53bcb8"}
Sep 10 21:11:28.483668 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.483540    2577 scope.go:117] "RemoveContainer" containerID="149bdf7aa4706ab30df4069f30673418a0b52206e13f4b583eee85e4e5727a0e"
Sep 10 21:11:28.497157 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.497086    2577 scope.go:117] "RemoveContainer" containerID="d659037cb09a1d150c695ba74bd052b1202ca6f2f582be4e9147c2273311864d"
Sep 10 21:11:28.507097 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.507074    2577 scope.go:117] "RemoveContainer" containerID="149bdf7aa4706ab30df4069f30673418a0b52206e13f4b583eee85e4e5727a0e"
Sep 10 21:11:28.507420 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:11:28.507396    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"149bdf7aa4706ab30df4069f30673418a0b52206e13f4b583eee85e4e5727a0e\": container with ID starting with 149bdf7aa4706ab30df4069f30673418a0b52206e13f4b583eee85e4e5727a0e not found: ID does not exist" containerID="149bdf7aa4706ab30df4069f30673418a0b52206e13f4b583eee85e4e5727a0e"
Sep 10 21:11:28.507502 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.507428    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"149bdf7aa4706ab30df4069f30673418a0b52206e13f4b583eee85e4e5727a0e"} err="failed to get container status \"149bdf7aa4706ab30df4069f30673418a0b52206e13f4b583eee85e4e5727a0e\": rpc error: code = NotFound desc = could not find container \"149bdf7aa4706ab30df4069f30673418a0b52206e13f4b583eee85e4e5727a0e\": container with ID starting with 149bdf7aa4706ab30df4069f30673418a0b52206e13f4b583eee85e4e5727a0e not found: ID does not exist"
Sep 10 21:11:28.507502 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.507446    2577 scope.go:117] "RemoveContainer" containerID="d659037cb09a1d150c695ba74bd052b1202ca6f2f582be4e9147c2273311864d"
Sep 10 21:11:28.507776 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:11:28.507748    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d659037cb09a1d150c695ba74bd052b1202ca6f2f582be4e9147c2273311864d\": container with ID starting with d659037cb09a1d150c695ba74bd052b1202ca6f2f582be4e9147c2273311864d not found: ID does not exist" containerID="d659037cb09a1d150c695ba74bd052b1202ca6f2f582be4e9147c2273311864d"
Sep 10 21:11:28.507857 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.507783    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d659037cb09a1d150c695ba74bd052b1202ca6f2f582be4e9147c2273311864d"} err="failed to get container status \"d659037cb09a1d150c695ba74bd052b1202ca6f2f582be4e9147c2273311864d\": rpc error: code = NotFound desc = could not find container \"d659037cb09a1d150c695ba74bd052b1202ca6f2f582be4e9147c2273311864d\": container with ID starting with d659037cb09a1d150c695ba74bd052b1202ca6f2f582be4e9147c2273311864d not found: ID does not exist"
Sep 10 21:11:28.508640 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.508398    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"]
Sep 10 21:11:28.512868 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.512844    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j"]
Sep 10 21:11:28.635793 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.635767    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"]
Sep 10 21:11:28.637567 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:11:28.637534    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c416c3_b463_421e_8ddb_ec6f2042c807.slice/crio-80b3b4cecfe79d54ac825f689fbc8a6b490b92962fe2742d2450a427a6935fb0 WatchSource:0}: Error finding container 80b3b4cecfe79d54ac825f689fbc8a6b490b92962fe2742d2450a427a6935fb0: Status 404 returned error can't find the container with id 80b3b4cecfe79d54ac825f689fbc8a6b490b92962fe2742d2450a427a6935fb0
Sep 10 21:11:28.734605 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.734578    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"]
Sep 10 21:11:28.735815 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:11:28.735790    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564e9739_0c7c_4abc_8f23_46671ce0ebdf.slice/crio-f778c2291f933210e5e57438a4adad4011cc994a24be5dc6c6f163c16b610621 WatchSource:0}: Error finding container f778c2291f933210e5e57438a4adad4011cc994a24be5dc6c6f163c16b610621: Status 404 returned error can't find the container with id f778c2291f933210e5e57438a4adad4011cc994a24be5dc6c6f163c16b610621
Sep 10 21:11:28.947109 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:28.947015    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" path="/var/lib/kubelet/pods/8451595c-d2d3-44dc-8272-6d5057b97d72/volumes"
Sep 10 21:11:29.492266 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:29.492222    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv" event={"ID":"564e9739-0c7c-4abc-8f23-46671ce0ebdf","Type":"ContainerStarted","Data":"96b91c65983bfb2e970c362726b4feea8481885f749f8adcf04603386a581cfb"}
Sep 10 21:11:29.492723 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:29.492307    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv" event={"ID":"564e9739-0c7c-4abc-8f23-46671ce0ebdf","Type":"ContainerStarted","Data":"f778c2291f933210e5e57438a4adad4011cc994a24be5dc6c6f163c16b610621"}
Sep 10 21:11:29.492723 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:29.492338    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"
Sep 10 21:11:29.494907 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:29.494879    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf" event={"ID":"30c416c3-b463-421e-8ddb-ec6f2042c807","Type":"ContainerStarted","Data":"4b524f6c533192445c76b4d4a3e4b98a003de8822238993603df56b395f120c1"}
Sep 10 21:11:29.495068 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:29.494924    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf" event={"ID":"30c416c3-b463-421e-8ddb-ec6f2042c807","Type":"ContainerStarted","Data":"80b3b4cecfe79d54ac825f689fbc8a6b490b92962fe2742d2450a427a6935fb0"}
Sep 10 21:11:29.495068 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:29.494959    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"
Sep 10 21:11:29.509614 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:29.509554    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv" podStartSLOduration=1.509536304 podStartE2EDuration="1.509536304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:29.508716651 +0000 UTC m=+817.082423016" watchObservedRunningTime="2026-09-10 21:11:29.509536304 +0000 UTC m=+817.083242678"
Sep 10 21:11:29.525295 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:29.525255    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf" podStartSLOduration=1.525245558 podStartE2EDuration="1.525245558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:29.523960804 +0000 UTC m=+817.097667180" watchObservedRunningTime="2026-09-10 21:11:29.525245558 +0000 UTC m=+817.098951931"
Sep 10 21:11:35.676544 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:35.676504    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"]
Sep 10 21:11:40.502560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:40.502533    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"
Sep 10 21:11:40.502995 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:40.502684    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"
Sep 10 21:11:42.512157 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:42.512116    2577 patch_prober.go:28] interesting pod/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:11:42.512526 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:42.512183    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:11:44.594351 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:44.594317    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerID="cc0f3c27fbda2b5f06b62aa922882156f5b18afceb32c4a66a8f46749cbfe0a5" exitCode=0
Sep 10 21:11:44.594771 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:44.594392    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" event={"ID":"1c48d251-2940-49e8-96a0-e97434fbf79b","Type":"ContainerDied","Data":"cc0f3c27fbda2b5f06b62aa922882156f5b18afceb32c4a66a8f46749cbfe0a5"}
Sep 10 21:11:44.594827 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:44.594789    2577 scope.go:117] "RemoveContainer" containerID="cc0f3c27fbda2b5f06b62aa922882156f5b18afceb32c4a66a8f46749cbfe0a5"
Sep 10 21:11:44.595828 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:44.595796    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:11:44.595879 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:44.595871    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:11:44.595914 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:44.595906    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:11:45.601911 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:45.601874    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" event={"ID":"1c48d251-2940-49e8-96a0-e97434fbf79b","Type":"ContainerStarted","Data":"a9c6057a86589808cae40bae4a6635d54683c81a2f56317c18edc392ab08f19a"}
Sep 10 21:11:45.895972 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:45.895866    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:45.896165 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:45.896140    2577 patch_prober.go:28] interesting pod/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:11:45.896224 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:45.896191    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 21:11:46.462914 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:46.462881    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:11:46.895618 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:46.895579    2577 patch_prober.go:28] interesting pod/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:11:46.896005 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:46.895641    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 21:11:47.895993 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:47.895957    2577 patch_prober.go:28] interesting pod/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:11:47.896418 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:47.896012    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 21:11:48.895833 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:48.895796    2577 patch_prober.go:28] interesting pod/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:11:48.896054 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:48.895853    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 21:11:49.896424 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:49.896389    2577 patch_prober.go:28] interesting pod/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:11:49.896796 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:49.896456    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 21:11:50.593971 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.593934    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg"]
Sep 10 21:11:50.594416 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.594401    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerName="istio-proxy"
Sep 10 21:11:50.594467 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.594418    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerName="istio-proxy"
Sep 10 21:11:50.594516 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.594506    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerName="istio-proxy"
Sep 10 21:11:50.597725 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.597709    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg"
Sep 10 21:11:50.600023 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.600000    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:11:50.600200 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.600002    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:11:50.604505 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.604481    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg"]
Sep 10 21:11:50.647417 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.647382    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34de42a0-a6fc-4d1a-987e-49704c03a142-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg\" (UID: \"34de42a0-a6fc-4d1a-987e-49704c03a142\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg"
Sep 10 21:11:50.695812 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.695770    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8" podUID="68075ec7-cf6c-43fd-9741-c7dfda3202e8" containerName="main" containerID="cri-o://5317d4c31c18d8fc647db0d5e1a955156cb1da67ce6e5b2884c42cefce669c2a" gracePeriod=45
Sep 10 21:11:50.748320 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.748291    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34de42a0-a6fc-4d1a-987e-49704c03a142-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg\" (UID: \"34de42a0-a6fc-4d1a-987e-49704c03a142\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg"
Sep 10 21:11:50.748902 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.748881    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34de42a0-a6fc-4d1a-987e-49704c03a142-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg\" (UID: \"34de42a0-a6fc-4d1a-987e-49704c03a142\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg"
Sep 10 21:11:50.773481 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.773450    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8" podUID="68075ec7-cf6c-43fd-9741-c7dfda3202e8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": dial tcp 10.132.0.47:8000: connect: connection refused"
Sep 10 21:11:50.896548 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.896515    2577 patch_prober.go:28] interesting pod/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:11:50.896927 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.896579    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 21:11:50.911409 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.911157    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg"
Sep 10 21:11:50.985292 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:50.985222    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:11:51.050587 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.050550    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-tmp-dir\") pod \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") "
Sep 10 21:11:51.050763 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.050625    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd25p\" (UniqueName: \"kubernetes.io/projected/68075ec7-cf6c-43fd-9741-c7dfda3202e8-kube-api-access-gd25p\") pod \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") "
Sep 10 21:11:51.050763 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.050713    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-home\") pod \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") "
Sep 10 21:11:51.050763 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.050747    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-model-cache\") pod \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") "
Sep 10 21:11:51.050942 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.050781    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-dshm\") pod \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") "
Sep 10 21:11:51.050942 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.050817    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68075ec7-cf6c-43fd-9741-c7dfda3202e8-tls-certs\") pod \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\" (UID: \"68075ec7-cf6c-43fd-9741-c7dfda3202e8\") "
Sep 10 21:11:51.051072 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.050930    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "68075ec7-cf6c-43fd-9741-c7dfda3202e8" (UID: "68075ec7-cf6c-43fd-9741-c7dfda3202e8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:51.051167 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.051145    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-model-cache" (OuterVolumeSpecName: "model-cache") pod "68075ec7-cf6c-43fd-9741-c7dfda3202e8" (UID: "68075ec7-cf6c-43fd-9741-c7dfda3202e8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:51.051242 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.051154    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-tmp-dir\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:51.052091 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.052058    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-home" (OuterVolumeSpecName: "home") pod "68075ec7-cf6c-43fd-9741-c7dfda3202e8" (UID: "68075ec7-cf6c-43fd-9741-c7dfda3202e8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:51.053583 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.053563    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68075ec7-cf6c-43fd-9741-c7dfda3202e8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "68075ec7-cf6c-43fd-9741-c7dfda3202e8" (UID: "68075ec7-cf6c-43fd-9741-c7dfda3202e8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:11:51.053785 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.053763    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-dshm" (OuterVolumeSpecName: "dshm") pod "68075ec7-cf6c-43fd-9741-c7dfda3202e8" (UID: "68075ec7-cf6c-43fd-9741-c7dfda3202e8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:51.053866 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.053849    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68075ec7-cf6c-43fd-9741-c7dfda3202e8-kube-api-access-gd25p" (OuterVolumeSpecName: "kube-api-access-gd25p") pod "68075ec7-cf6c-43fd-9741-c7dfda3202e8" (UID: "68075ec7-cf6c-43fd-9741-c7dfda3202e8"). InnerVolumeSpecName "kube-api-access-gd25p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:51.152727 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.152643    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-home\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:51.152727 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.152669    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-model-cache\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:51.152727 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.152679    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68075ec7-cf6c-43fd-9741-c7dfda3202e8-dshm\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:51.152727 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.152686    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68075ec7-cf6c-43fd-9741-c7dfda3202e8-tls-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:51.152727 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.152695    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd25p\" (UniqueName: \"kubernetes.io/projected/68075ec7-cf6c-43fd-9741-c7dfda3202e8-kube-api-access-gd25p\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:51.210808 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.210773    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg"]
Sep 10 21:11:51.213014 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:11:51.212984    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34de42a0_a6fc_4d1a_987e_49704c03a142.slice/crio-c3a2e5b18fce4c5cce56b5d2d16e8e54c018f566cb1a167d001ebcd53b78ab70 WatchSource:0}: Error finding container c3a2e5b18fce4c5cce56b5d2d16e8e54c018f566cb1a167d001ebcd53b78ab70: Status 404 returned error can't find the container with id c3a2e5b18fce4c5cce56b5d2d16e8e54c018f566cb1a167d001ebcd53b78ab70
Sep 10 21:11:51.652955 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.652922    2577 generic.go:356] "Generic (PLEG): container finished" podID="68075ec7-cf6c-43fd-9741-c7dfda3202e8" containerID="5317d4c31c18d8fc647db0d5e1a955156cb1da67ce6e5b2884c42cefce669c2a" exitCode=0
Sep 10 21:11:51.653153 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.652967    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"
Sep 10 21:11:51.653153 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.652994    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8" event={"ID":"68075ec7-cf6c-43fd-9741-c7dfda3202e8","Type":"ContainerDied","Data":"5317d4c31c18d8fc647db0d5e1a955156cb1da67ce6e5b2884c42cefce669c2a"}
Sep 10 21:11:51.653153 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.653051    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8" event={"ID":"68075ec7-cf6c-43fd-9741-c7dfda3202e8","Type":"ContainerDied","Data":"15a8e9483000044746afcdfab45783a43f6323f7038b9bc342d57dab4b78a8b4"}
Sep 10 21:11:51.653153 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.653078    2577 scope.go:117] "RemoveContainer" containerID="5317d4c31c18d8fc647db0d5e1a955156cb1da67ce6e5b2884c42cefce669c2a"
Sep 10 21:11:51.654959 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.654934    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg" event={"ID":"34de42a0-a6fc-4d1a-987e-49704c03a142","Type":"ContainerStarted","Data":"177fcb7c885dd21a7426e875481975f36cd2f4abb30ecda42e911d4aa52557f5"}
Sep 10 21:11:51.655109 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.654987    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg" event={"ID":"34de42a0-a6fc-4d1a-987e-49704c03a142","Type":"ContainerStarted","Data":"c3a2e5b18fce4c5cce56b5d2d16e8e54c018f566cb1a167d001ebcd53b78ab70"}
Sep 10 21:11:51.662633 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.662614    2577 scope.go:117] "RemoveContainer" containerID="5317d4c31c18d8fc647db0d5e1a955156cb1da67ce6e5b2884c42cefce669c2a"
Sep 10 21:11:51.662893 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:11:51.662874    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5317d4c31c18d8fc647db0d5e1a955156cb1da67ce6e5b2884c42cefce669c2a\": container with ID starting with 5317d4c31c18d8fc647db0d5e1a955156cb1da67ce6e5b2884c42cefce669c2a not found: ID does not exist" containerID="5317d4c31c18d8fc647db0d5e1a955156cb1da67ce6e5b2884c42cefce669c2a"
Sep 10 21:11:51.662952 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.662901    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5317d4c31c18d8fc647db0d5e1a955156cb1da67ce6e5b2884c42cefce669c2a"} err="failed to get container status \"5317d4c31c18d8fc647db0d5e1a955156cb1da67ce6e5b2884c42cefce669c2a\": rpc error: code = NotFound desc = could not find container \"5317d4c31c18d8fc647db0d5e1a955156cb1da67ce6e5b2884c42cefce669c2a\": container with ID starting with 5317d4c31c18d8fc647db0d5e1a955156cb1da67ce6e5b2884c42cefce669c2a not found: ID does not exist"
Sep 10 21:11:51.670255 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.670196    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg" podStartSLOduration=1.6701808059999999 podStartE2EDuration="1.670180806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:51.670087657 +0000 UTC m=+839.243794032" watchObservedRunningTime="2026-09-10 21:11:51.670180806 +0000 UTC m=+839.243887181"
Sep 10 21:11:51.683253 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.683205    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"]
Sep 10 21:11:51.686449 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.686429    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-267aa8ed-kserve-597d7c4665-cqtd8"]
Sep 10 21:11:51.899742 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.899710    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:51.900106 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.900055    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:51.900784 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:51.900769    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:11:52.662765 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:52.662729    2577 generic.go:356] "Generic (PLEG): container finished" podID="34de42a0-a6fc-4d1a-987e-49704c03a142" containerID="177fcb7c885dd21a7426e875481975f36cd2f4abb30ecda42e911d4aa52557f5" exitCode=0
Sep 10 21:11:52.662960 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:52.662813    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg" event={"ID":"34de42a0-a6fc-4d1a-987e-49704c03a142","Type":"ContainerDied","Data":"177fcb7c885dd21a7426e875481975f36cd2f4abb30ecda42e911d4aa52557f5"}
Sep 10 21:11:52.947988 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:52.947913    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68075ec7-cf6c-43fd-9741-c7dfda3202e8" path="/var/lib/kubelet/pods/68075ec7-cf6c-43fd-9741-c7dfda3202e8/volumes"
Sep 10 21:11:53.800125 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:53.800097    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg"
Sep 10 21:11:53.879195 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:53.879160    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34de42a0-a6fc-4d1a-987e-49704c03a142-maas-api-service-ca\") pod \"34de42a0-a6fc-4d1a-987e-49704c03a142\" (UID: \"34de42a0-a6fc-4d1a-987e-49704c03a142\") "
Sep 10 21:11:53.879545 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:53.879518    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34de42a0-a6fc-4d1a-987e-49704c03a142-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "34de42a0-a6fc-4d1a-987e-49704c03a142" (UID: "34de42a0-a6fc-4d1a-987e-49704c03a142"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:53.980101 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:53.980004    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34de42a0-a6fc-4d1a-987e-49704c03a142-maas-api-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:54.675437 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:54.675408    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg"
Sep 10 21:11:54.675607 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:54.675455    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg" event={"ID":"34de42a0-a6fc-4d1a-987e-49704c03a142","Type":"ContainerDied","Data":"c3a2e5b18fce4c5cce56b5d2d16e8e54c018f566cb1a167d001ebcd53b78ab70"}
Sep 10 21:11:54.675607 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:54.675509    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3a2e5b18fce4c5cce56b5d2d16e8e54c018f566cb1a167d001ebcd53b78ab70"
Sep 10 21:11:57.627313 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:57.627280    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"]
Sep 10 21:11:57.627720 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:57.627495    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv" podUID="564e9739-0c7c-4abc-8f23-46671ce0ebdf" containerName="payload-processing" containerID="cri-o://96b91c65983bfb2e970c362726b4feea8481885f749f8adcf04603386a581cfb" gracePeriod=30
Sep 10 21:11:57.637734 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:57.637702    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"]
Sep 10 21:11:57.637988 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:57.637953    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf" podUID="30c416c3-b463-421e-8ddb-ec6f2042c807" containerName="payload-pre-processing" containerID="cri-o://4b524f6c533192445c76b4d4a3e4b98a003de8822238993603df56b395f120c1" gracePeriod=30
Sep 10 21:11:57.783324 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:57.783283    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg"]
Sep 10 21:11:57.787577 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:57.787546    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f68becc7-nvhhg"]
Sep 10 21:11:57.911129 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:57.910986    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"]
Sep 10 21:11:57.911639 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:57.911238    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerName="istio-proxy" containerID="cri-o://a9c6057a86589808cae40bae4a6635d54683c81a2f56317c18edc392ab08f19a" gracePeriod=30
Sep 10 21:11:57.942839 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:57.942818    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"
Sep 10 21:11:57.946164 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:57.946144    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"
Sep 10 21:11:58.015765 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.015730    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30c416c3-b463-421e-8ddb-ec6f2042c807-plugins-config-volume\") pod \"30c416c3-b463-421e-8ddb-ec6f2042c807\" (UID: \"30c416c3-b463-421e-8ddb-ec6f2042c807\") "
Sep 10 21:11:58.015911 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.015807    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/564e9739-0c7c-4abc-8f23-46671ce0ebdf-plugins-config-volume\") pod \"564e9739-0c7c-4abc-8f23-46671ce0ebdf\" (UID: \"564e9739-0c7c-4abc-8f23-46671ce0ebdf\") "
Sep 10 21:11:58.015911 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.015871    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94vd9\" (UniqueName: \"kubernetes.io/projected/30c416c3-b463-421e-8ddb-ec6f2042c807-kube-api-access-94vd9\") pod \"30c416c3-b463-421e-8ddb-ec6f2042c807\" (UID: \"30c416c3-b463-421e-8ddb-ec6f2042c807\") "
Sep 10 21:11:58.015999 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.015951    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ksjp\" (UniqueName: \"kubernetes.io/projected/564e9739-0c7c-4abc-8f23-46671ce0ebdf-kube-api-access-5ksjp\") pod \"564e9739-0c7c-4abc-8f23-46671ce0ebdf\" (UID: \"564e9739-0c7c-4abc-8f23-46671ce0ebdf\") "
Sep 10 21:11:58.016076 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.016004    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30c416c3-b463-421e-8ddb-ec6f2042c807-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "30c416c3-b463-421e-8ddb-ec6f2042c807" (UID: "30c416c3-b463-421e-8ddb-ec6f2042c807"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:58.016317 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.016288    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/564e9739-0c7c-4abc-8f23-46671ce0ebdf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "564e9739-0c7c-4abc-8f23-46671ce0ebdf" (UID: "564e9739-0c7c-4abc-8f23-46671ce0ebdf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:58.016442 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.016298    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30c416c3-b463-421e-8ddb-ec6f2042c807-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:58.018022 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.017997    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/564e9739-0c7c-4abc-8f23-46671ce0ebdf-kube-api-access-5ksjp" (OuterVolumeSpecName: "kube-api-access-5ksjp") pod "564e9739-0c7c-4abc-8f23-46671ce0ebdf" (UID: "564e9739-0c7c-4abc-8f23-46671ce0ebdf"). InnerVolumeSpecName "kube-api-access-5ksjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:58.018022 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.018046    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30c416c3-b463-421e-8ddb-ec6f2042c807-kube-api-access-94vd9" (OuterVolumeSpecName: "kube-api-access-94vd9") pod "30c416c3-b463-421e-8ddb-ec6f2042c807" (UID: "30c416c3-b463-421e-8ddb-ec6f2042c807"). InnerVolumeSpecName "kube-api-access-94vd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:58.117490 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.117457    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ksjp\" (UniqueName: \"kubernetes.io/projected/564e9739-0c7c-4abc-8f23-46671ce0ebdf-kube-api-access-5ksjp\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:58.117490 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.117481    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/564e9739-0c7c-4abc-8f23-46671ce0ebdf-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:58.117490 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.117490    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94vd9\" (UniqueName: \"kubernetes.io/projected/30c416c3-b463-421e-8ddb-ec6f2042c807-kube-api-access-94vd9\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:11:58.702473 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.702441    2577 generic.go:356] "Generic (PLEG): container finished" podID="564e9739-0c7c-4abc-8f23-46671ce0ebdf" containerID="96b91c65983bfb2e970c362726b4feea8481885f749f8adcf04603386a581cfb" exitCode=0
Sep 10 21:11:58.702930 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.702486    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"
Sep 10 21:11:58.702930 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.702532    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv" event={"ID":"564e9739-0c7c-4abc-8f23-46671ce0ebdf","Type":"ContainerDied","Data":"96b91c65983bfb2e970c362726b4feea8481885f749f8adcf04603386a581cfb"}
Sep 10 21:11:58.702930 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.702596    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv" event={"ID":"564e9739-0c7c-4abc-8f23-46671ce0ebdf","Type":"ContainerDied","Data":"f778c2291f933210e5e57438a4adad4011cc994a24be5dc6c6f163c16b610621"}
Sep 10 21:11:58.702930 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.702631    2577 scope.go:117] "RemoveContainer" containerID="96b91c65983bfb2e970c362726b4feea8481885f749f8adcf04603386a581cfb"
Sep 10 21:11:58.703995 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.703928    2577 generic.go:356] "Generic (PLEG): container finished" podID="30c416c3-b463-421e-8ddb-ec6f2042c807" containerID="4b524f6c533192445c76b4d4a3e4b98a003de8822238993603df56b395f120c1" exitCode=0
Sep 10 21:11:58.703995 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.703958    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf" event={"ID":"30c416c3-b463-421e-8ddb-ec6f2042c807","Type":"ContainerDied","Data":"4b524f6c533192445c76b4d4a3e4b98a003de8822238993603df56b395f120c1"}
Sep 10 21:11:58.703995 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.703987    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"
Sep 10 21:11:58.704149 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.703996    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf" event={"ID":"30c416c3-b463-421e-8ddb-ec6f2042c807","Type":"ContainerDied","Data":"80b3b4cecfe79d54ac825f689fbc8a6b490b92962fe2742d2450a427a6935fb0"}
Sep 10 21:11:58.712340 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.712324    2577 scope.go:117] "RemoveContainer" containerID="96b91c65983bfb2e970c362726b4feea8481885f749f8adcf04603386a581cfb"
Sep 10 21:11:58.712619 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:11:58.712599    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96b91c65983bfb2e970c362726b4feea8481885f749f8adcf04603386a581cfb\": container with ID starting with 96b91c65983bfb2e970c362726b4feea8481885f749f8adcf04603386a581cfb not found: ID does not exist" containerID="96b91c65983bfb2e970c362726b4feea8481885f749f8adcf04603386a581cfb"
Sep 10 21:11:58.712701 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.712625    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96b91c65983bfb2e970c362726b4feea8481885f749f8adcf04603386a581cfb"} err="failed to get container status \"96b91c65983bfb2e970c362726b4feea8481885f749f8adcf04603386a581cfb\": rpc error: code = NotFound desc = could not find container \"96b91c65983bfb2e970c362726b4feea8481885f749f8adcf04603386a581cfb\": container with ID starting with 96b91c65983bfb2e970c362726b4feea8481885f749f8adcf04603386a581cfb not found: ID does not exist"
Sep 10 21:11:58.712701 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.712641    2577 scope.go:117] "RemoveContainer" containerID="4b524f6c533192445c76b4d4a3e4b98a003de8822238993603df56b395f120c1"
Sep 10 21:11:58.720917 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.720902    2577 scope.go:117] "RemoveContainer" containerID="4b524f6c533192445c76b4d4a3e4b98a003de8822238993603df56b395f120c1"
Sep 10 21:11:58.721190 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:11:58.721170    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b524f6c533192445c76b4d4a3e4b98a003de8822238993603df56b395f120c1\": container with ID starting with 4b524f6c533192445c76b4d4a3e4b98a003de8822238993603df56b395f120c1 not found: ID does not exist" containerID="4b524f6c533192445c76b4d4a3e4b98a003de8822238993603df56b395f120c1"
Sep 10 21:11:58.721243 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.721195    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b524f6c533192445c76b4d4a3e4b98a003de8822238993603df56b395f120c1"} err="failed to get container status \"4b524f6c533192445c76b4d4a3e4b98a003de8822238993603df56b395f120c1\": rpc error: code = NotFound desc = could not find container \"4b524f6c533192445c76b4d4a3e4b98a003de8822238993603df56b395f120c1\": container with ID starting with 4b524f6c533192445c76b4d4a3e4b98a003de8822238993603df56b395f120c1 not found: ID does not exist"
Sep 10 21:11:58.728835 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.728812    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"]
Sep 10 21:11:58.740356 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.740324    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf"]
Sep 10 21:11:58.750449 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.750428    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"]
Sep 10 21:11:58.754881 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.754853    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv"]
Sep 10 21:11:58.946799 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.946720    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30c416c3-b463-421e-8ddb-ec6f2042c807" path="/var/lib/kubelet/pods/30c416c3-b463-421e-8ddb-ec6f2042c807/volumes"
Sep 10 21:11:58.947078 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.947065    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34de42a0-a6fc-4d1a-987e-49704c03a142" path="/var/lib/kubelet/pods/34de42a0-a6fc-4d1a-987e-49704c03a142/volumes"
Sep 10 21:11:58.947389 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:11:58.947378    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="564e9739-0c7c-4abc-8f23-46671ce0ebdf" path="/var/lib/kubelet/pods/564e9739-0c7c-4abc-8f23-46671ce0ebdf/volumes"
Sep 10 21:12:03.176612 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.176590    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:12:03.258493 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.258420    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-workload-certs\") pod \"1c48d251-2940-49e8-96a0-e97434fbf79b\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") "
Sep 10 21:12:03.258493 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.258465    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c48d251-2940-49e8-96a0-e97434fbf79b-istiod-ca-cert\") pod \"1c48d251-2940-49e8-96a0-e97434fbf79b\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") "
Sep 10 21:12:03.258695 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.258509    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-podinfo\") pod \"1c48d251-2940-49e8-96a0-e97434fbf79b\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") "
Sep 10 21:12:03.258695 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.258535    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9dj2\" (UniqueName: \"kubernetes.io/projected/1c48d251-2940-49e8-96a0-e97434fbf79b-kube-api-access-s9dj2\") pod \"1c48d251-2940-49e8-96a0-e97434fbf79b\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") "
Sep 10 21:12:03.258695 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.258561    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-workload-socket\") pod \"1c48d251-2940-49e8-96a0-e97434fbf79b\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") "
Sep 10 21:12:03.258695 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.258587    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-envoy\") pod \"1c48d251-2940-49e8-96a0-e97434fbf79b\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") "
Sep 10 21:12:03.258896 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.258710    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-credential-socket\") pod \"1c48d251-2940-49e8-96a0-e97434fbf79b\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") "
Sep 10 21:12:03.258896 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.258734    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c48d251-2940-49e8-96a0-e97434fbf79b" (UID: "1c48d251-2940-49e8-96a0-e97434fbf79b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:03.258896 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.258743    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-data\") pod \"1c48d251-2940-49e8-96a0-e97434fbf79b\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") "
Sep 10 21:12:03.258896 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.258766    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-token\") pod \"1c48d251-2940-49e8-96a0-e97434fbf79b\" (UID: \"1c48d251-2940-49e8-96a0-e97434fbf79b\") "
Sep 10 21:12:03.258896 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.258857    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c48d251-2940-49e8-96a0-e97434fbf79b" (UID: "1c48d251-2940-49e8-96a0-e97434fbf79b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:03.259175 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.258954    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c48d251-2940-49e8-96a0-e97434fbf79b" (UID: "1c48d251-2940-49e8-96a0-e97434fbf79b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:03.259175 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.258964    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c48d251-2940-49e8-96a0-e97434fbf79b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c48d251-2940-49e8-96a0-e97434fbf79b" (UID: "1c48d251-2940-49e8-96a0-e97434fbf79b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:12:03.259175 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.259164    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c48d251-2940-49e8-96a0-e97434fbf79b" (UID: "1c48d251-2940-49e8-96a0-e97434fbf79b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:03.259324 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.259188    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-workload-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:12:03.259324 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.259212    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c48d251-2940-49e8-96a0-e97434fbf79b-istiod-ca-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:12:03.259324 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.259223    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-workload-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:12:03.259324 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.259236    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-credential-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:12:03.260804 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.260773    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c48d251-2940-49e8-96a0-e97434fbf79b" (UID: "1c48d251-2940-49e8-96a0-e97434fbf79b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:12:03.260804 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.260773    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c48d251-2940-49e8-96a0-e97434fbf79b-kube-api-access-s9dj2" (OuterVolumeSpecName: "kube-api-access-s9dj2") pod "1c48d251-2940-49e8-96a0-e97434fbf79b" (UID: "1c48d251-2940-49e8-96a0-e97434fbf79b"). InnerVolumeSpecName "kube-api-access-s9dj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:12:03.260804 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.260779    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c48d251-2940-49e8-96a0-e97434fbf79b" (UID: "1c48d251-2940-49e8-96a0-e97434fbf79b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:03.260992 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.260836    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c48d251-2940-49e8-96a0-e97434fbf79b" (UID: "1c48d251-2940-49e8-96a0-e97434fbf79b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:12:03.359594 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.359554    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-data\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:12:03.359594 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.359590    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-token\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:12:03.359748 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.359604    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-podinfo\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:12:03.359748 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.359616    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9dj2\" (UniqueName: \"kubernetes.io/projected/1c48d251-2940-49e8-96a0-e97434fbf79b-kube-api-access-s9dj2\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:12:03.359748 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.359629    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c48d251-2940-49e8-96a0-e97434fbf79b-istio-envoy\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:12:03.555054 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.554960    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:12:03.736646 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.736617    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerID="a9c6057a86589808cae40bae4a6635d54683c81a2f56317c18edc392ab08f19a" exitCode=0
Sep 10 21:12:03.736807 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.736678    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"
Sep 10 21:12:03.736807 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.736666    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" event={"ID":"1c48d251-2940-49e8-96a0-e97434fbf79b","Type":"ContainerDied","Data":"a9c6057a86589808cae40bae4a6635d54683c81a2f56317c18edc392ab08f19a"}
Sep 10 21:12:03.736907 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.736809    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l" event={"ID":"1c48d251-2940-49e8-96a0-e97434fbf79b","Type":"ContainerDied","Data":"eb5ea8a9d1029e747ceed47d21db84aa3eec55b45fe445acb6bf52d834f478da"}
Sep 10 21:12:03.736907 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.736833    2577 scope.go:117] "RemoveContainer" containerID="a9c6057a86589808cae40bae4a6635d54683c81a2f56317c18edc392ab08f19a"
Sep 10 21:12:03.746277 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.746263    2577 scope.go:117] "RemoveContainer" containerID="cc0f3c27fbda2b5f06b62aa922882156f5b18afceb32c4a66a8f46749cbfe0a5"
Sep 10 21:12:03.754147 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.754128    2577 scope.go:117] "RemoveContainer" containerID="a9c6057a86589808cae40bae4a6635d54683c81a2f56317c18edc392ab08f19a"
Sep 10 21:12:03.754380 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:12:03.754361    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9c6057a86589808cae40bae4a6635d54683c81a2f56317c18edc392ab08f19a\": container with ID starting with a9c6057a86589808cae40bae4a6635d54683c81a2f56317c18edc392ab08f19a not found: ID does not exist" containerID="a9c6057a86589808cae40bae4a6635d54683c81a2f56317c18edc392ab08f19a"
Sep 10 21:12:03.754448 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.754392    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c6057a86589808cae40bae4a6635d54683c81a2f56317c18edc392ab08f19a"} err="failed to get container status \"a9c6057a86589808cae40bae4a6635d54683c81a2f56317c18edc392ab08f19a\": rpc error: code = NotFound desc = could not find container \"a9c6057a86589808cae40bae4a6635d54683c81a2f56317c18edc392ab08f19a\": container with ID starting with a9c6057a86589808cae40bae4a6635d54683c81a2f56317c18edc392ab08f19a not found: ID does not exist"
Sep 10 21:12:03.754448 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.754415    2577 scope.go:117] "RemoveContainer" containerID="cc0f3c27fbda2b5f06b62aa922882156f5b18afceb32c4a66a8f46749cbfe0a5"
Sep 10 21:12:03.754702 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:12:03.754675    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc0f3c27fbda2b5f06b62aa922882156f5b18afceb32c4a66a8f46749cbfe0a5\": container with ID starting with cc0f3c27fbda2b5f06b62aa922882156f5b18afceb32c4a66a8f46749cbfe0a5 not found: ID does not exist" containerID="cc0f3c27fbda2b5f06b62aa922882156f5b18afceb32c4a66a8f46749cbfe0a5"
Sep 10 21:12:03.754797 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.754700    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0f3c27fbda2b5f06b62aa922882156f5b18afceb32c4a66a8f46749cbfe0a5"} err="failed to get container status \"cc0f3c27fbda2b5f06b62aa922882156f5b18afceb32c4a66a8f46749cbfe0a5\": rpc error: code = NotFound desc = could not find container \"cc0f3c27fbda2b5f06b62aa922882156f5b18afceb32c4a66a8f46749cbfe0a5\": container with ID starting with cc0f3c27fbda2b5f06b62aa922882156f5b18afceb32c4a66a8f46749cbfe0a5 not found: ID does not exist"
Sep 10 21:12:03.758525 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.758506    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"]
Sep 10 21:12:03.761863 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:03.761841    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l"]
Sep 10 21:12:04.946328 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:04.946295    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" path="/var/lib/kubelet/pods/1c48d251-2940-49e8-96a0-e97434fbf79b/volumes"
Sep 10 21:12:09.680905 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.680872    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"]
Sep 10 21:12:09.681449 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681427    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerName="istio-proxy"
Sep 10 21:12:09.681530 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681451    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerName="istio-proxy"
Sep 10 21:12:09.681530 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681462    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerName="istio-proxy"
Sep 10 21:12:09.681530 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681470    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerName="istio-proxy"
Sep 10 21:12:09.681530 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681484    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34de42a0-a6fc-4d1a-987e-49704c03a142" containerName="revoke-keys"
Sep 10 21:12:09.681530 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681492    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="34de42a0-a6fc-4d1a-987e-49704c03a142" containerName="revoke-keys"
Sep 10 21:12:09.681530 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681516    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30c416c3-b463-421e-8ddb-ec6f2042c807" containerName="payload-pre-processing"
Sep 10 21:12:09.681530 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681525    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="30c416c3-b463-421e-8ddb-ec6f2042c807" containerName="payload-pre-processing"
Sep 10 21:12:09.681855 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681573    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68075ec7-cf6c-43fd-9741-c7dfda3202e8" containerName="main"
Sep 10 21:12:09.681855 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681583    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="68075ec7-cf6c-43fd-9741-c7dfda3202e8" containerName="main"
Sep 10 21:12:09.681855 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681591    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="564e9739-0c7c-4abc-8f23-46671ce0ebdf" containerName="payload-processing"
Sep 10 21:12:09.681855 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681600    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="564e9739-0c7c-4abc-8f23-46671ce0ebdf" containerName="payload-processing"
Sep 10 21:12:09.681855 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681714    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8451595c-d2d3-44dc-8272-6d5057b97d72" containerName="istio-proxy"
Sep 10 21:12:09.681855 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681726    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="34de42a0-a6fc-4d1a-987e-49704c03a142" containerName="revoke-keys"
Sep 10 21:12:09.681855 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681734    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="564e9739-0c7c-4abc-8f23-46671ce0ebdf" containerName="payload-processing"
Sep 10 21:12:09.681855 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681746    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="68075ec7-cf6c-43fd-9741-c7dfda3202e8" containerName="main"
Sep 10 21:12:09.681855 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681753    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="30c416c3-b463-421e-8ddb-ec6f2042c807" containerName="payload-pre-processing"
Sep 10 21:12:09.681855 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681761    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerName="istio-proxy"
Sep 10 21:12:09.681855 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.681769    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerName="istio-proxy"
Sep 10 21:12:09.686585 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.686566    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.690255 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.690234    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-69dcc8\"/\"kube-root-ca.crt\""
Sep 10 21:12:09.690434 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.690417    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-69dcc8\"/\"test-model-69dcc8-kserve-self-signed-certs\""
Sep 10 21:12:09.690487 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.690447    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-69dcc8\"/\"openshift-service-ca.crt\""
Sep 10 21:12:09.690535 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.690517    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-69dcc8\"/\"default-dockercfg-r75m2\""
Sep 10 21:12:09.697454 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.697432    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"]
Sep 10 21:12:09.816122 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.816085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-home\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.816269 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.816137    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-model-cache\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.816269 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.816237    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c07a5e4-9b20-4b79-b6db-acc4071db336-tls-certs\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.816354 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.816264    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7kh4\" (UniqueName: \"kubernetes.io/projected/9c07a5e4-9b20-4b79-b6db-acc4071db336-kube-api-access-s7kh4\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.816354 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.816297    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-tmp-dir\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.816422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.816386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-dshm\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.917334 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.917301    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-dshm\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.917334 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.917335    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-home\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.917582 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.917360    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-model-cache\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.917582 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.917411    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c07a5e4-9b20-4b79-b6db-acc4071db336-tls-certs\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.917582 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.917428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7kh4\" (UniqueName: \"kubernetes.io/projected/9c07a5e4-9b20-4b79-b6db-acc4071db336-kube-api-access-s7kh4\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.917582 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.917463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-tmp-dir\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.917804 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.917779    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-model-cache\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.917804 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.917794    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-home\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.917892 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.917839    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-tmp-dir\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.919637 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.919615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-dshm\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.919733 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.919689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c07a5e4-9b20-4b79-b6db-acc4071db336-tls-certs\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.926011 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.925989    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7kh4\" (UniqueName: \"kubernetes.io/projected/9c07a5e4-9b20-4b79-b6db-acc4071db336-kube-api-access-s7kh4\") pod \"test-model-69dcc8-kserve-7bdf685d7-cb6lp\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") " pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:09.996234 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:09.996163    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:10.271019 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:10.270986    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"]
Sep 10 21:12:10.777020 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:10.776982    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp" event={"ID":"9c07a5e4-9b20-4b79-b6db-acc4071db336","Type":"ContainerStarted","Data":"d2692baa34530df8631d5125c758d2884a5eea9fc743beb13a4617ae1259468c"}
Sep 10 21:12:10.777020 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:10.777045    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp" event={"ID":"9c07a5e4-9b20-4b79-b6db-acc4071db336","Type":"ContainerStarted","Data":"856dd232be136f144c8e23c4a0b0e86c6781df03eaafa1979b98222d101a6239"}
Sep 10 21:12:10.795783 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:10.795738    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp" podStartSLOduration=1.795723364 podStartE2EDuration="1.795723364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:12:10.793703471 +0000 UTC m=+858.367409836" watchObservedRunningTime="2026-09-10 21:12:10.795723364 +0000 UTC m=+858.369429783"
Sep 10 21:12:17.979632 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:17.979594    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:12:19.996946 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:19.996903    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:19.996946 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:19.996953    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:20.008924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:20.008898    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:20.843722 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:20.843695    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:12:27.163811 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.163779    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"]
Sep 10 21:12:27.164406 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.164390    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerName="istio-proxy"
Sep 10 21:12:27.164453 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.164410    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c48d251-2940-49e8-96a0-e97434fbf79b" containerName="istio-proxy"
Sep 10 21:12:27.167927 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.167906    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.170375 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.170353    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-50ba47\"/\"openshift-service-ca.crt\""
Sep 10 21:12:27.170498 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.170406    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-50ba47\"/\"explicit-model-50ba47-kserve-self-signed-certs\""
Sep 10 21:12:27.170498 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.170454    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-50ba47\"/\"default-dockercfg-897qv\""
Sep 10 21:12:27.170498 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.170472    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-50ba47\"/\"kube-root-ca.crt\""
Sep 10 21:12:27.174538 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.174520    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"]
Sep 10 21:12:27.265606 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.265580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-home\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.265606 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.265614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-tmp-dir\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.265774 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.265644    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-dshm\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.265774 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.265737    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-862ds\" (UniqueName: \"kubernetes.io/projected/c17e94ac-18e8-451d-94ff-f8edd652eb43-kube-api-access-862ds\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.265841 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.265800    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c17e94ac-18e8-451d-94ff-f8edd652eb43-tls-certs\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.265841 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.265824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-model-cache\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.366411 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.366385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-home\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.366538 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.366420    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-tmp-dir\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.366538 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.366452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-dshm\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.366538 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.366508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-862ds\" (UniqueName: \"kubernetes.io/projected/c17e94ac-18e8-451d-94ff-f8edd652eb43-kube-api-access-862ds\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.366714 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.366569    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c17e94ac-18e8-451d-94ff-f8edd652eb43-tls-certs\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.366714 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.366597    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-model-cache\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.366921 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.366840    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-home\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.366921 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.366903    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-tmp-dir\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.367084 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.366971    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-model-cache\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.368928 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.368909    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c17e94ac-18e8-451d-94ff-f8edd652eb43-tls-certs\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.369050 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.368997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-dshm\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.375686 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.375589    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-862ds\" (UniqueName: \"kubernetes.io/projected/c17e94ac-18e8-451d-94ff-f8edd652eb43-kube-api-access-862ds\") pod \"explicit-model-50ba47-kserve-84499dbc47-w22w2\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") " pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.479223 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.479153    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:27.748438 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.748415    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"]
Sep 10 21:12:27.750085 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:12:27.750062    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc17e94ac_18e8_451d_94ff_f8edd652eb43.slice/crio-1f79ca9d2c05d380c20473adc55dab4b07e8363cc6f0e62a779129780abb2127 WatchSource:0}: Error finding container 1f79ca9d2c05d380c20473adc55dab4b07e8363cc6f0e62a779129780abb2127: Status 404 returned error can't find the container with id 1f79ca9d2c05d380c20473adc55dab4b07e8363cc6f0e62a779129780abb2127
Sep 10 21:12:27.872639 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.872607    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2" event={"ID":"c17e94ac-18e8-451d-94ff-f8edd652eb43","Type":"ContainerStarted","Data":"6550a0d080b6db55f92b77e7750deed1c56ab52cdae5a4b80636ee73742b4047"}
Sep 10 21:12:27.872775 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.872649    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2" event={"ID":"c17e94ac-18e8-451d-94ff-f8edd652eb43","Type":"ContainerStarted","Data":"1f79ca9d2c05d380c20473adc55dab4b07e8363cc6f0e62a779129780abb2127"}
Sep 10 21:12:27.889124 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:27.889079    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2" podStartSLOduration=0.889063743 podStartE2EDuration="889.063743ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:12:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:12:27.887882452 +0000 UTC m=+875.461588826" watchObservedRunningTime="2026-09-10 21:12:27.889063743 +0000 UTC m=+875.462770113"
Sep 10 21:12:33.859076 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:33.859041    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:12:37.480313 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:37.480263    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:37.480313 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:37.480326    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:37.492740 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:37.492713    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:37.941543 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:37.941512    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:12:50.661912 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:50.661830    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:12:50.872645 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:50.872616    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"]
Sep 10 21:12:51.000375 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:51.000294    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc"]
Sep 10 21:12:51.003907 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:51.003886    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc"
Sep 10 21:12:51.006156 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:51.006134    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:12:51.006304 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:51.006280    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:12:51.009727 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:51.009707    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc"]
Sep 10 21:12:51.054408 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:51.054386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93484ecb-9b08-42db-af26-218b47be712a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc\" (UID: \"93484ecb-9b08-42db-af26-218b47be712a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc"
Sep 10 21:12:51.155384 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:51.155359    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93484ecb-9b08-42db-af26-218b47be712a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc\" (UID: \"93484ecb-9b08-42db-af26-218b47be712a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc"
Sep 10 21:12:51.155932 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:51.155915    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93484ecb-9b08-42db-af26-218b47be712a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc\" (UID: \"93484ecb-9b08-42db-af26-218b47be712a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc"
Sep 10 21:12:51.315945 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:51.315921    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc"
Sep 10 21:12:51.588040 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:51.588003    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc"]
Sep 10 21:12:52.010063 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:52.009966    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc" event={"ID":"93484ecb-9b08-42db-af26-218b47be712a","Type":"ContainerStarted","Data":"3bc5ecbade969245f5031e5322f2c64e3e74ad95db7ecefeeee1841dd08461f0"}
Sep 10 21:12:52.010063 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:52.010022    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc" event={"ID":"93484ecb-9b08-42db-af26-218b47be712a","Type":"ContainerStarted","Data":"fc0753da4e236eb10aae46996c3888036477826ba7823802bf7bad069f9138b0"}
Sep 10 21:12:52.025545 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:52.025503    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc" podStartSLOduration=2.025489001 podStartE2EDuration="2.025489001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:12:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:12:52.023947308 +0000 UTC m=+899.597653682" watchObservedRunningTime="2026-09-10 21:12:52.025489001 +0000 UTC m=+899.599195372"
Sep 10 21:12:53.017973 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:53.017938    2577 generic.go:356] "Generic (PLEG): container finished" podID="93484ecb-9b08-42db-af26-218b47be712a" containerID="3bc5ecbade969245f5031e5322f2c64e3e74ad95db7ecefeeee1841dd08461f0" exitCode=0
Sep 10 21:12:53.018386 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:53.018018    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc" event={"ID":"93484ecb-9b08-42db-af26-218b47be712a","Type":"ContainerDied","Data":"3bc5ecbade969245f5031e5322f2c64e3e74ad95db7ecefeeee1841dd08461f0"}
Sep 10 21:12:54.151271 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:54.151247    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc"
Sep 10 21:12:54.175505 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:54.175479    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:12:54.177651 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:54.177632    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:12:54.183909 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:54.183886    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93484ecb-9b08-42db-af26-218b47be712a-maas-api-service-ca\") pod \"93484ecb-9b08-42db-af26-218b47be712a\" (UID: \"93484ecb-9b08-42db-af26-218b47be712a\") "
Sep 10 21:12:54.184279 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:54.184248    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93484ecb-9b08-42db-af26-218b47be712a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "93484ecb-9b08-42db-af26-218b47be712a" (UID: "93484ecb-9b08-42db-af26-218b47be712a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:12:54.285065 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:54.284992    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93484ecb-9b08-42db-af26-218b47be712a-maas-api-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:12:55.031419 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:55.031391    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc"
Sep 10 21:12:55.031547 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:55.031424    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc" event={"ID":"93484ecb-9b08-42db-af26-218b47be712a","Type":"ContainerDied","Data":"fc0753da4e236eb10aae46996c3888036477826ba7823802bf7bad069f9138b0"}
Sep 10 21:12:55.031547 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:12:55.031471    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc0753da4e236eb10aae46996c3888036477826ba7823802bf7bad069f9138b0"
Sep 10 21:13:01.509322 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:01.509288    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"]
Sep 10 21:13:01.509831 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:01.509527    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst" podUID="776e1a33-f171-4334-935c-f2c5736f4b0a" containerName="payload-pre-processing" containerID="cri-o://ae256a3892dc02e09975a67b4469ba1c9489246ef25839bac73e2892dcf79f61" gracePeriod=30
Sep 10 21:13:01.656344 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:01.656279    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc"]
Sep 10 21:13:01.658750 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:01.658726    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-50ba47-6vjdc"]
Sep 10 21:13:01.776051 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:01.775981    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"
Sep 10 21:13:01.856578 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:01.856550    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frm8t\" (UniqueName: \"kubernetes.io/projected/776e1a33-f171-4334-935c-f2c5736f4b0a-kube-api-access-frm8t\") pod \"776e1a33-f171-4334-935c-f2c5736f4b0a\" (UID: \"776e1a33-f171-4334-935c-f2c5736f4b0a\") "
Sep 10 21:13:01.856748 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:01.856592    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776e1a33-f171-4334-935c-f2c5736f4b0a-plugins-config-volume\") pod \"776e1a33-f171-4334-935c-f2c5736f4b0a\" (UID: \"776e1a33-f171-4334-935c-f2c5736f4b0a\") "
Sep 10 21:13:01.857017 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:01.856994    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/776e1a33-f171-4334-935c-f2c5736f4b0a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "776e1a33-f171-4334-935c-f2c5736f4b0a" (UID: "776e1a33-f171-4334-935c-f2c5736f4b0a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:13:01.858617 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:01.858595    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/776e1a33-f171-4334-935c-f2c5736f4b0a-kube-api-access-frm8t" (OuterVolumeSpecName: "kube-api-access-frm8t") pod "776e1a33-f171-4334-935c-f2c5736f4b0a" (UID: "776e1a33-f171-4334-935c-f2c5736f4b0a"). InnerVolumeSpecName "kube-api-access-frm8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:01.957575 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:01.957547    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776e1a33-f171-4334-935c-f2c5736f4b0a-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:01.957575 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:01.957571    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frm8t\" (UniqueName: \"kubernetes.io/projected/776e1a33-f171-4334-935c-f2c5736f4b0a-kube-api-access-frm8t\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:02.070163 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:02.070132    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:13:02.071216 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:02.071193    2577 generic.go:356] "Generic (PLEG): container finished" podID="776e1a33-f171-4334-935c-f2c5736f4b0a" containerID="ae256a3892dc02e09975a67b4469ba1c9489246ef25839bac73e2892dcf79f61" exitCode=0
Sep 10 21:13:02.071304 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:02.071232    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"
Sep 10 21:13:02.071304 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:02.071273    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst" event={"ID":"776e1a33-f171-4334-935c-f2c5736f4b0a","Type":"ContainerDied","Data":"ae256a3892dc02e09975a67b4469ba1c9489246ef25839bac73e2892dcf79f61"}
Sep 10 21:13:02.071386 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:02.071318    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst" event={"ID":"776e1a33-f171-4334-935c-f2c5736f4b0a","Type":"ContainerDied","Data":"5d46b8240e4559abd31888ef8ce362d0ef1346ed26640bea37690e3f8192a2bd"}
Sep 10 21:13:02.071386 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:02.071347    2577 scope.go:117] "RemoveContainer" containerID="ae256a3892dc02e09975a67b4469ba1c9489246ef25839bac73e2892dcf79f61"
Sep 10 21:13:02.080496 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:02.080478    2577 scope.go:117] "RemoveContainer" containerID="ae256a3892dc02e09975a67b4469ba1c9489246ef25839bac73e2892dcf79f61"
Sep 10 21:13:02.080770 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:13:02.080750    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae256a3892dc02e09975a67b4469ba1c9489246ef25839bac73e2892dcf79f61\": container with ID starting with ae256a3892dc02e09975a67b4469ba1c9489246ef25839bac73e2892dcf79f61 not found: ID does not exist" containerID="ae256a3892dc02e09975a67b4469ba1c9489246ef25839bac73e2892dcf79f61"
Sep 10 21:13:02.080840 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:02.080778    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae256a3892dc02e09975a67b4469ba1c9489246ef25839bac73e2892dcf79f61"} err="failed to get container status \"ae256a3892dc02e09975a67b4469ba1c9489246ef25839bac73e2892dcf79f61\": rpc error: code = NotFound desc = could not find container \"ae256a3892dc02e09975a67b4469ba1c9489246ef25839bac73e2892dcf79f61\": container with ID starting with ae256a3892dc02e09975a67b4469ba1c9489246ef25839bac73e2892dcf79f61 not found: ID does not exist"
Sep 10 21:13:02.091672 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:02.091652    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"]
Sep 10 21:13:02.097335 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:02.097316    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst"]
Sep 10 21:13:02.946389 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:02.946356    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="776e1a33-f171-4334-935c-f2c5736f4b0a" path="/var/lib/kubelet/pods/776e1a33-f171-4334-935c-f2c5736f4b0a/volumes"
Sep 10 21:13:02.946757 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:02.946677    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93484ecb-9b08-42db-af26-218b47be712a" path="/var/lib/kubelet/pods/93484ecb-9b08-42db-af26-218b47be712a/volumes"
Sep 10 21:13:05.891279 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:05.891237    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2" podUID="c17e94ac-18e8-451d-94ff-f8edd652eb43" containerName="main" containerID="cri-o://6550a0d080b6db55f92b77e7750deed1c56ab52cdae5a4b80636ee73742b4047" gracePeriod=45
Sep 10 21:13:06.096365 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.096329    2577 generic.go:356] "Generic (PLEG): container finished" podID="c17e94ac-18e8-451d-94ff-f8edd652eb43" containerID="6550a0d080b6db55f92b77e7750deed1c56ab52cdae5a4b80636ee73742b4047" exitCode=0
Sep 10 21:13:06.096493 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.096388    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2" event={"ID":"c17e94ac-18e8-451d-94ff-f8edd652eb43","Type":"ContainerDied","Data":"6550a0d080b6db55f92b77e7750deed1c56ab52cdae5a4b80636ee73742b4047"}
Sep 10 21:13:06.145918 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.145867    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:13:06.296391 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.296361    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-home\") pod \"c17e94ac-18e8-451d-94ff-f8edd652eb43\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") "
Sep 10 21:13:06.296554 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.296408    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c17e94ac-18e8-451d-94ff-f8edd652eb43-tls-certs\") pod \"c17e94ac-18e8-451d-94ff-f8edd652eb43\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") "
Sep 10 21:13:06.296554 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.296486    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-862ds\" (UniqueName: \"kubernetes.io/projected/c17e94ac-18e8-451d-94ff-f8edd652eb43-kube-api-access-862ds\") pod \"c17e94ac-18e8-451d-94ff-f8edd652eb43\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") "
Sep 10 21:13:06.296554 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.296529    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-tmp-dir\") pod \"c17e94ac-18e8-451d-94ff-f8edd652eb43\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") "
Sep 10 21:13:06.296673 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.296571    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-dshm\") pod \"c17e94ac-18e8-451d-94ff-f8edd652eb43\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") "
Sep 10 21:13:06.296673 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.296599    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-model-cache\") pod \"c17e94ac-18e8-451d-94ff-f8edd652eb43\" (UID: \"c17e94ac-18e8-451d-94ff-f8edd652eb43\") "
Sep 10 21:13:06.296673 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.296654    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-home" (OuterVolumeSpecName: "home") pod "c17e94ac-18e8-451d-94ff-f8edd652eb43" (UID: "c17e94ac-18e8-451d-94ff-f8edd652eb43"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:06.296836 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.296821    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-home\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:06.296900 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.296818    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c17e94ac-18e8-451d-94ff-f8edd652eb43" (UID: "c17e94ac-18e8-451d-94ff-f8edd652eb43"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:06.296949 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.296907    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-model-cache" (OuterVolumeSpecName: "model-cache") pod "c17e94ac-18e8-451d-94ff-f8edd652eb43" (UID: "c17e94ac-18e8-451d-94ff-f8edd652eb43"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:06.298778 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.298750    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c17e94ac-18e8-451d-94ff-f8edd652eb43-kube-api-access-862ds" (OuterVolumeSpecName: "kube-api-access-862ds") pod "c17e94ac-18e8-451d-94ff-f8edd652eb43" (UID: "c17e94ac-18e8-451d-94ff-f8edd652eb43"). InnerVolumeSpecName "kube-api-access-862ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:06.298778 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.298771    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-dshm" (OuterVolumeSpecName: "dshm") pod "c17e94ac-18e8-451d-94ff-f8edd652eb43" (UID: "c17e94ac-18e8-451d-94ff-f8edd652eb43"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:06.298920 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.298782    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c17e94ac-18e8-451d-94ff-f8edd652eb43-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c17e94ac-18e8-451d-94ff-f8edd652eb43" (UID: "c17e94ac-18e8-451d-94ff-f8edd652eb43"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:13:06.397869 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.397817    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c17e94ac-18e8-451d-94ff-f8edd652eb43-tls-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:06.397869 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.397837    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-862ds\" (UniqueName: \"kubernetes.io/projected/c17e94ac-18e8-451d-94ff-f8edd652eb43-kube-api-access-862ds\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:06.397869 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.397846    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-tmp-dir\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:06.397869 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.397856    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-dshm\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:06.397869 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:06.397864    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c17e94ac-18e8-451d-94ff-f8edd652eb43-model-cache\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:07.104298 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:07.104275    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"
Sep 10 21:13:07.104670 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:07.104279    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2" event={"ID":"c17e94ac-18e8-451d-94ff-f8edd652eb43","Type":"ContainerDied","Data":"1f79ca9d2c05d380c20473adc55dab4b07e8363cc6f0e62a779129780abb2127"}
Sep 10 21:13:07.104670 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:07.104380    2577 scope.go:117] "RemoveContainer" containerID="6550a0d080b6db55f92b77e7750deed1c56ab52cdae5a4b80636ee73742b4047"
Sep 10 21:13:07.124869 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:07.124849    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"]
Sep 10 21:13:07.136279 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:07.133669    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-50ba47/explicit-model-50ba47-kserve-84499dbc47-w22w2"]
Sep 10 21:13:08.946251 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:08.946216    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c17e94ac-18e8-451d-94ff-f8edd652eb43" path="/var/lib/kubelet/pods/c17e94ac-18e8-451d-94ff-f8edd652eb43/volumes"
Sep 10 21:13:09.094857 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.094826    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"]
Sep 10 21:13:09.095381 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.095358    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93484ecb-9b08-42db-af26-218b47be712a" containerName="revoke-keys"
Sep 10 21:13:09.095381 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.095381    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="93484ecb-9b08-42db-af26-218b47be712a" containerName="revoke-keys"
Sep 10 21:13:09.095558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.095402    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c17e94ac-18e8-451d-94ff-f8edd652eb43" containerName="main"
Sep 10 21:13:09.095558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.095411    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c17e94ac-18e8-451d-94ff-f8edd652eb43" containerName="main"
Sep 10 21:13:09.095558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.095428    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="776e1a33-f171-4334-935c-f2c5736f4b0a" containerName="payload-pre-processing"
Sep 10 21:13:09.095558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.095437    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="776e1a33-f171-4334-935c-f2c5736f4b0a" containerName="payload-pre-processing"
Sep 10 21:13:09.095558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.095526    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="776e1a33-f171-4334-935c-f2c5736f4b0a" containerName="payload-pre-processing"
Sep 10 21:13:09.095558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.095536    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c17e94ac-18e8-451d-94ff-f8edd652eb43" containerName="main"
Sep 10 21:13:09.095558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.095543    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="93484ecb-9b08-42db-af26-218b47be712a" containerName="revoke-keys"
Sep 10 21:13:09.100303 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.100279    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.102644 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.102618    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-40d65f-openshift-default-dockercfg-xldsf\""
Sep 10 21:13:09.107862 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.107837    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"]
Sep 10 21:13:09.224135 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.224058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-workload-socket\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.224135 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.224120    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-credential-socket\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.224310 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.224140    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-podinfo\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.224310 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.224162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-token\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.224310 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.224233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-data\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.224310 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.224269    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-workload-certs\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.224310 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.224299    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istiod-ca-cert\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.224469 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.224382    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwdbm\" (UniqueName: \"kubernetes.io/projected/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-kube-api-access-vwdbm\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.224469 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.224412    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-envoy\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.325299 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.325271    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-credential-socket\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.325299 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.325302    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-podinfo\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.325501 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.325323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-token\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.325501 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.325354    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-data\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.325501 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.325383    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-workload-certs\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.325501 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.325412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istiod-ca-cert\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.325501 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.325466    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwdbm\" (UniqueName: \"kubernetes.io/projected/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-kube-api-access-vwdbm\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.325501 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.325494    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-envoy\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.325782 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.325565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-workload-socket\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.325840 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.325783    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-data\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.325840 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.325828    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-workload-certs\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.325917 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.325870    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-workload-socket\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.325917 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.325874    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-credential-socket\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.326178 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.326157    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istiod-ca-cert\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.327582 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.327562    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-envoy\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.327924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.327900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-podinfo\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.332575 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.332555    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-token\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.332752 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.332733    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwdbm\" (UniqueName: \"kubernetes.io/projected/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-kube-api-access-vwdbm\") pod \"e2e-noten-40d65f-openshift-default-78479bb66-jrwpd\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") " pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.413101 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.413076    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:09.688901 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.688861    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"]
Sep 10 21:13:09.690244 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:13:09.690220    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8194d46_6acf_4a5a_ba0e_fd79ff29a861.slice/crio-f412ec77e6c024c9413097c5e474b3c822a627dc510b5d02df459ebd10b8db01 WatchSource:0}: Error finding container f412ec77e6c024c9413097c5e474b3c822a627dc510b5d02df459ebd10b8db01: Status 404 returned error can't find the container with id f412ec77e6c024c9413097c5e474b3c822a627dc510b5d02df459ebd10b8db01
Sep 10 21:13:09.692346 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.692311    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:13:09.692429 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.692376    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:13:09.692429 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:09.692402    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:13:10.127078 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:10.127023    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd" event={"ID":"f8194d46-6acf-4a5a-ba0e-fd79ff29a861","Type":"ContainerStarted","Data":"6c493917435dfadad8ea398acd23b1ce5ee6fbd666e35d073918d72a3524f63d"}
Sep 10 21:13:10.127456 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:10.127094    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd" event={"ID":"f8194d46-6acf-4a5a-ba0e-fd79ff29a861","Type":"ContainerStarted","Data":"f412ec77e6c024c9413097c5e474b3c822a627dc510b5d02df459ebd10b8db01"}
Sep 10 21:13:10.157356 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:10.157311    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd" podStartSLOduration=1.157295583 podStartE2EDuration="1.157295583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:13:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:13:10.155300322 +0000 UTC m=+917.729006707" watchObservedRunningTime="2026-09-10 21:13:10.157295583 +0000 UTC m=+917.731001955"
Sep 10 21:13:10.413643 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:10.413576    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:10.418417 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:10.418393    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:11.132461 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:11.132436    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:11.133335 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:11.133318    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:13.550737 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:13.550703    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:13:20.365722 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.365688    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"]
Sep 10 21:13:20.378160 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.378126    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.379700 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.379672    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"]
Sep 10 21:13:20.380576 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.380542    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-40d65f\"/\"noten-model-40d65f-kserve-self-signed-certs\""
Sep 10 21:13:20.380718 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.380670    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-40d65f\"/\"openshift-service-ca.crt\""
Sep 10 21:13:20.381247 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.381229    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-40d65f\"/\"default-dockercfg-m5sf2\""
Sep 10 21:13:20.381314 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.381267    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-40d65f\"/\"kube-root-ca.crt\""
Sep 10 21:13:20.527719 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.527669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-home\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.527923 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.527749    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-dshm\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.527923 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.527899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e1221c8-e0d8-41a8-8b71-377e5582577a-tls-certs\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.528065 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.527952    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-model-cache\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.528065 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.528015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-tmp-dir\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.528183 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.528065    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qff4\" (UniqueName: \"kubernetes.io/projected/6e1221c8-e0d8-41a8-8b71-377e5582577a-kube-api-access-2qff4\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.629441 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.629361    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-dshm\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.629441 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.629444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e1221c8-e0d8-41a8-8b71-377e5582577a-tls-certs\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.629625 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.629475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-model-cache\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.629625 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.629511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-tmp-dir\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.629625 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.629538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qff4\" (UniqueName: \"kubernetes.io/projected/6e1221c8-e0d8-41a8-8b71-377e5582577a-kube-api-access-2qff4\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.629625 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.629603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-home\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.629883 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.629860    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-model-cache\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.629954 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.629883    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-home\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.629954 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.629919    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-tmp-dir\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.631674 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.631653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-dshm\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.631927 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.631910    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e1221c8-e0d8-41a8-8b71-377e5582577a-tls-certs\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.637776 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.637752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qff4\" (UniqueName: \"kubernetes.io/projected/6e1221c8-e0d8-41a8-8b71-377e5582577a-kube-api-access-2qff4\") pod \"noten-model-40d65f-kserve-755f699cf5-7g4z6\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") " pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.688867 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.688842    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:20.957337 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:20.957314    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"]
Sep 10 21:13:20.958643 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:13:20.958615    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e1221c8_e0d8_41a8_8b71_377e5582577a.slice/crio-222c11232dda027d9484e59b4eecd604c6e4b115e1d281ecef052512fe4e5d58 WatchSource:0}: Error finding container 222c11232dda027d9484e59b4eecd604c6e4b115e1d281ecef052512fe4e5d58: Status 404 returned error can't find the container with id 222c11232dda027d9484e59b4eecd604c6e4b115e1d281ecef052512fe4e5d58
Sep 10 21:13:21.191503 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:21.191473    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6" event={"ID":"6e1221c8-e0d8-41a8-8b71-377e5582577a","Type":"ContainerStarted","Data":"49e6f9eb4594a52d39afef17c6b07f05b1887af316070e33db7089fe68f2bb91"}
Sep 10 21:13:21.191658 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:21.191513    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6" event={"ID":"6e1221c8-e0d8-41a8-8b71-377e5582577a","Type":"ContainerStarted","Data":"222c11232dda027d9484e59b4eecd604c6e4b115e1d281ecef052512fe4e5d58"}
Sep 10 21:13:21.207398 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:21.207311    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6" podStartSLOduration=1.20729757 podStartE2EDuration="1.20729757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:13:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:13:21.206178554 +0000 UTC m=+928.779884928" watchObservedRunningTime="2026-09-10 21:13:21.20729757 +0000 UTC m=+928.781003942"
Sep 10 21:13:22.463904 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:22.463870    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"]
Sep 10 21:13:22.574771 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:22.574734    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"]
Sep 10 21:13:22.575008 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:22.574980    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd" podUID="f8194d46-6acf-4a5a-ba0e-fd79ff29a861" containerName="istio-proxy" containerID="cri-o://6c493917435dfadad8ea398acd23b1ce5ee6fbd666e35d073918d72a3524f63d" gracePeriod=30
Sep 10 21:13:23.264273 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:23.264245    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:13:26.134667 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:26.134621    2577 patch_prober.go:28] interesting pod/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:13:26.135072 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:26.134703    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd" podUID="f8194d46-6acf-4a5a-ba0e-fd79ff29a861" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:13:27.830068 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.830044    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:27.894686 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.894615    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-workload-socket\") pod \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") "
Sep 10 21:13:27.894686 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.894646    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istiod-ca-cert\") pod \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") "
Sep 10 21:13:27.894887 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.894691    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-data\") pod \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") "
Sep 10 21:13:27.894887 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.894736    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwdbm\" (UniqueName: \"kubernetes.io/projected/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-kube-api-access-vwdbm\") pod \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") "
Sep 10 21:13:27.894887 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.894762    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-credential-socket\") pod \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") "
Sep 10 21:13:27.894887 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.894784    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-podinfo\") pod \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") "
Sep 10 21:13:27.894887 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.894811    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-envoy\") pod \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") "
Sep 10 21:13:27.894887 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.894861    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-token\") pod \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") "
Sep 10 21:13:27.895230 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.894890    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-workload-certs\") pod \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\" (UID: \"f8194d46-6acf-4a5a-ba0e-fd79ff29a861\") "
Sep 10 21:13:27.895230 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.894914    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f8194d46-6acf-4a5a-ba0e-fd79ff29a861" (UID: "f8194d46-6acf-4a5a-ba0e-fd79ff29a861"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:27.895230 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.895051    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-data" (OuterVolumeSpecName: "istio-data") pod "f8194d46-6acf-4a5a-ba0e-fd79ff29a861" (UID: "f8194d46-6acf-4a5a-ba0e-fd79ff29a861"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:27.895230 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.895086    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f8194d46-6acf-4a5a-ba0e-fd79ff29a861" (UID: "f8194d46-6acf-4a5a-ba0e-fd79ff29a861"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:13:27.895433 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.895267    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f8194d46-6acf-4a5a-ba0e-fd79ff29a861" (UID: "f8194d46-6acf-4a5a-ba0e-fd79ff29a861"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:27.895433 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.895321    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f8194d46-6acf-4a5a-ba0e-fd79ff29a861" (UID: "f8194d46-6acf-4a5a-ba0e-fd79ff29a861"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:27.895433 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.895343    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-workload-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:27.895433 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.895363    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istiod-ca-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:27.895433 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.895377    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-data\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:27.897111 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.897086    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-token" (OuterVolumeSpecName: "istio-token") pod "f8194d46-6acf-4a5a-ba0e-fd79ff29a861" (UID: "f8194d46-6acf-4a5a-ba0e-fd79ff29a861"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:27.897222 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.897124    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-kube-api-access-vwdbm" (OuterVolumeSpecName: "kube-api-access-vwdbm") pod "f8194d46-6acf-4a5a-ba0e-fd79ff29a861" (UID: "f8194d46-6acf-4a5a-ba0e-fd79ff29a861"). InnerVolumeSpecName "kube-api-access-vwdbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:27.897222 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.897140    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f8194d46-6acf-4a5a-ba0e-fd79ff29a861" (UID: "f8194d46-6acf-4a5a-ba0e-fd79ff29a861"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:13:27.897222 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.897176    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f8194d46-6acf-4a5a-ba0e-fd79ff29a861" (UID: "f8194d46-6acf-4a5a-ba0e-fd79ff29a861"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:27.995992 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.995953    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwdbm\" (UniqueName: \"kubernetes.io/projected/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-kube-api-access-vwdbm\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:27.995992 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.995984    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-credential-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:27.995992 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.995997    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-podinfo\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:27.996283 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.996008    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-envoy\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:27.996283 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.996019    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-istio-token\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:27.996283 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:27.996052    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8194d46-6acf-4a5a-ba0e-fd79ff29a861-workload-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:28.231149 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:28.231055    2577 generic.go:356] "Generic (PLEG): container finished" podID="f8194d46-6acf-4a5a-ba0e-fd79ff29a861" containerID="6c493917435dfadad8ea398acd23b1ce5ee6fbd666e35d073918d72a3524f63d" exitCode=0
Sep 10 21:13:28.231149 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:28.231092    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"
Sep 10 21:13:28.231149 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:28.231115    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd" event={"ID":"f8194d46-6acf-4a5a-ba0e-fd79ff29a861","Type":"ContainerDied","Data":"6c493917435dfadad8ea398acd23b1ce5ee6fbd666e35d073918d72a3524f63d"}
Sep 10 21:13:28.231422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:28.231181    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd" event={"ID":"f8194d46-6acf-4a5a-ba0e-fd79ff29a861","Type":"ContainerDied","Data":"f412ec77e6c024c9413097c5e474b3c822a627dc510b5d02df459ebd10b8db01"}
Sep 10 21:13:28.231422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:28.231210    2577 scope.go:117] "RemoveContainer" containerID="6c493917435dfadad8ea398acd23b1ce5ee6fbd666e35d073918d72a3524f63d"
Sep 10 21:13:28.240819 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:28.240803    2577 scope.go:117] "RemoveContainer" containerID="6c493917435dfadad8ea398acd23b1ce5ee6fbd666e35d073918d72a3524f63d"
Sep 10 21:13:28.241095 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:13:28.241077    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c493917435dfadad8ea398acd23b1ce5ee6fbd666e35d073918d72a3524f63d\": container with ID starting with 6c493917435dfadad8ea398acd23b1ce5ee6fbd666e35d073918d72a3524f63d not found: ID does not exist" containerID="6c493917435dfadad8ea398acd23b1ce5ee6fbd666e35d073918d72a3524f63d"
Sep 10 21:13:28.241150 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:28.241104    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c493917435dfadad8ea398acd23b1ce5ee6fbd666e35d073918d72a3524f63d"} err="failed to get container status \"6c493917435dfadad8ea398acd23b1ce5ee6fbd666e35d073918d72a3524f63d\": rpc error: code = NotFound desc = could not find container \"6c493917435dfadad8ea398acd23b1ce5ee6fbd666e35d073918d72a3524f63d\": container with ID starting with 6c493917435dfadad8ea398acd23b1ce5ee6fbd666e35d073918d72a3524f63d not found: ID does not exist"
Sep 10 21:13:28.252382 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:28.252360    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"]
Sep 10 21:13:28.256503 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:28.256481    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd"]
Sep 10 21:13:28.947195 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:28.947163    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8194d46-6acf-4a5a-ba0e-fd79ff29a861" path="/var/lib/kubelet/pods/f8194d46-6acf-4a5a-ba0e-fd79ff29a861/volumes"
Sep 10 21:13:30.689894 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:30.689859    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:32.540633 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.540601    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"]
Sep 10 21:13:32.541255 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.541237    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8194d46-6acf-4a5a-ba0e-fd79ff29a861" containerName="istio-proxy"
Sep 10 21:13:32.541334 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.541257    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8194d46-6acf-4a5a-ba0e-fd79ff29a861" containerName="istio-proxy"
Sep 10 21:13:32.541396 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.541349    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8194d46-6acf-4a5a-ba0e-fd79ff29a861" containerName="istio-proxy"
Sep 10 21:13:32.546211 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.546192    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.548523 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.548505    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-766d8c20-openshift-default-dockercfg-rhxnn\""
Sep 10 21:13:32.557355 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.557333    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"]
Sep 10 21:13:32.634433 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.634402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pkdw\" (UniqueName: \"kubernetes.io/projected/376ea151-5779-41cb-953a-80dd19cbd335-kube-api-access-5pkdw\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.634613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.634447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376ea151-5779-41cb-953a-80dd19cbd335-istiod-ca-cert\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.634613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.634465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-workload-socket\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.634613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.634489    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376ea151-5779-41cb-953a-80dd19cbd335-istio-podinfo\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.634613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.634558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-credential-socket\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.634786 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.634630    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376ea151-5779-41cb-953a-80dd19cbd335-istio-token\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.634786 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.634651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-workload-certs\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.634786 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.634695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-istio-data\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.634903 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.634782    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-istio-envoy\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.735745 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.735703    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-istio-envoy\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.735745 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.735751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pkdw\" (UniqueName: \"kubernetes.io/projected/376ea151-5779-41cb-953a-80dd19cbd335-kube-api-access-5pkdw\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.736000 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.735789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376ea151-5779-41cb-953a-80dd19cbd335-istiod-ca-cert\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.736000 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.735810    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-workload-socket\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.736000 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.735836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376ea151-5779-41cb-953a-80dd19cbd335-istio-podinfo\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.736000 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.735869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-credential-socket\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.736000 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.735923    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376ea151-5779-41cb-953a-80dd19cbd335-istio-token\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.736000 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.735951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-workload-certs\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.736349 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.736002    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-istio-data\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.736408 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.736368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-credential-socket\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.736408 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.736389    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-workload-socket\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.736520 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.736427    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-istio-data\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.736580 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.736518    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-workload-certs\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.736688 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.736666    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376ea151-5779-41cb-953a-80dd19cbd335-istiod-ca-cert\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.738099 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.738080    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-istio-envoy\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.738307 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.738290    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376ea151-5779-41cb-953a-80dd19cbd335-istio-podinfo\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.743468 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.743444    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376ea151-5779-41cb-953a-80dd19cbd335-istio-token\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.743578 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.743565    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pkdw\" (UniqueName: \"kubernetes.io/projected/376ea151-5779-41cb-953a-80dd19cbd335-kube-api-access-5pkdw\") pod \"e2e-mt-766d8c20-openshift-default-69f5999856-sk499\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") " pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:32.857823 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:32.857791    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:33.140020 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:33.139993    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"]
Sep 10 21:13:33.141262 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:13:33.141236    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod376ea151_5779_41cb_953a_80dd19cbd335.slice/crio-8cd3d958f6c57f208013c4c68592a31aa4f99d0b4250a1a449e392ee9cf08393 WatchSource:0}: Error finding container 8cd3d958f6c57f208013c4c68592a31aa4f99d0b4250a1a449e392ee9cf08393: Status 404 returned error can't find the container with id 8cd3d958f6c57f208013c4c68592a31aa4f99d0b4250a1a449e392ee9cf08393
Sep 10 21:13:33.143823 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:33.143790    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:13:33.143881 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:33.143853    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:13:33.143928 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:33.143884    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:13:33.262324 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:33.262277    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499" event={"ID":"376ea151-5779-41cb-953a-80dd19cbd335","Type":"ContainerStarted","Data":"dc2f968fbe6e1e12815f121e14dcbf3f72af2fea1b2cb6c9edf1f01e2e6052db"}
Sep 10 21:13:33.262484 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:33.262339    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499" event={"ID":"376ea151-5779-41cb-953a-80dd19cbd335","Type":"ContainerStarted","Data":"8cd3d958f6c57f208013c4c68592a31aa4f99d0b4250a1a449e392ee9cf08393"}
Sep 10 21:13:33.287361 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:33.287305    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499" podStartSLOduration=1.2872851490000001 podStartE2EDuration="1.287285149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:13:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:13:33.283378532 +0000 UTC m=+940.857084939" watchObservedRunningTime="2026-09-10 21:13:33.287285149 +0000 UTC m=+940.860991523"
Sep 10 21:13:33.858695 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:33.858662    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:34.862358 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:34.862328    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:35.274331 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:35.274249    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:35.275322 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:35.275305    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:36.893931 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:36.893897    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"]
Sep 10 21:13:36.897514 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:36.897496    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"
Sep 10 21:13:36.899552 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:36.899533    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-766d8c20-dockercfg-xrnbv\""
Sep 10 21:13:36.899552 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:36.899540    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-766d8c20\""
Sep 10 21:13:36.907238 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:36.907217    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"]
Sep 10 21:13:36.985530 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:36.985497    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfh7j\" (UniqueName: \"kubernetes.io/projected/373962f1-576e-45bc-979b-fc17aaa4be10-kube-api-access-sfh7j\") pod \"payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c\" (UID: \"373962f1-576e-45bc-979b-fc17aaa4be10\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"
Sep 10 21:13:36.985695 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:36.985553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/373962f1-576e-45bc-979b-fc17aaa4be10-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c\" (UID: \"373962f1-576e-45bc-979b-fc17aaa4be10\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"
Sep 10 21:13:37.086927 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:37.086886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfh7j\" (UniqueName: \"kubernetes.io/projected/373962f1-576e-45bc-979b-fc17aaa4be10-kube-api-access-sfh7j\") pod \"payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c\" (UID: \"373962f1-576e-45bc-979b-fc17aaa4be10\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"
Sep 10 21:13:37.087147 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:37.086951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/373962f1-576e-45bc-979b-fc17aaa4be10-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c\" (UID: \"373962f1-576e-45bc-979b-fc17aaa4be10\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"
Sep 10 21:13:37.087879 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:37.087852    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/373962f1-576e-45bc-979b-fc17aaa4be10-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c\" (UID: \"373962f1-576e-45bc-979b-fc17aaa4be10\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"
Sep 10 21:13:37.094487 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:37.094462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfh7j\" (UniqueName: \"kubernetes.io/projected/373962f1-576e-45bc-979b-fc17aaa4be10-kube-api-access-sfh7j\") pod \"payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c\" (UID: \"373962f1-576e-45bc-979b-fc17aaa4be10\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"
Sep 10 21:13:37.208390 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:37.208300    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"
Sep 10 21:13:37.365010 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:37.364980    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:13:37.477103 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:37.477071    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"]
Sep 10 21:13:37.477893 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:13:37.477870    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373962f1_576e_45bc_979b_fc17aaa4be10.slice/crio-9e191215f717dfe6a86d952670aecc5ce1bb59e19417dbf3f1280517b94c720a WatchSource:0}: Error finding container 9e191215f717dfe6a86d952670aecc5ce1bb59e19417dbf3f1280517b94c720a: Status 404 returned error can't find the container with id 9e191215f717dfe6a86d952670aecc5ce1bb59e19417dbf3f1280517b94c720a
Sep 10 21:13:38.220403 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.220366    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6" podUID="6e1221c8-e0d8-41a8-8b71-377e5582577a" containerName="main" containerID="cri-o://49e6f9eb4594a52d39afef17c6b07f05b1887af316070e33db7089fe68f2bb91" gracePeriod=45
Sep 10 21:13:38.293517 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.293482    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c" event={"ID":"373962f1-576e-45bc-979b-fc17aaa4be10","Type":"ContainerStarted","Data":"5bd7ec9ee9c8e06e9a1f9880cd41c4bbeefd6f0e5276986231d38b0d96d5d7e8"}
Sep 10 21:13:38.293696 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.293540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c" event={"ID":"373962f1-576e-45bc-979b-fc17aaa4be10","Type":"ContainerStarted","Data":"9e191215f717dfe6a86d952670aecc5ce1bb59e19417dbf3f1280517b94c720a"}
Sep 10 21:13:38.293696 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.293567    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"
Sep 10 21:13:38.310393 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.310345    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c" podStartSLOduration=2.310327442 podStartE2EDuration="2.310327442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:13:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:13:38.309181694 +0000 UTC m=+945.882888061" watchObservedRunningTime="2026-09-10 21:13:38.310327442 +0000 UTC m=+945.884033814"
Sep 10 21:13:38.481102 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.481047    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:38.600428 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.600388    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-dshm\") pod \"6e1221c8-e0d8-41a8-8b71-377e5582577a\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") "
Sep 10 21:13:38.600602 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.600446    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e1221c8-e0d8-41a8-8b71-377e5582577a-tls-certs\") pod \"6e1221c8-e0d8-41a8-8b71-377e5582577a\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") "
Sep 10 21:13:38.600602 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.600473    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-home\") pod \"6e1221c8-e0d8-41a8-8b71-377e5582577a\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") "
Sep 10 21:13:38.600602 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.600488    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qff4\" (UniqueName: \"kubernetes.io/projected/6e1221c8-e0d8-41a8-8b71-377e5582577a-kube-api-access-2qff4\") pod \"6e1221c8-e0d8-41a8-8b71-377e5582577a\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") "
Sep 10 21:13:38.600868 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.600722    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-model-cache\") pod \"6e1221c8-e0d8-41a8-8b71-377e5582577a\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") "
Sep 10 21:13:38.600868 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.600774    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-tmp-dir\") pod \"6e1221c8-e0d8-41a8-8b71-377e5582577a\" (UID: \"6e1221c8-e0d8-41a8-8b71-377e5582577a\") "
Sep 10 21:13:38.600868 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.600793    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-home" (OuterVolumeSpecName: "home") pod "6e1221c8-e0d8-41a8-8b71-377e5582577a" (UID: "6e1221c8-e0d8-41a8-8b71-377e5582577a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:38.600991 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.600966    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-model-cache" (OuterVolumeSpecName: "model-cache") pod "6e1221c8-e0d8-41a8-8b71-377e5582577a" (UID: "6e1221c8-e0d8-41a8-8b71-377e5582577a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:38.601065 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.600982    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6e1221c8-e0d8-41a8-8b71-377e5582577a" (UID: "6e1221c8-e0d8-41a8-8b71-377e5582577a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:38.601152 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.601136    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-model-cache\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:38.601205 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.601156    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-tmp-dir\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:38.601205 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.601169    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-home\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:38.602736 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.602709    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-dshm" (OuterVolumeSpecName: "dshm") pod "6e1221c8-e0d8-41a8-8b71-377e5582577a" (UID: "6e1221c8-e0d8-41a8-8b71-377e5582577a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:38.602855 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.602747    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1221c8-e0d8-41a8-8b71-377e5582577a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6e1221c8-e0d8-41a8-8b71-377e5582577a" (UID: "6e1221c8-e0d8-41a8-8b71-377e5582577a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:13:38.602855 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.602828    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e1221c8-e0d8-41a8-8b71-377e5582577a-kube-api-access-2qff4" (OuterVolumeSpecName: "kube-api-access-2qff4") pod "6e1221c8-e0d8-41a8-8b71-377e5582577a" (UID: "6e1221c8-e0d8-41a8-8b71-377e5582577a"). InnerVolumeSpecName "kube-api-access-2qff4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:38.702302 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.702260    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qff4\" (UniqueName: \"kubernetes.io/projected/6e1221c8-e0d8-41a8-8b71-377e5582577a-kube-api-access-2qff4\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:38.702302 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.702292    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e1221c8-e0d8-41a8-8b71-377e5582577a-dshm\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:38.702302 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:38.702304    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e1221c8-e0d8-41a8-8b71-377e5582577a-tls-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:39.300507 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:39.300426    2577 generic.go:356] "Generic (PLEG): container finished" podID="6e1221c8-e0d8-41a8-8b71-377e5582577a" containerID="49e6f9eb4594a52d39afef17c6b07f05b1887af316070e33db7089fe68f2bb91" exitCode=0
Sep 10 21:13:39.300507 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:39.300466    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"
Sep 10 21:13:39.300947 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:39.300512    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6" event={"ID":"6e1221c8-e0d8-41a8-8b71-377e5582577a","Type":"ContainerDied","Data":"49e6f9eb4594a52d39afef17c6b07f05b1887af316070e33db7089fe68f2bb91"}
Sep 10 21:13:39.300947 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:39.300559    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6" event={"ID":"6e1221c8-e0d8-41a8-8b71-377e5582577a","Type":"ContainerDied","Data":"222c11232dda027d9484e59b4eecd604c6e4b115e1d281ecef052512fe4e5d58"}
Sep 10 21:13:39.300947 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:39.300579    2577 scope.go:117] "RemoveContainer" containerID="49e6f9eb4594a52d39afef17c6b07f05b1887af316070e33db7089fe68f2bb91"
Sep 10 21:13:39.310118 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:39.310102    2577 scope.go:117] "RemoveContainer" containerID="49e6f9eb4594a52d39afef17c6b07f05b1887af316070e33db7089fe68f2bb91"
Sep 10 21:13:39.310381 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:13:39.310364    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49e6f9eb4594a52d39afef17c6b07f05b1887af316070e33db7089fe68f2bb91\": container with ID starting with 49e6f9eb4594a52d39afef17c6b07f05b1887af316070e33db7089fe68f2bb91 not found: ID does not exist" containerID="49e6f9eb4594a52d39afef17c6b07f05b1887af316070e33db7089fe68f2bb91"
Sep 10 21:13:39.310457 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:39.310388    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e6f9eb4594a52d39afef17c6b07f05b1887af316070e33db7089fe68f2bb91"} err="failed to get container status \"49e6f9eb4594a52d39afef17c6b07f05b1887af316070e33db7089fe68f2bb91\": rpc error: code = NotFound desc = could not find container \"49e6f9eb4594a52d39afef17c6b07f05b1887af316070e33db7089fe68f2bb91\": container with ID starting with 49e6f9eb4594a52d39afef17c6b07f05b1887af316070e33db7089fe68f2bb91 not found: ID does not exist"
Sep 10 21:13:39.316338 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:39.316317    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"]
Sep 10 21:13:39.322093 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:39.322070    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-40d65f/noten-model-40d65f-kserve-755f699cf5-7g4z6"]
Sep 10 21:13:40.946620 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:40.946590    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e1221c8-e0d8-41a8-8b71-377e5582577a" path="/var/lib/kubelet/pods/6e1221c8-e0d8-41a8-8b71-377e5582577a/volumes"
Sep 10 21:13:47.571563 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:47.571529    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"]
Sep 10 21:13:47.692788 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:47.692746    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4"]
Sep 10 21:13:47.693243 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:47.693224    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e1221c8-e0d8-41a8-8b71-377e5582577a" containerName="main"
Sep 10 21:13:47.693243 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:47.693244    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e1221c8-e0d8-41a8-8b71-377e5582577a" containerName="main"
Sep 10 21:13:47.693408 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:47.693369    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e1221c8-e0d8-41a8-8b71-377e5582577a" containerName="main"
Sep 10 21:13:47.697699 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:47.697678    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4"
Sep 10 21:13:47.700194 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:47.700008    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:13:47.700194 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:47.700049    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:13:47.702931 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:47.702906    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4"]
Sep 10 21:13:47.784952 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:47.784918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/032f1e88-d451-46dd-a4ae-23e140be66c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4\" (UID: \"032f1e88-d451-46dd-a4ae-23e140be66c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4"
Sep 10 21:13:47.886317 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:47.886216    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/032f1e88-d451-46dd-a4ae-23e140be66c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4\" (UID: \"032f1e88-d451-46dd-a4ae-23e140be66c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4"
Sep 10 21:13:47.886845 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:47.886824    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/032f1e88-d451-46dd-a4ae-23e140be66c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4\" (UID: \"032f1e88-d451-46dd-a4ae-23e140be66c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4"
Sep 10 21:13:48.010091 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:48.010055    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4"
Sep 10 21:13:48.290218 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:48.290195    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4"]
Sep 10 21:13:48.291200 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:13:48.291170    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032f1e88_d451_46dd_a4ae_23e140be66c6.slice/crio-f2a1852c57ccff5a3ed3ef797d7bb2bd8b11a8d0e7fc15f71a0bdda93847420e WatchSource:0}: Error finding container f2a1852c57ccff5a3ed3ef797d7bb2bd8b11a8d0e7fc15f71a0bdda93847420e: Status 404 returned error can't find the container with id f2a1852c57ccff5a3ed3ef797d7bb2bd8b11a8d0e7fc15f71a0bdda93847420e
Sep 10 21:13:48.358515 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:48.358487    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4" event={"ID":"032f1e88-d451-46dd-a4ae-23e140be66c6","Type":"ContainerStarted","Data":"f2a1852c57ccff5a3ed3ef797d7bb2bd8b11a8d0e7fc15f71a0bdda93847420e"}
Sep 10 21:13:49.302927 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:49.302898    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"
Sep 10 21:13:49.365662 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:49.365629    2577 generic.go:356] "Generic (PLEG): container finished" podID="032f1e88-d451-46dd-a4ae-23e140be66c6" containerID="32b27d16e3a8f4ada627b36cde321d6c25ba0517101cf3efdb7e08d8806a7f8a" exitCode=0
Sep 10 21:13:49.365837 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:49.365707    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4" event={"ID":"032f1e88-d451-46dd-a4ae-23e140be66c6","Type":"ContainerDied","Data":"32b27d16e3a8f4ada627b36cde321d6c25ba0517101cf3efdb7e08d8806a7f8a"}
Sep 10 21:13:50.538595 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:50.538572    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4"
Sep 10 21:13:50.630106 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:50.629396    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/032f1e88-d451-46dd-a4ae-23e140be66c6-maas-api-service-ca\") pod \"032f1e88-d451-46dd-a4ae-23e140be66c6\" (UID: \"032f1e88-d451-46dd-a4ae-23e140be66c6\") "
Sep 10 21:13:50.630269 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:50.630098    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/032f1e88-d451-46dd-a4ae-23e140be66c6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "032f1e88-d451-46dd-a4ae-23e140be66c6" (UID: "032f1e88-d451-46dd-a4ae-23e140be66c6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:13:50.730390 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:50.730346    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/032f1e88-d451-46dd-a4ae-23e140be66c6-maas-api-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:13:50.859010 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:50.858974    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:13:51.380081 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:51.380047    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4"
Sep 10 21:13:51.380081 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:51.380072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4" event={"ID":"032f1e88-d451-46dd-a4ae-23e140be66c6","Type":"ContainerDied","Data":"f2a1852c57ccff5a3ed3ef797d7bb2bd8b11a8d0e7fc15f71a0bdda93847420e"}
Sep 10 21:13:51.380284 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:51.380124    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2a1852c57ccff5a3ed3ef797d7bb2bd8b11a8d0e7fc15f71a0bdda93847420e"
Sep 10 21:13:55.409239 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:55.409200    2577 generic.go:356] "Generic (PLEG): container finished" podID="376ea151-5779-41cb-953a-80dd19cbd335" containerID="dc2f968fbe6e1e12815f121e14dcbf3f72af2fea1b2cb6c9edf1f01e2e6052db" exitCode=0
Sep 10 21:13:55.409647 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:55.409267    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499" event={"ID":"376ea151-5779-41cb-953a-80dd19cbd335","Type":"ContainerDied","Data":"dc2f968fbe6e1e12815f121e14dcbf3f72af2fea1b2cb6c9edf1f01e2e6052db"}
Sep 10 21:13:55.409690 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:55.409678    2577 scope.go:117] "RemoveContainer" containerID="dc2f968fbe6e1e12815f121e14dcbf3f72af2fea1b2cb6c9edf1f01e2e6052db"
Sep 10 21:13:55.410729 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:55.410694    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:13:55.410829 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:55.410779    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:13:55.410892 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:55.410827    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:13:56.421951 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:56.421913    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499" event={"ID":"376ea151-5779-41cb-953a-80dd19cbd335","Type":"ContainerStarted","Data":"bd7485ab33b6605e0ccb54511fbfabfd0cd12a7aaa21daefbe3f81b6b949792d"}
Sep 10 21:13:56.858724 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:56.858692    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:13:56.858924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:56.858899    2577 patch_prober.go:28] interesting pod/e2e-mt-766d8c20-openshift-default-69f5999856-sk499 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:13:56.858971 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:56.858953    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499" podUID="376ea151-5779-41cb-953a-80dd19cbd335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 21:13:57.858500 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:57.858466    2577 patch_prober.go:28] interesting pod/e2e-mt-766d8c20-openshift-default-69f5999856-sk499 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:13:57.858898 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:57.858522    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499" podUID="376ea151-5779-41cb-953a-80dd19cbd335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 21:13:58.456223 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:58.456184    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4"]
Sep 10 21:13:58.458696 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:58.458670    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a41a24-kdzq4"]
Sep 10 21:13:58.858246 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:58.858207    2577 patch_prober.go:28] interesting pod/e2e-mt-766d8c20-openshift-default-69f5999856-sk499 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:13:58.858455 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:58.858271    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499" podUID="376ea151-5779-41cb-953a-80dd19cbd335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 21:13:58.947241 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:58.947197    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="032f1e88-d451-46dd-a4ae-23e140be66c6" path="/var/lib/kubelet/pods/032f1e88-d451-46dd-a4ae-23e140be66c6/volumes"
Sep 10 21:13:59.858496 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:59.858460    2577 patch_prober.go:28] interesting pod/e2e-mt-766d8c20-openshift-default-69f5999856-sk499 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:13:59.858679 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:13:59.858519    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499" podUID="376ea151-5779-41cb-953a-80dd19cbd335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 21:14:00.858348 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:00.858311    2577 patch_prober.go:28] interesting pod/e2e-mt-766d8c20-openshift-default-69f5999856-sk499 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:14:00.858825 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:00.858385    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499" podUID="376ea151-5779-41cb-953a-80dd19cbd335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 21:14:01.663490 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:01.663444    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:14:01.862049 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:01.862005    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:14:01.862521 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:01.862504    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:14:01.863304 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:01.863282    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:14:02.591854 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.591813    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp" podUID="9c07a5e4-9b20-4b79-b6db-acc4071db336" containerName="main" containerID="cri-o://d2692baa34530df8631d5125c758d2884a5eea9fc743beb13a4617ae1259468c" gracePeriod=45
Sep 10 21:14:02.843869 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.843801    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:14:02.947915 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.947884    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c07a5e4-9b20-4b79-b6db-acc4071db336-tls-certs\") pod \"9c07a5e4-9b20-4b79-b6db-acc4071db336\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") "
Sep 10 21:14:02.948415 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.947929    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-home\") pod \"9c07a5e4-9b20-4b79-b6db-acc4071db336\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") "
Sep 10 21:14:02.948415 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.947955    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-tmp-dir\") pod \"9c07a5e4-9b20-4b79-b6db-acc4071db336\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") "
Sep 10 21:14:02.948415 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.947972    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7kh4\" (UniqueName: \"kubernetes.io/projected/9c07a5e4-9b20-4b79-b6db-acc4071db336-kube-api-access-s7kh4\") pod \"9c07a5e4-9b20-4b79-b6db-acc4071db336\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") "
Sep 10 21:14:02.948415 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.948007    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-model-cache\") pod \"9c07a5e4-9b20-4b79-b6db-acc4071db336\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") "
Sep 10 21:14:02.948415 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.948071    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-dshm\") pod \"9c07a5e4-9b20-4b79-b6db-acc4071db336\" (UID: \"9c07a5e4-9b20-4b79-b6db-acc4071db336\") "
Sep 10 21:14:02.948415 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.948261    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-home" (OuterVolumeSpecName: "home") pod "9c07a5e4-9b20-4b79-b6db-acc4071db336" (UID: "9c07a5e4-9b20-4b79-b6db-acc4071db336"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:02.948415 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.948279    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9c07a5e4-9b20-4b79-b6db-acc4071db336" (UID: "9c07a5e4-9b20-4b79-b6db-acc4071db336"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:02.948784 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.948415    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-model-cache" (OuterVolumeSpecName: "model-cache") pod "9c07a5e4-9b20-4b79-b6db-acc4071db336" (UID: "9c07a5e4-9b20-4b79-b6db-acc4071db336"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:02.948784 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.948472    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-home\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:02.948784 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.948486    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-tmp-dir\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:02.950369 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.950344    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-dshm" (OuterVolumeSpecName: "dshm") pod "9c07a5e4-9b20-4b79-b6db-acc4071db336" (UID: "9c07a5e4-9b20-4b79-b6db-acc4071db336"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:02.950482 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.950387    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c07a5e4-9b20-4b79-b6db-acc4071db336-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9c07a5e4-9b20-4b79-b6db-acc4071db336" (UID: "9c07a5e4-9b20-4b79-b6db-acc4071db336"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:14:02.950482 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:02.950394    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c07a5e4-9b20-4b79-b6db-acc4071db336-kube-api-access-s7kh4" (OuterVolumeSpecName: "kube-api-access-s7kh4") pod "9c07a5e4-9b20-4b79-b6db-acc4071db336" (UID: "9c07a5e4-9b20-4b79-b6db-acc4071db336"). InnerVolumeSpecName "kube-api-access-s7kh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:03.049752 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:03.049706    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c07a5e4-9b20-4b79-b6db-acc4071db336-tls-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:03.049752 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:03.049749    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7kh4\" (UniqueName: \"kubernetes.io/projected/9c07a5e4-9b20-4b79-b6db-acc4071db336-kube-api-access-s7kh4\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:03.049752 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:03.049760    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-model-cache\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:03.050001 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:03.049769    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c07a5e4-9b20-4b79-b6db-acc4071db336-dshm\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:03.473817 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:03.473774    2577 generic.go:356] "Generic (PLEG): container finished" podID="9c07a5e4-9b20-4b79-b6db-acc4071db336" containerID="d2692baa34530df8631d5125c758d2884a5eea9fc743beb13a4617ae1259468c" exitCode=0
Sep 10 21:14:03.474024 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:03.473824    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"
Sep 10 21:14:03.474024 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:03.473859    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp" event={"ID":"9c07a5e4-9b20-4b79-b6db-acc4071db336","Type":"ContainerDied","Data":"d2692baa34530df8631d5125c758d2884a5eea9fc743beb13a4617ae1259468c"}
Sep 10 21:14:03.474024 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:03.473902    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp" event={"ID":"9c07a5e4-9b20-4b79-b6db-acc4071db336","Type":"ContainerDied","Data":"856dd232be136f144c8e23c4a0b0e86c6781df03eaafa1979b98222d101a6239"}
Sep 10 21:14:03.474024 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:03.473924    2577 scope.go:117] "RemoveContainer" containerID="d2692baa34530df8631d5125c758d2884a5eea9fc743beb13a4617ae1259468c"
Sep 10 21:14:03.485306 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:03.485287    2577 scope.go:117] "RemoveContainer" containerID="d2692baa34530df8631d5125c758d2884a5eea9fc743beb13a4617ae1259468c"
Sep 10 21:14:03.485638 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:14:03.485619    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2692baa34530df8631d5125c758d2884a5eea9fc743beb13a4617ae1259468c\": container with ID starting with d2692baa34530df8631d5125c758d2884a5eea9fc743beb13a4617ae1259468c not found: ID does not exist" containerID="d2692baa34530df8631d5125c758d2884a5eea9fc743beb13a4617ae1259468c"
Sep 10 21:14:03.485709 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:03.485651    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2692baa34530df8631d5125c758d2884a5eea9fc743beb13a4617ae1259468c"} err="failed to get container status \"d2692baa34530df8631d5125c758d2884a5eea9fc743beb13a4617ae1259468c\": rpc error: code = NotFound desc = could not find container \"d2692baa34530df8631d5125c758d2884a5eea9fc743beb13a4617ae1259468c\": container with ID starting with d2692baa34530df8631d5125c758d2884a5eea9fc743beb13a4617ae1259468c not found: ID does not exist"
Sep 10 21:14:03.496188 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:03.496154    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"]
Sep 10 21:14:03.499525 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:03.499500    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-69dcc8/test-model-69dcc8-kserve-7bdf685d7-cb6lp"]
Sep 10 21:14:04.947116 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:04.947074    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c07a5e4-9b20-4b79-b6db-acc4071db336" path="/var/lib/kubelet/pods/9c07a5e4-9b20-4b79-b6db-acc4071db336/volumes"
Sep 10 21:14:05.540850 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.540817    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd"]
Sep 10 21:14:05.541263 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.541249    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c07a5e4-9b20-4b79-b6db-acc4071db336" containerName="main"
Sep 10 21:14:05.541315 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.541264    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c07a5e4-9b20-4b79-b6db-acc4071db336" containerName="main"
Sep 10 21:14:05.541315 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.541278    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="032f1e88-d451-46dd-a4ae-23e140be66c6" containerName="revoke-keys"
Sep 10 21:14:05.541315 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.541284    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="032f1e88-d451-46dd-a4ae-23e140be66c6" containerName="revoke-keys"
Sep 10 21:14:05.541422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.541345    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="032f1e88-d451-46dd-a4ae-23e140be66c6" containerName="revoke-keys"
Sep 10 21:14:05.541422 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.541355    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c07a5e4-9b20-4b79-b6db-acc4071db336" containerName="main"
Sep 10 21:14:05.544363 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.544348    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd"
Sep 10 21:14:05.546716 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.546695    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:14:05.546794 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.546773    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:14:05.552750 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.552719    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd"]
Sep 10 21:14:05.676519 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.676477    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/682e50c4-a40e-411e-b387-b291ca1dfba4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd\" (UID: \"682e50c4-a40e-411e-b387-b291ca1dfba4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd"
Sep 10 21:14:05.777727 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.777668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/682e50c4-a40e-411e-b387-b291ca1dfba4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd\" (UID: \"682e50c4-a40e-411e-b387-b291ca1dfba4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd"
Sep 10 21:14:05.778439 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.778408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/682e50c4-a40e-411e-b387-b291ca1dfba4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd\" (UID: \"682e50c4-a40e-411e-b387-b291ca1dfba4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd"
Sep 10 21:14:05.857284 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:05.857255    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd"
Sep 10 21:14:06.129363 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:06.129338    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd"]
Sep 10 21:14:06.130995 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:14:06.130957    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod682e50c4_a40e_411e_b387_b291ca1dfba4.slice/crio-d9c8f5670e023ab827ff0cebb5d28e3ea84255ac04f8000ec0e79685f8fdbf01 WatchSource:0}: Error finding container d9c8f5670e023ab827ff0cebb5d28e3ea84255ac04f8000ec0e79685f8fdbf01: Status 404 returned error can't find the container with id d9c8f5670e023ab827ff0cebb5d28e3ea84255ac04f8000ec0e79685f8fdbf01
Sep 10 21:14:06.498023 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:06.497983    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd" event={"ID":"682e50c4-a40e-411e-b387-b291ca1dfba4","Type":"ContainerStarted","Data":"21db08b87747032cc7fe77208382ca03888b1fefc0b4acb0ac4edcbbc9c9d192"}
Sep 10 21:14:06.498191 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:06.498067    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd" event={"ID":"682e50c4-a40e-411e-b387-b291ca1dfba4","Type":"ContainerStarted","Data":"d9c8f5670e023ab827ff0cebb5d28e3ea84255ac04f8000ec0e79685f8fdbf01"}
Sep 10 21:14:06.514242 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:06.514191    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd" podStartSLOduration=1.5141770079999999 podStartE2EDuration="1.514177008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:14:06.511944476 +0000 UTC m=+974.085650862" watchObservedRunningTime="2026-09-10 21:14:06.514177008 +0000 UTC m=+974.087883382"
Sep 10 21:14:07.505241 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:07.505207    2577 generic.go:356] "Generic (PLEG): container finished" podID="682e50c4-a40e-411e-b387-b291ca1dfba4" containerID="21db08b87747032cc7fe77208382ca03888b1fefc0b4acb0ac4edcbbc9c9d192" exitCode=0
Sep 10 21:14:07.505625 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:07.505297    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd" event={"ID":"682e50c4-a40e-411e-b387-b291ca1dfba4","Type":"ContainerDied","Data":"21db08b87747032cc7fe77208382ca03888b1fefc0b4acb0ac4edcbbc9c9d192"}
Sep 10 21:14:08.646746 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:08.646718    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd"
Sep 10 21:14:08.806452 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:08.806353    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/682e50c4-a40e-411e-b387-b291ca1dfba4-maas-api-service-ca\") pod \"682e50c4-a40e-411e-b387-b291ca1dfba4\" (UID: \"682e50c4-a40e-411e-b387-b291ca1dfba4\") "
Sep 10 21:14:08.806805 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:08.806779    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/682e50c4-a40e-411e-b387-b291ca1dfba4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "682e50c4-a40e-411e-b387-b291ca1dfba4" (UID: "682e50c4-a40e-411e-b387-b291ca1dfba4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:08.907186 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:08.907131    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/682e50c4-a40e-411e-b387-b291ca1dfba4-maas-api-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:09.518699 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:09.518670    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd"
Sep 10 21:14:09.518884 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:09.518712    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd" event={"ID":"682e50c4-a40e-411e-b387-b291ca1dfba4","Type":"ContainerDied","Data":"d9c8f5670e023ab827ff0cebb5d28e3ea84255ac04f8000ec0e79685f8fdbf01"}
Sep 10 21:14:09.518884 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:09.518764    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9c8f5670e023ab827ff0cebb5d28e3ea84255ac04f8000ec0e79685f8fdbf01"
Sep 10 21:14:16.363654 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:16.363564    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"]
Sep 10 21:14:16.364091 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:16.363767    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6" podUID="85593305-ebbc-481c-ac0d-e7a1de2c75f9" containerName="payload-pre-processing" containerID="cri-o://bbb90408c8f0bbb2d91f2267cf2cf29916daa0d1ad7f163d53d19559a92bcebe" gracePeriod=30
Sep 10 21:14:16.513515 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:16.513444    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd"]
Sep 10 21:14:16.516107 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:16.516081    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-69dcc8-ljfhd"]
Sep 10 21:14:16.561934 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:16.561905    2577 generic.go:356] "Generic (PLEG): container finished" podID="85593305-ebbc-481c-ac0d-e7a1de2c75f9" containerID="bbb90408c8f0bbb2d91f2267cf2cf29916daa0d1ad7f163d53d19559a92bcebe" exitCode=0
Sep 10 21:14:16.562078 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:16.561972    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6" event={"ID":"85593305-ebbc-481c-ac0d-e7a1de2c75f9","Type":"ContainerDied","Data":"bbb90408c8f0bbb2d91f2267cf2cf29916daa0d1ad7f163d53d19559a92bcebe"}
Sep 10 21:14:16.622851 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:16.622794    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"
Sep 10 21:14:16.676491 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:16.676458    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85593305-ebbc-481c-ac0d-e7a1de2c75f9-plugins-config-volume\") pod \"85593305-ebbc-481c-ac0d-e7a1de2c75f9\" (UID: \"85593305-ebbc-481c-ac0d-e7a1de2c75f9\") "
Sep 10 21:14:16.676640 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:16.676511    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdgjq\" (UniqueName: \"kubernetes.io/projected/85593305-ebbc-481c-ac0d-e7a1de2c75f9-kube-api-access-pdgjq\") pod \"85593305-ebbc-481c-ac0d-e7a1de2c75f9\" (UID: \"85593305-ebbc-481c-ac0d-e7a1de2c75f9\") "
Sep 10 21:14:16.676838 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:16.676815    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85593305-ebbc-481c-ac0d-e7a1de2c75f9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "85593305-ebbc-481c-ac0d-e7a1de2c75f9" (UID: "85593305-ebbc-481c-ac0d-e7a1de2c75f9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:16.678517 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:16.678492    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85593305-ebbc-481c-ac0d-e7a1de2c75f9-kube-api-access-pdgjq" (OuterVolumeSpecName: "kube-api-access-pdgjq") pod "85593305-ebbc-481c-ac0d-e7a1de2c75f9" (UID: "85593305-ebbc-481c-ac0d-e7a1de2c75f9"). InnerVolumeSpecName "kube-api-access-pdgjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:16.777073 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:16.777016    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85593305-ebbc-481c-ac0d-e7a1de2c75f9-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:16.777073 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:16.777061    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdgjq\" (UniqueName: \"kubernetes.io/projected/85593305-ebbc-481c-ac0d-e7a1de2c75f9-kube-api-access-pdgjq\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:16.946929 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:16.946853    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="682e50c4-a40e-411e-b387-b291ca1dfba4" path="/var/lib/kubelet/pods/682e50c4-a40e-411e-b387-b291ca1dfba4/volumes"
Sep 10 21:14:17.569096 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:17.569066    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"
Sep 10 21:14:17.569512 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:17.569071    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6" event={"ID":"85593305-ebbc-481c-ac0d-e7a1de2c75f9","Type":"ContainerDied","Data":"c66b5e88d0d8ced9b69bf9f8cc374c9873c0bd349f2be24e69e09a246764f364"}
Sep 10 21:14:17.569512 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:17.569226    2577 scope.go:117] "RemoveContainer" containerID="bbb90408c8f0bbb2d91f2267cf2cf29916daa0d1ad7f163d53d19559a92bcebe"
Sep 10 21:14:17.586171 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:17.586141    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"]
Sep 10 21:14:17.589532 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:17.589511    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6"]
Sep 10 21:14:18.273403 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.273370    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"]
Sep 10 21:14:18.273654 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.273604    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c" podUID="373962f1-576e-45bc-979b-fc17aaa4be10" containerName="payload-pre-processing" containerID="cri-o://5bd7ec9ee9c8e06e9a1f9880cd41c4bbeefd6f0e5276986231d38b0d96d5d7e8" gracePeriod=30
Sep 10 21:14:18.532523 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.532449    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"
Sep 10 21:14:18.578176 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.578144    2577 generic.go:356] "Generic (PLEG): container finished" podID="373962f1-576e-45bc-979b-fc17aaa4be10" containerID="5bd7ec9ee9c8e06e9a1f9880cd41c4bbeefd6f0e5276986231d38b0d96d5d7e8" exitCode=0
Sep 10 21:14:18.578613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.578192    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"
Sep 10 21:14:18.578613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.578226    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c" event={"ID":"373962f1-576e-45bc-979b-fc17aaa4be10","Type":"ContainerDied","Data":"5bd7ec9ee9c8e06e9a1f9880cd41c4bbeefd6f0e5276986231d38b0d96d5d7e8"}
Sep 10 21:14:18.578613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.578272    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c" event={"ID":"373962f1-576e-45bc-979b-fc17aaa4be10","Type":"ContainerDied","Data":"9e191215f717dfe6a86d952670aecc5ce1bb59e19417dbf3f1280517b94c720a"}
Sep 10 21:14:18.578613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.578286    2577 scope.go:117] "RemoveContainer" containerID="5bd7ec9ee9c8e06e9a1f9880cd41c4bbeefd6f0e5276986231d38b0d96d5d7e8"
Sep 10 21:14:18.587160 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.587143    2577 scope.go:117] "RemoveContainer" containerID="5bd7ec9ee9c8e06e9a1f9880cd41c4bbeefd6f0e5276986231d38b0d96d5d7e8"
Sep 10 21:14:18.587425 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:14:18.587407    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bd7ec9ee9c8e06e9a1f9880cd41c4bbeefd6f0e5276986231d38b0d96d5d7e8\": container with ID starting with 5bd7ec9ee9c8e06e9a1f9880cd41c4bbeefd6f0e5276986231d38b0d96d5d7e8 not found: ID does not exist" containerID="5bd7ec9ee9c8e06e9a1f9880cd41c4bbeefd6f0e5276986231d38b0d96d5d7e8"
Sep 10 21:14:18.587474 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.587435    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bd7ec9ee9c8e06e9a1f9880cd41c4bbeefd6f0e5276986231d38b0d96d5d7e8"} err="failed to get container status \"5bd7ec9ee9c8e06e9a1f9880cd41c4bbeefd6f0e5276986231d38b0d96d5d7e8\": rpc error: code = NotFound desc = could not find container \"5bd7ec9ee9c8e06e9a1f9880cd41c4bbeefd6f0e5276986231d38b0d96d5d7e8\": container with ID starting with 5bd7ec9ee9c8e06e9a1f9880cd41c4bbeefd6f0e5276986231d38b0d96d5d7e8 not found: ID does not exist"
Sep 10 21:14:18.596819 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.596800    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfh7j\" (UniqueName: \"kubernetes.io/projected/373962f1-576e-45bc-979b-fc17aaa4be10-kube-api-access-sfh7j\") pod \"373962f1-576e-45bc-979b-fc17aaa4be10\" (UID: \"373962f1-576e-45bc-979b-fc17aaa4be10\") "
Sep 10 21:14:18.596926 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.596853    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/373962f1-576e-45bc-979b-fc17aaa4be10-plugins-config-volume\") pod \"373962f1-576e-45bc-979b-fc17aaa4be10\" (UID: \"373962f1-576e-45bc-979b-fc17aaa4be10\") "
Sep 10 21:14:18.597310 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.597274    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/373962f1-576e-45bc-979b-fc17aaa4be10-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "373962f1-576e-45bc-979b-fc17aaa4be10" (UID: "373962f1-576e-45bc-979b-fc17aaa4be10"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:18.599293 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.599271    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/373962f1-576e-45bc-979b-fc17aaa4be10-kube-api-access-sfh7j" (OuterVolumeSpecName: "kube-api-access-sfh7j") pod "373962f1-576e-45bc-979b-fc17aaa4be10" (UID: "373962f1-576e-45bc-979b-fc17aaa4be10"). InnerVolumeSpecName "kube-api-access-sfh7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:18.698530 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.698505    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/373962f1-576e-45bc-979b-fc17aaa4be10-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:18.698530 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.698527    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfh7j\" (UniqueName: \"kubernetes.io/projected/373962f1-576e-45bc-979b-fc17aaa4be10-kube-api-access-sfh7j\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:18.899534 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.899509    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"]
Sep 10 21:14:18.903628 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.903607    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c"]
Sep 10 21:14:18.947568 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.947539    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="373962f1-576e-45bc-979b-fc17aaa4be10" path="/var/lib/kubelet/pods/373962f1-576e-45bc-979b-fc17aaa4be10/volumes"
Sep 10 21:14:18.947878 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:18.947866    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85593305-ebbc-481c-ac0d-e7a1de2c75f9" path="/var/lib/kubelet/pods/85593305-ebbc-481c-ac0d-e7a1de2c75f9/volumes"
Sep 10 21:14:20.362432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:20.362399    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:14:23.744154 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.744116    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"]
Sep 10 21:14:23.744764 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.744746    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="373962f1-576e-45bc-979b-fc17aaa4be10" containerName="payload-pre-processing"
Sep 10 21:14:23.744816 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.744767    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="373962f1-576e-45bc-979b-fc17aaa4be10" containerName="payload-pre-processing"
Sep 10 21:14:23.744816 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.744782    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="682e50c4-a40e-411e-b387-b291ca1dfba4" containerName="revoke-keys"
Sep 10 21:14:23.744816 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.744791    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="682e50c4-a40e-411e-b387-b291ca1dfba4" containerName="revoke-keys"
Sep 10 21:14:23.744816 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.744807    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85593305-ebbc-481c-ac0d-e7a1de2c75f9" containerName="payload-pre-processing"
Sep 10 21:14:23.744943 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.744817    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="85593305-ebbc-481c-ac0d-e7a1de2c75f9" containerName="payload-pre-processing"
Sep 10 21:14:23.744943 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.744902    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="85593305-ebbc-481c-ac0d-e7a1de2c75f9" containerName="payload-pre-processing"
Sep 10 21:14:23.744943 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.744913    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="373962f1-576e-45bc-979b-fc17aaa4be10" containerName="payload-pre-processing"
Sep 10 21:14:23.744943 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.744924    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="682e50c4-a40e-411e-b387-b291ca1dfba4" containerName="revoke-keys"
Sep 10 21:14:23.747551 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.747530    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.750004 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.749980    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-8623b2-openshift-default-dockercfg-vftn9\""
Sep 10 21:14:23.759155 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.759135    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"]
Sep 10 21:14:23.844182 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.844146    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trqnn\" (UniqueName: \"kubernetes.io/projected/c58b90a8-c691-46f8-8e83-213113c5b167-kube-api-access-trqnn\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.844358 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.844190    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-workload-certs\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.844358 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.844210    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c58b90a8-c691-46f8-8e83-213113c5b167-istio-podinfo\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.844358 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.844313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-istio-envoy\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.844358 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.844352    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-credential-socket\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.844586 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.844439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c58b90a8-c691-46f8-8e83-213113c5b167-istio-token\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.844586 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.844482    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c58b90a8-c691-46f8-8e83-213113c5b167-istiod-ca-cert\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.844586 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.844512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-workload-socket\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.844706 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.844617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-istio-data\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.945924 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.945882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqnn\" (UniqueName: \"kubernetes.io/projected/c58b90a8-c691-46f8-8e83-213113c5b167-kube-api-access-trqnn\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.946156 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.945930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-workload-certs\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.946156 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.946074    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c58b90a8-c691-46f8-8e83-213113c5b167-istio-podinfo\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.946156 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.946123    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-istio-envoy\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.946156 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.946152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-credential-socket\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.946397 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.946204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c58b90a8-c691-46f8-8e83-213113c5b167-istio-token\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.946397 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.946247    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c58b90a8-c691-46f8-8e83-213113c5b167-istiod-ca-cert\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.946397 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.946277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-workload-socket\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.946397 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.946372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-istio-data\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.946397 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.946387    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-workload-certs\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.946748 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.946723    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-workload-socket\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.946826 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.946760    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-credential-socket\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.946826 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.946805    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-istio-data\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.946940 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.946865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c58b90a8-c691-46f8-8e83-213113c5b167-istiod-ca-cert\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.948717 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.948693    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-istio-envoy\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.948998 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.948983    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c58b90a8-c691-46f8-8e83-213113c5b167-istio-podinfo\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.953573 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.953554    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trqnn\" (UniqueName: \"kubernetes.io/projected/c58b90a8-c691-46f8-8e83-213113c5b167-kube-api-access-trqnn\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:23.957460 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:23.957438    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c58b90a8-c691-46f8-8e83-213113c5b167-istio-token\") pod \"e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") " pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:24.059122 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:24.059046    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:24.332112 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:24.332072    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"]
Sep 10 21:14:24.333372 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:14:24.333349    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58b90a8_c691_46f8_8e83_213113c5b167.slice/crio-f30994205035055e61eb77f6d66dc006582615ee59208ad490dcb42dd51c3420 WatchSource:0}: Error finding container f30994205035055e61eb77f6d66dc006582615ee59208ad490dcb42dd51c3420: Status 404 returned error can't find the container with id f30994205035055e61eb77f6d66dc006582615ee59208ad490dcb42dd51c3420
Sep 10 21:14:24.335440 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:24.335410    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:14:24.335515 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:24.335469    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:14:24.335553 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:24.335514    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:14:24.615618 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:24.615535    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" event={"ID":"c58b90a8-c691-46f8-8e83-213113c5b167","Type":"ContainerStarted","Data":"26b80e450dfb6b22d69a7bbc9138148ee0c6d9592594395eea1c9dfba0c6f5e4"}
Sep 10 21:14:24.615618 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:24.615588    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" event={"ID":"c58b90a8-c691-46f8-8e83-213113c5b167","Type":"ContainerStarted","Data":"f30994205035055e61eb77f6d66dc006582615ee59208ad490dcb42dd51c3420"}
Sep 10 21:14:24.634535 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:24.634485    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" podStartSLOduration=1.634467814 podStartE2EDuration="1.634467814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:14:24.633266625 +0000 UTC m=+992.206972998" watchObservedRunningTime="2026-09-10 21:14:24.634467814 +0000 UTC m=+992.208174187"
Sep 10 21:14:25.059385 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:25.059309    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:25.060869 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:25.060842    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 10 21:14:25.060984 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:25.060898    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 10 21:14:25.205554 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:25.205504    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"]
Sep 10 21:14:25.205811 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:25.205776    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499" podUID="376ea151-5779-41cb-953a-80dd19cbd335" containerName="istio-proxy" containerID="cri-o://bd7485ab33b6605e0ccb54511fbfabfd0cd12a7aaa21daefbe3f81b6b949792d" gracePeriod=30
Sep 10 21:14:26.064063 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:26.064022    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:26.628518 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:26.628484    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:26.629599 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:26.629572    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:30.453162 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.453137    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:14:30.609832 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.609801    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pkdw\" (UniqueName: \"kubernetes.io/projected/376ea151-5779-41cb-953a-80dd19cbd335-kube-api-access-5pkdw\") pod \"376ea151-5779-41cb-953a-80dd19cbd335\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") "
Sep 10 21:14:30.610006 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.609847    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-istio-envoy\") pod \"376ea151-5779-41cb-953a-80dd19cbd335\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") "
Sep 10 21:14:30.610006 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.609882    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376ea151-5779-41cb-953a-80dd19cbd335-istiod-ca-cert\") pod \"376ea151-5779-41cb-953a-80dd19cbd335\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") "
Sep 10 21:14:30.610006 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.609939    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376ea151-5779-41cb-953a-80dd19cbd335-istio-podinfo\") pod \"376ea151-5779-41cb-953a-80dd19cbd335\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") "
Sep 10 21:14:30.610006 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.609975    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-workload-certs\") pod \"376ea151-5779-41cb-953a-80dd19cbd335\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") "
Sep 10 21:14:30.610244 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.610070    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376ea151-5779-41cb-953a-80dd19cbd335-istio-token\") pod \"376ea151-5779-41cb-953a-80dd19cbd335\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") "
Sep 10 21:14:30.610244 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.610097    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-istio-data\") pod \"376ea151-5779-41cb-953a-80dd19cbd335\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") "
Sep 10 21:14:30.610244 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.610130    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-workload-socket\") pod \"376ea151-5779-41cb-953a-80dd19cbd335\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") "
Sep 10 21:14:30.610244 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.610155    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-credential-socket\") pod \"376ea151-5779-41cb-953a-80dd19cbd335\" (UID: \"376ea151-5779-41cb-953a-80dd19cbd335\") "
Sep 10 21:14:30.610439 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.610341    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/376ea151-5779-41cb-953a-80dd19cbd335-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "376ea151-5779-41cb-953a-80dd19cbd335" (UID: "376ea151-5779-41cb-953a-80dd19cbd335"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:30.610917 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.610520    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376ea151-5779-41cb-953a-80dd19cbd335-istiod-ca-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:30.610917 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.610701    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "376ea151-5779-41cb-953a-80dd19cbd335" (UID: "376ea151-5779-41cb-953a-80dd19cbd335"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:30.610917 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.610745    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-istio-data" (OuterVolumeSpecName: "istio-data") pod "376ea151-5779-41cb-953a-80dd19cbd335" (UID: "376ea151-5779-41cb-953a-80dd19cbd335"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:30.610917 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.610872    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "376ea151-5779-41cb-953a-80dd19cbd335" (UID: "376ea151-5779-41cb-953a-80dd19cbd335"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:30.610917 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.610884    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "376ea151-5779-41cb-953a-80dd19cbd335" (UID: "376ea151-5779-41cb-953a-80dd19cbd335"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:30.612275 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.612247    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/376ea151-5779-41cb-953a-80dd19cbd335-kube-api-access-5pkdw" (OuterVolumeSpecName: "kube-api-access-5pkdw") pod "376ea151-5779-41cb-953a-80dd19cbd335" (UID: "376ea151-5779-41cb-953a-80dd19cbd335"). InnerVolumeSpecName "kube-api-access-5pkdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:30.612477 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.612457    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/376ea151-5779-41cb-953a-80dd19cbd335-istio-token" (OuterVolumeSpecName: "istio-token") pod "376ea151-5779-41cb-953a-80dd19cbd335" (UID: "376ea151-5779-41cb-953a-80dd19cbd335"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:30.612656 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.612631    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "376ea151-5779-41cb-953a-80dd19cbd335" (UID: "376ea151-5779-41cb-953a-80dd19cbd335"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:30.612753 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.612661    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/376ea151-5779-41cb-953a-80dd19cbd335-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "376ea151-5779-41cb-953a-80dd19cbd335" (UID: "376ea151-5779-41cb-953a-80dd19cbd335"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:14:30.655057 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.655014    2577 generic.go:356] "Generic (PLEG): container finished" podID="376ea151-5779-41cb-953a-80dd19cbd335" containerID="bd7485ab33b6605e0ccb54511fbfabfd0cd12a7aaa21daefbe3f81b6b949792d" exitCode=0
Sep 10 21:14:30.655171 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.655057    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499" event={"ID":"376ea151-5779-41cb-953a-80dd19cbd335","Type":"ContainerDied","Data":"bd7485ab33b6605e0ccb54511fbfabfd0cd12a7aaa21daefbe3f81b6b949792d"}
Sep 10 21:14:30.655171 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.655078    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"
Sep 10 21:14:30.655171 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.655109    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499" event={"ID":"376ea151-5779-41cb-953a-80dd19cbd335","Type":"ContainerDied","Data":"8cd3d958f6c57f208013c4c68592a31aa4f99d0b4250a1a449e392ee9cf08393"}
Sep 10 21:14:30.655171 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.655131    2577 scope.go:117] "RemoveContainer" containerID="bd7485ab33b6605e0ccb54511fbfabfd0cd12a7aaa21daefbe3f81b6b949792d"
Sep 10 21:14:30.664613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.664598    2577 scope.go:117] "RemoveContainer" containerID="dc2f968fbe6e1e12815f121e14dcbf3f72af2fea1b2cb6c9edf1f01e2e6052db"
Sep 10 21:14:30.675962 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.675935    2577 scope.go:117] "RemoveContainer" containerID="bd7485ab33b6605e0ccb54511fbfabfd0cd12a7aaa21daefbe3f81b6b949792d"
Sep 10 21:14:30.677303 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:14:30.677234    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd7485ab33b6605e0ccb54511fbfabfd0cd12a7aaa21daefbe3f81b6b949792d\": container with ID starting with bd7485ab33b6605e0ccb54511fbfabfd0cd12a7aaa21daefbe3f81b6b949792d not found: ID does not exist" containerID="bd7485ab33b6605e0ccb54511fbfabfd0cd12a7aaa21daefbe3f81b6b949792d"
Sep 10 21:14:30.677303 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.677272    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd7485ab33b6605e0ccb54511fbfabfd0cd12a7aaa21daefbe3f81b6b949792d"} err="failed to get container status \"bd7485ab33b6605e0ccb54511fbfabfd0cd12a7aaa21daefbe3f81b6b949792d\": rpc error: code = NotFound desc = could not find container \"bd7485ab33b6605e0ccb54511fbfabfd0cd12a7aaa21daefbe3f81b6b949792d\": container with ID starting with bd7485ab33b6605e0ccb54511fbfabfd0cd12a7aaa21daefbe3f81b6b949792d not found: ID does not exist"
Sep 10 21:14:30.677303 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.677298    2577 scope.go:117] "RemoveContainer" containerID="dc2f968fbe6e1e12815f121e14dcbf3f72af2fea1b2cb6c9edf1f01e2e6052db"
Sep 10 21:14:30.677958 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:14:30.677845    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc2f968fbe6e1e12815f121e14dcbf3f72af2fea1b2cb6c9edf1f01e2e6052db\": container with ID starting with dc2f968fbe6e1e12815f121e14dcbf3f72af2fea1b2cb6c9edf1f01e2e6052db not found: ID does not exist" containerID="dc2f968fbe6e1e12815f121e14dcbf3f72af2fea1b2cb6c9edf1f01e2e6052db"
Sep 10 21:14:30.677958 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.677877    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc2f968fbe6e1e12815f121e14dcbf3f72af2fea1b2cb6c9edf1f01e2e6052db"} err="failed to get container status \"dc2f968fbe6e1e12815f121e14dcbf3f72af2fea1b2cb6c9edf1f01e2e6052db\": rpc error: code = NotFound desc = could not find container \"dc2f968fbe6e1e12815f121e14dcbf3f72af2fea1b2cb6c9edf1f01e2e6052db\": container with ID starting with dc2f968fbe6e1e12815f121e14dcbf3f72af2fea1b2cb6c9edf1f01e2e6052db not found: ID does not exist"
Sep 10 21:14:30.679510 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.679493    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"]
Sep 10 21:14:30.681672 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.681653    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499"]
Sep 10 21:14:30.711437 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.711416    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376ea151-5779-41cb-953a-80dd19cbd335-istio-token\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:30.711437 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.711437    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-istio-data\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:30.711560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.711446    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-workload-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:30.711560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.711455    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-credential-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:30.711560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.711465    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pkdw\" (UniqueName: \"kubernetes.io/projected/376ea151-5779-41cb-953a-80dd19cbd335-kube-api-access-5pkdw\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:30.711560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.711474    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-istio-envoy\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:30.711560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.711482    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376ea151-5779-41cb-953a-80dd19cbd335-istio-podinfo\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:30.711560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.711490    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376ea151-5779-41cb-953a-80dd19cbd335-workload-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:14:30.946656 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:30.946575    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="376ea151-5779-41cb-953a-80dd19cbd335" path="/var/lib/kubelet/pods/376ea151-5779-41cb-953a-80dd19cbd335/volumes"
Sep 10 21:14:31.478010 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:31.477979    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:14:38.350829 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.350794    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"]
Sep 10 21:14:38.351429 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.351410    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376ea151-5779-41cb-953a-80dd19cbd335" containerName="istio-proxy"
Sep 10 21:14:38.351507 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.351432    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="376ea151-5779-41cb-953a-80dd19cbd335" containerName="istio-proxy"
Sep 10 21:14:38.351563 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.351551    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="376ea151-5779-41cb-953a-80dd19cbd335" containerName="istio-proxy"
Sep 10 21:14:38.351600 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.351569    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="376ea151-5779-41cb-953a-80dd19cbd335" containerName="istio-proxy"
Sep 10 21:14:38.355763 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.355743    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.358080 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.358057    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-91c25e-openshift-default-dockercfg-pw42l\""
Sep 10 21:14:38.365410 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.365386    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"]
Sep 10 21:14:38.490379 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.490284    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-credential-socket\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.490379 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.490331    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-token\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.490379 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.490376    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-data\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.490692 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.490399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-envoy\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.490692 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.490421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0046d4aa-1663-442f-bde8-d5c93044c0e7-istiod-ca-cert\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.490692 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.490447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkkpt\" (UniqueName: \"kubernetes.io/projected/0046d4aa-1663-442f-bde8-d5c93044c0e7-kube-api-access-rkkpt\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.490692 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.490471    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-podinfo\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.490692 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.490497    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-workload-certs\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.490692 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.490513    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-workload-socket\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.591729 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.591685    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-token\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.591929 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.591755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-data\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.591929 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.591793    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-envoy\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.591929 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.591822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0046d4aa-1663-442f-bde8-d5c93044c0e7-istiod-ca-cert\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.591929 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.591845    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkkpt\" (UniqueName: \"kubernetes.io/projected/0046d4aa-1663-442f-bde8-d5c93044c0e7-kube-api-access-rkkpt\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.591929 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.591876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-podinfo\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.591929 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.591919    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-workload-certs\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.592284 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.591944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-workload-socket\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.592284 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.592011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-credential-socket\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.592401 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.592288    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-data\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.592459 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.592403    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-credential-socket\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.592558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.592534    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-workload-certs\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.592668 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.592615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0046d4aa-1663-442f-bde8-d5c93044c0e7-istiod-ca-cert\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.592712 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.592664    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-workload-socket\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.594701 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.594678    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-envoy\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.594812 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.594754    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-podinfo\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.606293 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.606261    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-token\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.606897 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.606868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkkpt\" (UniqueName: \"kubernetes.io/projected/0046d4aa-1663-442f-bde8-d5c93044c0e7-kube-api-access-rkkpt\") pod \"e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") " pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.668848 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.668803    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:38.959748 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.959723    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"]
Sep 10 21:14:38.962470 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:14:38.962444    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0046d4aa_1663_442f_bde8_d5c93044c0e7.slice/crio-6688e1a524cbd6577075846821eb4af2da6a95cf410168cfd47de58edea1d76c WatchSource:0}: Error finding container 6688e1a524cbd6577075846821eb4af2da6a95cf410168cfd47de58edea1d76c: Status 404 returned error can't find the container with id 6688e1a524cbd6577075846821eb4af2da6a95cf410168cfd47de58edea1d76c
Sep 10 21:14:38.965007 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.964971    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:14:38.965093 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.965054    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:14:38.965093 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:38.965084    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:14:39.712313 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:39.712278    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv" event={"ID":"0046d4aa-1663-442f-bde8-d5c93044c0e7","Type":"ContainerStarted","Data":"b49473eb9d86d8bc20cc6557a732267c0e2ae466b6d9e5a7160c85c683a70529"}
Sep 10 21:14:39.712825 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:39.712344    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv" event={"ID":"0046d4aa-1663-442f-bde8-d5c93044c0e7","Type":"ContainerStarted","Data":"6688e1a524cbd6577075846821eb4af2da6a95cf410168cfd47de58edea1d76c"}
Sep 10 21:14:39.732851 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:39.732788    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv" podStartSLOduration=1.732769501 podStartE2EDuration="1.732769501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:14:39.730223225 +0000 UTC m=+1007.303929623" watchObservedRunningTime="2026-09-10 21:14:39.732769501 +0000 UTC m=+1007.306475875"
Sep 10 21:14:40.669139 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:40.669100    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:40.674266 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:40.674239    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:40.719852 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:40.719818    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:40.720800 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:40.720779    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:41.630274 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:41.630236    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 10 21:14:41.630481 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:41.630300    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 10 21:14:41.727131 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:41.727097    2577 generic.go:356] "Generic (PLEG): container finished" podID="c58b90a8-c691-46f8-8e83-213113c5b167" containerID="26b80e450dfb6b22d69a7bbc9138148ee0c6d9592594395eea1c9dfba0c6f5e4" exitCode=0
Sep 10 21:14:41.727540 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:41.727167    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" event={"ID":"c58b90a8-c691-46f8-8e83-213113c5b167","Type":"ContainerDied","Data":"26b80e450dfb6b22d69a7bbc9138148ee0c6d9592594395eea1c9dfba0c6f5e4"}
Sep 10 21:14:41.727624 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:41.727607    2577 scope.go:117] "RemoveContainer" containerID="26b80e450dfb6b22d69a7bbc9138148ee0c6d9592594395eea1c9dfba0c6f5e4"
Sep 10 21:14:41.728654 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:41.728625    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:14:41.728751 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:41.728716    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:14:41.728818 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:41.728773    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:14:42.736590 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:42.736551    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" event={"ID":"c58b90a8-c691-46f8-8e83-213113c5b167","Type":"ContainerStarted","Data":"b00917ad21e7acafdf22f1072794d259490ab1aad49935a90baa2158e7dd1bfc"}
Sep 10 21:14:43.060252 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.060169    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:43.060410 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.060388    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 10 21:14:43.060454 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.060437    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 10 21:14:43.499751 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.499720    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"]
Sep 10 21:14:43.500173 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.500157    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376ea151-5779-41cb-953a-80dd19cbd335" containerName="istio-proxy"
Sep 10 21:14:43.500235 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.500176    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="376ea151-5779-41cb-953a-80dd19cbd335" containerName="istio-proxy"
Sep 10 21:14:43.502509 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.502493    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"
Sep 10 21:14:43.504900 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.504869    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-91c25e-dockercfg-4wn9s\""
Sep 10 21:14:43.505096 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.505083    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-91c25e\""
Sep 10 21:14:43.519763 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.519730    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"]
Sep 10 21:14:43.642530 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.642496    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/709cd439-90d2-46c5-ad64-e0ce1be4fd4e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn\" (UID: \"709cd439-90d2-46c5-ad64-e0ce1be4fd4e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"
Sep 10 21:14:43.642710 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.642543    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mzs2\" (UniqueName: \"kubernetes.io/projected/709cd439-90d2-46c5-ad64-e0ce1be4fd4e-kube-api-access-6mzs2\") pod \"payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn\" (UID: \"709cd439-90d2-46c5-ad64-e0ce1be4fd4e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"
Sep 10 21:14:43.743139 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.743110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/709cd439-90d2-46c5-ad64-e0ce1be4fd4e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn\" (UID: \"709cd439-90d2-46c5-ad64-e0ce1be4fd4e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"
Sep 10 21:14:43.743509 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.743149    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mzs2\" (UniqueName: \"kubernetes.io/projected/709cd439-90d2-46c5-ad64-e0ce1be4fd4e-kube-api-access-6mzs2\") pod \"payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn\" (UID: \"709cd439-90d2-46c5-ad64-e0ce1be4fd4e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"
Sep 10 21:14:43.743862 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.743841    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/709cd439-90d2-46c5-ad64-e0ce1be4fd4e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn\" (UID: \"709cd439-90d2-46c5-ad64-e0ce1be4fd4e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"
Sep 10 21:14:43.750338 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.750288    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mzs2\" (UniqueName: \"kubernetes.io/projected/709cd439-90d2-46c5-ad64-e0ce1be4fd4e-kube-api-access-6mzs2\") pod \"payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn\" (UID: \"709cd439-90d2-46c5-ad64-e0ce1be4fd4e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"
Sep 10 21:14:43.820328 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:43.820296    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"
Sep 10 21:14:44.060345 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:44.060249    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 10 21:14:44.060345 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:44.060313    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 10 21:14:44.092994 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:44.092973    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"]
Sep 10 21:14:44.094539 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:14:44.094480    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod709cd439_90d2_46c5_ad64_e0ce1be4fd4e.slice/crio-282f2c3cd8d44b7013293d9b7bf1da74c5a16c6a712048bc8aeffa55a69f8452 WatchSource:0}: Error finding container 282f2c3cd8d44b7013293d9b7bf1da74c5a16c6a712048bc8aeffa55a69f8452: Status 404 returned error can't find the container with id 282f2c3cd8d44b7013293d9b7bf1da74c5a16c6a712048bc8aeffa55a69f8452
Sep 10 21:14:44.750613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:44.750572    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn" event={"ID":"709cd439-90d2-46c5-ad64-e0ce1be4fd4e","Type":"ContainerStarted","Data":"b8f2c2d0e0b9c50a5f458cb10eb470b6c347777827c1bef28bcd4a487dc1653f"}
Sep 10 21:14:44.751105 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:44.750653    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn" event={"ID":"709cd439-90d2-46c5-ad64-e0ce1be4fd4e","Type":"ContainerStarted","Data":"282f2c3cd8d44b7013293d9b7bf1da74c5a16c6a712048bc8aeffa55a69f8452"}
Sep 10 21:14:44.751105 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:44.750685    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"
Sep 10 21:14:44.768845 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:44.768784    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn" podStartSLOduration=1.768768432 podStartE2EDuration="1.768768432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:14:44.764661635 +0000 UTC m=+1012.338368022" watchObservedRunningTime="2026-09-10 21:14:44.768768432 +0000 UTC m=+1012.342474806"
Sep 10 21:14:45.060405 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:45.060314    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 10 21:14:45.060405 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:45.060367    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 10 21:14:46.060411 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:46.060376    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 10 21:14:46.060857 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:46.060557    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 10 21:14:46.760531 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:46.760496    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:14:47.059571 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:47.059493    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 10 21:14:47.059779 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:47.059748    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 10 21:14:48.060164 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:48.060126    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 10 21:14:48.060543 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:48.060182    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 10 21:14:49.063714 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:49.063686    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:49.064120 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:49.063991    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:49.064622 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:49.064607    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:14:55.758421 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:55.758392    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"
Sep 10 21:14:56.171131 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.171088    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": read tcp 10.132.0.2:47856->10.132.0.74:15021: read: connection reset by peer" start-of-body=
Sep 10 21:14:56.171311 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.171160    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv" podUID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": read tcp 10.132.0.2:47856->10.132.0.74:15021: read: connection reset by peer"
Sep 10 21:14:56.460670 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.460585    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"]
Sep 10 21:14:56.463170 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.463152    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"
Sep 10 21:14:56.465504 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.465481    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-4eb314\""
Sep 10 21:14:56.465599 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.465523    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-4eb314-dockercfg-ws45z\""
Sep 10 21:14:56.472292 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.472271    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"]
Sep 10 21:14:56.578618 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.578580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrfk8\" (UniqueName: \"kubernetes.io/projected/3cf07b59-1e22-4887-a136-dc3cc97edfe0-kube-api-access-rrfk8\") pod \"payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g\" (UID: \"3cf07b59-1e22-4887-a136-dc3cc97edfe0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"
Sep 10 21:14:56.578799 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.578637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf07b59-1e22-4887-a136-dc3cc97edfe0-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g\" (UID: \"3cf07b59-1e22-4887-a136-dc3cc97edfe0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"
Sep 10 21:14:56.679447 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.679419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrfk8\" (UniqueName: \"kubernetes.io/projected/3cf07b59-1e22-4887-a136-dc3cc97edfe0-kube-api-access-rrfk8\") pod \"payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g\" (UID: \"3cf07b59-1e22-4887-a136-dc3cc97edfe0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"
Sep 10 21:14:56.679596 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.679464    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf07b59-1e22-4887-a136-dc3cc97edfe0-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g\" (UID: \"3cf07b59-1e22-4887-a136-dc3cc97edfe0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"
Sep 10 21:14:56.680184 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.680165    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf07b59-1e22-4887-a136-dc3cc97edfe0-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g\" (UID: \"3cf07b59-1e22-4887-a136-dc3cc97edfe0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"
Sep 10 21:14:56.687809 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.687783    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrfk8\" (UniqueName: \"kubernetes.io/projected/3cf07b59-1e22-4887-a136-dc3cc97edfe0-kube-api-access-rrfk8\") pod \"payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g\" (UID: \"3cf07b59-1e22-4887-a136-dc3cc97edfe0\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"
Sep 10 21:14:56.774871 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.774806    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"
Sep 10 21:14:56.823578 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.823399    2577 generic.go:356] "Generic (PLEG): container finished" podID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerID="b49473eb9d86d8bc20cc6557a732267c0e2ae466b6d9e5a7160c85c683a70529" exitCode=0
Sep 10 21:14:56.823578 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.823499    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv" event={"ID":"0046d4aa-1663-442f-bde8-d5c93044c0e7","Type":"ContainerDied","Data":"b49473eb9d86d8bc20cc6557a732267c0e2ae466b6d9e5a7160c85c683a70529"}
Sep 10 21:14:56.824073 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.824052    2577 scope.go:117] "RemoveContainer" containerID="b49473eb9d86d8bc20cc6557a732267c0e2ae466b6d9e5a7160c85c683a70529"
Sep 10 21:14:56.825592 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.825514    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:14:56.825706 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.825608    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:14:56.825706 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:56.825657    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:14:57.045106 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:57.045066    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"]
Sep 10 21:14:57.045763 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:14:57.045737    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf07b59_1e22_4887_a136_dc3cc97edfe0.slice/crio-8a677533b9520d1ade7a73bf5f9c66422a784fe0b5791b6b8e880ff9d22015ca WatchSource:0}: Error finding container 8a677533b9520d1ade7a73bf5f9c66422a784fe0b5791b6b8e880ff9d22015ca: Status 404 returned error can't find the container with id 8a677533b9520d1ade7a73bf5f9c66422a784fe0b5791b6b8e880ff9d22015ca
Sep 10 21:14:57.834321 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:57.834279    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g" event={"ID":"3cf07b59-1e22-4887-a136-dc3cc97edfe0","Type":"ContainerStarted","Data":"7d18b03a59f15ec9209aff70e8d9b0c0234fc39f01bf7ff27f58f93f1e725a0c"}
Sep 10 21:14:57.834879 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:57.834347    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g" event={"ID":"3cf07b59-1e22-4887-a136-dc3cc97edfe0","Type":"ContainerStarted","Data":"8a677533b9520d1ade7a73bf5f9c66422a784fe0b5791b6b8e880ff9d22015ca"}
Sep 10 21:14:57.834879 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:57.834374    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"
Sep 10 21:14:57.836404 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:57.836380    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv" event={"ID":"0046d4aa-1663-442f-bde8-d5c93044c0e7","Type":"ContainerStarted","Data":"e8dd9dd35072211e51e95926ca175f707b13dadde28e70e193ffa3d8484e8060"}
Sep 10 21:14:57.849799 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:57.849754    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g" podStartSLOduration=1.849740924 podStartE2EDuration="1.849740924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:14:57.849298565 +0000 UTC m=+1025.423004969" watchObservedRunningTime="2026-09-10 21:14:57.849740924 +0000 UTC m=+1025.423447298"
Sep 10 21:14:58.668963 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:58.668931    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:14:58.669167 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:58.669128    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 21:14:58.669215 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:58.669170    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv" podUID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 21:14:59.670111 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:59.670076    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 21:14:59.670497 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:14:59.670132    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv" podUID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 21:15:00.140568 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.140538    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-91c25e-29817915-2sp76"]
Sep 10 21:15:00.143119 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.143102    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp"]
Sep 10 21:15:00.143226 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.143208    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-91c25e-29817915-2sp76"
Sep 10 21:15:00.145235 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.145216    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:15:00.145557 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.145540    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp"
Sep 10 21:15:00.153623 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.153596    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-91c25e-29817915-2sp76"]
Sep 10 21:15:00.157184 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.157160    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp"]
Sep 10 21:15:00.158292 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.158272    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-91c25e-29817915-2sp76"
Sep 10 21:15:00.165373 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.165356    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp"
Sep 10 21:15:00.453560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.453531    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-91c25e-29817915-2sp76"]
Sep 10 21:15:00.454393 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:15:00.454367    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb94200bd_4954_4a98_884b_0b14d76ac9f6.slice/crio-2d42f3a953a42f40c496ba7891d5c100188287c6a5d3c791eb09f47648e6538a WatchSource:0}: Error finding container 2d42f3a953a42f40c496ba7891d5c100188287c6a5d3c791eb09f47648e6538a: Status 404 returned error can't find the container with id 2d42f3a953a42f40c496ba7891d5c100188287c6a5d3c791eb09f47648e6538a
Sep 10 21:15:00.475558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.475516    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp"]
Sep 10 21:15:00.476618 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:15:00.476599    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b50d731_2c42_4ae0_abcf_e62ef6a90cf5.slice/crio-b8ca4e191d2e3cd5aef606df2c6da784c55efc7df0de69397275908a2bee3a6c WatchSource:0}: Error finding container b8ca4e191d2e3cd5aef606df2c6da784c55efc7df0de69397275908a2bee3a6c: Status 404 returned error can't find the container with id b8ca4e191d2e3cd5aef606df2c6da784c55efc7df0de69397275908a2bee3a6c
Sep 10 21:15:00.669908 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.669877    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 21:15:00.670059 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.669936    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv" podUID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 21:15:00.777962 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.777885    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:15:00.858943 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.858896    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp" event={"ID":"9b50d731-2c42-4ae0-abcf-e62ef6a90cf5","Type":"ContainerStarted","Data":"a3dbe6a47774559bcd1f65301dcb0c8b4cba1413f499cf3ae43b42426e00913b"}
Sep 10 21:15:00.859153 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.858955    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp" event={"ID":"9b50d731-2c42-4ae0-abcf-e62ef6a90cf5","Type":"ContainerStarted","Data":"b8ca4e191d2e3cd5aef606df2c6da784c55efc7df0de69397275908a2bee3a6c"}
Sep 10 21:15:00.860588 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.860561    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-91c25e-29817915-2sp76" event={"ID":"b94200bd-4954-4a98-884b-0b14d76ac9f6","Type":"ContainerStarted","Data":"9a695fe5db7993b7246e7c5d8957177811b08fc86ca84ee3913bd7a25040db9b"}
Sep 10 21:15:00.860705 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.860601    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-91c25e-29817915-2sp76" event={"ID":"b94200bd-4954-4a98-884b-0b14d76ac9f6","Type":"ContainerStarted","Data":"2d42f3a953a42f40c496ba7891d5c100188287c6a5d3c791eb09f47648e6538a"}
Sep 10 21:15:00.875589 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.875543    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp" podStartSLOduration=0.875529248 podStartE2EDuration="875.529248ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:00.872332005 +0000 UTC m=+1028.446038370" watchObservedRunningTime="2026-09-10 21:15:00.875529248 +0000 UTC m=+1028.449235622"
Sep 10 21:15:00.886352 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:00.886316    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-91c25e-29817915-2sp76" podStartSLOduration=0.886304455 podStartE2EDuration="886.304455ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:00.885464862 +0000 UTC m=+1028.459171248" watchObservedRunningTime="2026-09-10 21:15:00.886304455 +0000 UTC m=+1028.460010829"
Sep 10 21:15:01.670149 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:01.670068    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 21:15:01.670149 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:01.670121    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv" podUID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 21:15:01.868865 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:01.868832    2577 generic.go:356] "Generic (PLEG): container finished" podID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5" containerID="a3dbe6a47774559bcd1f65301dcb0c8b4cba1413f499cf3ae43b42426e00913b" exitCode=7
Sep 10 21:15:01.869357 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:01.868914    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp" event={"ID":"9b50d731-2c42-4ae0-abcf-e62ef6a90cf5","Type":"ContainerDied","Data":"a3dbe6a47774559bcd1f65301dcb0c8b4cba1413f499cf3ae43b42426e00913b"}
Sep 10 21:15:01.869357 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:01.869088    2577 scope.go:117] "RemoveContainer" containerID="a3dbe6a47774559bcd1f65301dcb0c8b4cba1413f499cf3ae43b42426e00913b"
Sep 10 21:15:01.870929 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:01.870905    2577 generic.go:356] "Generic (PLEG): container finished" podID="b94200bd-4954-4a98-884b-0b14d76ac9f6" containerID="9a695fe5db7993b7246e7c5d8957177811b08fc86ca84ee3913bd7a25040db9b" exitCode=0
Sep 10 21:15:01.871129 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:01.871061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-91c25e-29817915-2sp76" event={"ID":"b94200bd-4954-4a98-884b-0b14d76ac9f6","Type":"ContainerDied","Data":"9a695fe5db7993b7246e7c5d8957177811b08fc86ca84ee3913bd7a25040db9b"}
Sep 10 21:15:02.669370 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:02.669332    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 21:15:02.669580 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:02.669389    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv" podUID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 21:15:02.879693 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:02.879658    2577 generic.go:356] "Generic (PLEG): container finished" podID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5" containerID="a9eb9dd71c5ae1b6f94b3e8b8c172d0139727f6445dedd15e9d810ee0eb474e1" exitCode=7
Sep 10 21:15:02.880102 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:02.879733    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp" event={"ID":"9b50d731-2c42-4ae0-abcf-e62ef6a90cf5","Type":"ContainerDied","Data":"a9eb9dd71c5ae1b6f94b3e8b8c172d0139727f6445dedd15e9d810ee0eb474e1"}
Sep 10 21:15:02.880102 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:02.879793    2577 scope.go:117] "RemoveContainer" containerID="a3dbe6a47774559bcd1f65301dcb0c8b4cba1413f499cf3ae43b42426e00913b"
Sep 10 21:15:02.880102 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:02.880008    2577 scope.go:117] "RemoveContainer" containerID="a9eb9dd71c5ae1b6f94b3e8b8c172d0139727f6445dedd15e9d810ee0eb474e1"
Sep 10 21:15:02.880605 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:15:02.880292    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp_odh-ai-gateway-infra(9b50d731-2c42-4ae0-abcf-e62ef6a90cf5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp" podUID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5"
Sep 10 21:15:03.010244 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:03.010218    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-91c25e-29817915-2sp76"
Sep 10 21:15:03.672877 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:03.672849    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:15:03.673307 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:03.673286    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:15:03.673900 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:03.673881    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:15:03.887072 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:03.887043    2577 scope.go:117] "RemoveContainer" containerID="a9eb9dd71c5ae1b6f94b3e8b8c172d0139727f6445dedd15e9d810ee0eb474e1"
Sep 10 21:15:03.887463 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:15:03.887268    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp_odh-ai-gateway-infra(9b50d731-2c42-4ae0-abcf-e62ef6a90cf5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp" podUID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5"
Sep 10 21:15:03.888305 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:03.888281    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-91c25e-29817915-2sp76"
Sep 10 21:15:03.888426 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:03.888304    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-91c25e-29817915-2sp76" event={"ID":"b94200bd-4954-4a98-884b-0b14d76ac9f6","Type":"ContainerDied","Data":"2d42f3a953a42f40c496ba7891d5c100188287c6a5d3c791eb09f47648e6538a"}
Sep 10 21:15:03.888426 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:03.888378    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d42f3a953a42f40c496ba7891d5c100188287c6a5d3c791eb09f47648e6538a"
Sep 10 21:15:08.844605 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:08.844577    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"
Sep 10 21:15:12.517463 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.517431    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"]
Sep 10 21:15:12.517843 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.517830    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b94200bd-4954-4a98-884b-0b14d76ac9f6" containerName="cleanup"
Sep 10 21:15:12.517903 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.517845    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b94200bd-4954-4a98-884b-0b14d76ac9f6" containerName="cleanup"
Sep 10 21:15:12.517940 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.517926    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b94200bd-4954-4a98-884b-0b14d76ac9f6" containerName="cleanup"
Sep 10 21:15:12.520846 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.520827    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"
Sep 10 21:15:12.523121 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.523098    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-837e16\""
Sep 10 21:15:12.523230 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.523102    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-837e16-dockercfg-t76dr\""
Sep 10 21:15:12.531808 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.531785    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"]
Sep 10 21:15:12.542398 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.542371    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hjgd\" (UniqueName: \"kubernetes.io/projected/cc0449dd-1118-4bc0-adda-9183773580ac-kube-api-access-4hjgd\") pod \"payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx\" (UID: \"cc0449dd-1118-4bc0-adda-9183773580ac\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"
Sep 10 21:15:12.542498 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.542423    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0449dd-1118-4bc0-adda-9183773580ac-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx\" (UID: \"cc0449dd-1118-4bc0-adda-9183773580ac\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"
Sep 10 21:15:12.643364 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.643311    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hjgd\" (UniqueName: \"kubernetes.io/projected/cc0449dd-1118-4bc0-adda-9183773580ac-kube-api-access-4hjgd\") pod \"payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx\" (UID: \"cc0449dd-1118-4bc0-adda-9183773580ac\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"
Sep 10 21:15:12.643562 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.643376    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0449dd-1118-4bc0-adda-9183773580ac-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx\" (UID: \"cc0449dd-1118-4bc0-adda-9183773580ac\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"
Sep 10 21:15:12.644076 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.644052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0449dd-1118-4bc0-adda-9183773580ac-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx\" (UID: \"cc0449dd-1118-4bc0-adda-9183773580ac\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"
Sep 10 21:15:12.651105 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.651076    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hjgd\" (UniqueName: \"kubernetes.io/projected/cc0449dd-1118-4bc0-adda-9183773580ac-kube-api-access-4hjgd\") pod \"payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx\" (UID: \"cc0449dd-1118-4bc0-adda-9183773580ac\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"
Sep 10 21:15:12.832368 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:12.832340    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"
Sep 10 21:15:13.101852 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:13.101824    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"]
Sep 10 21:15:13.102759 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:15:13.102735    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0449dd_1118_4bc0_adda_9183773580ac.slice/crio-0ba9aa9ab12386f9e7f7e2f577d0089b99d4fb3af88578c90c8ac4aa36d984a0 WatchSource:0}: Error finding container 0ba9aa9ab12386f9e7f7e2f577d0089b99d4fb3af88578c90c8ac4aa36d984a0: Status 404 returned error can't find the container with id 0ba9aa9ab12386f9e7f7e2f577d0089b99d4fb3af88578c90c8ac4aa36d984a0
Sep 10 21:15:13.953112 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:13.953082    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx" event={"ID":"cc0449dd-1118-4bc0-adda-9183773580ac","Type":"ContainerStarted","Data":"dd95cbf4b13039eae54f076b6f97e8cdc5cf03b0e79fa600619f482757a5625e"}
Sep 10 21:15:13.953112 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:13.953124    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx" event={"ID":"cc0449dd-1118-4bc0-adda-9183773580ac","Type":"ContainerStarted","Data":"0ba9aa9ab12386f9e7f7e2f577d0089b99d4fb3af88578c90c8ac4aa36d984a0"}
Sep 10 21:15:13.953518 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:13.953271    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"
Sep 10 21:15:13.969067 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:13.968992    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx" podStartSLOduration=1.968976345 podStartE2EDuration="1.968976345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:13.967864612 +0000 UTC m=+1041.541570986" watchObservedRunningTime="2026-09-10 21:15:13.968976345 +0000 UTC m=+1041.542682720"
Sep 10 21:15:16.940625 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:16.940596    2577 scope.go:117] "RemoveContainer" containerID="a9eb9dd71c5ae1b6f94b3e8b8c172d0139727f6445dedd15e9d810ee0eb474e1"
Sep 10 21:15:17.977201 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:17.977125    2577 generic.go:356] "Generic (PLEG): container finished" podID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5" containerID="872c3d18f3ae96d3b42843a2563d14bc0ece0abf2c0096c95ae53129632ebdd0" exitCode=0
Sep 10 21:15:17.977569 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:17.977200    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp" event={"ID":"9b50d731-2c42-4ae0-abcf-e62ef6a90cf5","Type":"ContainerDied","Data":"872c3d18f3ae96d3b42843a2563d14bc0ece0abf2c0096c95ae53129632ebdd0"}
Sep 10 21:15:17.977569 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:17.977259    2577 scope.go:117] "RemoveContainer" containerID="a9eb9dd71c5ae1b6f94b3e8b8c172d0139727f6445dedd15e9d810ee0eb474e1"
Sep 10 21:15:19.006158 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:19.006122    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp"]
Sep 10 21:15:19.116391 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:19.116369    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp"
Sep 10 21:15:19.990388 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:19.990358    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp"
Sep 10 21:15:19.990573 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:19.990408    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp" event={"ID":"9b50d731-2c42-4ae0-abcf-e62ef6a90cf5","Type":"ContainerDied","Data":"b8ca4e191d2e3cd5aef606df2c6da784c55efc7df0de69397275908a2bee3a6c"}
Sep 10 21:15:19.990573 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:19.990464    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8ca4e191d2e3cd5aef606df2c6da784c55efc7df0de69397275908a2bee3a6c"
Sep 10 21:15:20.016397 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:20.016375    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp"]
Sep 10 21:15:20.025560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:20.025540    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4eb314-29817915-dmszp"]
Sep 10 21:15:20.275994 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:20.275904    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:15:20.947292 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:20.947261    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5" path="/var/lib/kubelet/pods/9b50d731-2c42-4ae0-abcf-e62ef6a90cf5/volumes"
Sep 10 21:15:24.960135 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:24.960108    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"
Sep 10 21:15:44.362193 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.362158    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:15:44.635822 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.635747    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"]
Sep 10 21:15:44.636233 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.636220    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5" containerName="cleanup"
Sep 10 21:15:44.636302 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.636236    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5" containerName="cleanup"
Sep 10 21:15:44.636302 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.636250    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5" containerName="cleanup"
Sep 10 21:15:44.636302 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.636258    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5" containerName="cleanup"
Sep 10 21:15:44.636302 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.636270    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5" containerName="cleanup"
Sep 10 21:15:44.636302 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.636275    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5" containerName="cleanup"
Sep 10 21:15:44.636467 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.636336    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5" containerName="cleanup"
Sep 10 21:15:44.636467 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.636349    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5" containerName="cleanup"
Sep 10 21:15:44.639550 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.639533    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.641886 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.641867    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8ba2d470-openshift-default-dockercfg-hk5h8\""
Sep 10 21:15:44.649616 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.649594    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"]
Sep 10 21:15:44.753430 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.753394    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-workload-socket\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.753573 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.753447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-envoy\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.753573 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.753472    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-token\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.753573 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.753525    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-credential-socket\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.753573 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.753561    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-data\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.753719 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.753594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-podinfo\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.753719 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.753627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-workload-certs\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.753719 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.753650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p5tk\" (UniqueName: \"kubernetes.io/projected/fca85417-6df8-4dca-afc8-ce3a0733d3ed-kube-api-access-8p5tk\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.753719 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.753698    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istiod-ca-cert\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.855182 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.855144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istiod-ca-cert\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.855362 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.855195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-workload-socket\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.855362 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.855229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-envoy\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.855362 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.855252    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-token\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.855506 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.855363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-credential-socket\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.855506 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.855396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-data\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.855506 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.855439    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-podinfo\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.855506 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.855471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-workload-certs\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.855506 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.855499    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p5tk\" (UniqueName: \"kubernetes.io/projected/fca85417-6df8-4dca-afc8-ce3a0733d3ed-kube-api-access-8p5tk\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.855767 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.855667    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-workload-socket\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.855831 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.855760    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-data\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.855887 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.855830    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-credential-socket\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.856079 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.856059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-workload-certs\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.856162 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.856089    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istiod-ca-cert\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.857614 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.857590    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-envoy\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.857989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.857967    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-podinfo\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.868907 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.868881    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-token\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.869001 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.868984    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p5tk\" (UniqueName: \"kubernetes.io/projected/fca85417-6df8-4dca-afc8-ce3a0733d3ed-kube-api-access-8p5tk\") pod \"e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") " pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:44.950785 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:44.950734    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:45.228923 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:45.228890    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"]
Sep 10 21:15:45.229101 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:15:45.229049    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca85417_6df8_4dca_afc8_ce3a0733d3ed.slice/crio-24993b0a6fbc0aaaa46c2bf84821cd39fa2a67badcc009c9bf1dee4ba9af486b WatchSource:0}: Error finding container 24993b0a6fbc0aaaa46c2bf84821cd39fa2a67badcc009c9bf1dee4ba9af486b: Status 404 returned error can't find the container with id 24993b0a6fbc0aaaa46c2bf84821cd39fa2a67badcc009c9bf1dee4ba9af486b
Sep 10 21:15:45.231282 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:45.231245    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:15:45.231373 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:45.231314    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:15:45.231373 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:45.231342    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:15:46.168848 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:46.168808    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2" event={"ID":"fca85417-6df8-4dca-afc8-ce3a0733d3ed","Type":"ContainerStarted","Data":"16ed0c3977eeb37987e3c8dc9daaf084ac037c486eb6d31759e28dc876b733b1"}
Sep 10 21:15:46.169259 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:46.168895    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2" event={"ID":"fca85417-6df8-4dca-afc8-ce3a0733d3ed","Type":"ContainerStarted","Data":"24993b0a6fbc0aaaa46c2bf84821cd39fa2a67badcc009c9bf1dee4ba9af486b"}
Sep 10 21:15:46.188991 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:46.188946    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2" podStartSLOduration=2.188931432 podStartE2EDuration="2.188931432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:46.187327993 +0000 UTC m=+1073.761034366" watchObservedRunningTime="2026-09-10 21:15:46.188931432 +0000 UTC m=+1073.762637807"
Sep 10 21:15:46.951299 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:46.951268    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:46.956299 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:46.956276    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:47.174904 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:47.174876    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:47.175767 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:47.175746    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:15:58.565485 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:15:58.565450    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:16:08.313207 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:08.313175    2577 generic.go:356] "Generic (PLEG): container finished" podID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerID="16ed0c3977eeb37987e3c8dc9daaf084ac037c486eb6d31759e28dc876b733b1" exitCode=0
Sep 10 21:16:08.313544 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:08.313250    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2" event={"ID":"fca85417-6df8-4dca-afc8-ce3a0733d3ed","Type":"ContainerDied","Data":"16ed0c3977eeb37987e3c8dc9daaf084ac037c486eb6d31759e28dc876b733b1"}
Sep 10 21:16:08.313630 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:08.313615    2577 scope.go:117] "RemoveContainer" containerID="16ed0c3977eeb37987e3c8dc9daaf084ac037c486eb6d31759e28dc876b733b1"
Sep 10 21:16:08.314712 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:08.314683    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:16:08.314772 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:08.314750    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:16:08.314812 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:08.314787    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:16:09.321362 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:09.321325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2" event={"ID":"fca85417-6df8-4dca-afc8-ce3a0733d3ed","Type":"ContainerStarted","Data":"e3a052d7e5d834eaacbc46c60b4430517cafc74b40ae331063a138b4b6c7c72f"}
Sep 10 21:16:09.951177 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:09.951138    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:16:09.951381 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:09.951324    2577 patch_prober.go:28] interesting pod/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 10 21:16:09.951463 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:09.951376    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2" podUID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 10 21:16:10.951605 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:10.951575    2577 patch_prober.go:28] interesting pod/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 10 21:16:10.951973 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:10.951622    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2" podUID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 10 21:16:11.951804 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:11.951767    2577 patch_prober.go:28] interesting pod/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 10 21:16:11.952236 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:11.951833    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2" podUID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 10 21:16:12.951523 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:12.951484    2577 patch_prober.go:28] interesting pod/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 10 21:16:12.951735 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:12.951546    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2" podUID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 10 21:16:13.951486 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:13.951450    2577 patch_prober.go:28] interesting pod/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 10 21:16:13.951878 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:13.951506    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2" podUID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 10 21:16:14.951735 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:14.951701    2577 patch_prober.go:28] interesting pod/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 10 21:16:14.952249 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:14.951765    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2" podUID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 10 21:16:15.954853 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:15.954816    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:16:15.955265 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:15.955131    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:16:15.955709 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:15.955686    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:16:29.261303 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:29.261260    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:16:37.969792 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:37.969763    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"]
Sep 10 21:16:37.970296 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:37.970281    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b50d731-2c42-4ae0-abcf-e62ef6a90cf5" containerName="cleanup"
Sep 10 21:16:37.973320 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:37.973300    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:37.975568 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:37.975550    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8ba2d470\"/\"default-dockercfg-smzd6\""
Sep 10 21:16:37.976383 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:37.976368    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8ba2d470\"/\"e2e-lifecycle-model-8ba2d470-kserve-self-signed-certs\""
Sep 10 21:16:37.976450 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:37.976376    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8ba2d470\"/\"kube-root-ca.crt\""
Sep 10 21:16:37.976450 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:37.976419    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8ba2d470\"/\"openshift-service-ca.crt\""
Sep 10 21:16:37.981937 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:37.981916    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"]
Sep 10 21:16:38.074186 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.074154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-tmp-dir\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.074186 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.074191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-dshm\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.074418 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.074214    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sftcl\" (UniqueName: \"kubernetes.io/projected/53cb4223-0760-4bdc-a3c2-72687e886de3-kube-api-access-sftcl\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.074418 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.074298    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cb4223-0760-4bdc-a3c2-72687e886de3-tls-certs\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.074418 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.074318    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-home\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.074418 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.074343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-model-cache\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.175454 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.175398    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sftcl\" (UniqueName: \"kubernetes.io/projected/53cb4223-0760-4bdc-a3c2-72687e886de3-kube-api-access-sftcl\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.175792 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.175750    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cb4223-0760-4bdc-a3c2-72687e886de3-tls-certs\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.175921 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.175801    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-home\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.175921 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.175845    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-model-cache\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.176077 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.175975    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-tmp-dir\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.176077 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.176006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-dshm\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.176773 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.176752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-home\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.177206 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.177184    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-model-cache\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.177412 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.177383    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-tmp-dir\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.178936 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.178916    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-dshm\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.184906 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.184882    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cb4223-0760-4bdc-a3c2-72687e886de3-tls-certs\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.186758 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.186738    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sftcl\" (UniqueName: \"kubernetes.io/projected/53cb4223-0760-4bdc-a3c2-72687e886de3-kube-api-access-sftcl\") pod \"e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") " pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.284627 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.284553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:38.557336 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:38.557306    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"]
Sep 10 21:16:38.558469 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:16:38.558443    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53cb4223_0760_4bdc_a3c2_72687e886de3.slice/crio-e40ecc7bf88e4090996447950b5ea766b19ef065d1126fae9e172d9f125d214c WatchSource:0}: Error finding container e40ecc7bf88e4090996447950b5ea766b19ef065d1126fae9e172d9f125d214c: Status 404 returned error can't find the container with id e40ecc7bf88e4090996447950b5ea766b19ef065d1126fae9e172d9f125d214c
Sep 10 21:16:39.511234 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:39.511194    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4" event={"ID":"53cb4223-0760-4bdc-a3c2-72687e886de3","Type":"ContainerStarted","Data":"cb03d79512c1b171cf5ab14ac8ade8b14b449c0c019bd0a2f8131f5830349900"}
Sep 10 21:16:39.511621 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:39.511245    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4" event={"ID":"53cb4223-0760-4bdc-a3c2-72687e886de3","Type":"ContainerStarted","Data":"e40ecc7bf88e4090996447950b5ea766b19ef065d1126fae9e172d9f125d214c"}
Sep 10 21:16:39.528981 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:39.528932    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4" podStartSLOduration=2.528918237 podStartE2EDuration="2.528918237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:16:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:16:39.527556095 +0000 UTC m=+1127.101262469" watchObservedRunningTime="2026-09-10 21:16:39.528918237 +0000 UTC m=+1127.102624610"
Sep 10 21:16:42.461711 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:42.461675    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:16:48.284671 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:48.284628    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:48.285264 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:48.284694    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:48.297543 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:48.297518    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:48.577258 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:48.577231    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:16:53.106795 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:53.106760    2577 scope.go:117] "RemoveContainer" containerID="4fa9dc5d64dec33ae523b0543868e3ef782111723f7f76d1c923bcab8103f975"
Sep 10 21:16:53.116147 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:53.116126    2577 scope.go:117] "RemoveContainer" containerID="8f5226a6f9ae3589629ceeec6d734b315bd4b52220d9486a9ba5a7fdc7d2564b"
Sep 10 21:16:53.124971 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:16:53.124953    2577 scope.go:117] "RemoveContainer" containerID="327b927957ec3b8937ae22364f0e2cf670d8b8372ecfba3654782b6bf5f3d9d5"
Sep 10 21:17:04.960586 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:04.960545    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:17:23.462928 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:23.462846    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:17:38.156664 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:38.156629    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:17:41.465427 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:41.465393    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"]
Sep 10 21:17:53.159563 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:53.159532    2577 scope.go:117] "RemoveContainer" containerID="0a4b3dd19690a7b575f4b874af6e113c37cc34f230b4fa62067d02fc1bd83295"
Sep 10 21:17:53.168372 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:53.168348    2577 scope.go:117] "RemoveContainer" containerID="177fcb7c885dd21a7426e875481975f36cd2f4abb30ecda42e911d4aa52557f5"
Sep 10 21:17:54.055894 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:54.055858    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:17:54.220867 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:54.220840    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:17:54.225126 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:54.225099    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:17:56.485000 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.484932    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4" podUID="53cb4223-0760-4bdc-a3c2-72687e886de3" containerName="main" containerID="cri-o://cb03d79512c1b171cf5ab14ac8ade8b14b449c0c019bd0a2f8131f5830349900" gracePeriod=45
Sep 10 21:17:56.738665 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.738602    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:17:56.831400 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.831369    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-model-cache\") pod \"53cb4223-0760-4bdc-a3c2-72687e886de3\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") "
Sep 10 21:17:56.831572 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.831427    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-dshm\") pod \"53cb4223-0760-4bdc-a3c2-72687e886de3\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") "
Sep 10 21:17:56.831572 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.831474    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cb4223-0760-4bdc-a3c2-72687e886de3-tls-certs\") pod \"53cb4223-0760-4bdc-a3c2-72687e886de3\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") "
Sep 10 21:17:56.831572 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.831495    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-tmp-dir\") pod \"53cb4223-0760-4bdc-a3c2-72687e886de3\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") "
Sep 10 21:17:56.831572 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.831538    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-home\") pod \"53cb4223-0760-4bdc-a3c2-72687e886de3\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") "
Sep 10 21:17:56.831804 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.831580    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sftcl\" (UniqueName: \"kubernetes.io/projected/53cb4223-0760-4bdc-a3c2-72687e886de3-kube-api-access-sftcl\") pod \"53cb4223-0760-4bdc-a3c2-72687e886de3\" (UID: \"53cb4223-0760-4bdc-a3c2-72687e886de3\") "
Sep 10 21:17:56.831804 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.831620    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-model-cache" (OuterVolumeSpecName: "model-cache") pod "53cb4223-0760-4bdc-a3c2-72687e886de3" (UID: "53cb4223-0760-4bdc-a3c2-72687e886de3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:17:56.831929 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.831814    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-home" (OuterVolumeSpecName: "home") pod "53cb4223-0760-4bdc-a3c2-72687e886de3" (UID: "53cb4223-0760-4bdc-a3c2-72687e886de3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:17:56.831929 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.831833    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "53cb4223-0760-4bdc-a3c2-72687e886de3" (UID: "53cb4223-0760-4bdc-a3c2-72687e886de3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:17:56.831929 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.831897    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-model-cache\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:17:56.833780 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.833745    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-dshm" (OuterVolumeSpecName: "dshm") pod "53cb4223-0760-4bdc-a3c2-72687e886de3" (UID: "53cb4223-0760-4bdc-a3c2-72687e886de3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:17:56.833907 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.833804    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53cb4223-0760-4bdc-a3c2-72687e886de3-kube-api-access-sftcl" (OuterVolumeSpecName: "kube-api-access-sftcl") pod "53cb4223-0760-4bdc-a3c2-72687e886de3" (UID: "53cb4223-0760-4bdc-a3c2-72687e886de3"). InnerVolumeSpecName "kube-api-access-sftcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:17:56.833907 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.833813    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53cb4223-0760-4bdc-a3c2-72687e886de3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "53cb4223-0760-4bdc-a3c2-72687e886de3" (UID: "53cb4223-0760-4bdc-a3c2-72687e886de3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:17:56.932959 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.932924    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-dshm\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:17:56.932959 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.932953    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cb4223-0760-4bdc-a3c2-72687e886de3-tls-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:17:56.932959 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.932963    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-tmp-dir\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:17:56.933219 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.932971    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cb4223-0760-4bdc-a3c2-72687e886de3-home\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:17:56.933219 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.932981    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sftcl\" (UniqueName: \"kubernetes.io/projected/53cb4223-0760-4bdc-a3c2-72687e886de3-kube-api-access-sftcl\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:17:56.977996 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.977967    2577 generic.go:356] "Generic (PLEG): container finished" podID="53cb4223-0760-4bdc-a3c2-72687e886de3" containerID="cb03d79512c1b171cf5ab14ac8ade8b14b449c0c019bd0a2f8131f5830349900" exitCode=0
Sep 10 21:17:56.978130 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.978020    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"
Sep 10 21:17:56.978130 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.978055    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4" event={"ID":"53cb4223-0760-4bdc-a3c2-72687e886de3","Type":"ContainerDied","Data":"cb03d79512c1b171cf5ab14ac8ade8b14b449c0c019bd0a2f8131f5830349900"}
Sep 10 21:17:56.978130 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.978098    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4" event={"ID":"53cb4223-0760-4bdc-a3c2-72687e886de3","Type":"ContainerDied","Data":"e40ecc7bf88e4090996447950b5ea766b19ef065d1126fae9e172d9f125d214c"}
Sep 10 21:17:56.978130 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.978114    2577 scope.go:117] "RemoveContainer" containerID="cb03d79512c1b171cf5ab14ac8ade8b14b449c0c019bd0a2f8131f5830349900"
Sep 10 21:17:56.987194 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.987176    2577 scope.go:117] "RemoveContainer" containerID="cb03d79512c1b171cf5ab14ac8ade8b14b449c0c019bd0a2f8131f5830349900"
Sep 10 21:17:56.987455 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:17:56.987440    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb03d79512c1b171cf5ab14ac8ade8b14b449c0c019bd0a2f8131f5830349900\": container with ID starting with cb03d79512c1b171cf5ab14ac8ade8b14b449c0c019bd0a2f8131f5830349900 not found: ID does not exist" containerID="cb03d79512c1b171cf5ab14ac8ade8b14b449c0c019bd0a2f8131f5830349900"
Sep 10 21:17:56.987496 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.987462    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb03d79512c1b171cf5ab14ac8ade8b14b449c0c019bd0a2f8131f5830349900"} err="failed to get container status \"cb03d79512c1b171cf5ab14ac8ade8b14b449c0c019bd0a2f8131f5830349900\": rpc error: code = NotFound desc = could not find container \"cb03d79512c1b171cf5ab14ac8ade8b14b449c0c019bd0a2f8131f5830349900\": container with ID starting with cb03d79512c1b171cf5ab14ac8ade8b14b449c0c019bd0a2f8131f5830349900 not found: ID does not exist"
Sep 10 21:17:56.994906 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.994852    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"]
Sep 10 21:17:56.998948 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:56.998924    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-8ba2d470/e2e-lifecycle-model-8ba2d470-kserve-f45f9cf5f-v8tk4"]
Sep 10 21:17:58.948316 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:17:58.948285    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53cb4223-0760-4bdc-a3c2-72687e886de3" path="/var/lib/kubelet/pods/53cb4223-0760-4bdc-a3c2-72687e886de3/volumes"
Sep 10 21:18:07.153739 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:07.153705    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:18:23.557407 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:23.557367    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:18:24.300432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:24.300396    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"]
Sep 10 21:18:24.300678 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:24.300629    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2" podUID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerName="istio-proxy" containerID="cri-o://e3a052d7e5d834eaacbc46c60b4430517cafc74b40ae331063a138b4b6c7c72f" gracePeriod=30
Sep 10 21:18:29.554404 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.554376    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:18:29.647086 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.646954    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-credential-socket\") pod \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") "
Sep 10 21:18:29.647086 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647012    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-workload-socket\") pod \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") "
Sep 10 21:18:29.647086 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647086    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-podinfo\") pod \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") "
Sep 10 21:18:29.647393 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647111    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-token\") pod \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") "
Sep 10 21:18:29.647393 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647136    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-workload-certs\") pod \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") "
Sep 10 21:18:29.647393 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647177    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-envoy\") pod \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") "
Sep 10 21:18:29.647393 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647206    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8p5tk\" (UniqueName: \"kubernetes.io/projected/fca85417-6df8-4dca-afc8-ce3a0733d3ed-kube-api-access-8p5tk\") pod \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") "
Sep 10 21:18:29.647393 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647242    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istiod-ca-cert\") pod \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") "
Sep 10 21:18:29.647393 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647302    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-data\") pod \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\" (UID: \"fca85417-6df8-4dca-afc8-ce3a0733d3ed\") "
Sep 10 21:18:29.647393 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647313    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fca85417-6df8-4dca-afc8-ce3a0733d3ed" (UID: "fca85417-6df8-4dca-afc8-ce3a0733d3ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:18:29.647393 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647379    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fca85417-6df8-4dca-afc8-ce3a0733d3ed" (UID: "fca85417-6df8-4dca-afc8-ce3a0733d3ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:18:29.647807 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647480    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fca85417-6df8-4dca-afc8-ce3a0733d3ed" (UID: "fca85417-6df8-4dca-afc8-ce3a0733d3ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:18:29.647807 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647663    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-credential-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:18:29.647807 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647702    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-workload-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:18:29.647807 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647717    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-workload-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:18:29.647807 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647659    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fca85417-6df8-4dca-afc8-ce3a0733d3ed" (UID: "fca85417-6df8-4dca-afc8-ce3a0733d3ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:18:29.647807 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.647728    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "fca85417-6df8-4dca-afc8-ce3a0733d3ed" (UID: "fca85417-6df8-4dca-afc8-ce3a0733d3ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:18:29.649483 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.649459    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fca85417-6df8-4dca-afc8-ce3a0733d3ed" (UID: "fca85417-6df8-4dca-afc8-ce3a0733d3ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:18:29.649614 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.649497    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "fca85417-6df8-4dca-afc8-ce3a0733d3ed" (UID: "fca85417-6df8-4dca-afc8-ce3a0733d3ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:18:29.649744 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.649726    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fca85417-6df8-4dca-afc8-ce3a0733d3ed" (UID: "fca85417-6df8-4dca-afc8-ce3a0733d3ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:18:29.649804 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.649743    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca85417-6df8-4dca-afc8-ce3a0733d3ed-kube-api-access-8p5tk" (OuterVolumeSpecName: "kube-api-access-8p5tk") pod "fca85417-6df8-4dca-afc8-ce3a0733d3ed" (UID: "fca85417-6df8-4dca-afc8-ce3a0733d3ed"). InnerVolumeSpecName "kube-api-access-8p5tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:18:29.748239 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.748198    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-podinfo\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:18:29.748239 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.748234    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-token\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:18:29.748239 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.748244    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-envoy\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:18:29.748239 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.748253    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p5tk\" (UniqueName: \"kubernetes.io/projected/fca85417-6df8-4dca-afc8-ce3a0733d3ed-kube-api-access-8p5tk\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:18:29.748493 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.748264    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istiod-ca-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:18:29.748493 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:29.748272    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fca85417-6df8-4dca-afc8-ce3a0733d3ed-istio-data\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:18:30.188194 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:30.188162    2577 generic.go:356] "Generic (PLEG): container finished" podID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerID="e3a052d7e5d834eaacbc46c60b4430517cafc74b40ae331063a138b4b6c7c72f" exitCode=0
Sep 10 21:18:30.188376 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:30.188206    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"
Sep 10 21:18:30.188376 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:30.188246    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2" event={"ID":"fca85417-6df8-4dca-afc8-ce3a0733d3ed","Type":"ContainerDied","Data":"e3a052d7e5d834eaacbc46c60b4430517cafc74b40ae331063a138b4b6c7c72f"}
Sep 10 21:18:30.188376 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:30.188296    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2" event={"ID":"fca85417-6df8-4dca-afc8-ce3a0733d3ed","Type":"ContainerDied","Data":"24993b0a6fbc0aaaa46c2bf84821cd39fa2a67badcc009c9bf1dee4ba9af486b"}
Sep 10 21:18:30.188376 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:30.188318    2577 scope.go:117] "RemoveContainer" containerID="e3a052d7e5d834eaacbc46c60b4430517cafc74b40ae331063a138b4b6c7c72f"
Sep 10 21:18:30.198196 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:30.198178    2577 scope.go:117] "RemoveContainer" containerID="16ed0c3977eeb37987e3c8dc9daaf084ac037c486eb6d31759e28dc876b733b1"
Sep 10 21:18:30.207162 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:30.207086    2577 scope.go:117] "RemoveContainer" containerID="e3a052d7e5d834eaacbc46c60b4430517cafc74b40ae331063a138b4b6c7c72f"
Sep 10 21:18:30.207680 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:18:30.207660    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3a052d7e5d834eaacbc46c60b4430517cafc74b40ae331063a138b4b6c7c72f\": container with ID starting with e3a052d7e5d834eaacbc46c60b4430517cafc74b40ae331063a138b4b6c7c72f not found: ID does not exist" containerID="e3a052d7e5d834eaacbc46c60b4430517cafc74b40ae331063a138b4b6c7c72f"
Sep 10 21:18:30.207816 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:30.207687    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3a052d7e5d834eaacbc46c60b4430517cafc74b40ae331063a138b4b6c7c72f"} err="failed to get container status \"e3a052d7e5d834eaacbc46c60b4430517cafc74b40ae331063a138b4b6c7c72f\": rpc error: code = NotFound desc = could not find container \"e3a052d7e5d834eaacbc46c60b4430517cafc74b40ae331063a138b4b6c7c72f\": container with ID starting with e3a052d7e5d834eaacbc46c60b4430517cafc74b40ae331063a138b4b6c7c72f not found: ID does not exist"
Sep 10 21:18:30.207816 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:30.207708    2577 scope.go:117] "RemoveContainer" containerID="16ed0c3977eeb37987e3c8dc9daaf084ac037c486eb6d31759e28dc876b733b1"
Sep 10 21:18:30.208050 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:18:30.208016    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16ed0c3977eeb37987e3c8dc9daaf084ac037c486eb6d31759e28dc876b733b1\": container with ID starting with 16ed0c3977eeb37987e3c8dc9daaf084ac037c486eb6d31759e28dc876b733b1 not found: ID does not exist" containerID="16ed0c3977eeb37987e3c8dc9daaf084ac037c486eb6d31759e28dc876b733b1"
Sep 10 21:18:30.208109 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:30.208057    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16ed0c3977eeb37987e3c8dc9daaf084ac037c486eb6d31759e28dc876b733b1"} err="failed to get container status \"16ed0c3977eeb37987e3c8dc9daaf084ac037c486eb6d31759e28dc876b733b1\": rpc error: code = NotFound desc = could not find container \"16ed0c3977eeb37987e3c8dc9daaf084ac037c486eb6d31759e28dc876b733b1\": container with ID starting with 16ed0c3977eeb37987e3c8dc9daaf084ac037c486eb6d31759e28dc876b733b1 not found: ID does not exist"
Sep 10 21:18:30.210087 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:30.210068    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"]
Sep 10 21:18:30.215407 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:30.215389    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2"]
Sep 10 21:18:30.947813 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:30.947779    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" path="/var/lib/kubelet/pods/fca85417-6df8-4dca-afc8-ce3a0733d3ed/volumes"
Sep 10 21:18:40.761874 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:40.761836    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:18:48.769444 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.769363    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"]
Sep 10 21:18:48.769833 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.769820    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerName="istio-proxy"
Sep 10 21:18:48.769874 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.769834    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerName="istio-proxy"
Sep 10 21:18:48.769874 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.769864    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53cb4223-0760-4bdc-a3c2-72687e886de3" containerName="main"
Sep 10 21:18:48.769874 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.769870    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="53cb4223-0760-4bdc-a3c2-72687e886de3" containerName="main"
Sep 10 21:18:48.769972 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.769933    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerName="istio-proxy"
Sep 10 21:18:48.769972 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.769944    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerName="istio-proxy"
Sep 10 21:18:48.769972 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.769951    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="53cb4223-0760-4bdc-a3c2-72687e886de3" containerName="main"
Sep 10 21:18:48.774271 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.774253    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.777845 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.777821    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-8623b2\"/\"kube-root-ca.crt\""
Sep 10 21:18:48.777969 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.777863    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-8623b2\"/\"default-dockercfg-t2sp2\""
Sep 10 21:18:48.777969 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.777870    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-8623b2\"/\"sub-test-model-8623b2-kserve-self-signed-certs\""
Sep 10 21:18:48.777969 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.777896    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-8623b2\"/\"openshift-service-ca.crt\""
Sep 10 21:18:48.783200 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.783178    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"]
Sep 10 21:18:48.822752 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.822719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-model-cache\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.822752 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.822756    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-dshm\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.822963 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.822795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgslt\" (UniqueName: \"kubernetes.io/projected/ea1e9084-3144-4a26-9770-95597fab2371-kube-api-access-dgslt\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.822963 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.822848    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-tmp-dir\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.822963 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.822881    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea1e9084-3144-4a26-9770-95597fab2371-tls-certs\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.822963 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.822904    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-home\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.924254 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.924217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgslt\" (UniqueName: \"kubernetes.io/projected/ea1e9084-3144-4a26-9770-95597fab2371-kube-api-access-dgslt\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.924439 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.924262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-tmp-dir\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.924504 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.924455    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea1e9084-3144-4a26-9770-95597fab2371-tls-certs\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.924504 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.924496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-home\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.924631 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.924583    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-model-cache\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.924631 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.924604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-dshm\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.924745 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.924707    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-tmp-dir\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.924865 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.924845    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-home\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.924939 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.924909    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-model-cache\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.926729 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.926709    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-dshm\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.926870 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.926854    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea1e9084-3144-4a26-9770-95597fab2371-tls-certs\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:48.931779 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:48.931757    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgslt\" (UniqueName: \"kubernetes.io/projected/ea1e9084-3144-4a26-9770-95597fab2371-kube-api-access-dgslt\") pod \"sub-test-model-8623b2-kserve-9dbf78685-p5vj8\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") " pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:49.085239 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:49.085203    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:49.357825 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:49.357800    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"]
Sep 10 21:18:49.358740 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:18:49.358716    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea1e9084_3144_4a26_9770_95597fab2371.slice/crio-5f020dcae0a1468db636424787faa947779820ef6ad7035ae7633c7cc13e1952 WatchSource:0}: Error finding container 5f020dcae0a1468db636424787faa947779820ef6ad7035ae7633c7cc13e1952: Status 404 returned error can't find the container with id 5f020dcae0a1468db636424787faa947779820ef6ad7035ae7633c7cc13e1952
Sep 10 21:18:50.308823 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:50.308784    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8" event={"ID":"ea1e9084-3144-4a26-9770-95597fab2371","Type":"ContainerStarted","Data":"9f15a46430ca0f4d1c1c61de8ffc57b71ebb3deea5b5e4d43b1c06c7855f5f0d"}
Sep 10 21:18:50.309214 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:50.308832    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8" event={"ID":"ea1e9084-3144-4a26-9770-95597fab2371","Type":"ContainerStarted","Data":"5f020dcae0a1468db636424787faa947779820ef6ad7035ae7633c7cc13e1952"}
Sep 10 21:18:50.324944 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:50.324899    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8" podStartSLOduration=2.32488479 podStartE2EDuration="2.32488479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:18:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:18:50.324108418 +0000 UTC m=+1257.897814793" watchObservedRunningTime="2026-09-10 21:18:50.32488479 +0000 UTC m=+1257.898591184"
Sep 10 21:18:53.193726 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:53.193693    2577 scope.go:117] "RemoveContainer" containerID="3bc5ecbade969245f5031e5322f2c64e3e74ad95db7ecefeeee1841dd08461f0"
Sep 10 21:18:55.461877 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:55.461841    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:18:59.086158 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:59.086116    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:59.086628 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:59.086177    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:59.099638 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:59.099613    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:18:59.373243 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:18:59.373168    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:19:14.264839 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:14.264800    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:19:22.891083 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:22.891049    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"]
Sep 10 21:19:22.891914 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:22.891472    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerName="istio-proxy"
Sep 10 21:19:22.891914 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:22.891483    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca85417-6df8-4dca-afc8-ce3a0733d3ed" containerName="istio-proxy"
Sep 10 21:19:22.894626 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:22.894610    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"
Sep 10 21:19:22.897192 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:22.897165    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-3a1a62\""
Sep 10 21:19:22.897381 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:22.897363    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-3a1a62-dockercfg-ptfcv\""
Sep 10 21:19:22.903835 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:22.903811    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"]
Sep 10 21:19:22.954050 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:22.951109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/808599a5-5e80-4447-a7d5-cc4a3b7d98e2-plugins-config-volume\") pod \"payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts\" (UID: \"808599a5-5e80-4447-a7d5-cc4a3b7d98e2\") " pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"
Sep 10 21:19:22.954050 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:22.951236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwwl2\" (UniqueName: \"kubernetes.io/projected/808599a5-5e80-4447-a7d5-cc4a3b7d98e2-kube-api-access-xwwl2\") pod \"payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts\" (UID: \"808599a5-5e80-4447-a7d5-cc4a3b7d98e2\") " pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"
Sep 10 21:19:23.052871 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:23.052832    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/808599a5-5e80-4447-a7d5-cc4a3b7d98e2-plugins-config-volume\") pod \"payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts\" (UID: \"808599a5-5e80-4447-a7d5-cc4a3b7d98e2\") " pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"
Sep 10 21:19:23.053074 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:23.052903    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwwl2\" (UniqueName: \"kubernetes.io/projected/808599a5-5e80-4447-a7d5-cc4a3b7d98e2-kube-api-access-xwwl2\") pod \"payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts\" (UID: \"808599a5-5e80-4447-a7d5-cc4a3b7d98e2\") " pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"
Sep 10 21:19:23.053602 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:23.053580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/808599a5-5e80-4447-a7d5-cc4a3b7d98e2-plugins-config-volume\") pod \"payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts\" (UID: \"808599a5-5e80-4447-a7d5-cc4a3b7d98e2\") " pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"
Sep 10 21:19:23.060508 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:23.060477    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwwl2\" (UniqueName: \"kubernetes.io/projected/808599a5-5e80-4447-a7d5-cc4a3b7d98e2-kube-api-access-xwwl2\") pod \"payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts\" (UID: \"808599a5-5e80-4447-a7d5-cc4a3b7d98e2\") " pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"
Sep 10 21:19:23.206792 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:23.206713    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"
Sep 10 21:19:23.479082 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:23.479054    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"]
Sep 10 21:19:23.479818 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:19:23.479786    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808599a5_5e80_4447_a7d5_cc4a3b7d98e2.slice/crio-b21f33680e2a8f89306ea6fe3214865c7d40ec9551bfbe396a7de1f00939f2fc WatchSource:0}: Error finding container b21f33680e2a8f89306ea6fe3214865c7d40ec9551bfbe396a7de1f00939f2fc: Status 404 returned error can't find the container with id b21f33680e2a8f89306ea6fe3214865c7d40ec9551bfbe396a7de1f00939f2fc
Sep 10 21:19:23.502282 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:23.502260    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts" event={"ID":"808599a5-5e80-4447-a7d5-cc4a3b7d98e2","Type":"ContainerStarted","Data":"b21f33680e2a8f89306ea6fe3214865c7d40ec9551bfbe396a7de1f00939f2fc"}
Sep 10 21:19:24.509340 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:24.509304    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts" event={"ID":"808599a5-5e80-4447-a7d5-cc4a3b7d98e2","Type":"ContainerStarted","Data":"b37b25a71889c01634d5e0a90fca7349685a522b683a2ab01647668ffc032a3c"}
Sep 10 21:19:24.509778 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:24.509373    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"
Sep 10 21:19:24.526967 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:24.526920    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts" podStartSLOduration=2.5269045759999997 podStartE2EDuration="2.526904576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:24.524068892 +0000 UTC m=+1292.097775264" watchObservedRunningTime="2026-09-10 21:19:24.526904576 +0000 UTC m=+1292.100610991"
Sep 10 21:19:31.869833 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:31.869798    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:19:35.517452 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:35.517423    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"
Sep 10 21:19:46.791823 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.791780    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"]
Sep 10 21:19:46.795614 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.795590    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.797768 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.797745    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-044266-openshift-default-dockercfg-qrdrq\""
Sep 10 21:19:46.807470 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.807445    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"]
Sep 10 21:19:46.861737 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.861712    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-podinfo\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.861848 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.861767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istiod-ca-cert\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.861848 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.861788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-envoy\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.861848 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.861815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r8nx\" (UniqueName: \"kubernetes.io/projected/ca203ced-0dca-4bbc-a27d-1258f298ec0b-kube-api-access-9r8nx\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.861848 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.861837    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-workload-certs\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.862018 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.861855    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-credential-socket\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.862018 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.861880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-token\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.862018 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.861899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-workload-socket\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.862018 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.861990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-data\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.962755 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.962722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-podinfo\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.962934 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.962774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istiod-ca-cert\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.962934 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.962794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-envoy\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.962934 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.962830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r8nx\" (UniqueName: \"kubernetes.io/projected/ca203ced-0dca-4bbc-a27d-1258f298ec0b-kube-api-access-9r8nx\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.962934 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.962855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-workload-certs\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.962934 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.962875    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-credential-socket\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.962934 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.962916    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-token\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.963360 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.962951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-workload-socket\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.963360 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.962987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-data\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.963360 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.963326    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-workload-certs\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.963519 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.963367    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-credential-socket\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.963519 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.963509    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-data\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.963747 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.963723    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-workload-socket\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.963819 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.963781    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istiod-ca-cert\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.965157 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.965136    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-envoy\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.965563 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.965541    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-podinfo\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.971095 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.971070    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-token\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:46.971175 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:46.971131    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r8nx\" (UniqueName: \"kubernetes.io/projected/ca203ced-0dca-4bbc-a27d-1258f298ec0b-kube-api-access-9r8nx\") pod \"e2e-api-b-044266-openshift-default-95fddb794-86m9l\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") " pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:47.107528 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:47.107494    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:47.380971 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:47.380947    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"]
Sep 10 21:19:47.382284 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:19:47.382256    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca203ced_0dca_4bbc_a27d_1258f298ec0b.slice/crio-e6a7996e76959b60295e2843222a47ed9aebe350d24068055c62a0c3f51b7cc6 WatchSource:0}: Error finding container e6a7996e76959b60295e2843222a47ed9aebe350d24068055c62a0c3f51b7cc6: Status 404 returned error can't find the container with id e6a7996e76959b60295e2843222a47ed9aebe350d24068055c62a0c3f51b7cc6
Sep 10 21:19:47.384590 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:47.384555    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:19:47.384680 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:47.384619    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:19:47.384680 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:47.384647    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:19:47.651421 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:47.651329    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l" event={"ID":"ca203ced-0dca-4bbc-a27d-1258f298ec0b","Type":"ContainerStarted","Data":"958fcc11961f2affe31ee3dcaff2cd9e9c5eb8d35e23f4688ddbf1fd1972d7bd"}
Sep 10 21:19:47.651421 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:47.651397    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l" event={"ID":"ca203ced-0dca-4bbc-a27d-1258f298ec0b","Type":"ContainerStarted","Data":"e6a7996e76959b60295e2843222a47ed9aebe350d24068055c62a0c3f51b7cc6"}
Sep 10 21:19:47.672271 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:47.672224    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l" podStartSLOduration=1.67220722 podStartE2EDuration="1.67220722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:47.669383557 +0000 UTC m=+1315.243089932" watchObservedRunningTime="2026-09-10 21:19:47.67220722 +0000 UTC m=+1315.245913644"
Sep 10 21:19:48.108239 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:48.108208    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:48.113344 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:48.113322    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:48.658073 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:48.658020    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:48.658838 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:48.658817    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:19:53.223395 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:53.223365    2577 scope.go:117] "RemoveContainer" containerID="32b27d16e3a8f4ada627b36cde321d6c25ba0517101cf3efdb7e08d8806a7f8a"
Sep 10 21:19:56.460130 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:19:56.460086    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:20:04.699255 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:04.699199    2577 patch_prober.go:28] interesting pod/e2e-api-b-044266-openshift-default-95fddb794-86m9l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:20:04.699794 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:04.699274    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l" podUID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:20:06.782871 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:06.782769    2577 generic.go:356] "Generic (PLEG): container finished" podID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerID="958fcc11961f2affe31ee3dcaff2cd9e9c5eb8d35e23f4688ddbf1fd1972d7bd" exitCode=0
Sep 10 21:20:06.782871 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:06.782853    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l" event={"ID":"ca203ced-0dca-4bbc-a27d-1258f298ec0b","Type":"ContainerDied","Data":"958fcc11961f2affe31ee3dcaff2cd9e9c5eb8d35e23f4688ddbf1fd1972d7bd"}
Sep 10 21:20:06.783445 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:06.783351    2577 scope.go:117] "RemoveContainer" containerID="958fcc11961f2affe31ee3dcaff2cd9e9c5eb8d35e23f4688ddbf1fd1972d7bd"
Sep 10 21:20:06.784487 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:06.784458    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:20:06.784566 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:06.784527    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:20:06.784566 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:06.784558    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:20:07.790964 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:07.790932    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l" event={"ID":"ca203ced-0dca-4bbc-a27d-1258f298ec0b","Type":"ContainerStarted","Data":"c5fb167df6c70cadd3a6404d217c633121b393b02ed79cee96fb0b540df679c0"}
Sep 10 21:20:08.108195 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:08.108085    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:20:08.108425 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:08.108376    2577 patch_prober.go:28] interesting pod/e2e-api-b-044266-openshift-default-95fddb794-86m9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 10 21:20:08.108509 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:08.108431    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l" podUID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 10 21:20:09.108436 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:09.107965    2577 patch_prober.go:28] interesting pod/e2e-api-b-044266-openshift-default-95fddb794-86m9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 10 21:20:09.108436 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:09.108059    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l" podUID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 10 21:20:10.108691 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:10.108649    2577 patch_prober.go:28] interesting pod/e2e-api-b-044266-openshift-default-95fddb794-86m9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 10 21:20:10.109315 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:10.109277    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l" podUID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 10 21:20:11.108131 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:11.108093    2577 patch_prober.go:28] interesting pod/e2e-api-b-044266-openshift-default-95fddb794-86m9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 10 21:20:11.108352 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:11.108175    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l" podUID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 10 21:20:12.108387 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:12.108343    2577 patch_prober.go:28] interesting pod/e2e-api-b-044266-openshift-default-95fddb794-86m9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 10 21:20:12.108888 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:12.108411    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l" podUID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 10 21:20:13.112236 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:13.112206    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:20:13.112635 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:13.112609    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:20:13.113315 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:13.113292    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:20:17.248259 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:17.248180    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq"]
Sep 10 21:20:17.250823 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:17.250804    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq"
Sep 10 21:20:17.253038 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:17.253001    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:20:17.253150 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:17.253013    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:20:17.260073 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:17.260019    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq"]
Sep 10 21:20:17.359827 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:17.359796    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d73a21-d722-427e-982e-9bb196f4dc59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq\" (UID: \"00d73a21-d722-427e-982e-9bb196f4dc59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq"
Sep 10 21:20:17.461227 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:17.461200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d73a21-d722-427e-982e-9bb196f4dc59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq\" (UID: \"00d73a21-d722-427e-982e-9bb196f4dc59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq"
Sep 10 21:20:17.461792 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:17.461772    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d73a21-d722-427e-982e-9bb196f4dc59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq\" (UID: \"00d73a21-d722-427e-982e-9bb196f4dc59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq"
Sep 10 21:20:17.563294 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:17.563217    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq"
Sep 10 21:20:17.844187 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:17.844158    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq"]
Sep 10 21:20:17.845817 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:20:17.845789    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d73a21_d722_427e_982e_9bb196f4dc59.slice/crio-711f8da5c731720ec5e76a050ad9e91649d1c49d57c544c8a91afdb7926a3b6d WatchSource:0}: Error finding container 711f8da5c731720ec5e76a050ad9e91649d1c49d57c544c8a91afdb7926a3b6d: Status 404 returned error can't find the container with id 711f8da5c731720ec5e76a050ad9e91649d1c49d57c544c8a91afdb7926a3b6d
Sep 10 21:20:17.862841 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:17.862819    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq" event={"ID":"00d73a21-d722-427e-982e-9bb196f4dc59","Type":"ContainerStarted","Data":"711f8da5c731720ec5e76a050ad9e91649d1c49d57c544c8a91afdb7926a3b6d"}
Sep 10 21:20:18.870098 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:18.870065    2577 generic.go:356] "Generic (PLEG): container finished" podID="00d73a21-d722-427e-982e-9bb196f4dc59" containerID="83ae863f85e2ffd689986ac66813c38c731f471fc041b76bef975d76465333fa" exitCode=0
Sep 10 21:20:18.870464 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:18.870155    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq" event={"ID":"00d73a21-d722-427e-982e-9bb196f4dc59","Type":"ContainerDied","Data":"83ae863f85e2ffd689986ac66813c38c731f471fc041b76bef975d76465333fa"}
Sep 10 21:20:20.003423 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:20.003399    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq"
Sep 10 21:20:20.089643 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:20.089601    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d73a21-d722-427e-982e-9bb196f4dc59-maas-api-service-ca\") pod \"00d73a21-d722-427e-982e-9bb196f4dc59\" (UID: \"00d73a21-d722-427e-982e-9bb196f4dc59\") "
Sep 10 21:20:20.089985 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:20.089962    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00d73a21-d722-427e-982e-9bb196f4dc59-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "00d73a21-d722-427e-982e-9bb196f4dc59" (UID: "00d73a21-d722-427e-982e-9bb196f4dc59"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:20:20.190565 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:20.190484    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d73a21-d722-427e-982e-9bb196f4dc59-maas-api-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:20:20.882291 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:20.882266    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq"
Sep 10 21:20:20.882455 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:20.882264    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq" event={"ID":"00d73a21-d722-427e-982e-9bb196f4dc59","Type":"ContainerDied","Data":"711f8da5c731720ec5e76a050ad9e91649d1c49d57c544c8a91afdb7926a3b6d"}
Sep 10 21:20:20.882455 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:20.882419    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="711f8da5c731720ec5e76a050ad9e91649d1c49d57c544c8a91afdb7926a3b6d"
Sep 10 21:20:25.860525 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:25.860488    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:20:32.978872 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:32.978835    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"]
Sep 10 21:20:32.979415 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:32.979013    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts" podUID="808599a5-5e80-4447-a7d5-cc4a3b7d98e2" containerName="payload-processing" containerID="cri-o://b37b25a71889c01634d5e0a90fca7349685a522b683a2ab01647668ffc032a3c" gracePeriod=30
Sep 10 21:20:33.133557 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.133520    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq"]
Sep 10 21:20:33.136603 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.136579    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3a1a62-9s6xq"]
Sep 10 21:20:33.258842 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.258816    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"
Sep 10 21:20:33.414321 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.414293    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwwl2\" (UniqueName: \"kubernetes.io/projected/808599a5-5e80-4447-a7d5-cc4a3b7d98e2-kube-api-access-xwwl2\") pod \"808599a5-5e80-4447-a7d5-cc4a3b7d98e2\" (UID: \"808599a5-5e80-4447-a7d5-cc4a3b7d98e2\") "
Sep 10 21:20:33.414523 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.414348    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/808599a5-5e80-4447-a7d5-cc4a3b7d98e2-plugins-config-volume\") pod \"808599a5-5e80-4447-a7d5-cc4a3b7d98e2\" (UID: \"808599a5-5e80-4447-a7d5-cc4a3b7d98e2\") "
Sep 10 21:20:33.414681 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.414660    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/808599a5-5e80-4447-a7d5-cc4a3b7d98e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "808599a5-5e80-4447-a7d5-cc4a3b7d98e2" (UID: "808599a5-5e80-4447-a7d5-cc4a3b7d98e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:20:33.416365 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.416335    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/808599a5-5e80-4447-a7d5-cc4a3b7d98e2-kube-api-access-xwwl2" (OuterVolumeSpecName: "kube-api-access-xwwl2") pod "808599a5-5e80-4447-a7d5-cc4a3b7d98e2" (UID: "808599a5-5e80-4447-a7d5-cc4a3b7d98e2"). InnerVolumeSpecName "kube-api-access-xwwl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:20:33.515953 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.515877    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwwl2\" (UniqueName: \"kubernetes.io/projected/808599a5-5e80-4447-a7d5-cc4a3b7d98e2-kube-api-access-xwwl2\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:20:33.515953 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.515905    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/808599a5-5e80-4447-a7d5-cc4a3b7d98e2-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:20:33.959593 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.959558    2577 generic.go:356] "Generic (PLEG): container finished" podID="808599a5-5e80-4447-a7d5-cc4a3b7d98e2" containerID="b37b25a71889c01634d5e0a90fca7349685a522b683a2ab01647668ffc032a3c" exitCode=0
Sep 10 21:20:33.959802 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.959600    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"
Sep 10 21:20:33.959802 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.959644    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts" event={"ID":"808599a5-5e80-4447-a7d5-cc4a3b7d98e2","Type":"ContainerDied","Data":"b37b25a71889c01634d5e0a90fca7349685a522b683a2ab01647668ffc032a3c"}
Sep 10 21:20:33.959802 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.959697    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts" event={"ID":"808599a5-5e80-4447-a7d5-cc4a3b7d98e2","Type":"ContainerDied","Data":"b21f33680e2a8f89306ea6fe3214865c7d40ec9551bfbe396a7de1f00939f2fc"}
Sep 10 21:20:33.959802 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.959727    2577 scope.go:117] "RemoveContainer" containerID="b37b25a71889c01634d5e0a90fca7349685a522b683a2ab01647668ffc032a3c"
Sep 10 21:20:33.969596 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.969580    2577 scope.go:117] "RemoveContainer" containerID="b37b25a71889c01634d5e0a90fca7349685a522b683a2ab01647668ffc032a3c"
Sep 10 21:20:33.969851 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:20:33.969831    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b37b25a71889c01634d5e0a90fca7349685a522b683a2ab01647668ffc032a3c\": container with ID starting with b37b25a71889c01634d5e0a90fca7349685a522b683a2ab01647668ffc032a3c not found: ID does not exist" containerID="b37b25a71889c01634d5e0a90fca7349685a522b683a2ab01647668ffc032a3c"
Sep 10 21:20:33.969895 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.969860    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b37b25a71889c01634d5e0a90fca7349685a522b683a2ab01647668ffc032a3c"} err="failed to get container status \"b37b25a71889c01634d5e0a90fca7349685a522b683a2ab01647668ffc032a3c\": rpc error: code = NotFound desc = could not find container \"b37b25a71889c01634d5e0a90fca7349685a522b683a2ab01647668ffc032a3c\": container with ID starting with b37b25a71889c01634d5e0a90fca7349685a522b683a2ab01647668ffc032a3c not found: ID does not exist"
Sep 10 21:20:33.982502 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.982479    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"]
Sep 10 21:20:33.986374 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:33.986355    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts"]
Sep 10 21:20:34.947225 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:34.947192    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00d73a21-d722-427e-982e-9bb196f4dc59" path="/var/lib/kubelet/pods/00d73a21-d722-427e-982e-9bb196f4dc59/volumes"
Sep 10 21:20:34.947550 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:34.947536    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="808599a5-5e80-4447-a7d5-cc4a3b7d98e2" path="/var/lib/kubelet/pods/808599a5-5e80-4447-a7d5-cc4a3b7d98e2/volumes"
Sep 10 21:20:35.164364 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:35.164331    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"]
Sep 10 21:20:41.055091 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:41.055054    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:20:50.183998 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.183960    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8" podUID="ea1e9084-3144-4a26-9770-95597fab2371" containerName="main" containerID="cri-o://9f15a46430ca0f4d1c1c61de8ffc57b71ebb3deea5b5e4d43b1c06c7855f5f0d" gracePeriod=45
Sep 10 21:20:50.428856 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.428833    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:20:50.468147 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.468074    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-model-cache\") pod \"ea1e9084-3144-4a26-9770-95597fab2371\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") "
Sep 10 21:20:50.468147 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.468113    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea1e9084-3144-4a26-9770-95597fab2371-tls-certs\") pod \"ea1e9084-3144-4a26-9770-95597fab2371\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") "
Sep 10 21:20:50.468357 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.468178    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-dshm\") pod \"ea1e9084-3144-4a26-9770-95597fab2371\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") "
Sep 10 21:20:50.468357 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.468220    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgslt\" (UniqueName: \"kubernetes.io/projected/ea1e9084-3144-4a26-9770-95597fab2371-kube-api-access-dgslt\") pod \"ea1e9084-3144-4a26-9770-95597fab2371\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") "
Sep 10 21:20:50.468357 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.468252    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-home\") pod \"ea1e9084-3144-4a26-9770-95597fab2371\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") "
Sep 10 21:20:50.468357 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.468309    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-tmp-dir\") pod \"ea1e9084-3144-4a26-9770-95597fab2371\" (UID: \"ea1e9084-3144-4a26-9770-95597fab2371\") "
Sep 10 21:20:50.468357 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.468311    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-model-cache" (OuterVolumeSpecName: "model-cache") pod "ea1e9084-3144-4a26-9770-95597fab2371" (UID: "ea1e9084-3144-4a26-9770-95597fab2371"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:20:50.468596 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.468533    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-home" (OuterVolumeSpecName: "home") pod "ea1e9084-3144-4a26-9770-95597fab2371" (UID: "ea1e9084-3144-4a26-9770-95597fab2371"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:20:50.468596 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.468567    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ea1e9084-3144-4a26-9770-95597fab2371" (UID: "ea1e9084-3144-4a26-9770-95597fab2371"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:20:50.468751 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.468732    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-model-cache\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:20:50.468814 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.468755    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-home\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:20:50.468814 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.468768    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-tmp-dir\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:20:50.470417 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.470388    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-dshm" (OuterVolumeSpecName: "dshm") pod "ea1e9084-3144-4a26-9770-95597fab2371" (UID: "ea1e9084-3144-4a26-9770-95597fab2371"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:20:50.470530 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.470419    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea1e9084-3144-4a26-9770-95597fab2371-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ea1e9084-3144-4a26-9770-95597fab2371" (UID: "ea1e9084-3144-4a26-9770-95597fab2371"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:20:50.470530 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.470456    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea1e9084-3144-4a26-9770-95597fab2371-kube-api-access-dgslt" (OuterVolumeSpecName: "kube-api-access-dgslt") pod "ea1e9084-3144-4a26-9770-95597fab2371" (UID: "ea1e9084-3144-4a26-9770-95597fab2371"). InnerVolumeSpecName "kube-api-access-dgslt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:20:50.569526 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.569502    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea1e9084-3144-4a26-9770-95597fab2371-dshm\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:20:50.569526 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.569525    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgslt\" (UniqueName: \"kubernetes.io/projected/ea1e9084-3144-4a26-9770-95597fab2371-kube-api-access-dgslt\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:20:50.569662 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:50.569536    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea1e9084-3144-4a26-9770-95597fab2371-tls-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:20:51.057254 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:51.057224    2577 generic.go:356] "Generic (PLEG): container finished" podID="ea1e9084-3144-4a26-9770-95597fab2371" containerID="9f15a46430ca0f4d1c1c61de8ffc57b71ebb3deea5b5e4d43b1c06c7855f5f0d" exitCode=0
Sep 10 21:20:51.057407 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:51.057260    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"
Sep 10 21:20:51.057407 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:51.057303    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8" event={"ID":"ea1e9084-3144-4a26-9770-95597fab2371","Type":"ContainerDied","Data":"9f15a46430ca0f4d1c1c61de8ffc57b71ebb3deea5b5e4d43b1c06c7855f5f0d"}
Sep 10 21:20:51.057407 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:51.057344    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8" event={"ID":"ea1e9084-3144-4a26-9770-95597fab2371","Type":"ContainerDied","Data":"5f020dcae0a1468db636424787faa947779820ef6ad7035ae7633c7cc13e1952"}
Sep 10 21:20:51.057407 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:51.057366    2577 scope.go:117] "RemoveContainer" containerID="9f15a46430ca0f4d1c1c61de8ffc57b71ebb3deea5b5e4d43b1c06c7855f5f0d"
Sep 10 21:20:51.066378 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:51.066361    2577 scope.go:117] "RemoveContainer" containerID="9f15a46430ca0f4d1c1c61de8ffc57b71ebb3deea5b5e4d43b1c06c7855f5f0d"
Sep 10 21:20:51.066703 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:20:51.066683    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f15a46430ca0f4d1c1c61de8ffc57b71ebb3deea5b5e4d43b1c06c7855f5f0d\": container with ID starting with 9f15a46430ca0f4d1c1c61de8ffc57b71ebb3deea5b5e4d43b1c06c7855f5f0d not found: ID does not exist" containerID="9f15a46430ca0f4d1c1c61de8ffc57b71ebb3deea5b5e4d43b1c06c7855f5f0d"
Sep 10 21:20:51.066783 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:51.066709    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f15a46430ca0f4d1c1c61de8ffc57b71ebb3deea5b5e4d43b1c06c7855f5f0d"} err="failed to get container status \"9f15a46430ca0f4d1c1c61de8ffc57b71ebb3deea5b5e4d43b1c06c7855f5f0d\": rpc error: code = NotFound desc = could not find container \"9f15a46430ca0f4d1c1c61de8ffc57b71ebb3deea5b5e4d43b1c06c7855f5f0d\": container with ID starting with 9f15a46430ca0f4d1c1c61de8ffc57b71ebb3deea5b5e4d43b1c06c7855f5f0d not found: ID does not exist"
Sep 10 21:20:51.073679 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:51.073657    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"]
Sep 10 21:20:51.077272 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:51.077251    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8623b2/sub-test-model-8623b2-kserve-9dbf78685-p5vj8"]
Sep 10 21:20:52.947225 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:52.947194    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea1e9084-3144-4a26-9770-95597fab2371" path="/var/lib/kubelet/pods/ea1e9084-3144-4a26-9770-95597fab2371/volumes"
Sep 10 21:20:53.244681 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:53.244595    2577 scope.go:117] "RemoveContainer" containerID="21db08b87747032cc7fe77208382ca03888b1fefc0b4acb0ac4edcbbc9c9d192"
Sep 10 21:20:59.254286 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:20:59.254253    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:21:01.453392 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:01.453362    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"]
Sep 10 21:21:01.453783 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:01.453568    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l" podUID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerName="istio-proxy" containerID="cri-o://c5fb167df6c70cadd3a6404d217c633121b393b02ed79cee96fb0b540df679c0" gracePeriod=30
Sep 10 21:21:06.715743 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.715682    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:21:06.822373 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.822338    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-podinfo\") pod \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") "
Sep 10 21:21:06.822373 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.822377    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-token\") pod \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") "
Sep 10 21:21:06.822603 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.822444    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istiod-ca-cert\") pod \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") "
Sep 10 21:21:06.822603 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.822490    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-workload-certs\") pod \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") "
Sep 10 21:21:06.822603 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.822532    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-credential-socket\") pod \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") "
Sep 10 21:21:06.822603 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.822551    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9r8nx\" (UniqueName: \"kubernetes.io/projected/ca203ced-0dca-4bbc-a27d-1258f298ec0b-kube-api-access-9r8nx\") pod \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") "
Sep 10 21:21:06.822603 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.822592    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-workload-socket\") pod \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") "
Sep 10 21:21:06.822869 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.822620    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-data\") pod \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") "
Sep 10 21:21:06.822869 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.822665    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-envoy\") pod \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\" (UID: \"ca203ced-0dca-4bbc-a27d-1258f298ec0b\") "
Sep 10 21:21:06.822869 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.822815    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ca203ced-0dca-4bbc-a27d-1258f298ec0b" (UID: "ca203ced-0dca-4bbc-a27d-1258f298ec0b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:21:06.822869 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.822842    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ca203ced-0dca-4bbc-a27d-1258f298ec0b" (UID: "ca203ced-0dca-4bbc-a27d-1258f298ec0b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:06.823122 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.822867    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ca203ced-0dca-4bbc-a27d-1258f298ec0b" (UID: "ca203ced-0dca-4bbc-a27d-1258f298ec0b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:06.823122 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.823058    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ca203ced-0dca-4bbc-a27d-1258f298ec0b" (UID: "ca203ced-0dca-4bbc-a27d-1258f298ec0b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:06.823122 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.823082    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-data" (OuterVolumeSpecName: "istio-data") pod "ca203ced-0dca-4bbc-a27d-1258f298ec0b" (UID: "ca203ced-0dca-4bbc-a27d-1258f298ec0b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:06.823122 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.823108    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-credential-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:06.823290 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.823129    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istiod-ca-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:06.823290 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.823144    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-workload-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:06.824611 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.824587    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ca203ced-0dca-4bbc-a27d-1258f298ec0b" (UID: "ca203ced-0dca-4bbc-a27d-1258f298ec0b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:21:06.824795 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.824781    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ca203ced-0dca-4bbc-a27d-1258f298ec0b" (UID: "ca203ced-0dca-4bbc-a27d-1258f298ec0b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:06.825086 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.825055    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca203ced-0dca-4bbc-a27d-1258f298ec0b-kube-api-access-9r8nx" (OuterVolumeSpecName: "kube-api-access-9r8nx") pod "ca203ced-0dca-4bbc-a27d-1258f298ec0b" (UID: "ca203ced-0dca-4bbc-a27d-1258f298ec0b"). InnerVolumeSpecName "kube-api-access-9r8nx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:06.825165 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.825109    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-token" (OuterVolumeSpecName: "istio-token") pod "ca203ced-0dca-4bbc-a27d-1258f298ec0b" (UID: "ca203ced-0dca-4bbc-a27d-1258f298ec0b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:06.924013 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.923976    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r8nx\" (UniqueName: \"kubernetes.io/projected/ca203ced-0dca-4bbc-a27d-1258f298ec0b-kube-api-access-9r8nx\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:06.924013 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.924007    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-workload-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:06.924013 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.924018    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-data\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:06.924280 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.924053    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-envoy\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:06.924280 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.924065    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-podinfo\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:06.924280 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:06.924074    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca203ced-0dca-4bbc-a27d-1258f298ec0b-istio-token\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:07.156460 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:07.156426    2577 generic.go:356] "Generic (PLEG): container finished" podID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerID="c5fb167df6c70cadd3a6404d217c633121b393b02ed79cee96fb0b540df679c0" exitCode=0
Sep 10 21:21:07.156613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:07.156473    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"
Sep 10 21:21:07.156613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:07.156472    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l" event={"ID":"ca203ced-0dca-4bbc-a27d-1258f298ec0b","Type":"ContainerDied","Data":"c5fb167df6c70cadd3a6404d217c633121b393b02ed79cee96fb0b540df679c0"}
Sep 10 21:21:07.156613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:07.156533    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l" event={"ID":"ca203ced-0dca-4bbc-a27d-1258f298ec0b","Type":"ContainerDied","Data":"e6a7996e76959b60295e2843222a47ed9aebe350d24068055c62a0c3f51b7cc6"}
Sep 10 21:21:07.156613 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:07.156558    2577 scope.go:117] "RemoveContainer" containerID="c5fb167df6c70cadd3a6404d217c633121b393b02ed79cee96fb0b540df679c0"
Sep 10 21:21:07.166260 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:07.166244    2577 scope.go:117] "RemoveContainer" containerID="958fcc11961f2affe31ee3dcaff2cd9e9c5eb8d35e23f4688ddbf1fd1972d7bd"
Sep 10 21:21:07.173950 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:07.173928    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"]
Sep 10 21:21:07.175313 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:07.175254    2577 scope.go:117] "RemoveContainer" containerID="c5fb167df6c70cadd3a6404d217c633121b393b02ed79cee96fb0b540df679c0"
Sep 10 21:21:07.175546 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:21:07.175524    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5fb167df6c70cadd3a6404d217c633121b393b02ed79cee96fb0b540df679c0\": container with ID starting with c5fb167df6c70cadd3a6404d217c633121b393b02ed79cee96fb0b540df679c0 not found: ID does not exist" containerID="c5fb167df6c70cadd3a6404d217c633121b393b02ed79cee96fb0b540df679c0"
Sep 10 21:21:07.175684 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:07.175553    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5fb167df6c70cadd3a6404d217c633121b393b02ed79cee96fb0b540df679c0"} err="failed to get container status \"c5fb167df6c70cadd3a6404d217c633121b393b02ed79cee96fb0b540df679c0\": rpc error: code = NotFound desc = could not find container \"c5fb167df6c70cadd3a6404d217c633121b393b02ed79cee96fb0b540df679c0\": container with ID starting with c5fb167df6c70cadd3a6404d217c633121b393b02ed79cee96fb0b540df679c0 not found: ID does not exist"
Sep 10 21:21:07.175684 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:07.175570    2577 scope.go:117] "RemoveContainer" containerID="958fcc11961f2affe31ee3dcaff2cd9e9c5eb8d35e23f4688ddbf1fd1972d7bd"
Sep 10 21:21:07.175807 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:21:07.175795    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"958fcc11961f2affe31ee3dcaff2cd9e9c5eb8d35e23f4688ddbf1fd1972d7bd\": container with ID starting with 958fcc11961f2affe31ee3dcaff2cd9e9c5eb8d35e23f4688ddbf1fd1972d7bd not found: ID does not exist" containerID="958fcc11961f2affe31ee3dcaff2cd9e9c5eb8d35e23f4688ddbf1fd1972d7bd"
Sep 10 21:21:07.175863 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:07.175815    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"958fcc11961f2affe31ee3dcaff2cd9e9c5eb8d35e23f4688ddbf1fd1972d7bd"} err="failed to get container status \"958fcc11961f2affe31ee3dcaff2cd9e9c5eb8d35e23f4688ddbf1fd1972d7bd\": rpc error: code = NotFound desc = could not find container \"958fcc11961f2affe31ee3dcaff2cd9e9c5eb8d35e23f4688ddbf1fd1972d7bd\": container with ID starting with 958fcc11961f2affe31ee3dcaff2cd9e9c5eb8d35e23f4688ddbf1fd1972d7bd not found: ID does not exist"
Sep 10 21:21:07.177835 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:07.177816    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l"]
Sep 10 21:21:08.947631 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:08.947597    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" path="/var/lib/kubelet/pods/ca203ced-0dca-4bbc-a27d-1258f298ec0b/volumes"
Sep 10 21:21:12.250270 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:12.250237    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-91c25e-29817915-2sp76"]
Sep 10 21:21:12.252842 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:12.252819    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-91c25e-29817915-2sp76"]
Sep 10 21:21:12.283477 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:12.283446    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"]
Sep 10 21:21:12.283762 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:12.283711    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn" podUID="709cd439-90d2-46c5-ad64-e0ce1be4fd4e" containerName="payload-pre-processing" containerID="cri-o://b8f2c2d0e0b9c50a5f458cb10eb470b6c347777827c1bef28bcd4a487dc1653f" gracePeriod=30
Sep 10 21:21:12.537992 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:12.537964    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"
Sep 10 21:21:12.678671 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:12.678640    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/709cd439-90d2-46c5-ad64-e0ce1be4fd4e-plugins-config-volume\") pod \"709cd439-90d2-46c5-ad64-e0ce1be4fd4e\" (UID: \"709cd439-90d2-46c5-ad64-e0ce1be4fd4e\") "
Sep 10 21:21:12.678671 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:12.678671    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mzs2\" (UniqueName: \"kubernetes.io/projected/709cd439-90d2-46c5-ad64-e0ce1be4fd4e-kube-api-access-6mzs2\") pod \"709cd439-90d2-46c5-ad64-e0ce1be4fd4e\" (UID: \"709cd439-90d2-46c5-ad64-e0ce1be4fd4e\") "
Sep 10 21:21:12.678992 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:12.678968    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/709cd439-90d2-46c5-ad64-e0ce1be4fd4e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "709cd439-90d2-46c5-ad64-e0ce1be4fd4e" (UID: "709cd439-90d2-46c5-ad64-e0ce1be4fd4e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:21:12.680817 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:12.680794    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/709cd439-90d2-46c5-ad64-e0ce1be4fd4e-kube-api-access-6mzs2" (OuterVolumeSpecName: "kube-api-access-6mzs2") pod "709cd439-90d2-46c5-ad64-e0ce1be4fd4e" (UID: "709cd439-90d2-46c5-ad64-e0ce1be4fd4e"). InnerVolumeSpecName "kube-api-access-6mzs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:12.779873 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:12.779794    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/709cd439-90d2-46c5-ad64-e0ce1be4fd4e-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:12.779873 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:12.779819    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mzs2\" (UniqueName: \"kubernetes.io/projected/709cd439-90d2-46c5-ad64-e0ce1be4fd4e-kube-api-access-6mzs2\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:12.947012 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:12.946977    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b94200bd-4954-4a98-884b-0b14d76ac9f6" path="/var/lib/kubelet/pods/b94200bd-4954-4a98-884b-0b14d76ac9f6/volumes"
Sep 10 21:21:13.192761 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:13.192726    2577 generic.go:356] "Generic (PLEG): container finished" podID="709cd439-90d2-46c5-ad64-e0ce1be4fd4e" containerID="b8f2c2d0e0b9c50a5f458cb10eb470b6c347777827c1bef28bcd4a487dc1653f" exitCode=0
Sep 10 21:21:13.192933 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:13.192771    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"
Sep 10 21:21:13.192933 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:13.192780    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn" event={"ID":"709cd439-90d2-46c5-ad64-e0ce1be4fd4e","Type":"ContainerDied","Data":"b8f2c2d0e0b9c50a5f458cb10eb470b6c347777827c1bef28bcd4a487dc1653f"}
Sep 10 21:21:13.192933 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:13.192820    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn" event={"ID":"709cd439-90d2-46c5-ad64-e0ce1be4fd4e","Type":"ContainerDied","Data":"282f2c3cd8d44b7013293d9b7bf1da74c5a16c6a712048bc8aeffa55a69f8452"}
Sep 10 21:21:13.192933 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:13.192849    2577 scope.go:117] "RemoveContainer" containerID="b8f2c2d0e0b9c50a5f458cb10eb470b6c347777827c1bef28bcd4a487dc1653f"
Sep 10 21:21:13.202006 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:13.201988    2577 scope.go:117] "RemoveContainer" containerID="b8f2c2d0e0b9c50a5f458cb10eb470b6c347777827c1bef28bcd4a487dc1653f"
Sep 10 21:21:13.202286 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:21:13.202261    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8f2c2d0e0b9c50a5f458cb10eb470b6c347777827c1bef28bcd4a487dc1653f\": container with ID starting with b8f2c2d0e0b9c50a5f458cb10eb470b6c347777827c1bef28bcd4a487dc1653f not found: ID does not exist" containerID="b8f2c2d0e0b9c50a5f458cb10eb470b6c347777827c1bef28bcd4a487dc1653f"
Sep 10 21:21:13.202336 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:13.202288    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8f2c2d0e0b9c50a5f458cb10eb470b6c347777827c1bef28bcd4a487dc1653f"} err="failed to get container status \"b8f2c2d0e0b9c50a5f458cb10eb470b6c347777827c1bef28bcd4a487dc1653f\": rpc error: code = NotFound desc = could not find container \"b8f2c2d0e0b9c50a5f458cb10eb470b6c347777827c1bef28bcd4a487dc1653f\": container with ID starting with b8f2c2d0e0b9c50a5f458cb10eb470b6c347777827c1bef28bcd4a487dc1653f not found: ID does not exist"
Sep 10 21:21:13.208383 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:13.208361    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"]
Sep 10 21:21:13.211725 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:13.211704    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn"]
Sep 10 21:21:14.953570 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:14.953539    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="709cd439-90d2-46c5-ad64-e0ce1be4fd4e" path="/var/lib/kubelet/pods/709cd439-90d2-46c5-ad64-e0ce1be4fd4e/volumes"
Sep 10 21:21:16.760856 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:16.760823    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:21:18.674947 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:18.674913    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"]
Sep 10 21:21:18.675505 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:18.675169    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv" podUID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerName="istio-proxy" containerID="cri-o://e8dd9dd35072211e51e95926ca175f707b13dadde28e70e193ffa3d8484e8060" gracePeriod=30
Sep 10 21:21:23.928593 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:23.928567    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:21:24.088271 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.088243    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-credential-socket\") pod \"0046d4aa-1663-442f-bde8-d5c93044c0e7\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") "
Sep 10 21:21:24.088432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.088277    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-workload-certs\") pod \"0046d4aa-1663-442f-bde8-d5c93044c0e7\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") "
Sep 10 21:21:24.088432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.088305    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-envoy\") pod \"0046d4aa-1663-442f-bde8-d5c93044c0e7\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") "
Sep 10 21:21:24.088432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.088387    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0046d4aa-1663-442f-bde8-d5c93044c0e7-istiod-ca-cert\") pod \"0046d4aa-1663-442f-bde8-d5c93044c0e7\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") "
Sep 10 21:21:24.088592 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.088435    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-token\") pod \"0046d4aa-1663-442f-bde8-d5c93044c0e7\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") "
Sep 10 21:21:24.088592 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.088472    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-workload-socket\") pod \"0046d4aa-1663-442f-bde8-d5c93044c0e7\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") "
Sep 10 21:21:24.088592 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.088498    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-podinfo\") pod \"0046d4aa-1663-442f-bde8-d5c93044c0e7\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") "
Sep 10 21:21:24.088592 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.088530    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkkpt\" (UniqueName: \"kubernetes.io/projected/0046d4aa-1663-442f-bde8-d5c93044c0e7-kube-api-access-rkkpt\") pod \"0046d4aa-1663-442f-bde8-d5c93044c0e7\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") "
Sep 10 21:21:24.088592 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.088565    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-data\") pod \"0046d4aa-1663-442f-bde8-d5c93044c0e7\" (UID: \"0046d4aa-1663-442f-bde8-d5c93044c0e7\") "
Sep 10 21:21:24.089263 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.088559    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0046d4aa-1663-442f-bde8-d5c93044c0e7" (UID: "0046d4aa-1663-442f-bde8-d5c93044c0e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:24.089263 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.088577    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0046d4aa-1663-442f-bde8-d5c93044c0e7" (UID: "0046d4aa-1663-442f-bde8-d5c93044c0e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:24.089446 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.088835    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0046d4aa-1663-442f-bde8-d5c93044c0e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0046d4aa-1663-442f-bde8-d5c93044c0e7" (UID: "0046d4aa-1663-442f-bde8-d5c93044c0e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:21:24.089446 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.088907    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "0046d4aa-1663-442f-bde8-d5c93044c0e7" (UID: "0046d4aa-1663-442f-bde8-d5c93044c0e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:24.089637 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.089618    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-data\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:24.089713 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.089643    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-credential-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:24.089713 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.089658    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-workload-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:24.089713 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.089673    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0046d4aa-1663-442f-bde8-d5c93044c0e7-istiod-ca-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:24.090066 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.090019    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0046d4aa-1663-442f-bde8-d5c93044c0e7" (UID: "0046d4aa-1663-442f-bde8-d5c93044c0e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:24.090856 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.090834    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0046d4aa-1663-442f-bde8-d5c93044c0e7" (UID: "0046d4aa-1663-442f-bde8-d5c93044c0e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:24.090948 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.090899    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "0046d4aa-1663-442f-bde8-d5c93044c0e7" (UID: "0046d4aa-1663-442f-bde8-d5c93044c0e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:24.091073 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.091055    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0046d4aa-1663-442f-bde8-d5c93044c0e7-kube-api-access-rkkpt" (OuterVolumeSpecName: "kube-api-access-rkkpt") pod "0046d4aa-1663-442f-bde8-d5c93044c0e7" (UID: "0046d4aa-1663-442f-bde8-d5c93044c0e7"). InnerVolumeSpecName "kube-api-access-rkkpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:24.091136 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.091064    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0046d4aa-1663-442f-bde8-d5c93044c0e7" (UID: "0046d4aa-1663-442f-bde8-d5c93044c0e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:21:24.190373 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.190338    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-workload-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:24.190373 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.190366    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-podinfo\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:24.190373 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.190377    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkkpt\" (UniqueName: \"kubernetes.io/projected/0046d4aa-1663-442f-bde8-d5c93044c0e7-kube-api-access-rkkpt\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:24.190605 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.190387    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-envoy\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:24.190605 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.190395    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0046d4aa-1663-442f-bde8-d5c93044c0e7-istio-token\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:24.259505 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.259472    2577 generic.go:356] "Generic (PLEG): container finished" podID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerID="e8dd9dd35072211e51e95926ca175f707b13dadde28e70e193ffa3d8484e8060" exitCode=0
Sep 10 21:21:24.259673 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.259521    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"
Sep 10 21:21:24.259673 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.259544    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv" event={"ID":"0046d4aa-1663-442f-bde8-d5c93044c0e7","Type":"ContainerDied","Data":"e8dd9dd35072211e51e95926ca175f707b13dadde28e70e193ffa3d8484e8060"}
Sep 10 21:21:24.259673 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.259595    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv" event={"ID":"0046d4aa-1663-442f-bde8-d5c93044c0e7","Type":"ContainerDied","Data":"6688e1a524cbd6577075846821eb4af2da6a95cf410168cfd47de58edea1d76c"}
Sep 10 21:21:24.259673 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.259624    2577 scope.go:117] "RemoveContainer" containerID="e8dd9dd35072211e51e95926ca175f707b13dadde28e70e193ffa3d8484e8060"
Sep 10 21:21:24.271691 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.271669    2577 scope.go:117] "RemoveContainer" containerID="b49473eb9d86d8bc20cc6557a732267c0e2ae466b6d9e5a7160c85c683a70529"
Sep 10 21:21:24.281734 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.280771    2577 scope.go:117] "RemoveContainer" containerID="e8dd9dd35072211e51e95926ca175f707b13dadde28e70e193ffa3d8484e8060"
Sep 10 21:21:24.281734 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:21:24.281169    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8dd9dd35072211e51e95926ca175f707b13dadde28e70e193ffa3d8484e8060\": container with ID starting with e8dd9dd35072211e51e95926ca175f707b13dadde28e70e193ffa3d8484e8060 not found: ID does not exist" containerID="e8dd9dd35072211e51e95926ca175f707b13dadde28e70e193ffa3d8484e8060"
Sep 10 21:21:24.281734 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.281220    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8dd9dd35072211e51e95926ca175f707b13dadde28e70e193ffa3d8484e8060"} err="failed to get container status \"e8dd9dd35072211e51e95926ca175f707b13dadde28e70e193ffa3d8484e8060\": rpc error: code = NotFound desc = could not find container \"e8dd9dd35072211e51e95926ca175f707b13dadde28e70e193ffa3d8484e8060\": container with ID starting with e8dd9dd35072211e51e95926ca175f707b13dadde28e70e193ffa3d8484e8060 not found: ID does not exist"
Sep 10 21:21:24.281734 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.281244    2577 scope.go:117] "RemoveContainer" containerID="b49473eb9d86d8bc20cc6557a732267c0e2ae466b6d9e5a7160c85c683a70529"
Sep 10 21:21:24.281734 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:21:24.281587    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b49473eb9d86d8bc20cc6557a732267c0e2ae466b6d9e5a7160c85c683a70529\": container with ID starting with b49473eb9d86d8bc20cc6557a732267c0e2ae466b6d9e5a7160c85c683a70529 not found: ID does not exist" containerID="b49473eb9d86d8bc20cc6557a732267c0e2ae466b6d9e5a7160c85c683a70529"
Sep 10 21:21:24.281734 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.281638    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b49473eb9d86d8bc20cc6557a732267c0e2ae466b6d9e5a7160c85c683a70529"} err="failed to get container status \"b49473eb9d86d8bc20cc6557a732267c0e2ae466b6d9e5a7160c85c683a70529\": rpc error: code = NotFound desc = could not find container \"b49473eb9d86d8bc20cc6557a732267c0e2ae466b6d9e5a7160c85c683a70529\": container with ID starting with b49473eb9d86d8bc20cc6557a732267c0e2ae466b6d9e5a7160c85c683a70529 not found: ID does not exist"
Sep 10 21:21:24.284451 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.284430    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"]
Sep 10 21:21:24.286716 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.286697    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv"]
Sep 10 21:21:24.947205 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:24.947172    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0046d4aa-1663-442f-bde8-d5c93044c0e7" path="/var/lib/kubelet/pods/0046d4aa-1663-442f-bde8-d5c93044c0e7/volumes"
Sep 10 21:21:29.476355 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:29.476318    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"]
Sep 10 21:21:29.476894 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:29.476578    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx" podUID="cc0449dd-1118-4bc0-adda-9183773580ac" containerName="payload-processing" containerID="cri-o://dd95cbf4b13039eae54f076b6f97e8cdc5cf03b0e79fa600619f482757a5625e" gracePeriod=30
Sep 10 21:21:29.730968 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:29.730910    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"
Sep 10 21:21:29.840953 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:29.840920    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hjgd\" (UniqueName: \"kubernetes.io/projected/cc0449dd-1118-4bc0-adda-9183773580ac-kube-api-access-4hjgd\") pod \"cc0449dd-1118-4bc0-adda-9183773580ac\" (UID: \"cc0449dd-1118-4bc0-adda-9183773580ac\") "
Sep 10 21:21:29.841147 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:29.841081    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0449dd-1118-4bc0-adda-9183773580ac-plugins-config-volume\") pod \"cc0449dd-1118-4bc0-adda-9183773580ac\" (UID: \"cc0449dd-1118-4bc0-adda-9183773580ac\") "
Sep 10 21:21:29.841432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:29.841410    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc0449dd-1118-4bc0-adda-9183773580ac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc0449dd-1118-4bc0-adda-9183773580ac" (UID: "cc0449dd-1118-4bc0-adda-9183773580ac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:21:29.842955 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:29.842936    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0449dd-1118-4bc0-adda-9183773580ac-kube-api-access-4hjgd" (OuterVolumeSpecName: "kube-api-access-4hjgd") pod "cc0449dd-1118-4bc0-adda-9183773580ac" (UID: "cc0449dd-1118-4bc0-adda-9183773580ac"). InnerVolumeSpecName "kube-api-access-4hjgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:29.941890 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:29.941857    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0449dd-1118-4bc0-adda-9183773580ac-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:29.941890 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:29.941886    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hjgd\" (UniqueName: \"kubernetes.io/projected/cc0449dd-1118-4bc0-adda-9183773580ac-kube-api-access-4hjgd\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:21:30.294763 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:30.294726    2577 generic.go:356] "Generic (PLEG): container finished" podID="cc0449dd-1118-4bc0-adda-9183773580ac" containerID="dd95cbf4b13039eae54f076b6f97e8cdc5cf03b0e79fa600619f482757a5625e" exitCode=0
Sep 10 21:21:30.294928 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:30.294767    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"
Sep 10 21:21:30.294928 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:30.294772    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx" event={"ID":"cc0449dd-1118-4bc0-adda-9183773580ac","Type":"ContainerDied","Data":"dd95cbf4b13039eae54f076b6f97e8cdc5cf03b0e79fa600619f482757a5625e"}
Sep 10 21:21:30.294928 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:30.294898    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx" event={"ID":"cc0449dd-1118-4bc0-adda-9183773580ac","Type":"ContainerDied","Data":"0ba9aa9ab12386f9e7f7e2f577d0089b99d4fb3af88578c90c8ac4aa36d984a0"}
Sep 10 21:21:30.294928 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:30.294925    2577 scope.go:117] "RemoveContainer" containerID="dd95cbf4b13039eae54f076b6f97e8cdc5cf03b0e79fa600619f482757a5625e"
Sep 10 21:21:30.304313 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:30.304297    2577 scope.go:117] "RemoveContainer" containerID="dd95cbf4b13039eae54f076b6f97e8cdc5cf03b0e79fa600619f482757a5625e"
Sep 10 21:21:30.304561 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:21:30.304542    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd95cbf4b13039eae54f076b6f97e8cdc5cf03b0e79fa600619f482757a5625e\": container with ID starting with dd95cbf4b13039eae54f076b6f97e8cdc5cf03b0e79fa600619f482757a5625e not found: ID does not exist" containerID="dd95cbf4b13039eae54f076b6f97e8cdc5cf03b0e79fa600619f482757a5625e"
Sep 10 21:21:30.304606 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:30.304567    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd95cbf4b13039eae54f076b6f97e8cdc5cf03b0e79fa600619f482757a5625e"} err="failed to get container status \"dd95cbf4b13039eae54f076b6f97e8cdc5cf03b0e79fa600619f482757a5625e\": rpc error: code = NotFound desc = could not find container \"dd95cbf4b13039eae54f076b6f97e8cdc5cf03b0e79fa600619f482757a5625e\": container with ID starting with dd95cbf4b13039eae54f076b6f97e8cdc5cf03b0e79fa600619f482757a5625e not found: ID does not exist"
Sep 10 21:21:30.315857 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:30.315835    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"]
Sep 10 21:21:30.319988 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:30.319962    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx"]
Sep 10 21:21:30.946985 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:30.946953    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc0449dd-1118-4bc0-adda-9183773580ac" path="/var/lib/kubelet/pods/cc0449dd-1118-4bc0-adda-9183773580ac/volumes"
Sep 10 21:21:33.553588 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:33.553551    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:21:46.163824 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:46.163747    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:21:53.274133 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:53.274098    2577 scope.go:117] "RemoveContainer" containerID="9a695fe5db7993b7246e7c5d8957177811b08fc86ca84ee3913bd7a25040db9b"
Sep 10 21:21:53.283309 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:53.283284    2577 scope.go:117] "RemoveContainer" containerID="872c3d18f3ae96d3b42843a2563d14bc0ece0abf2c0096c95ae53129632ebdd0"
Sep 10 21:21:59.266180 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:21:59.266147    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:22:09.357445 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:09.357409    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:22:20.179792 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:20.179756    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:22:21.865858 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.865827    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"]
Sep 10 21:22:21.866264 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866229    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="709cd439-90d2-46c5-ad64-e0ce1be4fd4e" containerName="payload-pre-processing"
Sep 10 21:22:21.866264 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866242    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="709cd439-90d2-46c5-ad64-e0ce1be4fd4e" containerName="payload-pre-processing"
Sep 10 21:22:21.866264 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866252    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerName="istio-proxy"
Sep 10 21:22:21.866264 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866257    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerName="istio-proxy"
Sep 10 21:22:21.866264 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866264    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="808599a5-5e80-4447-a7d5-cc4a3b7d98e2" containerName="payload-processing"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866271    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="808599a5-5e80-4447-a7d5-cc4a3b7d98e2" containerName="payload-processing"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866283    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerName="istio-proxy"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866288    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerName="istio-proxy"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866299    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc0449dd-1118-4bc0-adda-9183773580ac" containerName="payload-processing"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866304    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc0449dd-1118-4bc0-adda-9183773580ac" containerName="payload-processing"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866316    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea1e9084-3144-4a26-9770-95597fab2371" containerName="main"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866321    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea1e9084-3144-4a26-9770-95597fab2371" containerName="main"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866331    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d73a21-d722-427e-982e-9bb196f4dc59" containerName="revoke-keys"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866337    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d73a21-d722-427e-982e-9bb196f4dc59" containerName="revoke-keys"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866345    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerName="istio-proxy"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866350    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerName="istio-proxy"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866404    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerName="istio-proxy"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866413    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="709cd439-90d2-46c5-ad64-e0ce1be4fd4e" containerName="payload-pre-processing"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866419    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc0449dd-1118-4bc0-adda-9183773580ac" containerName="payload-processing"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866424    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerName="istio-proxy"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866431    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea1e9084-3144-4a26-9770-95597fab2371" containerName="main"
Sep 10 21:22:21.866432 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866438    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca203ced-0dca-4bbc-a27d-1258f298ec0b" containerName="istio-proxy"
Sep 10 21:22:21.866946 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866444    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="808599a5-5e80-4447-a7d5-cc4a3b7d98e2" containerName="payload-processing"
Sep 10 21:22:21.866946 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866450    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerName="istio-proxy"
Sep 10 21:22:21.866946 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.866455    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="00d73a21-d722-427e-982e-9bb196f4dc59" containerName="revoke-keys"
Sep 10 21:22:21.870955 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.870935    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"
Sep 10 21:22:21.873485 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.873467    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-3dfe0c-dockercfg-l4wf5\""
Sep 10 21:22:21.873734 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.873721    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-3dfe0c\""
Sep 10 21:22:21.882654 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.882634    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"]
Sep 10 21:22:21.902632 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.902606    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"]
Sep 10 21:22:21.903228 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.903208    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerName="istio-proxy"
Sep 10 21:22:21.903284 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.903234    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0046d4aa-1663-442f-bde8-d5c93044c0e7" containerName="istio-proxy"
Sep 10 21:22:21.906881 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.906863    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"
Sep 10 21:22:21.913777 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.913757    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"]
Sep 10 21:22:21.921594 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.921569    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22qmn\" (UniqueName: \"kubernetes.io/projected/4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae-kube-api-access-22qmn\") pod \"payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r\" (UID: \"4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"
Sep 10 21:22:21.921709 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:21.921602    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r\" (UID: \"4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"
Sep 10 21:22:22.022908 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.022874    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22qmn\" (UniqueName: \"kubernetes.io/projected/4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae-kube-api-access-22qmn\") pod \"payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r\" (UID: \"4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"
Sep 10 21:22:22.022908 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.022910    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7rbb\" (UniqueName: \"kubernetes.io/projected/89b396a3-6fbc-48be-83d4-df9e812aea4c-kube-api-access-b7rbb\") pod \"payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd\" (UID: \"89b396a3-6fbc-48be-83d4-df9e812aea4c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"
Sep 10 21:22:22.023155 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.022937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r\" (UID: \"4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"
Sep 10 21:22:22.023155 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.023123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89b396a3-6fbc-48be-83d4-df9e812aea4c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd\" (UID: \"89b396a3-6fbc-48be-83d4-df9e812aea4c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"
Sep 10 21:22:22.023654 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.023635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r\" (UID: \"4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"
Sep 10 21:22:22.030447 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.030417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22qmn\" (UniqueName: \"kubernetes.io/projected/4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae-kube-api-access-22qmn\") pod \"payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r\" (UID: \"4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"
Sep 10 21:22:22.124501 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.124425    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89b396a3-6fbc-48be-83d4-df9e812aea4c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd\" (UID: \"89b396a3-6fbc-48be-83d4-df9e812aea4c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"
Sep 10 21:22:22.124501 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.124472    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7rbb\" (UniqueName: \"kubernetes.io/projected/89b396a3-6fbc-48be-83d4-df9e812aea4c-kube-api-access-b7rbb\") pod \"payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd\" (UID: \"89b396a3-6fbc-48be-83d4-df9e812aea4c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"
Sep 10 21:22:22.125127 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.125106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89b396a3-6fbc-48be-83d4-df9e812aea4c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd\" (UID: \"89b396a3-6fbc-48be-83d4-df9e812aea4c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"
Sep 10 21:22:22.132603 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.132575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7rbb\" (UniqueName: \"kubernetes.io/projected/89b396a3-6fbc-48be-83d4-df9e812aea4c-kube-api-access-b7rbb\") pod \"payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd\" (UID: \"89b396a3-6fbc-48be-83d4-df9e812aea4c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"
Sep 10 21:22:22.181273 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.181242    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"
Sep 10 21:22:22.218197 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.218171    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"
Sep 10 21:22:22.459768 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.459737    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"]
Sep 10 21:22:22.461314 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:22:22.461289    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bfa1f64_229c_4d4d_9d0e_90c58fcaa2ae.slice/crio-266eee609620dbfb4db749b458ee9b249e46c68f5bb975f12bfaf9609339887d WatchSource:0}: Error finding container 266eee609620dbfb4db749b458ee9b249e46c68f5bb975f12bfaf9609339887d: Status 404 returned error can't find the container with id 266eee609620dbfb4db749b458ee9b249e46c68f5bb975f12bfaf9609339887d
Sep 10 21:22:22.497809 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.497780    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"]
Sep 10 21:22:22.498840 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:22:22.498811    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89b396a3_6fbc_48be_83d4_df9e812aea4c.slice/crio-dfbe9dea87e60f6b23527f0d321511f2a39c94f5a85c73a027c2746c59137bbb WatchSource:0}: Error finding container dfbe9dea87e60f6b23527f0d321511f2a39c94f5a85c73a027c2746c59137bbb: Status 404 returned error can't find the container with id dfbe9dea87e60f6b23527f0d321511f2a39c94f5a85c73a027c2746c59137bbb
Sep 10 21:22:22.590209 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.590167    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r" event={"ID":"4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae","Type":"ContainerStarted","Data":"a658cde1d67497f5536e4d3f23ba5489b433f4ab0b9e5346cefbd64026032714"}
Sep 10 21:22:22.590405 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.590235    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r" event={"ID":"4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae","Type":"ContainerStarted","Data":"266eee609620dbfb4db749b458ee9b249e46c68f5bb975f12bfaf9609339887d"}
Sep 10 21:22:22.590405 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.590265    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"
Sep 10 21:22:22.591717 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.591693    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd" event={"ID":"89b396a3-6fbc-48be-83d4-df9e812aea4c","Type":"ContainerStarted","Data":"be7ddf9a8131a6fce2f74d3ca393e57df4fa0ccca12239593e66f034eca0c3e7"}
Sep 10 21:22:22.591840 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.591729    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd" event={"ID":"89b396a3-6fbc-48be-83d4-df9e812aea4c","Type":"ContainerStarted","Data":"dfbe9dea87e60f6b23527f0d321511f2a39c94f5a85c73a027c2746c59137bbb"}
Sep 10 21:22:22.591840 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.591792    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"
Sep 10 21:22:22.605260 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.605206    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r" podStartSLOduration=1.605186088 podStartE2EDuration="1.605186088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:22:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:22:22.604941606 +0000 UTC m=+1470.178647981" watchObservedRunningTime="2026-09-10 21:22:22.605186088 +0000 UTC m=+1470.178892462"
Sep 10 21:22:22.622905 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:22.622850    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd" podStartSLOduration=1.622830575 podStartE2EDuration="1.622830575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:22:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:22:22.620232257 +0000 UTC m=+1470.193938634" watchObservedRunningTime="2026-09-10 21:22:22.622830575 +0000 UTC m=+1470.196536952"
Sep 10 21:22:33.066037 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:33.065994    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:22:33.599493 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:33.599464    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"
Sep 10 21:22:33.599656 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:33.599534    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"
Sep 10 21:22:51.062445 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.062411    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"]
Sep 10 21:22:51.065698 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.065682    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"
Sep 10 21:22:51.067958 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.067935    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-636944-dockercfg-cr8cj\""
Sep 10 21:22:51.068116 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.067941    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-636944\""
Sep 10 21:22:51.076417 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.076394    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"]
Sep 10 21:22:51.093946 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.093912    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"]
Sep 10 21:22:51.099556 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.099528    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"
Sep 10 21:22:51.102305 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.102279    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2sn6\" (UniqueName: \"kubernetes.io/projected/f6aa9ec8-c159-400e-93d3-4447e05a5abf-kube-api-access-j2sn6\") pod \"payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z\" (UID: \"f6aa9ec8-c159-400e-93d3-4447e05a5abf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"
Sep 10 21:22:51.102425 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.102333    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6aa9ec8-c159-400e-93d3-4447e05a5abf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z\" (UID: \"f6aa9ec8-c159-400e-93d3-4447e05a5abf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"
Sep 10 21:22:51.102425 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.102410    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f6063b2-dfec-4902-b2e1-36cad159dc05-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-636944-58b969c559-52glp\" (UID: \"0f6063b2-dfec-4902-b2e1-36cad159dc05\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"
Sep 10 21:22:51.102552 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.102440    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rzt7\" (UniqueName: \"kubernetes.io/projected/0f6063b2-dfec-4902-b2e1-36cad159dc05-kube-api-access-6rzt7\") pod \"payload-processing-e2e-ipp-b-636944-58b969c559-52glp\" (UID: \"0f6063b2-dfec-4902-b2e1-36cad159dc05\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"
Sep 10 21:22:51.106261 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.106236    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"]
Sep 10 21:22:51.203902 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.203856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2sn6\" (UniqueName: \"kubernetes.io/projected/f6aa9ec8-c159-400e-93d3-4447e05a5abf-kube-api-access-j2sn6\") pod \"payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z\" (UID: \"f6aa9ec8-c159-400e-93d3-4447e05a5abf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"
Sep 10 21:22:51.204113 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.203984    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6aa9ec8-c159-400e-93d3-4447e05a5abf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z\" (UID: \"f6aa9ec8-c159-400e-93d3-4447e05a5abf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"
Sep 10 21:22:51.204113 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.204054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f6063b2-dfec-4902-b2e1-36cad159dc05-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-636944-58b969c559-52glp\" (UID: \"0f6063b2-dfec-4902-b2e1-36cad159dc05\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"
Sep 10 21:22:51.204113 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.204077    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rzt7\" (UniqueName: \"kubernetes.io/projected/0f6063b2-dfec-4902-b2e1-36cad159dc05-kube-api-access-6rzt7\") pod \"payload-processing-e2e-ipp-b-636944-58b969c559-52glp\" (UID: \"0f6063b2-dfec-4902-b2e1-36cad159dc05\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"
Sep 10 21:22:51.204951 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.204928    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f6063b2-dfec-4902-b2e1-36cad159dc05-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-636944-58b969c559-52glp\" (UID: \"0f6063b2-dfec-4902-b2e1-36cad159dc05\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"
Sep 10 21:22:51.205009 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.204928    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6aa9ec8-c159-400e-93d3-4447e05a5abf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z\" (UID: \"f6aa9ec8-c159-400e-93d3-4447e05a5abf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"
Sep 10 21:22:51.213500 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.213469    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2sn6\" (UniqueName: \"kubernetes.io/projected/f6aa9ec8-c159-400e-93d3-4447e05a5abf-kube-api-access-j2sn6\") pod \"payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z\" (UID: \"f6aa9ec8-c159-400e-93d3-4447e05a5abf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"
Sep 10 21:22:51.213500 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.213486    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rzt7\" (UniqueName: \"kubernetes.io/projected/0f6063b2-dfec-4902-b2e1-36cad159dc05-kube-api-access-6rzt7\") pod \"payload-processing-e2e-ipp-b-636944-58b969c559-52glp\" (UID: \"0f6063b2-dfec-4902-b2e1-36cad159dc05\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"
Sep 10 21:22:51.376763 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.376737    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"
Sep 10 21:22:51.412541 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.412512    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"
Sep 10 21:22:51.646592 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.646561    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"]
Sep 10 21:22:51.647813 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:22:51.647791    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6aa9ec8_c159_400e_93d3_4447e05a5abf.slice/crio-e0c77a66b3e8e5b44ac91852141da4907df81f5d4baa1bf8013f7ae6a7f90d0d WatchSource:0}: Error finding container e0c77a66b3e8e5b44ac91852141da4907df81f5d4baa1bf8013f7ae6a7f90d0d: Status 404 returned error can't find the container with id e0c77a66b3e8e5b44ac91852141da4907df81f5d4baa1bf8013f7ae6a7f90d0d
Sep 10 21:22:51.693253 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.693229    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"]
Sep 10 21:22:51.694304 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:22:51.694278    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6063b2_dfec_4902_b2e1_36cad159dc05.slice/crio-7d2fe5ab746b69f55d374ae67bcda4f30ce0d868ae69867422bacaf77b2c6f6f WatchSource:0}: Error finding container 7d2fe5ab746b69f55d374ae67bcda4f30ce0d868ae69867422bacaf77b2c6f6f: Status 404 returned error can't find the container with id 7d2fe5ab746b69f55d374ae67bcda4f30ce0d868ae69867422bacaf77b2c6f6f
Sep 10 21:22:51.761558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.761529    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z" event={"ID":"f6aa9ec8-c159-400e-93d3-4447e05a5abf","Type":"ContainerStarted","Data":"382c7e602bcc84af87acdd6e7166df057cacf602807e1bb46683ec5b5d5eeaf6"}
Sep 10 21:22:51.761683 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.761586    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z" event={"ID":"f6aa9ec8-c159-400e-93d3-4447e05a5abf","Type":"ContainerStarted","Data":"e0c77a66b3e8e5b44ac91852141da4907df81f5d4baa1bf8013f7ae6a7f90d0d"}
Sep 10 21:22:51.761748 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.761701    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"
Sep 10 21:22:51.763207 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.763183    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp" event={"ID":"0f6063b2-dfec-4902-b2e1-36cad159dc05","Type":"ContainerStarted","Data":"e622987a21c86b32698d7ad1aa800166deac5a4fc2c3edb5855600f2964d23e6"}
Sep 10 21:22:51.763331 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.763226    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp" event={"ID":"0f6063b2-dfec-4902-b2e1-36cad159dc05","Type":"ContainerStarted","Data":"7d2fe5ab746b69f55d374ae67bcda4f30ce0d868ae69867422bacaf77b2c6f6f"}
Sep 10 21:22:51.763398 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.763362    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"
Sep 10 21:22:51.778121 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.778082    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z" podStartSLOduration=0.778067924 podStartE2EDuration="778.067924ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:22:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:22:51.775537054 +0000 UTC m=+1499.349243429" watchObservedRunningTime="2026-09-10 21:22:51.778067924 +0000 UTC m=+1499.351774297"
Sep 10 21:22:51.793156 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:51.793109    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp" podStartSLOduration=0.79309032 podStartE2EDuration="793.09032ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:22:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:22:51.792303145 +0000 UTC m=+1499.366009520" watchObservedRunningTime="2026-09-10 21:22:51.79309032 +0000 UTC m=+1499.366796698"
Sep 10 21:22:54.261270 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:54.261236    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:22:54.266946 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:54.266920    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:22:56.960318 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:22:56.960284    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:23:02.770963 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:23:02.770931    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"
Sep 10 21:23:02.771457 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:23:02.771180    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"
Sep 10 21:23:19.325813 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:23:19.325748    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-636944-58b969c559-52glp_0f6063b2-dfec-4902-b2e1-36cad159dc05/payload-processing/0.log"
Sep 10 21:23:45.167693 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:23:45.167655    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:23:59.257166 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:23:59.257133    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:24:05.020684 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:05.020655    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd_89b396a3-6fbc-48be-83d4-df9e812aea4c/payload-processing/0.log"
Sep 10 21:24:05.262736 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:05.262709    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-636944-58b969c559-52glp_0f6063b2-dfec-4902-b2e1-36cad159dc05/payload-processing/0.log"
Sep 10 21:24:10.582247 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.582215    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"]
Sep 10 21:24:10.586275 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.586257    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"
Sep 10 21:24:10.588590 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.588566    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-361296\""
Sep 10 21:24:10.588704 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.588566    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-361296-dockercfg-c9j8d\""
Sep 10 21:24:10.594558 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.594535    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"]
Sep 10 21:24:10.614209 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.614186    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"]
Sep 10 21:24:10.617732 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.617712    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"
Sep 10 21:24:10.626752 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.626729    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"]
Sep 10 21:24:10.723218 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.723173    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68ad89e9-d74e-4b41-9775-dde593184c0e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8\" (UID: \"68ad89e9-d74e-4b41-9775-dde593184c0e\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"
Sep 10 21:24:10.723456 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.723243    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq84p\" (UniqueName: \"kubernetes.io/projected/716c67ea-da56-4cda-bc4d-23d6099146ff-kube-api-access-mq84p\") pod \"payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd\" (UID: \"716c67ea-da56-4cda-bc4d-23d6099146ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"
Sep 10 21:24:10.723456 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.723342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/716c67ea-da56-4cda-bc4d-23d6099146ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd\" (UID: \"716c67ea-da56-4cda-bc4d-23d6099146ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"
Sep 10 21:24:10.723456 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.723373    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm48c\" (UniqueName: \"kubernetes.io/projected/68ad89e9-d74e-4b41-9775-dde593184c0e-kube-api-access-pm48c\") pod \"payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8\" (UID: \"68ad89e9-d74e-4b41-9775-dde593184c0e\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"
Sep 10 21:24:10.823952 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.823913    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq84p\" (UniqueName: \"kubernetes.io/projected/716c67ea-da56-4cda-bc4d-23d6099146ff-kube-api-access-mq84p\") pod \"payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd\" (UID: \"716c67ea-da56-4cda-bc4d-23d6099146ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"
Sep 10 21:24:10.824153 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.824008    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/716c67ea-da56-4cda-bc4d-23d6099146ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd\" (UID: \"716c67ea-da56-4cda-bc4d-23d6099146ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"
Sep 10 21:24:10.824153 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.824064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm48c\" (UniqueName: \"kubernetes.io/projected/68ad89e9-d74e-4b41-9775-dde593184c0e-kube-api-access-pm48c\") pod \"payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8\" (UID: \"68ad89e9-d74e-4b41-9775-dde593184c0e\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"
Sep 10 21:24:10.824153 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.824092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68ad89e9-d74e-4b41-9775-dde593184c0e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8\" (UID: \"68ad89e9-d74e-4b41-9775-dde593184c0e\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"
Sep 10 21:24:10.824756 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.824736    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/716c67ea-da56-4cda-bc4d-23d6099146ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd\" (UID: \"716c67ea-da56-4cda-bc4d-23d6099146ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"
Sep 10 21:24:10.824794 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.824758    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68ad89e9-d74e-4b41-9775-dde593184c0e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8\" (UID: \"68ad89e9-d74e-4b41-9775-dde593184c0e\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"
Sep 10 21:24:10.831785 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.831763    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm48c\" (UniqueName: \"kubernetes.io/projected/68ad89e9-d74e-4b41-9775-dde593184c0e-kube-api-access-pm48c\") pod \"payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8\" (UID: \"68ad89e9-d74e-4b41-9775-dde593184c0e\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"
Sep 10 21:24:10.832550 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.832512    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq84p\" (UniqueName: \"kubernetes.io/projected/716c67ea-da56-4cda-bc4d-23d6099146ff-kube-api-access-mq84p\") pod \"payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd\" (UID: \"716c67ea-da56-4cda-bc4d-23d6099146ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"
Sep 10 21:24:10.898327 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.898289    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"
Sep 10 21:24:10.929712 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:10.929682    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"
Sep 10 21:24:11.169688 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:11.169664    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"]
Sep 10 21:24:11.171193 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:24:11.171160    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716c67ea_da56_4cda_bc4d_23d6099146ff.slice/crio-9ec78f96ed7b4c7c2d319eb3b6a771cc9cf3b39781b472a9172f870d137e5080 WatchSource:0}: Error finding container 9ec78f96ed7b4c7c2d319eb3b6a771cc9cf3b39781b472a9172f870d137e5080: Status 404 returned error can't find the container with id 9ec78f96ed7b4c7c2d319eb3b6a771cc9cf3b39781b472a9172f870d137e5080
Sep 10 21:24:11.208264 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:11.208239    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"]
Sep 10 21:24:11.209198 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:24:11.209174    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ad89e9_d74e_4b41_9775_dde593184c0e.slice/crio-395d4433d6026c6b7b9810d126ec2f2320a6de85755396ec7f55e858ac8b531b WatchSource:0}: Error finding container 395d4433d6026c6b7b9810d126ec2f2320a6de85755396ec7f55e858ac8b531b: Status 404 returned error can't find the container with id 395d4433d6026c6b7b9810d126ec2f2320a6de85755396ec7f55e858ac8b531b
Sep 10 21:24:11.229877 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:11.229849    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8" event={"ID":"68ad89e9-d74e-4b41-9775-dde593184c0e","Type":"ContainerStarted","Data":"395d4433d6026c6b7b9810d126ec2f2320a6de85755396ec7f55e858ac8b531b"}
Sep 10 21:24:11.231995 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:11.231975    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd" event={"ID":"716c67ea-da56-4cda-bc4d-23d6099146ff","Type":"ContainerStarted","Data":"9ec78f96ed7b4c7c2d319eb3b6a771cc9cf3b39781b472a9172f870d137e5080"}
Sep 10 21:24:12.238968 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:12.238935    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8" event={"ID":"68ad89e9-d74e-4b41-9775-dde593184c0e","Type":"ContainerStarted","Data":"fe3387046a148290d3927f5d8251da63508999c56e4009e8e84ab9346e020386"}
Sep 10 21:24:12.239415 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:12.239042    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"
Sep 10 21:24:12.240665 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:12.240643    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd" event={"ID":"716c67ea-da56-4cda-bc4d-23d6099146ff","Type":"ContainerStarted","Data":"0b0069638a698309123c39c7bef1e0d495b9ec2d2dc70bfe97650600a7c457d9"}
Sep 10 21:24:12.240785 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:12.240708    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"
Sep 10 21:24:12.254639 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:12.254594    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8" podStartSLOduration=2.254581751 podStartE2EDuration="2.254581751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:24:12.254064107 +0000 UTC m=+1579.827770482" watchObservedRunningTime="2026-09-10 21:24:12.254581751 +0000 UTC m=+1579.828288125"
Sep 10 21:24:12.268910 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:12.268872    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd" podStartSLOduration=2.268856156 podStartE2EDuration="2.268856156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:24:12.268107858 +0000 UTC m=+1579.841814231" watchObservedRunningTime="2026-09-10 21:24:12.268856156 +0000 UTC m=+1579.842562533"
Sep 10 21:24:19.467514 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:19.467475    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:24:23.248977 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:23.248950    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"
Sep 10 21:24:23.249390 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:23.249019    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"
Sep 10 21:24:34.446835 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:34.446799    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm"]
Sep 10 21:24:34.450517 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:34.450500    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm"
Sep 10 21:24:34.452475 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:34.452449    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:24:34.452585 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:34.452521    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:24:34.457067 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:34.457043    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm"]
Sep 10 21:24:34.537433 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:34.537398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79fad4bf-0aef-4e30-b8a9-2105b9329ddf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm\" (UID: \"79fad4bf-0aef-4e30-b8a9-2105b9329ddf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm"
Sep 10 21:24:34.638019 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:34.637983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79fad4bf-0aef-4e30-b8a9-2105b9329ddf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm\" (UID: \"79fad4bf-0aef-4e30-b8a9-2105b9329ddf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm"
Sep 10 21:24:34.638605 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:34.638584    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79fad4bf-0aef-4e30-b8a9-2105b9329ddf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm\" (UID: \"79fad4bf-0aef-4e30-b8a9-2105b9329ddf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm"
Sep 10 21:24:34.764346 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:34.764263    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm"
Sep 10 21:24:35.034072 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:35.034044    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm"]
Sep 10 21:24:35.035540 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:24:35.035515    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fad4bf_0aef_4e30_b8a9_2105b9329ddf.slice/crio-49bdb6bda636a3187811a8ea0b8574aca99e58db885c14398deb0feaf1a12490 WatchSource:0}: Error finding container 49bdb6bda636a3187811a8ea0b8574aca99e58db885c14398deb0feaf1a12490: Status 404 returned error can't find the container with id 49bdb6bda636a3187811a8ea0b8574aca99e58db885c14398deb0feaf1a12490
Sep 10 21:24:35.373711 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:35.373678    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm" event={"ID":"79fad4bf-0aef-4e30-b8a9-2105b9329ddf","Type":"ContainerStarted","Data":"42d5f11de427244a5962315c9821f53c9915f44e58815b8da0f514d235032403"}
Sep 10 21:24:35.373844 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:35.373729    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm" event={"ID":"79fad4bf-0aef-4e30-b8a9-2105b9329ddf","Type":"ContainerStarted","Data":"49bdb6bda636a3187811a8ea0b8574aca99e58db885c14398deb0feaf1a12490"}
Sep 10 21:24:35.387379 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:35.387337    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm" podStartSLOduration=1.387317483 podStartE2EDuration="1.387317483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:24:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:24:35.386639542 +0000 UTC m=+1602.960345928" watchObservedRunningTime="2026-09-10 21:24:35.387317483 +0000 UTC m=+1602.961023860"
Sep 10 21:24:36.381122 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:36.381088    2577 generic.go:356] "Generic (PLEG): container finished" podID="79fad4bf-0aef-4e30-b8a9-2105b9329ddf" containerID="42d5f11de427244a5962315c9821f53c9915f44e58815b8da0f514d235032403" exitCode=0
Sep 10 21:24:36.381518 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:36.381170    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm" event={"ID":"79fad4bf-0aef-4e30-b8a9-2105b9329ddf","Type":"ContainerDied","Data":"42d5f11de427244a5962315c9821f53c9915f44e58815b8da0f514d235032403"}
Sep 10 21:24:37.519604 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:37.519574    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm"
Sep 10 21:24:37.667843 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:37.667741    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79fad4bf-0aef-4e30-b8a9-2105b9329ddf-maas-api-service-ca\") pod \"79fad4bf-0aef-4e30-b8a9-2105b9329ddf\" (UID: \"79fad4bf-0aef-4e30-b8a9-2105b9329ddf\") "
Sep 10 21:24:37.668104 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:37.668082    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79fad4bf-0aef-4e30-b8a9-2105b9329ddf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "79fad4bf-0aef-4e30-b8a9-2105b9329ddf" (UID: "79fad4bf-0aef-4e30-b8a9-2105b9329ddf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:24:37.769324 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:37.769292    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79fad4bf-0aef-4e30-b8a9-2105b9329ddf-maas-api-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:24:38.393549 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:38.393515    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm" event={"ID":"79fad4bf-0aef-4e30-b8a9-2105b9329ddf","Type":"ContainerDied","Data":"49bdb6bda636a3187811a8ea0b8574aca99e58db885c14398deb0feaf1a12490"}
Sep 10 21:24:38.393696 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:38.393564    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49bdb6bda636a3187811a8ea0b8574aca99e58db885c14398deb0feaf1a12490"
Sep 10 21:24:38.393696 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:38.393529    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm"
Sep 10 21:24:40.504000 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.503965    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"]
Sep 10 21:24:40.504490 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.504203    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8" podUID="68ad89e9-d74e-4b41-9775-dde593184c0e" containerName="payload-processing" containerID="cri-o://fe3387046a148290d3927f5d8251da63508999c56e4009e8e84ab9346e020386" gracePeriod=30
Sep 10 21:24:40.511007 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.510984    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"]
Sep 10 21:24:40.511289 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.511260    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd" podUID="716c67ea-da56-4cda-bc4d-23d6099146ff" containerName="payload-pre-processing" containerID="cri-o://0b0069638a698309123c39c7bef1e0d495b9ec2d2dc70bfe97650600a7c457d9" gracePeriod=30
Sep 10 21:24:40.661465 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.661431    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm"]
Sep 10 21:24:40.664643 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.664616    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-361296-sd7vm"]
Sep 10 21:24:40.785386 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.785363    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"
Sep 10 21:24:40.788395 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.788375    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"
Sep 10 21:24:40.895186 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.895154    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq84p\" (UniqueName: \"kubernetes.io/projected/716c67ea-da56-4cda-bc4d-23d6099146ff-kube-api-access-mq84p\") pod \"716c67ea-da56-4cda-bc4d-23d6099146ff\" (UID: \"716c67ea-da56-4cda-bc4d-23d6099146ff\") "
Sep 10 21:24:40.895362 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.895199    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm48c\" (UniqueName: \"kubernetes.io/projected/68ad89e9-d74e-4b41-9775-dde593184c0e-kube-api-access-pm48c\") pod \"68ad89e9-d74e-4b41-9775-dde593184c0e\" (UID: \"68ad89e9-d74e-4b41-9775-dde593184c0e\") "
Sep 10 21:24:40.895362 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.895228    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68ad89e9-d74e-4b41-9775-dde593184c0e-plugins-config-volume\") pod \"68ad89e9-d74e-4b41-9775-dde593184c0e\" (UID: \"68ad89e9-d74e-4b41-9775-dde593184c0e\") "
Sep 10 21:24:40.895362 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.895288    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/716c67ea-da56-4cda-bc4d-23d6099146ff-plugins-config-volume\") pod \"716c67ea-da56-4cda-bc4d-23d6099146ff\" (UID: \"716c67ea-da56-4cda-bc4d-23d6099146ff\") "
Sep 10 21:24:40.895654 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.895626    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68ad89e9-d74e-4b41-9775-dde593184c0e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "68ad89e9-d74e-4b41-9775-dde593184c0e" (UID: "68ad89e9-d74e-4b41-9775-dde593184c0e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:24:40.895731 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.895672    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716c67ea-da56-4cda-bc4d-23d6099146ff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "716c67ea-da56-4cda-bc4d-23d6099146ff" (UID: "716c67ea-da56-4cda-bc4d-23d6099146ff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:24:40.897298 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.897280    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716c67ea-da56-4cda-bc4d-23d6099146ff-kube-api-access-mq84p" (OuterVolumeSpecName: "kube-api-access-mq84p") pod "716c67ea-da56-4cda-bc4d-23d6099146ff" (UID: "716c67ea-da56-4cda-bc4d-23d6099146ff"). InnerVolumeSpecName "kube-api-access-mq84p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:24:40.897356 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.897320    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68ad89e9-d74e-4b41-9775-dde593184c0e-kube-api-access-pm48c" (OuterVolumeSpecName: "kube-api-access-pm48c") pod "68ad89e9-d74e-4b41-9775-dde593184c0e" (UID: "68ad89e9-d74e-4b41-9775-dde593184c0e"). InnerVolumeSpecName "kube-api-access-pm48c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:24:40.946959 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.946929    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79fad4bf-0aef-4e30-b8a9-2105b9329ddf" path="/var/lib/kubelet/pods/79fad4bf-0aef-4e30-b8a9-2105b9329ddf/volumes"
Sep 10 21:24:40.996516 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.996489    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm48c\" (UniqueName: \"kubernetes.io/projected/68ad89e9-d74e-4b41-9775-dde593184c0e-kube-api-access-pm48c\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:24:40.996516 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.996515    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68ad89e9-d74e-4b41-9775-dde593184c0e-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:24:40.996639 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.996526    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/716c67ea-da56-4cda-bc4d-23d6099146ff-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:24:40.996639 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:40.996536    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq84p\" (UniqueName: \"kubernetes.io/projected/716c67ea-da56-4cda-bc4d-23d6099146ff-kube-api-access-mq84p\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:24:41.411933 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.411899    2577 generic.go:356] "Generic (PLEG): container finished" podID="68ad89e9-d74e-4b41-9775-dde593184c0e" containerID="fe3387046a148290d3927f5d8251da63508999c56e4009e8e84ab9346e020386" exitCode=0
Sep 10 21:24:41.412140 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.411939    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"
Sep 10 21:24:41.412140 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.411974    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8" event={"ID":"68ad89e9-d74e-4b41-9775-dde593184c0e","Type":"ContainerDied","Data":"fe3387046a148290d3927f5d8251da63508999c56e4009e8e84ab9346e020386"}
Sep 10 21:24:41.412140 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.412056    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8" event={"ID":"68ad89e9-d74e-4b41-9775-dde593184c0e","Type":"ContainerDied","Data":"395d4433d6026c6b7b9810d126ec2f2320a6de85755396ec7f55e858ac8b531b"}
Sep 10 21:24:41.412140 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.412092    2577 scope.go:117] "RemoveContainer" containerID="fe3387046a148290d3927f5d8251da63508999c56e4009e8e84ab9346e020386"
Sep 10 21:24:41.413379 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.413331    2577 generic.go:356] "Generic (PLEG): container finished" podID="716c67ea-da56-4cda-bc4d-23d6099146ff" containerID="0b0069638a698309123c39c7bef1e0d495b9ec2d2dc70bfe97650600a7c457d9" exitCode=0
Sep 10 21:24:41.413379 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.413368    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd" event={"ID":"716c67ea-da56-4cda-bc4d-23d6099146ff","Type":"ContainerDied","Data":"0b0069638a698309123c39c7bef1e0d495b9ec2d2dc70bfe97650600a7c457d9"}
Sep 10 21:24:41.413509 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.413377    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"
Sep 10 21:24:41.413509 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.413400    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd" event={"ID":"716c67ea-da56-4cda-bc4d-23d6099146ff","Type":"ContainerDied","Data":"9ec78f96ed7b4c7c2d319eb3b6a771cc9cf3b39781b472a9172f870d137e5080"}
Sep 10 21:24:41.421361 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.421346    2577 scope.go:117] "RemoveContainer" containerID="fe3387046a148290d3927f5d8251da63508999c56e4009e8e84ab9346e020386"
Sep 10 21:24:41.421617 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:24:41.421598    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe3387046a148290d3927f5d8251da63508999c56e4009e8e84ab9346e020386\": container with ID starting with fe3387046a148290d3927f5d8251da63508999c56e4009e8e84ab9346e020386 not found: ID does not exist" containerID="fe3387046a148290d3927f5d8251da63508999c56e4009e8e84ab9346e020386"
Sep 10 21:24:41.421689 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.421624    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe3387046a148290d3927f5d8251da63508999c56e4009e8e84ab9346e020386"} err="failed to get container status \"fe3387046a148290d3927f5d8251da63508999c56e4009e8e84ab9346e020386\": rpc error: code = NotFound desc = could not find container \"fe3387046a148290d3927f5d8251da63508999c56e4009e8e84ab9346e020386\": container with ID starting with fe3387046a148290d3927f5d8251da63508999c56e4009e8e84ab9346e020386 not found: ID does not exist"
Sep 10 21:24:41.421689 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.421640    2577 scope.go:117] "RemoveContainer" containerID="0b0069638a698309123c39c7bef1e0d495b9ec2d2dc70bfe97650600a7c457d9"
Sep 10 21:24:41.429785 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.429764    2577 scope.go:117] "RemoveContainer" containerID="0b0069638a698309123c39c7bef1e0d495b9ec2d2dc70bfe97650600a7c457d9"
Sep 10 21:24:41.431321 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:24:41.430357    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b0069638a698309123c39c7bef1e0d495b9ec2d2dc70bfe97650600a7c457d9\": container with ID starting with 0b0069638a698309123c39c7bef1e0d495b9ec2d2dc70bfe97650600a7c457d9 not found: ID does not exist" containerID="0b0069638a698309123c39c7bef1e0d495b9ec2d2dc70bfe97650600a7c457d9"
Sep 10 21:24:41.431321 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.430400    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0069638a698309123c39c7bef1e0d495b9ec2d2dc70bfe97650600a7c457d9"} err="failed to get container status \"0b0069638a698309123c39c7bef1e0d495b9ec2d2dc70bfe97650600a7c457d9\": rpc error: code = NotFound desc = could not find container \"0b0069638a698309123c39c7bef1e0d495b9ec2d2dc70bfe97650600a7c457d9\": container with ID starting with 0b0069638a698309123c39c7bef1e0d495b9ec2d2dc70bfe97650600a7c457d9 not found: ID does not exist"
Sep 10 21:24:41.435413 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.435374    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"]
Sep 10 21:24:41.438264 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.437462    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd"]
Sep 10 21:24:41.444851 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.444832    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"]
Sep 10 21:24:41.448646 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:41.448625    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8"]
Sep 10 21:24:42.946932 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:42.946899    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68ad89e9-d74e-4b41-9775-dde593184c0e" path="/var/lib/kubelet/pods/68ad89e9-d74e-4b41-9775-dde593184c0e/volumes"
Sep 10 21:24:42.947300 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:42.947259    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="716c67ea-da56-4cda-bc4d-23d6099146ff" path="/var/lib/kubelet/pods/716c67ea-da56-4cda-bc4d-23d6099146ff/volumes"
Sep 10 21:24:45.058609 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:45.058555    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:24:50.337709 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.337676    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw"]
Sep 10 21:24:50.338145 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.338129    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716c67ea-da56-4cda-bc4d-23d6099146ff" containerName="payload-pre-processing"
Sep 10 21:24:50.338210 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.338146    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="716c67ea-da56-4cda-bc4d-23d6099146ff" containerName="payload-pre-processing"
Sep 10 21:24:50.338210 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.338167    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ad89e9-d74e-4b41-9775-dde593184c0e" containerName="payload-processing"
Sep 10 21:24:50.338210 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.338173    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ad89e9-d74e-4b41-9775-dde593184c0e" containerName="payload-processing"
Sep 10 21:24:50.338210 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.338182    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79fad4bf-0aef-4e30-b8a9-2105b9329ddf" containerName="revoke-keys"
Sep 10 21:24:50.338210 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.338188    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="79fad4bf-0aef-4e30-b8a9-2105b9329ddf" containerName="revoke-keys"
Sep 10 21:24:50.338376 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.338250    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="79fad4bf-0aef-4e30-b8a9-2105b9329ddf" containerName="revoke-keys"
Sep 10 21:24:50.338376 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.338263    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="716c67ea-da56-4cda-bc4d-23d6099146ff" containerName="payload-pre-processing"
Sep 10 21:24:50.338376 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.338269    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="68ad89e9-d74e-4b41-9775-dde593184c0e" containerName="payload-processing"
Sep 10 21:24:50.342864 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.342848    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw"
Sep 10 21:24:50.345345 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.345325    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:24:50.346226 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.346209    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:24:50.349647 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.349628    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw"]
Sep 10 21:24:50.480682 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.480654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c0085f3-fa84-4275-97c2-dc81aa662e0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw\" (UID: \"5c0085f3-fa84-4275-97c2-dc81aa662e0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw"
Sep 10 21:24:50.581716 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.581671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c0085f3-fa84-4275-97c2-dc81aa662e0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw\" (UID: \"5c0085f3-fa84-4275-97c2-dc81aa662e0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw"
Sep 10 21:24:50.582327 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.582308    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c0085f3-fa84-4275-97c2-dc81aa662e0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw\" (UID: \"5c0085f3-fa84-4275-97c2-dc81aa662e0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw"
Sep 10 21:24:50.654745 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.654676    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw"
Sep 10 21:24:50.923751 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:50.923729    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw"]
Sep 10 21:24:50.925456 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:24:50.925433    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c0085f3_fa84_4275_97c2_dc81aa662e0b.slice/crio-925b2ff40eb339daf6368e144820442414b46f6f5f6de16aa20313c1afcdc548 WatchSource:0}: Error finding container 925b2ff40eb339daf6368e144820442414b46f6f5f6de16aa20313c1afcdc548: Status 404 returned error can't find the container with id 925b2ff40eb339daf6368e144820442414b46f6f5f6de16aa20313c1afcdc548
Sep 10 21:24:51.474302 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:51.474209    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw" event={"ID":"5c0085f3-fa84-4275-97c2-dc81aa662e0b","Type":"ContainerStarted","Data":"e3b8e888430d7c3bec583a8bc6d37c9727c1afebedde4eda381a27f5915f7380"}
Sep 10 21:24:51.474302 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:51.474267    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw" event={"ID":"5c0085f3-fa84-4275-97c2-dc81aa662e0b","Type":"ContainerStarted","Data":"925b2ff40eb339daf6368e144820442414b46f6f5f6de16aa20313c1afcdc548"}
Sep 10 21:24:51.487315 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:51.487248    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw" podStartSLOduration=1.4872304029999999 podStartE2EDuration="1.487230403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:24:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:24:51.487189199 +0000 UTC m=+1619.060895573" watchObservedRunningTime="2026-09-10 21:24:51.487230403 +0000 UTC m=+1619.060936820"
Sep 10 21:24:52.481813 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:52.481777    2577 generic.go:356] "Generic (PLEG): container finished" podID="5c0085f3-fa84-4275-97c2-dc81aa662e0b" containerID="e3b8e888430d7c3bec583a8bc6d37c9727c1afebedde4eda381a27f5915f7380" exitCode=0
Sep 10 21:24:52.482213 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:52.481862    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw" event={"ID":"5c0085f3-fa84-4275-97c2-dc81aa662e0b","Type":"ContainerDied","Data":"e3b8e888430d7c3bec583a8bc6d37c9727c1afebedde4eda381a27f5915f7380"}
Sep 10 21:24:53.624591 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:53.624564    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw"
Sep 10 21:24:53.709168 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:53.709132    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c0085f3-fa84-4275-97c2-dc81aa662e0b-maas-api-service-ca\") pod \"5c0085f3-fa84-4275-97c2-dc81aa662e0b\" (UID: \"5c0085f3-fa84-4275-97c2-dc81aa662e0b\") "
Sep 10 21:24:53.709505 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:53.709485    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c0085f3-fa84-4275-97c2-dc81aa662e0b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5c0085f3-fa84-4275-97c2-dc81aa662e0b" (UID: "5c0085f3-fa84-4275-97c2-dc81aa662e0b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:24:53.810008 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:53.809982    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c0085f3-fa84-4275-97c2-dc81aa662e0b-maas-api-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:24:54.495152 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:54.495124    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw"
Sep 10 21:24:54.495152 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:54.495132    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw" event={"ID":"5c0085f3-fa84-4275-97c2-dc81aa662e0b","Type":"ContainerDied","Data":"925b2ff40eb339daf6368e144820442414b46f6f5f6de16aa20313c1afcdc548"}
Sep 10 21:24:54.495370 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:24:54.495183    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="925b2ff40eb339daf6368e144820442414b46f6f5f6de16aa20313c1afcdc548"
Sep 10 21:25:03.757700 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:03.757665    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:25:05.916399 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:05.916362    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"]
Sep 10 21:25:05.916798 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:05.916616    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd" podUID="89b396a3-6fbc-48be-83d4-df9e812aea4c" containerName="payload-processing" containerID="cri-o://be7ddf9a8131a6fce2f74d3ca393e57df4fa0ccca12239593e66f034eca0c3e7" gracePeriod=30
Sep 10 21:25:05.923001 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:05.922970    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"]
Sep 10 21:25:05.923436 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:05.923382    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r" podUID="4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae" containerName="payload-pre-processing" containerID="cri-o://a658cde1d67497f5536e4d3f23ba5489b433f4ab0b9e5346cefbd64026032714" gracePeriod=30
Sep 10 21:25:06.075919 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.075884    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw"]
Sep 10 21:25:06.079167 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.079136    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3dfe0c-55fqw"]
Sep 10 21:25:06.202577 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.202549    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"
Sep 10 21:25:06.205340 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.205324    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"
Sep 10 21:25:06.213986 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.213968    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22qmn\" (UniqueName: \"kubernetes.io/projected/4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae-kube-api-access-22qmn\") pod \"4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae\" (UID: \"4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae\") "
Sep 10 21:25:06.214077 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.214000    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae-plugins-config-volume\") pod \"4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae\" (UID: \"4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae\") "
Sep 10 21:25:06.214077 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.214064    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7rbb\" (UniqueName: \"kubernetes.io/projected/89b396a3-6fbc-48be-83d4-df9e812aea4c-kube-api-access-b7rbb\") pod \"89b396a3-6fbc-48be-83d4-df9e812aea4c\" (UID: \"89b396a3-6fbc-48be-83d4-df9e812aea4c\") "
Sep 10 21:25:06.214213 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.214191    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89b396a3-6fbc-48be-83d4-df9e812aea4c-plugins-config-volume\") pod \"89b396a3-6fbc-48be-83d4-df9e812aea4c\" (UID: \"89b396a3-6fbc-48be-83d4-df9e812aea4c\") "
Sep 10 21:25:06.214477 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.214385    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae" (UID: "4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:25:06.214560 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.214531    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89b396a3-6fbc-48be-83d4-df9e812aea4c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "89b396a3-6fbc-48be-83d4-df9e812aea4c" (UID: "89b396a3-6fbc-48be-83d4-df9e812aea4c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:25:06.216165 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.216138    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae-kube-api-access-22qmn" (OuterVolumeSpecName: "kube-api-access-22qmn") pod "4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae" (UID: "4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae"). InnerVolumeSpecName "kube-api-access-22qmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:25:06.216165 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.216152    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89b396a3-6fbc-48be-83d4-df9e812aea4c-kube-api-access-b7rbb" (OuterVolumeSpecName: "kube-api-access-b7rbb") pod "89b396a3-6fbc-48be-83d4-df9e812aea4c" (UID: "89b396a3-6fbc-48be-83d4-df9e812aea4c"). InnerVolumeSpecName "kube-api-access-b7rbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:25:06.315699 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.315659    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7rbb\" (UniqueName: \"kubernetes.io/projected/89b396a3-6fbc-48be-83d4-df9e812aea4c-kube-api-access-b7rbb\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:25:06.315699 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.315695    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89b396a3-6fbc-48be-83d4-df9e812aea4c-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:25:06.315922 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.315710    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22qmn\" (UniqueName: \"kubernetes.io/projected/4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae-kube-api-access-22qmn\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:25:06.315922 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.315723    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:25:06.564291 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.564117    2577 generic.go:356] "Generic (PLEG): container finished" podID="4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae" containerID="a658cde1d67497f5536e4d3f23ba5489b433f4ab0b9e5346cefbd64026032714" exitCode=0
Sep 10 21:25:06.564291 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.564161    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"
Sep 10 21:25:06.564291 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.564203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r" event={"ID":"4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae","Type":"ContainerDied","Data":"a658cde1d67497f5536e4d3f23ba5489b433f4ab0b9e5346cefbd64026032714"}
Sep 10 21:25:06.564291 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.564261    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r" event={"ID":"4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae","Type":"ContainerDied","Data":"266eee609620dbfb4db749b458ee9b249e46c68f5bb975f12bfaf9609339887d"}
Sep 10 21:25:06.564291 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.564285    2577 scope.go:117] "RemoveContainer" containerID="a658cde1d67497f5536e4d3f23ba5489b433f4ab0b9e5346cefbd64026032714"
Sep 10 21:25:06.565897 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.565874    2577 generic.go:356] "Generic (PLEG): container finished" podID="89b396a3-6fbc-48be-83d4-df9e812aea4c" containerID="be7ddf9a8131a6fce2f74d3ca393e57df4fa0ccca12239593e66f034eca0c3e7" exitCode=0
Sep 10 21:25:06.565982 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.565901    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"
Sep 10 21:25:06.565982 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.565956    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd" event={"ID":"89b396a3-6fbc-48be-83d4-df9e812aea4c","Type":"ContainerDied","Data":"be7ddf9a8131a6fce2f74d3ca393e57df4fa0ccca12239593e66f034eca0c3e7"}
Sep 10 21:25:06.566079 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.566012    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd" event={"ID":"89b396a3-6fbc-48be-83d4-df9e812aea4c","Type":"ContainerDied","Data":"dfbe9dea87e60f6b23527f0d321511f2a39c94f5a85c73a027c2746c59137bbb"}
Sep 10 21:25:06.574209 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.574192    2577 scope.go:117] "RemoveContainer" containerID="a658cde1d67497f5536e4d3f23ba5489b433f4ab0b9e5346cefbd64026032714"
Sep 10 21:25:06.574502 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:25:06.574485    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a658cde1d67497f5536e4d3f23ba5489b433f4ab0b9e5346cefbd64026032714\": container with ID starting with a658cde1d67497f5536e4d3f23ba5489b433f4ab0b9e5346cefbd64026032714 not found: ID does not exist" containerID="a658cde1d67497f5536e4d3f23ba5489b433f4ab0b9e5346cefbd64026032714"
Sep 10 21:25:06.574567 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.574509    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a658cde1d67497f5536e4d3f23ba5489b433f4ab0b9e5346cefbd64026032714"} err="failed to get container status \"a658cde1d67497f5536e4d3f23ba5489b433f4ab0b9e5346cefbd64026032714\": rpc error: code = NotFound desc = could not find container \"a658cde1d67497f5536e4d3f23ba5489b433f4ab0b9e5346cefbd64026032714\": container with ID starting with a658cde1d67497f5536e4d3f23ba5489b433f4ab0b9e5346cefbd64026032714 not found: ID does not exist"
Sep 10 21:25:06.574567 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.574524    2577 scope.go:117] "RemoveContainer" containerID="be7ddf9a8131a6fce2f74d3ca393e57df4fa0ccca12239593e66f034eca0c3e7"
Sep 10 21:25:06.582546 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.582522    2577 scope.go:117] "RemoveContainer" containerID="be7ddf9a8131a6fce2f74d3ca393e57df4fa0ccca12239593e66f034eca0c3e7"
Sep 10 21:25:06.582806 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:25:06.582788    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be7ddf9a8131a6fce2f74d3ca393e57df4fa0ccca12239593e66f034eca0c3e7\": container with ID starting with be7ddf9a8131a6fce2f74d3ca393e57df4fa0ccca12239593e66f034eca0c3e7 not found: ID does not exist" containerID="be7ddf9a8131a6fce2f74d3ca393e57df4fa0ccca12239593e66f034eca0c3e7"
Sep 10 21:25:06.582882 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.582810    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be7ddf9a8131a6fce2f74d3ca393e57df4fa0ccca12239593e66f034eca0c3e7"} err="failed to get container status \"be7ddf9a8131a6fce2f74d3ca393e57df4fa0ccca12239593e66f034eca0c3e7\": rpc error: code = NotFound desc = could not find container \"be7ddf9a8131a6fce2f74d3ca393e57df4fa0ccca12239593e66f034eca0c3e7\": container with ID starting with be7ddf9a8131a6fce2f74d3ca393e57df4fa0ccca12239593e66f034eca0c3e7 not found: ID does not exist"
Sep 10 21:25:06.588841 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.588808    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"]
Sep 10 21:25:06.592334 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.592313    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r"]
Sep 10 21:25:06.602258 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.602234    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"]
Sep 10 21:25:06.604322 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.604303    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd"]
Sep 10 21:25:06.947259 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.947232    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae" path="/var/lib/kubelet/pods/4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae/volumes"
Sep 10 21:25:06.947561 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.947553    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c0085f3-fa84-4275-97c2-dc81aa662e0b" path="/var/lib/kubelet/pods/5c0085f3-fa84-4275-97c2-dc81aa662e0b/volumes"
Sep 10 21:25:06.947876 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:06.947863    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89b396a3-6fbc-48be-83d4-df9e812aea4c" path="/var/lib/kubelet/pods/89b396a3-6fbc-48be-83d4-df9e812aea4c/volumes"
Sep 10 21:25:12.560224 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:12.560188    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:25:54.700226 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.700195    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx"]
Sep 10 21:25:54.700624 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.700581    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c0085f3-fa84-4275-97c2-dc81aa662e0b" containerName="revoke-keys"
Sep 10 21:25:54.700624 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.700592    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c0085f3-fa84-4275-97c2-dc81aa662e0b" containerName="revoke-keys"
Sep 10 21:25:54.700624 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.700608    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b396a3-6fbc-48be-83d4-df9e812aea4c" containerName="payload-processing"
Sep 10 21:25:54.700624 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.700614    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b396a3-6fbc-48be-83d4-df9e812aea4c" containerName="payload-processing"
Sep 10 21:25:54.700754 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.700631    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae" containerName="payload-pre-processing"
Sep 10 21:25:54.700754 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.700638    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae" containerName="payload-pre-processing"
Sep 10 21:25:54.700754 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.700697    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="89b396a3-6fbc-48be-83d4-df9e812aea4c" containerName="payload-processing"
Sep 10 21:25:54.700754 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.700705    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c0085f3-fa84-4275-97c2-dc81aa662e0b" containerName="revoke-keys"
Sep 10 21:25:54.700754 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.700715    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bfa1f64-229c-4d4d-9d0e-90c58fcaa2ae" containerName="payload-pre-processing"
Sep 10 21:25:54.703564 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.703547    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx"
Sep 10 21:25:54.705721 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.705691    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:25:54.705721 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.705700    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:25:54.711618 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.711338    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx"]
Sep 10 21:25:54.753635 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.753590    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/632fcd65-676e-48ea-8ec8-4ad0fd677583-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx\" (UID: \"632fcd65-676e-48ea-8ec8-4ad0fd677583\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx"
Sep 10 21:25:54.854258 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.854222    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/632fcd65-676e-48ea-8ec8-4ad0fd677583-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx\" (UID: \"632fcd65-676e-48ea-8ec8-4ad0fd677583\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx"
Sep 10 21:25:54.854833 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:54.854808    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/632fcd65-676e-48ea-8ec8-4ad0fd677583-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx\" (UID: \"632fcd65-676e-48ea-8ec8-4ad0fd677583\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx"
Sep 10 21:25:55.015698 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:55.015620    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx"
Sep 10 21:25:55.282760 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:55.282734    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx"]
Sep 10 21:25:55.283826 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:25:55.283799    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod632fcd65_676e_48ea_8ec8_4ad0fd677583.slice/crio-c349af3a81967536a13ec5b8687cc13085f35e70c38e7049813f6f0a81284e8c WatchSource:0}: Error finding container c349af3a81967536a13ec5b8687cc13085f35e70c38e7049813f6f0a81284e8c: Status 404 returned error can't find the container with id c349af3a81967536a13ec5b8687cc13085f35e70c38e7049813f6f0a81284e8c
Sep 10 21:25:55.859306 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:55.859267    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx" event={"ID":"632fcd65-676e-48ea-8ec8-4ad0fd677583","Type":"ContainerStarted","Data":"15d092f3e4e3b8159b6af57acee37e5c1f124c131866fba917d04ee3eb780a8d"}
Sep 10 21:25:55.859684 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:55.859325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx" event={"ID":"632fcd65-676e-48ea-8ec8-4ad0fd677583","Type":"ContainerStarted","Data":"c349af3a81967536a13ec5b8687cc13085f35e70c38e7049813f6f0a81284e8c"}
Sep 10 21:25:55.874853 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:55.874759    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx" podStartSLOduration=1.874744381 podStartE2EDuration="1.874744381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:25:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:25:55.873630911 +0000 UTC m=+1683.447337286" watchObservedRunningTime="2026-09-10 21:25:55.874744381 +0000 UTC m=+1683.448450753"
Sep 10 21:25:56.867169 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:56.867131    2577 generic.go:356] "Generic (PLEG): container finished" podID="632fcd65-676e-48ea-8ec8-4ad0fd677583" containerID="15d092f3e4e3b8159b6af57acee37e5c1f124c131866fba917d04ee3eb780a8d" exitCode=0
Sep 10 21:25:56.867646 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:56.867175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx" event={"ID":"632fcd65-676e-48ea-8ec8-4ad0fd677583","Type":"ContainerDied","Data":"15d092f3e4e3b8159b6af57acee37e5c1f124c131866fba917d04ee3eb780a8d"}
Sep 10 21:25:58.001834 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:58.001810    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx"
Sep 10 21:25:58.177732 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:58.177640    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/632fcd65-676e-48ea-8ec8-4ad0fd677583-maas-api-service-ca\") pod \"632fcd65-676e-48ea-8ec8-4ad0fd677583\" (UID: \"632fcd65-676e-48ea-8ec8-4ad0fd677583\") "
Sep 10 21:25:58.177973 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:58.177950    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/632fcd65-676e-48ea-8ec8-4ad0fd677583-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "632fcd65-676e-48ea-8ec8-4ad0fd677583" (UID: "632fcd65-676e-48ea-8ec8-4ad0fd677583"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:25:58.278350 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:58.278309    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/632fcd65-676e-48ea-8ec8-4ad0fd677583-maas-api-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:25:58.879120 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:58.879088    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx"
Sep 10 21:25:58.879285 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:58.879126    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx" event={"ID":"632fcd65-676e-48ea-8ec8-4ad0fd677583","Type":"ContainerDied","Data":"c349af3a81967536a13ec5b8687cc13085f35e70c38e7049813f6f0a81284e8c"}
Sep 10 21:25:58.879285 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:25:58.879171    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c349af3a81967536a13ec5b8687cc13085f35e70c38e7049813f6f0a81284e8c"
Sep 10 21:26:05.298917 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.298878    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"]
Sep 10 21:26:05.299388 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.299201    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp" podUID="0f6063b2-dfec-4902-b2e1-36cad159dc05" containerName="payload-processing" containerID="cri-o://e622987a21c86b32698d7ad1aa800166deac5a4fc2c3edb5855600f2964d23e6" gracePeriod=30
Sep 10 21:26:05.308754 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.308723    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"]
Sep 10 21:26:05.309074 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.309010    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z" podUID="f6aa9ec8-c159-400e-93d3-4447e05a5abf" containerName="payload-pre-processing" containerID="cri-o://382c7e602bcc84af87acdd6e7166df057cacf602807e1bb46683ec5b5d5eeaf6" gracePeriod=30
Sep 10 21:26:05.456526 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.456462    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx"]
Sep 10 21:26:05.459701 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.459675    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-636944-tlzdx"]
Sep 10 21:26:05.585216 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.585188    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"
Sep 10 21:26:05.588134 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.588114    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"
Sep 10 21:26:05.640363 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.639488    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2sn6\" (UniqueName: \"kubernetes.io/projected/f6aa9ec8-c159-400e-93d3-4447e05a5abf-kube-api-access-j2sn6\") pod \"f6aa9ec8-c159-400e-93d3-4447e05a5abf\" (UID: \"f6aa9ec8-c159-400e-93d3-4447e05a5abf\") "
Sep 10 21:26:05.640363 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.639539    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6aa9ec8-c159-400e-93d3-4447e05a5abf-plugins-config-volume\") pod \"f6aa9ec8-c159-400e-93d3-4447e05a5abf\" (UID: \"f6aa9ec8-c159-400e-93d3-4447e05a5abf\") "
Sep 10 21:26:05.640363 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.639593    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f6063b2-dfec-4902-b2e1-36cad159dc05-plugins-config-volume\") pod \"0f6063b2-dfec-4902-b2e1-36cad159dc05\" (UID: \"0f6063b2-dfec-4902-b2e1-36cad159dc05\") "
Sep 10 21:26:05.640363 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.639636    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rzt7\" (UniqueName: \"kubernetes.io/projected/0f6063b2-dfec-4902-b2e1-36cad159dc05-kube-api-access-6rzt7\") pod \"0f6063b2-dfec-4902-b2e1-36cad159dc05\" (UID: \"0f6063b2-dfec-4902-b2e1-36cad159dc05\") "
Sep 10 21:26:05.640711 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.640409    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f6063b2-dfec-4902-b2e1-36cad159dc05-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0f6063b2-dfec-4902-b2e1-36cad159dc05" (UID: "0f6063b2-dfec-4902-b2e1-36cad159dc05"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:05.640771 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.640701    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6aa9ec8-c159-400e-93d3-4447e05a5abf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f6aa9ec8-c159-400e-93d3-4447e05a5abf" (UID: "f6aa9ec8-c159-400e-93d3-4447e05a5abf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:05.646178 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.645882    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f6063b2-dfec-4902-b2e1-36cad159dc05-kube-api-access-6rzt7" (OuterVolumeSpecName: "kube-api-access-6rzt7") pod "0f6063b2-dfec-4902-b2e1-36cad159dc05" (UID: "0f6063b2-dfec-4902-b2e1-36cad159dc05"). InnerVolumeSpecName "kube-api-access-6rzt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:05.646178 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.646090    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6aa9ec8-c159-400e-93d3-4447e05a5abf-kube-api-access-j2sn6" (OuterVolumeSpecName: "kube-api-access-j2sn6") pod "f6aa9ec8-c159-400e-93d3-4447e05a5abf" (UID: "f6aa9ec8-c159-400e-93d3-4447e05a5abf"). InnerVolumeSpecName "kube-api-access-j2sn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:05.740708 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.740679    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6aa9ec8-c159-400e-93d3-4447e05a5abf-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:05.740708 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.740705    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f6063b2-dfec-4902-b2e1-36cad159dc05-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:05.740708 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.740714    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rzt7\" (UniqueName: \"kubernetes.io/projected/0f6063b2-dfec-4902-b2e1-36cad159dc05-kube-api-access-6rzt7\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:05.740931 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.740724    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2sn6\" (UniqueName: \"kubernetes.io/projected/f6aa9ec8-c159-400e-93d3-4447e05a5abf-kube-api-access-j2sn6\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:05.922651 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.922614    2577 generic.go:356] "Generic (PLEG): container finished" podID="f6aa9ec8-c159-400e-93d3-4447e05a5abf" containerID="382c7e602bcc84af87acdd6e7166df057cacf602807e1bb46683ec5b5d5eeaf6" exitCode=0
Sep 10 21:26:05.922842 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.922662    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"
Sep 10 21:26:05.922842 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.922708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z" event={"ID":"f6aa9ec8-c159-400e-93d3-4447e05a5abf","Type":"ContainerDied","Data":"382c7e602bcc84af87acdd6e7166df057cacf602807e1bb46683ec5b5d5eeaf6"}
Sep 10 21:26:05.922842 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.922758    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z" event={"ID":"f6aa9ec8-c159-400e-93d3-4447e05a5abf","Type":"ContainerDied","Data":"e0c77a66b3e8e5b44ac91852141da4907df81f5d4baa1bf8013f7ae6a7f90d0d"}
Sep 10 21:26:05.922842 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.922787    2577 scope.go:117] "RemoveContainer" containerID="382c7e602bcc84af87acdd6e7166df057cacf602807e1bb46683ec5b5d5eeaf6"
Sep 10 21:26:05.924135 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.924112    2577 generic.go:356] "Generic (PLEG): container finished" podID="0f6063b2-dfec-4902-b2e1-36cad159dc05" containerID="e622987a21c86b32698d7ad1aa800166deac5a4fc2c3edb5855600f2964d23e6" exitCode=0
Sep 10 21:26:05.924228 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.924154    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"
Sep 10 21:26:05.924228 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.924204    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp" event={"ID":"0f6063b2-dfec-4902-b2e1-36cad159dc05","Type":"ContainerDied","Data":"e622987a21c86b32698d7ad1aa800166deac5a4fc2c3edb5855600f2964d23e6"}
Sep 10 21:26:05.924307 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.924258    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp" event={"ID":"0f6063b2-dfec-4902-b2e1-36cad159dc05","Type":"ContainerDied","Data":"7d2fe5ab746b69f55d374ae67bcda4f30ce0d868ae69867422bacaf77b2c6f6f"}
Sep 10 21:26:05.933342 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.933320    2577 scope.go:117] "RemoveContainer" containerID="382c7e602bcc84af87acdd6e7166df057cacf602807e1bb46683ec5b5d5eeaf6"
Sep 10 21:26:05.933649 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:26:05.933627    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"382c7e602bcc84af87acdd6e7166df057cacf602807e1bb46683ec5b5d5eeaf6\": container with ID starting with 382c7e602bcc84af87acdd6e7166df057cacf602807e1bb46683ec5b5d5eeaf6 not found: ID does not exist" containerID="382c7e602bcc84af87acdd6e7166df057cacf602807e1bb46683ec5b5d5eeaf6"
Sep 10 21:26:05.933706 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.933662    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"382c7e602bcc84af87acdd6e7166df057cacf602807e1bb46683ec5b5d5eeaf6"} err="failed to get container status \"382c7e602bcc84af87acdd6e7166df057cacf602807e1bb46683ec5b5d5eeaf6\": rpc error: code = NotFound desc = could not find container \"382c7e602bcc84af87acdd6e7166df057cacf602807e1bb46683ec5b5d5eeaf6\": container with ID starting with 382c7e602bcc84af87acdd6e7166df057cacf602807e1bb46683ec5b5d5eeaf6 not found: ID does not exist"
Sep 10 21:26:05.933706 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.933683    2577 scope.go:117] "RemoveContainer" containerID="e622987a21c86b32698d7ad1aa800166deac5a4fc2c3edb5855600f2964d23e6"
Sep 10 21:26:05.941591 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.941573    2577 scope.go:117] "RemoveContainer" containerID="e622987a21c86b32698d7ad1aa800166deac5a4fc2c3edb5855600f2964d23e6"
Sep 10 21:26:05.941841 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:26:05.941823    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e622987a21c86b32698d7ad1aa800166deac5a4fc2c3edb5855600f2964d23e6\": container with ID starting with e622987a21c86b32698d7ad1aa800166deac5a4fc2c3edb5855600f2964d23e6 not found: ID does not exist" containerID="e622987a21c86b32698d7ad1aa800166deac5a4fc2c3edb5855600f2964d23e6"
Sep 10 21:26:05.941887 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.941847    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e622987a21c86b32698d7ad1aa800166deac5a4fc2c3edb5855600f2964d23e6"} err="failed to get container status \"e622987a21c86b32698d7ad1aa800166deac5a4fc2c3edb5855600f2964d23e6\": rpc error: code = NotFound desc = could not find container \"e622987a21c86b32698d7ad1aa800166deac5a4fc2c3edb5855600f2964d23e6\": container with ID starting with e622987a21c86b32698d7ad1aa800166deac5a4fc2c3edb5855600f2964d23e6 not found: ID does not exist"
Sep 10 21:26:05.947604 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.947583    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"]
Sep 10 21:26:05.951520 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.951499    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z"]
Sep 10 21:26:05.960555 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.960536    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"]
Sep 10 21:26:05.962497 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:05.962478    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp"]
Sep 10 21:26:06.946484 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:06.946451    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f6063b2-dfec-4902-b2e1-36cad159dc05" path="/var/lib/kubelet/pods/0f6063b2-dfec-4902-b2e1-36cad159dc05/volumes"
Sep 10 21:26:06.946842 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:06.946797    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="632fcd65-676e-48ea-8ec8-4ad0fd677583" path="/var/lib/kubelet/pods/632fcd65-676e-48ea-8ec8-4ad0fd677583/volumes"
Sep 10 21:26:06.947138 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:06.947123    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6aa9ec8-c159-400e-93d3-4447e05a5abf" path="/var/lib/kubelet/pods/f6aa9ec8-c159-400e-93d3-4447e05a5abf/volumes"
Sep 10 21:26:08.855656 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:08.855623    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:26:12.114999 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.114967    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t"]
Sep 10 21:26:12.115379 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.115360    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="632fcd65-676e-48ea-8ec8-4ad0fd677583" containerName="revoke-keys"
Sep 10 21:26:12.115379 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.115374    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="632fcd65-676e-48ea-8ec8-4ad0fd677583" containerName="revoke-keys"
Sep 10 21:26:12.115447 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.115387    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f6063b2-dfec-4902-b2e1-36cad159dc05" containerName="payload-processing"
Sep 10 21:26:12.115447 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.115393    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f6063b2-dfec-4902-b2e1-36cad159dc05" containerName="payload-processing"
Sep 10 21:26:12.115447 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.115404    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6aa9ec8-c159-400e-93d3-4447e05a5abf" containerName="payload-pre-processing"
Sep 10 21:26:12.115447 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.115410    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6aa9ec8-c159-400e-93d3-4447e05a5abf" containerName="payload-pre-processing"
Sep 10 21:26:12.115571 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.115472    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f6063b2-dfec-4902-b2e1-36cad159dc05" containerName="payload-processing"
Sep 10 21:26:12.115571 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.115481    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6aa9ec8-c159-400e-93d3-4447e05a5abf" containerName="payload-pre-processing"
Sep 10 21:26:12.115571 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.115490    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="632fcd65-676e-48ea-8ec8-4ad0fd677583" containerName="revoke-keys"
Sep 10 21:26:12.120153 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.120133    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t"
Sep 10 21:26:12.122723 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.122694    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:26:12.123119 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.123094    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:26:12.125891 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.125866    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t"]
Sep 10 21:26:12.196406 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.196369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68328cb1-25f0-4d43-9d69-5c98d4d538a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t\" (UID: \"68328cb1-25f0-4d43-9d69-5c98d4d538a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t"
Sep 10 21:26:12.297801 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.297768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68328cb1-25f0-4d43-9d69-5c98d4d538a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t\" (UID: \"68328cb1-25f0-4d43-9d69-5c98d4d538a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t"
Sep 10 21:26:12.298428 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.298411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68328cb1-25f0-4d43-9d69-5c98d4d538a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t\" (UID: \"68328cb1-25f0-4d43-9d69-5c98d4d538a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t"
Sep 10 21:26:12.432883 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.432800    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t"
Sep 10 21:26:12.705674 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.705647    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t"]
Sep 10 21:26:12.706764 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:26:12.706741    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68328cb1_25f0_4d43_9d69_5c98d4d538a7.slice/crio-7290d4ec4dae7ea7094bb69bc69eb04d36f85074b9755357ee555b7c2b22b4de WatchSource:0}: Error finding container 7290d4ec4dae7ea7094bb69bc69eb04d36f85074b9755357ee555b7c2b22b4de: Status 404 returned error can't find the container with id 7290d4ec4dae7ea7094bb69bc69eb04d36f85074b9755357ee555b7c2b22b4de
Sep 10 21:26:12.965820 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:12.965746    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t" event={"ID":"68328cb1-25f0-4d43-9d69-5c98d4d538a7","Type":"ContainerStarted","Data":"7290d4ec4dae7ea7094bb69bc69eb04d36f85074b9755357ee555b7c2b22b4de"}
Sep 10 21:26:13.972955 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:13.972918    2577 generic.go:356] "Generic (PLEG): container finished" podID="68328cb1-25f0-4d43-9d69-5c98d4d538a7" containerID="491bd5f9cd12f0ac11125dec219a30d019946e479961d2fea2fa0fb3ac7b4aaf" exitCode=0
Sep 10 21:26:13.973418 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:13.972995    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t" event={"ID":"68328cb1-25f0-4d43-9d69-5c98d4d538a7","Type":"ContainerDied","Data":"491bd5f9cd12f0ac11125dec219a30d019946e479961d2fea2fa0fb3ac7b4aaf"}
Sep 10 21:26:15.105455 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:15.105427    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t"
Sep 10 21:26:15.225567 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:15.225473    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68328cb1-25f0-4d43-9d69-5c98d4d538a7-maas-api-service-ca\") pod \"68328cb1-25f0-4d43-9d69-5c98d4d538a7\" (UID: \"68328cb1-25f0-4d43-9d69-5c98d4d538a7\") "
Sep 10 21:26:15.225854 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:15.225829    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68328cb1-25f0-4d43-9d69-5c98d4d538a7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "68328cb1-25f0-4d43-9d69-5c98d4d538a7" (UID: "68328cb1-25f0-4d43-9d69-5c98d4d538a7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:15.326168 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:15.326135    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68328cb1-25f0-4d43-9d69-5c98d4d538a7-maas-api-service-ca\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:15.984194 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:15.984161    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t"
Sep 10 21:26:15.984370 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:15.984161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t" event={"ID":"68328cb1-25f0-4d43-9d69-5c98d4d538a7","Type":"ContainerDied","Data":"7290d4ec4dae7ea7094bb69bc69eb04d36f85074b9755357ee555b7c2b22b4de"}
Sep 10 21:26:15.984370 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:15.984293    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7290d4ec4dae7ea7094bb69bc69eb04d36f85074b9755357ee555b7c2b22b4de"
Sep 10 21:26:22.776611 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:22.776572    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t"]
Sep 10 21:26:22.779199 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:22.779172    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8623b2-4758t"]
Sep 10 21:26:22.949692 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:22.949660    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68328cb1-25f0-4d43-9d69-5c98d4d538a7" path="/var/lib/kubelet/pods/68328cb1-25f0-4d43-9d69-5c98d4d538a7/volumes"
Sep 10 21:26:25.756610 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:25.756578    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:26:29.272309 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:29.272277    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"]
Sep 10 21:26:29.272736 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:29.272492    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy" containerID="cri-o://b00917ad21e7acafdf22f1072794d259490ab1aad49935a90baa2158e7dd1bfc" gracePeriod=30
Sep 10 21:26:34.066732 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.066700    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:26:34.067125 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.066754    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:26:34.518541 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.518515    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:26:34.601987 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.601950    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c58b90a8-c691-46f8-8e83-213113c5b167-istio-token\") pod \"c58b90a8-c691-46f8-8e83-213113c5b167\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") "
Sep 10 21:26:34.602211 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.602006    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c58b90a8-c691-46f8-8e83-213113c5b167-istiod-ca-cert\") pod \"c58b90a8-c691-46f8-8e83-213113c5b167\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") "
Sep 10 21:26:34.602211 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.602086    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-workload-socket\") pod \"c58b90a8-c691-46f8-8e83-213113c5b167\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") "
Sep 10 21:26:34.602211 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.602149    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-workload-certs\") pod \"c58b90a8-c691-46f8-8e83-213113c5b167\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") "
Sep 10 21:26:34.602211 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.602170    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-istio-envoy\") pod \"c58b90a8-c691-46f8-8e83-213113c5b167\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") "
Sep 10 21:26:34.602211 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.602200    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trqnn\" (UniqueName: \"kubernetes.io/projected/c58b90a8-c691-46f8-8e83-213113c5b167-kube-api-access-trqnn\") pod \"c58b90a8-c691-46f8-8e83-213113c5b167\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") "
Sep 10 21:26:34.602421 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.602226    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-credential-socket\") pod \"c58b90a8-c691-46f8-8e83-213113c5b167\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") "
Sep 10 21:26:34.602801 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.602765    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c58b90a8-c691-46f8-8e83-213113c5b167-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c58b90a8-c691-46f8-8e83-213113c5b167" (UID: "c58b90a8-c691-46f8-8e83-213113c5b167"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:34.602911 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.602792    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c58b90a8-c691-46f8-8e83-213113c5b167" (UID: "c58b90a8-c691-46f8-8e83-213113c5b167"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:34.602972 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.602908    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c58b90a8-c691-46f8-8e83-213113c5b167" (UID: "c58b90a8-c691-46f8-8e83-213113c5b167"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:34.602972 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.602942    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-istio-data\") pod \"c58b90a8-c691-46f8-8e83-213113c5b167\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") "
Sep 10 21:26:34.603127 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.603008    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c58b90a8-c691-46f8-8e83-213113c5b167-istio-podinfo\") pod \"c58b90a8-c691-46f8-8e83-213113c5b167\" (UID: \"c58b90a8-c691-46f8-8e83-213113c5b167\") "
Sep 10 21:26:34.603127 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.603057    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c58b90a8-c691-46f8-8e83-213113c5b167" (UID: "c58b90a8-c691-46f8-8e83-213113c5b167"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:34.603259 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.603226    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-istio-data" (OuterVolumeSpecName: "istio-data") pod "c58b90a8-c691-46f8-8e83-213113c5b167" (UID: "c58b90a8-c691-46f8-8e83-213113c5b167"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:34.605076 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.605003    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-workload-certs\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:34.610907 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.605218    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-credential-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:34.610907 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.605254    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-istio-data\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:34.610907 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.605270    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c58b90a8-c691-46f8-8e83-213113c5b167-istiod-ca-cert\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:34.610907 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.605284    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-workload-socket\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:34.611216 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.610998    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c58b90a8-c691-46f8-8e83-213113c5b167-istio-token" (OuterVolumeSpecName: "istio-token") pod "c58b90a8-c691-46f8-8e83-213113c5b167" (UID: "c58b90a8-c691-46f8-8e83-213113c5b167"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:34.611367 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.611311    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c58b90a8-c691-46f8-8e83-213113c5b167-kube-api-access-trqnn" (OuterVolumeSpecName: "kube-api-access-trqnn") pod "c58b90a8-c691-46f8-8e83-213113c5b167" (UID: "c58b90a8-c691-46f8-8e83-213113c5b167"). InnerVolumeSpecName "kube-api-access-trqnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:34.611367 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.611323    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c58b90a8-c691-46f8-8e83-213113c5b167" (UID: "c58b90a8-c691-46f8-8e83-213113c5b167"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:34.611599 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.611572    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c58b90a8-c691-46f8-8e83-213113c5b167-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c58b90a8-c691-46f8-8e83-213113c5b167" (UID: "c58b90a8-c691-46f8-8e83-213113c5b167"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:26:34.706293 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.706209    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c58b90a8-c691-46f8-8e83-213113c5b167-istio-envoy\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:34.706293 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.706238    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trqnn\" (UniqueName: \"kubernetes.io/projected/c58b90a8-c691-46f8-8e83-213113c5b167-kube-api-access-trqnn\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:34.706293 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.706248    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c58b90a8-c691-46f8-8e83-213113c5b167-istio-podinfo\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:34.706293 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:34.706257    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c58b90a8-c691-46f8-8e83-213113c5b167-istio-token\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:35.097248 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:35.097200    2577 generic.go:356] "Generic (PLEG): container finished" podID="c58b90a8-c691-46f8-8e83-213113c5b167" containerID="b00917ad21e7acafdf22f1072794d259490ab1aad49935a90baa2158e7dd1bfc" exitCode=0
Sep 10 21:26:35.097728 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:35.097272    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"
Sep 10 21:26:35.097728 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:35.097285    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" event={"ID":"c58b90a8-c691-46f8-8e83-213113c5b167","Type":"ContainerDied","Data":"b00917ad21e7acafdf22f1072794d259490ab1aad49935a90baa2158e7dd1bfc"}
Sep 10 21:26:35.097728 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:35.097340    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh" event={"ID":"c58b90a8-c691-46f8-8e83-213113c5b167","Type":"ContainerDied","Data":"f30994205035055e61eb77f6d66dc006582615ee59208ad490dcb42dd51c3420"}
Sep 10 21:26:35.097728 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:35.097363    2577 scope.go:117] "RemoveContainer" containerID="b00917ad21e7acafdf22f1072794d259490ab1aad49935a90baa2158e7dd1bfc"
Sep 10 21:26:35.106637 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:35.106621    2577 scope.go:117] "RemoveContainer" containerID="26b80e450dfb6b22d69a7bbc9138148ee0c6d9592594395eea1c9dfba0c6f5e4"
Sep 10 21:26:35.115477 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:35.115172    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"]
Sep 10 21:26:35.115477 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:35.115325    2577 scope.go:117] "RemoveContainer" containerID="b00917ad21e7acafdf22f1072794d259490ab1aad49935a90baa2158e7dd1bfc"
Sep 10 21:26:35.115872 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:26:35.115795    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b00917ad21e7acafdf22f1072794d259490ab1aad49935a90baa2158e7dd1bfc\": container with ID starting with b00917ad21e7acafdf22f1072794d259490ab1aad49935a90baa2158e7dd1bfc not found: ID does not exist" containerID="b00917ad21e7acafdf22f1072794d259490ab1aad49935a90baa2158e7dd1bfc"
Sep 10 21:26:35.115987 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:35.115883    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b00917ad21e7acafdf22f1072794d259490ab1aad49935a90baa2158e7dd1bfc"} err="failed to get container status \"b00917ad21e7acafdf22f1072794d259490ab1aad49935a90baa2158e7dd1bfc\": rpc error: code = NotFound desc = could not find container \"b00917ad21e7acafdf22f1072794d259490ab1aad49935a90baa2158e7dd1bfc\": container with ID starting with b00917ad21e7acafdf22f1072794d259490ab1aad49935a90baa2158e7dd1bfc not found: ID does not exist"
Sep 10 21:26:35.115987 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:35.115921    2577 scope.go:117] "RemoveContainer" containerID="26b80e450dfb6b22d69a7bbc9138148ee0c6d9592594395eea1c9dfba0c6f5e4"
Sep 10 21:26:35.116266 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:26:35.116244    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26b80e450dfb6b22d69a7bbc9138148ee0c6d9592594395eea1c9dfba0c6f5e4\": container with ID starting with 26b80e450dfb6b22d69a7bbc9138148ee0c6d9592594395eea1c9dfba0c6f5e4 not found: ID does not exist" containerID="26b80e450dfb6b22d69a7bbc9138148ee0c6d9592594395eea1c9dfba0c6f5e4"
Sep 10 21:26:35.116321 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:35.116273    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26b80e450dfb6b22d69a7bbc9138148ee0c6d9592594395eea1c9dfba0c6f5e4"} err="failed to get container status \"26b80e450dfb6b22d69a7bbc9138148ee0c6d9592594395eea1c9dfba0c6f5e4\": rpc error: code = NotFound desc = could not find container \"26b80e450dfb6b22d69a7bbc9138148ee0c6d9592594395eea1c9dfba0c6f5e4\": container with ID starting with 26b80e450dfb6b22d69a7bbc9138148ee0c6d9592594395eea1c9dfba0c6f5e4 not found: ID does not exist"
Sep 10 21:26:35.118419 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:35.118403    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh"]
Sep 10 21:26:36.946526 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:36.946491    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" path="/var/lib/kubelet/pods/c58b90a8-c691-46f8-8e83-213113c5b167/volumes"
Sep 10 21:26:40.111684 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:40.111616    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"]
Sep 10 21:26:40.112187 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:40.111878    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g" podUID="3cf07b59-1e22-4887-a136-dc3cc97edfe0" containerName="payload-processing" containerID="cri-o://7d18b03a59f15ec9209aff70e8d9b0c0234fc39f01bf7ff27f58f93f1e725a0c" gracePeriod=30
Sep 10 21:26:40.371671 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:40.371610    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"
Sep 10 21:26:40.560776 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:40.560735    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrfk8\" (UniqueName: \"kubernetes.io/projected/3cf07b59-1e22-4887-a136-dc3cc97edfe0-kube-api-access-rrfk8\") pod \"3cf07b59-1e22-4887-a136-dc3cc97edfe0\" (UID: \"3cf07b59-1e22-4887-a136-dc3cc97edfe0\") "
Sep 10 21:26:40.560963 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:40.560830    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf07b59-1e22-4887-a136-dc3cc97edfe0-plugins-config-volume\") pod \"3cf07b59-1e22-4887-a136-dc3cc97edfe0\" (UID: \"3cf07b59-1e22-4887-a136-dc3cc97edfe0\") "
Sep 10 21:26:40.561283 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:40.561252    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cf07b59-1e22-4887-a136-dc3cc97edfe0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3cf07b59-1e22-4887-a136-dc3cc97edfe0" (UID: "3cf07b59-1e22-4887-a136-dc3cc97edfe0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:40.562946 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:40.562921    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf07b59-1e22-4887-a136-dc3cc97edfe0-kube-api-access-rrfk8" (OuterVolumeSpecName: "kube-api-access-rrfk8") pod "3cf07b59-1e22-4887-a136-dc3cc97edfe0" (UID: "3cf07b59-1e22-4887-a136-dc3cc97edfe0"). InnerVolumeSpecName "kube-api-access-rrfk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:40.661740 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:40.661636    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrfk8\" (UniqueName: \"kubernetes.io/projected/3cf07b59-1e22-4887-a136-dc3cc97edfe0-kube-api-access-rrfk8\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:40.661740 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:40.661675    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf07b59-1e22-4887-a136-dc3cc97edfe0-plugins-config-volume\") on node \"ip-10-0-136-151.ec2.internal\" DevicePath \"\""
Sep 10 21:26:41.135455 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:41.135416    2577 generic.go:356] "Generic (PLEG): container finished" podID="3cf07b59-1e22-4887-a136-dc3cc97edfe0" containerID="7d18b03a59f15ec9209aff70e8d9b0c0234fc39f01bf7ff27f58f93f1e725a0c" exitCode=0
Sep 10 21:26:41.135967 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:41.135461    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"
Sep 10 21:26:41.135967 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:41.135502    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g" event={"ID":"3cf07b59-1e22-4887-a136-dc3cc97edfe0","Type":"ContainerDied","Data":"7d18b03a59f15ec9209aff70e8d9b0c0234fc39f01bf7ff27f58f93f1e725a0c"}
Sep 10 21:26:41.135967 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:41.135551    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g" event={"ID":"3cf07b59-1e22-4887-a136-dc3cc97edfe0","Type":"ContainerDied","Data":"8a677533b9520d1ade7a73bf5f9c66422a784fe0b5791b6b8e880ff9d22015ca"}
Sep 10 21:26:41.135967 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:41.135573    2577 scope.go:117] "RemoveContainer" containerID="7d18b03a59f15ec9209aff70e8d9b0c0234fc39f01bf7ff27f58f93f1e725a0c"
Sep 10 21:26:41.144993 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:41.144976    2577 scope.go:117] "RemoveContainer" containerID="7d18b03a59f15ec9209aff70e8d9b0c0234fc39f01bf7ff27f58f93f1e725a0c"
Sep 10 21:26:41.145322 ip-10-0-136-151 kubenswrapper[2577]: E0910 21:26:41.145296    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d18b03a59f15ec9209aff70e8d9b0c0234fc39f01bf7ff27f58f93f1e725a0c\": container with ID starting with 7d18b03a59f15ec9209aff70e8d9b0c0234fc39f01bf7ff27f58f93f1e725a0c not found: ID does not exist" containerID="7d18b03a59f15ec9209aff70e8d9b0c0234fc39f01bf7ff27f58f93f1e725a0c"
Sep 10 21:26:41.145385 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:41.145332    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d18b03a59f15ec9209aff70e8d9b0c0234fc39f01bf7ff27f58f93f1e725a0c"} err="failed to get container status \"7d18b03a59f15ec9209aff70e8d9b0c0234fc39f01bf7ff27f58f93f1e725a0c\": rpc error: code = NotFound desc = could not find container \"7d18b03a59f15ec9209aff70e8d9b0c0234fc39f01bf7ff27f58f93f1e725a0c\": container with ID starting with 7d18b03a59f15ec9209aff70e8d9b0c0234fc39f01bf7ff27f58f93f1e725a0c not found: ID does not exist"
Sep 10 21:26:41.152151 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:41.152130    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"]
Sep 10 21:26:41.158173 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:41.158152    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g"]
Sep 10 21:26:42.567744 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:42.567704    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:26:42.946891 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:42.946800    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cf07b59-1e22-4887-a136-dc3cc97edfe0" path="/var/lib/kubelet/pods/3cf07b59-1e22-4887-a136-dc3cc97edfe0/volumes"
Sep 10 21:26:52.060209 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:52.060175    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:26:53.378800 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:26:53.378766    2577 scope.go:117] "RemoveContainer" containerID="83ae863f85e2ffd689986ac66813c38c731f471fc041b76bef975d76465333fa"
Sep 10 21:27:54.302742 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:27:54.302708    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:27:54.316427 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:27:54.316392    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:28:12.658462 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:28:12.658419    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:28:38.076329 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:28:38.076292    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:28:46.351212 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:28:46.351168    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:28:55.760100 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:28:55.760060    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:29:13.659123 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:29:13.659079    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:29:19.667863 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:29:19.667768    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:30:00.138451 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.138409    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817930-d67z7"]
Sep 10 21:30:00.138989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.138840    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy"
Sep 10 21:30:00.138989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.138852    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy"
Sep 10 21:30:00.138989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.138870    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68328cb1-25f0-4d43-9d69-5c98d4d538a7" containerName="revoke-keys"
Sep 10 21:30:00.138989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.138875    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="68328cb1-25f0-4d43-9d69-5c98d4d538a7" containerName="revoke-keys"
Sep 10 21:30:00.138989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.138888    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf07b59-1e22-4887-a136-dc3cc97edfe0" containerName="payload-processing"
Sep 10 21:30:00.138989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.138895    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf07b59-1e22-4887-a136-dc3cc97edfe0" containerName="payload-processing"
Sep 10 21:30:00.138989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.138964    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy"
Sep 10 21:30:00.138989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.138971    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf07b59-1e22-4887-a136-dc3cc97edfe0" containerName="payload-processing"
Sep 10 21:30:00.138989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.138980    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="68328cb1-25f0-4d43-9d69-5c98d4d538a7" containerName="revoke-keys"
Sep 10 21:30:00.138989 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.138986    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy"
Sep 10 21:30:00.141972 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.141951    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817930-d67z7"
Sep 10 21:30:00.144575 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.144537    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6hlm\""
Sep 10 21:30:00.147594 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.147562    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817930-d67z7"]
Sep 10 21:30:00.154824 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.154795    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817930-d67z7"
Sep 10 21:30:00.433337 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:00.433308    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817930-d67z7"]
Sep 10 21:30:00.435493 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:30:00.435457    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c727bcf_4d9c_41c1_bf83_cc16fa688f75.slice/crio-b6684a73f03527a898048f7091f10c81e815d61cd81a7c3e1743b7b41d8d3b15 WatchSource:0}: Error finding container b6684a73f03527a898048f7091f10c81e815d61cd81a7c3e1743b7b41d8d3b15: Status 404 returned error can't find the container with id b6684a73f03527a898048f7091f10c81e815d61cd81a7c3e1743b7b41d8d3b15
Sep 10 21:30:01.272952 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:01.272915    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817930-d67z7" event={"ID":"6c727bcf-4d9c-41c1-bf83-cc16fa688f75","Type":"ContainerStarted","Data":"f3b27d212d774f338408194b365a1fb542a380162e4fc07d323189c2a1052c79"}
Sep 10 21:30:01.273384 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:01.272972    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817930-d67z7" event={"ID":"6c727bcf-4d9c-41c1-bf83-cc16fa688f75","Type":"ContainerStarted","Data":"b6684a73f03527a898048f7091f10c81e815d61cd81a7c3e1743b7b41d8d3b15"}
Sep 10 21:30:01.289329 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:01.289273    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817930-d67z7" podStartSLOduration=1.289255129 podStartE2EDuration="1.289255129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:30:01.286348778 +0000 UTC m=+1928.860055176" watchObservedRunningTime="2026-09-10 21:30:01.289255129 +0000 UTC m=+1928.862961503"
Sep 10 21:30:02.281090 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:02.281013    2577 generic.go:356] "Generic (PLEG): container finished" podID="6c727bcf-4d9c-41c1-bf83-cc16fa688f75" containerID="f3b27d212d774f338408194b365a1fb542a380162e4fc07d323189c2a1052c79" exitCode=0
Sep 10 21:30:02.281514 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:02.281102    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817930-d67z7" event={"ID":"6c727bcf-4d9c-41c1-bf83-cc16fa688f75","Type":"ContainerDied","Data":"f3b27d212d774f338408194b365a1fb542a380162e4fc07d323189c2a1052c79"}
Sep 10 21:30:03.427626 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:03.427591    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817930-d67z7"
Sep 10 21:30:04.294827 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:04.294793    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817930-d67z7" event={"ID":"6c727bcf-4d9c-41c1-bf83-cc16fa688f75","Type":"ContainerDied","Data":"b6684a73f03527a898048f7091f10c81e815d61cd81a7c3e1743b7b41d8d3b15"}
Sep 10 21:30:04.294992 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:04.294840    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6684a73f03527a898048f7091f10c81e815d61cd81a7c3e1743b7b41d8d3b15"
Sep 10 21:30:04.294992 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:04.294803    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817930-d67z7"
Sep 10 21:30:46.364483 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:46.364402    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:30:52.757140 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:52.757095    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:30:53.441074 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:53.441022    2577 scope.go:117] "RemoveContainer" containerID="42d5f11de427244a5962315c9821f53c9915f44e58815b8da0f514d235032403"
Sep 10 21:30:53.450213 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:30:53.450189    2577 scope.go:117] "RemoveContainer" containerID="e3b8e888430d7c3bec583a8bc6d37c9727c1afebedde4eda381a27f5915f7380"
Sep 10 21:31:02.165086 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:31:02.165038    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:31:14.862880 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:31:14.862835    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:31:39.760338 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:31:39.760298    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:31:47.472779 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:31:47.472738    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:31:53.754976 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:31:53.754935    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:32:01.260126 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:01.260089    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:32:08.263374 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:08.263331    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:32:14.357292 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:14.357251    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:32:20.659407 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:20.659314    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fxcd4"]
Sep 10 21:32:29.037941 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:29.037913    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-n7v68_c03f6a36-58f1-4148-bb58-fc5b7059f210/server/0.log"
Sep 10 21:32:29.148221 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:29.148186    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6hq44_7d550f5b-60e8-4061-93e1-31554eeca51a/manager/0.log"
Sep 10 21:32:29.369264 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:29.369230    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d855cccc6-lm4ft_49c678b2-0b7b-4aa1-8113-5c90517538b6/copy-manifests/0.log"
Sep 10 21:32:29.375839 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:29.375813    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d855cccc6-lm4ft_49c678b2-0b7b-4aa1-8113-5c90517538b6/manager/0.log"
Sep 10 21:32:30.136215 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:30.136184    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817930-d67z7_6c727bcf-4d9c-41c1-bf83-cc16fa688f75/cleanup/0.log"
Sep 10 21:32:31.548393 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:31.548363    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fxcd4_d02c1cda-bf71-43b9-b2b3-2ccec0e292d1/limitador/0.log"
Sep 10 21:32:32.019854 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:32.019825    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg_32013db8-bc81-4371-9805-dce0f91ec710/istio-proxy/0.log"
Sep 10 21:32:32.135437 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:32.135400    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2krmt_a095b41a-44b8-4831-910d-d7d314cc6c80/discovery/0.log"
Sep 10 21:32:32.796037 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:32.795943    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d6cf958b-xf674_0d76ce81-20d8-49cb-bf21-f01ab5f63317/router/0.log"
Sep 10 21:32:33.544190 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:33.544162    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmkl2t_6ce864a0-5584-45dd-bab5-19367a78a44a/main/0.log"
Sep 10 21:32:41.845260 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:41.845221    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wdxkj_f7c136d4-6105-4707-add6-396ab1649cc2/global-pull-secret-syncer/0.log"
Sep 10 21:32:41.922779 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:41.922747    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t4b45_5f0ed195-24d8-48fe-b0f6-2c9d498ee2b4/konnectivity-agent/0.log"
Sep 10 21:32:42.016238 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:42.016197    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-151.ec2.internal_2f47af150f2ad7e8a6a0fa4881de13e4/haproxy/0.log"
Sep 10 21:32:46.096964 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:46.096934    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fxcd4_d02c1cda-bf71-43b9-b2b3-2ccec0e292d1/limitador/0.log"
Sep 10 21:32:47.832680 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:47.832646    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_003afeb0-2bc2-4e10-808e-418ad2408eae/alertmanager/0.log"
Sep 10 21:32:47.856913 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:47.856880    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_003afeb0-2bc2-4e10-808e-418ad2408eae/config-reloader/0.log"
Sep 10 21:32:47.877417 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:47.877357    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_003afeb0-2bc2-4e10-808e-418ad2408eae/kube-rbac-proxy-web/0.log"
Sep 10 21:32:47.897679 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:47.897652    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_003afeb0-2bc2-4e10-808e-418ad2408eae/kube-rbac-proxy/0.log"
Sep 10 21:32:47.916968 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:47.916935    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_003afeb0-2bc2-4e10-808e-418ad2408eae/kube-rbac-proxy-metric/0.log"
Sep 10 21:32:47.935886 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:47.935860    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_003afeb0-2bc2-4e10-808e-418ad2408eae/prom-label-proxy/0.log"
Sep 10 21:32:47.956349 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:47.956322    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_003afeb0-2bc2-4e10-808e-418ad2408eae/init-config-reloader/0.log"
Sep 10 21:32:47.990657 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:47.990622    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-9mmdw_a283a451-553e-4578-bc9c-643b9237e1d0/cluster-monitoring-operator/0.log"
Sep 10 21:32:48.195820 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:48.195731    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qp985_e35d43dc-bfa4-4efa-9c60-7f64d6a2c850/node-exporter/0.log"
Sep 10 21:32:48.214625 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:48.214584    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qp985_e35d43dc-bfa4-4efa-9c60-7f64d6a2c850/kube-rbac-proxy/0.log"
Sep 10 21:32:48.235279 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:48.235252    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qp985_e35d43dc-bfa4-4efa-9c60-7f64d6a2c850/init-textfile/0.log"
Sep 10 21:32:48.342699 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:48.342670    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-5bt44_080c0e6b-ef9d-479c-a832-8e141b05a08a/kube-rbac-proxy-main/0.log"
Sep 10 21:32:48.364414 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:48.364388    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-5bt44_080c0e6b-ef9d-479c-a832-8e141b05a08a/kube-rbac-proxy-self/0.log"
Sep 10 21:32:48.385346 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:48.385316    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-5bt44_080c0e6b-ef9d-479c-a832-8e141b05a08a/openshift-state-metrics/0.log"
Sep 10 21:32:48.731464 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:48.731431    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f87df9b69-dhvfp_9c5a61cc-f796-4573-8cb3-b753ea12f5fe/thanos-query/0.log"
Sep 10 21:32:48.769622 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:48.769596    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f87df9b69-dhvfp_9c5a61cc-f796-4573-8cb3-b753ea12f5fe/kube-rbac-proxy-web/0.log"
Sep 10 21:32:48.795817 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:48.795790    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f87df9b69-dhvfp_9c5a61cc-f796-4573-8cb3-b753ea12f5fe/kube-rbac-proxy/0.log"
Sep 10 21:32:48.831660 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:48.831632    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f87df9b69-dhvfp_9c5a61cc-f796-4573-8cb3-b753ea12f5fe/prom-label-proxy/0.log"
Sep 10 21:32:48.857974 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:48.857941    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f87df9b69-dhvfp_9c5a61cc-f796-4573-8cb3-b753ea12f5fe/kube-rbac-proxy-rules/0.log"
Sep 10 21:32:48.890967 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:48.890940    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f87df9b69-dhvfp_9c5a61cc-f796-4573-8cb3-b753ea12f5fe/kube-rbac-proxy-metrics/0.log"
Sep 10 21:32:50.685954 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:50.685926    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-7wkln_713c4120-1f4e-4ada-b6ed-58830761895e/networking-console-plugin/0.log"
Sep 10 21:32:51.316156 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:51.316123    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:32:51.320521 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:51.320495    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/3.log"
Sep 10 21:32:52.177820 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.177779    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"]
Sep 10 21:32:52.178238 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.178198    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c727bcf-4d9c-41c1-bf83-cc16fa688f75" containerName="cleanup"
Sep 10 21:32:52.178238 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.178210    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c727bcf-4d9c-41c1-bf83-cc16fa688f75" containerName="cleanup"
Sep 10 21:32:52.178238 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.178226    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy"
Sep 10 21:32:52.178238 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.178231    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c58b90a8-c691-46f8-8e83-213113c5b167" containerName="istio-proxy"
Sep 10 21:32:52.178376 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.178299    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c727bcf-4d9c-41c1-bf83-cc16fa688f75" containerName="cleanup"
Sep 10 21:32:52.181633 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.181615    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.183625 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.183594    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47z52\"/\"kube-root-ca.crt\""
Sep 10 21:32:52.183852 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.183835    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47z52\"/\"openshift-service-ca.crt\""
Sep 10 21:32:52.184685 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.184663    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-47z52\"/\"default-dockercfg-fsfx2\""
Sep 10 21:32:52.191104 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.191074    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"]
Sep 10 21:32:52.281899 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.281858    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d427807-1faa-4e65-ab46-077c80c24ff9-podres\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.282130 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.281906    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzqct\" (UniqueName: \"kubernetes.io/projected/1d427807-1faa-4e65-ab46-077c80c24ff9-kube-api-access-kzqct\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.282130 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.281967    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d427807-1faa-4e65-ab46-077c80c24ff9-sys\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.282130 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.281994    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d427807-1faa-4e65-ab46-077c80c24ff9-lib-modules\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.282130 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.282020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d427807-1faa-4e65-ab46-077c80c24ff9-proc\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.383047 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.382999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d427807-1faa-4e65-ab46-077c80c24ff9-podres\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.383237 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.383074    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzqct\" (UniqueName: \"kubernetes.io/projected/1d427807-1faa-4e65-ab46-077c80c24ff9-kube-api-access-kzqct\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.383237 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.383112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d427807-1faa-4e65-ab46-077c80c24ff9-sys\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.383237 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.383149    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d427807-1faa-4e65-ab46-077c80c24ff9-lib-modules\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.383237 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.383188    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d427807-1faa-4e65-ab46-077c80c24ff9-podres\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.383237 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.383208    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d427807-1faa-4e65-ab46-077c80c24ff9-proc\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.383446 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.383251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d427807-1faa-4e65-ab46-077c80c24ff9-proc\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.383446 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.383266    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d427807-1faa-4e65-ab46-077c80c24ff9-sys\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.383446 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.383283    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d427807-1faa-4e65-ab46-077c80c24ff9-lib-modules\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.390571 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.390547    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzqct\" (UniqueName: \"kubernetes.io/projected/1d427807-1faa-4e65-ab46-077c80c24ff9-kube-api-access-kzqct\") pod \"perf-node-gather-daemonset-c8j5k\" (UID: \"1d427807-1faa-4e65-ab46-077c80c24ff9\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.493281 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.493181    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:52.594242 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.594206    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-wn27x_91a65d43-13c4-4d6c-9690-fe7ab89554e5/volume-data-source-validator/0.log"
Sep 10 21:32:52.768981 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:52.768900    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"]
Sep 10 21:32:52.772297 ip-10-0-136-151 kubenswrapper[2577]: W0910 21:32:52.772268    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1d427807_1faa_4e65_ab46_077c80c24ff9.slice/crio-d5a27262eb9fa9388bbe05bd0c9cc48232ae194619daf7a2d024799d3e8ea72a WatchSource:0}: Error finding container d5a27262eb9fa9388bbe05bd0c9cc48232ae194619daf7a2d024799d3e8ea72a: Status 404 returned error can't find the container with id d5a27262eb9fa9388bbe05bd0c9cc48232ae194619daf7a2d024799d3e8ea72a
Sep 10 21:32:53.261925 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:53.261887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k" event={"ID":"1d427807-1faa-4e65-ab46-077c80c24ff9","Type":"ContainerStarted","Data":"5e0d997081f02dc7ed1d1eadebdcc8912f8f659411092838350e9aa3c3e08450"}
Sep 10 21:32:53.262349 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:53.261951    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:53.262349 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:53.261970    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k" event={"ID":"1d427807-1faa-4e65-ab46-077c80c24ff9","Type":"ContainerStarted","Data":"d5a27262eb9fa9388bbe05bd0c9cc48232ae194619daf7a2d024799d3e8ea72a"}
Sep 10 21:32:53.277838 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:53.277780    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k" podStartSLOduration=1.277763493 podStartE2EDuration="1.277763493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:32:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:32:53.275874335 +0000 UTC m=+2100.849580736" watchObservedRunningTime="2026-09-10 21:32:53.277763493 +0000 UTC m=+2100.851469867"
Sep 10 21:32:53.488174 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:53.488141    2577 scope.go:117] "RemoveContainer" containerID="15d092f3e4e3b8159b6af57acee37e5c1f124c131866fba917d04ee3eb780a8d"
Sep 10 21:32:53.497368 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:53.497227    2577 scope.go:117] "RemoveContainer" containerID="491bd5f9cd12f0ac11125dec219a30d019946e479961d2fea2fa0fb3ac7b4aaf"
Sep 10 21:32:53.733873 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:53.733841    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h8z6q_de7b33a4-bb24-4e27-a1c9-6eec4f07d263/dns/0.log"
Sep 10 21:32:53.752364 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:53.752334    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h8z6q_de7b33a4-bb24-4e27-a1c9-6eec4f07d263/kube-rbac-proxy/0.log"
Sep 10 21:32:53.895516 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:53.895485    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vrfnj_7b43f658-f338-479a-b979-4461acdc7696/dns-node-resolver/0.log"
Sep 10 21:32:54.350475 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:54.350442    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:32:54.359128 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:54.359095    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2mqjs_b58c2c3a-5930-45ab-83b7-f51b29b82a1f/console-operator/2.log"
Sep 10 21:32:54.426325 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:54.426284    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dhdcz_0a0a76c1-fac6-4c96-baf9-345e0fcf9d52/node-ca/0.log"
Sep 10 21:32:55.300858 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:55.300804    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg_32013db8-bc81-4371-9805-dce0f91ec710/istio-proxy/0.log"
Sep 10 21:32:55.523042 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:55.522996    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2krmt_a095b41a-44b8-4831-910d-d7d314cc6c80/discovery/0.log"
Sep 10 21:32:55.693809 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:55.693771    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d6cf958b-xf674_0d76ce81-20d8-49cb-bf21-f01ab5f63317/router/0.log"
Sep 10 21:32:56.522608 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:56.522576    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7w8w9_4fbaa2ca-55f1-45b4-8b64-6e31f788e200/serve-healthcheck-canary/0.log"
Sep 10 21:32:57.018985 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:57.018942    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-svh6n_2cb1e53a-557c-4fcb-aba1-165d52863de8/insights-operator/0.log"
Sep 10 21:32:57.020365 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:57.020345    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-svh6n_2cb1e53a-557c-4fcb-aba1-165d52863de8/insights-operator/1.log"
Sep 10 21:32:57.039077 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:57.039043    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kmnp2_a2fcf18f-8812-4837-9d60-49f2e76623bd/kube-rbac-proxy/0.log"
Sep 10 21:32:57.057891 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:57.057865    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kmnp2_a2fcf18f-8812-4837-9d60-49f2e76623bd/exporter/0.log"
Sep 10 21:32:57.079022 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:57.078994    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kmnp2_a2fcf18f-8812-4837-9d60-49f2e76623bd/extractor/0.log"
Sep 10 21:32:59.277806 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:59.277772    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-47z52/perf-node-gather-daemonset-c8j5k"
Sep 10 21:32:59.455580 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:59.455546    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-n7v68_c03f6a36-58f1-4148-bb58-fc5b7059f210/server/0.log"
Sep 10 21:32:59.529629 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:59.529531    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6hq44_7d550f5b-60e8-4061-93e1-31554eeca51a/manager/0.log"
Sep 10 21:32:59.600573 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:59.600538    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d855cccc6-lm4ft_49c678b2-0b7b-4aa1-8113-5c90517538b6/manager/0.log"
Sep 10 21:32:59.622184 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:32:59.622152    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d855cccc6-lm4ft_49c678b2-0b7b-4aa1-8113-5c90517538b6/copy-manifests/0.log"
Sep 10 21:33:00.946844 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:00.946811    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f8c8876d7-db8x6_929e72ad-7b47-4404-a781-1b7b8935d01d/manager/0.log"
Sep 10 21:33:02.341137 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:02.341105    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg_32013db8-bc81-4371-9805-dce0f91ec710/istio-proxy/0.log"
Sep 10 21:33:02.556631 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:02.556532    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2krmt_a095b41a-44b8-4831-910d-d7d314cc6c80/discovery/0.log"
Sep 10 21:33:02.669758 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:02.669724    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d6cf958b-xf674_0d76ce81-20d8-49cb-bf21-f01ab5f63317/router/0.log"
Sep 10 21:33:04.223347 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:04.223314    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg_32013db8-bc81-4371-9805-dce0f91ec710/istio-proxy/0.log"
Sep 10 21:33:04.445373 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:04.445336    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2krmt_a095b41a-44b8-4831-910d-d7d314cc6c80/discovery/0.log"
Sep 10 21:33:04.575559 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:04.575526    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d6cf958b-xf674_0d76ce81-20d8-49cb-bf21-f01ab5f63317/router/0.log"
Sep 10 21:33:06.613938 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:06.613893    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-7r9ll_3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a/kube-storage-version-migrator-operator/1.log"
Sep 10 21:33:06.614897 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:06.614878    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-7r9ll_3cd6cc06-3022-4cba-8da9-a37eb1bfbc6a/kube-storage-version-migrator-operator/0.log"
Sep 10 21:33:07.601970 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:07.601934    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bs2jp_d352d84c-ee74-469f-a98f-93ebff5effea/kube-multus-additional-cni-plugins/0.log"
Sep 10 21:33:07.623879 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:07.623853    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bs2jp_d352d84c-ee74-469f-a98f-93ebff5effea/egress-router-binary-copy/0.log"
Sep 10 21:33:07.646069 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:07.646019    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bs2jp_d352d84c-ee74-469f-a98f-93ebff5effea/cni-plugins/0.log"
Sep 10 21:33:07.666606 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:07.666571    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bs2jp_d352d84c-ee74-469f-a98f-93ebff5effea/bond-cni-plugin/0.log"
Sep 10 21:33:07.686460 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:07.686430    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bs2jp_d352d84c-ee74-469f-a98f-93ebff5effea/routeoverride-cni/0.log"
Sep 10 21:33:07.706724 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:07.706697    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bs2jp_d352d84c-ee74-469f-a98f-93ebff5effea/whereabouts-cni-bincopy/0.log"
Sep 10 21:33:07.727914 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:07.727882    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bs2jp_d352d84c-ee74-469f-a98f-93ebff5effea/whereabouts-cni/0.log"
Sep 10 21:33:08.145081 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:08.145043    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rq9nm_5399360e-7ba7-4137-a37c-d4546fb4fc23/kube-multus/0.log"
Sep 10 21:33:08.168247 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:08.168215    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5ll4j_c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda/network-metrics-daemon/0.log"
Sep 10 21:33:08.185697 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:08.185622    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5ll4j_c7509d9d-d9c8-4d6e-a4c8-b63b790f5dda/kube-rbac-proxy/0.log"
Sep 10 21:33:09.081237 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:09.081206    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rz57_51f4f335-90ff-481d-98bc-3599dda22b78/ovn-controller/0.log"
Sep 10 21:33:09.096410 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:09.096382    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rz57_51f4f335-90ff-481d-98bc-3599dda22b78/ovn-acl-logging/0.log"
Sep 10 21:33:09.117542 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:09.117508    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rz57_51f4f335-90ff-481d-98bc-3599dda22b78/kube-rbac-proxy-node/0.log"
Sep 10 21:33:09.136309 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:09.136280    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rz57_51f4f335-90ff-481d-98bc-3599dda22b78/kube-rbac-proxy-ovn-metrics/0.log"
Sep 10 21:33:09.154183 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:09.154154    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rz57_51f4f335-90ff-481d-98bc-3599dda22b78/northd/0.log"
Sep 10 21:33:09.173673 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:09.173644    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rz57_51f4f335-90ff-481d-98bc-3599dda22b78/nbdb/0.log"
Sep 10 21:33:09.193387 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:09.193355    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rz57_51f4f335-90ff-481d-98bc-3599dda22b78/sbdb/0.log"
Sep 10 21:33:09.250364 ip-10-0-136-151 kubenswrapper[2577]: I0910 21:33:09.250329    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rz57_51f4f335-90ff-481d-98bc-3599dda22b78/ovnkube-controller/0.log"