Sep 10 13:14:58.599790 ip-10-0-143-211 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 13:14:58.599802 ip-10-0-143-211 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 13:14:58.599812 ip-10-0-143-211 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 13:14:58.600145 ip-10-0-143-211 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 13:15:09.723408 ip-10-0-143-211 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 13:15:09.723428 ip-10-0-143-211 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8875da0025e94a2ba8e22a1186613ad2 --
Sep 10 13:16:43.972821 ip-10-0-143-211 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 13:16:44.416749 ip-10-0-143-211 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 13:16:44.416749 ip-10-0-143-211 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 13:16:44.416749 ip-10-0-143-211 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 13:16:44.416749 ip-10-0-143-211 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 13:16:44.416749 ip-10-0-143-211 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 13:16:44.417764 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.417678    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 13:16:44.424934 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424916    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 13:16:44.424934 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424933    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424937    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424941    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424944    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424949    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424956    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424959    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424964    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424967    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424969    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424972    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424975    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424977    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424980    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424982    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424985    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424987    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424990    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424992    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 13:16:44.425002 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424995    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.424997    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425000    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425002    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425005    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425008    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425011    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425014    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425017    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425019    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425022    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425024    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425027    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425029    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425032    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425034    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425036    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425039    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425041    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425044    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 13:16:44.425590 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425047    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425049    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425052    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425054    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425057    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425060    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425064    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425067    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425070    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425072    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425075    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425077    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425081    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425083    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425086    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425089    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425092    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425095    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425097    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425099    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 13:16:44.426089 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425102    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425105    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425107    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425110    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425112    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425115    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425117    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425120    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425122    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425124    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425127    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425130    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425135    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425138    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425142    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425144    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425147    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425150    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425153    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 13:16:44.426595 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425155    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425158    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425160    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425163    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425165    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425168    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425171    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425175    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425178    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425181    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425183    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425186    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425189    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425192    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425194    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425197    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425199    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425202    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425205    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.425207    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 13:16:44.427060 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426082    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426090    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426093    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426097    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426100    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426103    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426111    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426114    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426118    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426120    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426123    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426126    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426128    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426131    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426134    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426137    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426139    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426142    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426144    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426147    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 13:16:44.427588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426150    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426152    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426155    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426157    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426160    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426162    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426165    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426167    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426169    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426172    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426174    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426177    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426179    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426182    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426184    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426187    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426189    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426192    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426194    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426202    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 13:16:44.428091 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426205    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426209    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426213    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426216    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426219    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426222    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426226    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426229    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426232    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426234    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426237    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426239    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426242    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426244    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426247    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426249    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426252    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426254    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426262    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 13:16:44.428593 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426265    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426268    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426270    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426273    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426275    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426278    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426280    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426283    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426285    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426288    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426290    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426293    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426295    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426303    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426306    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426309    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426311    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426314    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426317    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426319    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 13:16:44.429049 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426322    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426324    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426327    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426329    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426337    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426339    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426342    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426344    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426348    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426352    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426355    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426358    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426361    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426363    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426366    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426368    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426371    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426374    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426376    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426379    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 13:16:44.429579 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426841    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426847    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426849    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426852    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426854    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426862    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426865    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426868    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426871    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426873    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426876    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426878    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426882    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426886    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426889    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426891    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426894    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426897    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426899    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 13:16:44.430082 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426902    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426904    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426907    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426909    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426912    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426914    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426917    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426919    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426922    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426924    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426927    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426929    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426932    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426934    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426937    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426939    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426942    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426944    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426947    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426955    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 13:16:44.430597 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426958    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426960    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426963    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426965    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426968    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426972    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426976    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426979    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426983    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426985    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426988    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426991    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426994    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426996    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.426999    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427001    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427004    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427006    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427008    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 13:16:44.431087 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427011    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427013    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427016    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427018    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427021    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427023    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427026    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427028    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427031    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427034    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427038    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427040    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427043    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427052    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427055    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427057    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427060    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427062    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427065    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427068    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 13:16:44.431570 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427070    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427073    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427076    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427078    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427081    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427083    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427085    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427088    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427090    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427093    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427096    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427099    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427101    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427104    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427106    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427108    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427119    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427121    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427124    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427127    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 13:16:44.432095 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427129    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427209    2584 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427244    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427254    2584 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427258    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427262    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427270    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427278    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427282    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427286    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427289    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427292    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427295    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427299    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427302    2584 flags.go:64] FLAG: --cgroup-root=""
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427305    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427308    2584 flags.go:64] FLAG: --client-ca-file=""
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427311    2584 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427314    2584 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427319    2584 flags.go:64] FLAG: --cluster-domain=""
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427322    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427325    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427328    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427331    2584 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 13:16:44.432583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427335    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427338    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427341    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427344    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427348    2584 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427351    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427354    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427357    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427360    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427364    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427366    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427369    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427372    2584 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427375    2584 flags.go:64] FLAG: --enable-server="true"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427378    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427391    2584 flags.go:64] FLAG: --event-burst="100"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427394    2584 flags.go:64] FLAG: --event-qps="50"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427397    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427400    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427403    2584 flags.go:64] FLAG: --eviction-hard=""
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427406    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427409    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427413    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427416    2584 flags.go:64] FLAG: --eviction-soft=""
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427419    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 13:16:44.433172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427422    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427424    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427427    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427431    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427433    2584 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427436    2584 flags.go:64] FLAG: --feature-gates=""
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427440    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427443    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427446    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427449    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427452    2584 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427456    2584 flags.go:64] FLAG: --help="false"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427459    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427462    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427464    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427484    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427491    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427495    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427498    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427501    2584 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427503    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427508    2584 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427511    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427521    2584 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 13:16:44.433799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427524    2584 flags.go:64] FLAG: --kube-reserved=""
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427527    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427529    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427532    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427535    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427538    2584 flags.go:64] FLAG: --lock-file=""
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427540    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427543    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427546    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427552    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427554    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427557    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427560    2584 flags.go:64] FLAG: --logging-format="text"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427563    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427566    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427569    2584 flags.go:64] FLAG: --manifest-url=""
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427572    2584 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427576    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427579    2584 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427584    2584 flags.go:64] FLAG: --max-pods="110"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427587    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427590    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427593    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427596    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427599    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 13:16:44.434412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427602    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427605    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427612    2584 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427615    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427619    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427622    2584 flags.go:64] FLAG: --pod-cidr=""
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427625    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427636    2584 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427639    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427642    2584 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427645    2584 flags.go:64] FLAG: --port="10250"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427648    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427651    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-008bc1c8a7184cbeb"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427654    2584 flags.go:64] FLAG: --qos-reserved=""
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427657    2584 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427660    2584 flags.go:64] FLAG: --register-node="true"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427663    2584 flags.go:64] FLAG: --register-with-taints=""
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427666    2584 flags.go:64] FLAG: --registry-burst="10"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427669    2584 flags.go:64] FLAG: --registry-qps="5"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427672    2584 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427675    2584 flags.go:64] FLAG: --reserved-memory=""
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427678    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427681    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427684    2584 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427687    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 13:16:44.435047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427689    2584 flags.go:64] FLAG: --runonce="false"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427692    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427696    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427699    2584 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427701    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427704    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427707    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427710    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427713    2584 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427715    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427718    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427722    2584 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427726    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427729    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427731    2584 flags.go:64] FLAG: --system-cgroups=""
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427740    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427745    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427748    2584 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427751    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427757    2584 flags.go:64] FLAG: --tls-min-version=""
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427759    2584 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427762    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427764    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427767    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427770    2584 flags.go:64] FLAG: --v="2"
Sep 10 13:16:44.443932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427774    2584 flags.go:64] FLAG: --version="false"
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427778    2584 flags.go:64] FLAG: --vmodule=""
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427781    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.427784    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427951    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427955    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427958    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427961    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427964    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427968    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427971    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427974    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427977    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427979    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427982    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427984    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427987    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427989    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427993    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427996    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 13:16:44.444668 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.427998    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428000    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428003    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428011    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428014    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428016    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428019    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428021    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428024    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428026    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428028    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428031    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428033    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428036    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428038    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428040    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428043    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428045    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428048    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428050    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 13:16:44.445171 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428053    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428056    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428059    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428061    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428064    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428066    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428069    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428071    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428074    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428078    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428082    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428086    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428088    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428091    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428094    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428097    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428105    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428108    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428111    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 13:16:44.445676 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428114    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428117    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428120    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428122    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428124    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428127    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428130    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428132    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428134    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428137    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428139    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428142    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428144    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428147    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428152    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428156    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428159    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428162    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428165    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428168    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 13:16:44.446160 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428170    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428173    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428175    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428179    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428182    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428186    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428189    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428193    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428196    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428198    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428206    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428209    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428212    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428214    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428216    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428229    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428232    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428235    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428244    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 13:16:44.446672 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428257    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428259    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428262    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428264    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.428267    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.428990    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.440437    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.440453    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.440486    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.440492    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440559    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440564    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440567    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440570    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440573    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 13:16:44.447147 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440576    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440580    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440582    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440585    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440589    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440593    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440597    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440600    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440603    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440606    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440609    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440612    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440615    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440618    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440621    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440624    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440627    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440629    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440632    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 13:16:44.447582 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440636    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440640    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440642    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440645    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440654    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440656    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440659    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440662    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440664    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440667    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440670    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440672    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440675    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440677    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440680    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440683    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440685    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440688    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440691    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440693    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 13:16:44.448057 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440696    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440698    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440706    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440710    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440712    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440715    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440717    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440720    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440722    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440724    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440727    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440729    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440732    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440734    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440736    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440739    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440741    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440744    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440747    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 13:16:44.448560 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440751    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440754    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440757    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440760    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440763    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440766    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440768    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440771    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440774    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440776    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440779    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440781    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440783    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440786    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440788    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440791    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440798    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440801    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440804    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440806    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 13:16:44.449015 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440809    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440812    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440814    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440817    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440819    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440822    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440824    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440827    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440829    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440831    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440834    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440837    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440839    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440841    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440844    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 13:16:44.449494 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440846    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.440852    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440978    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440983    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440986    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440989    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440991    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440994    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440996    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.440999    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441001    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441004    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441006    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441009    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441017    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 13:16:44.449868 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441019    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441022    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441024    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441027    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441029    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441032    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441034    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441037    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441041    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441044    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441047    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441050    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441053    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441056    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441059    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441061    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441064    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441066    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441068    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 13:16:44.450514 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441071    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441073    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441076    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441078    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441081    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441083    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441086    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441088    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441091    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441093    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441096    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441098    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441101    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441104    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441107    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441109    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441112    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441114    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441119    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441121    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 13:16:44.451346 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441123    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441126    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441129    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441131    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441134    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441136    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441138    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441141    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441144    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441146    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441149    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441152    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441156    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441158    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441162    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441165    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441167    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441170    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441173    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441175    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 13:16:44.452229 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441178    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441180    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441184    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441187    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441190    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441193    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441196    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441199    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441201    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441204    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441207    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441210    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441212    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441215    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441218    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441220    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441223    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441225    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441228    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 13:16:44.453245 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441230    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 13:16:44.453791 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441233    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 13:16:44.453791 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441235    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 13:16:44.453791 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441238    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 13:16:44.453791 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441240    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 13:16:44.453791 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441243    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 13:16:44.453791 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441245    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 13:16:44.453791 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:44.441249    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 13:16:44.453791 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.441254    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 13:16:44.453791 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.441377    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 13:16:44.453791 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.446820    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 13:16:44.453791 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.447808    2584 server.go:1019] "Starting client certificate rotation"
Sep 10 13:16:44.453791 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.447907    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 13:16:44.453791 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.447937    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 13:16:44.453791 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.450754    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 13:16:44.454154 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.451958    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 13:16:44.467119 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.467097    2584 log.go:25] "Validated CRI v1 runtime API"
Sep 10 13:16:44.470783 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.470763    2584 log.go:25] "Validated CRI v1 image API"
Sep 10 13:16:44.471595 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.471581    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 13:16:44.475913 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.475892    2584 fs.go:135] Filesystem UUIDs: map[1cdbbdfe-3f74-4308-919b-297a17673b3f:/dev/nvme0n1p4 4432f6ae-aefb-4c80-952c-d6e891830870:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 10 13:16:44.475998 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.475911    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 13:16:44.476466 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.476447    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 13:16:44.482724 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.482602    2584 manager.go:216] Machine: {Timestamp:2026-09-10 13:16:44.481141786 +0000 UTC m=+0.380851659 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100070 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e8c5b97d01c385e161339a2a83681 SystemUUID:ec2e8c5b-97d0-1c38-5e16-1339a2a83681 BootID:8875da00-25e9-4a2b-a8e2-2a1186613ad2 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f4:4c:a8:62:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f4:4c:a8:62:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:4d:19:be:03:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 13:16:44.482724 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.482718    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 13:16:44.482816 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.482800    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 13:16:44.485548 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.485524    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 13:16:44.485749 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.485561    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-211.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 13:16:44.486410 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.486400    2584 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 13:16:44.486442 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.486413    2584 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 13:16:44.486442 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.486422    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 13:16:44.486442 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.486438    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 13:16:44.488228 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.488217    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 13:16:44.492751 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.492739    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 13:16:44.492868 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.492859    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 13:16:44.492898 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.492889    2584 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 13:16:44.492931 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.492904    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 13:16:44.492931 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.492924    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 13:16:44.492988 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.492933    2584 kubelet.go:398] "Adding apiserver pod source"
Sep 10 13:16:44.492988 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.492949    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 13:16:44.493371 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.493347    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 13:16:44.493371 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.493366    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 13:16:44.496652 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.496631    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 13:16:44.499849 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.499832    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 13:16:44.499949 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.499863    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 13:16:44.500039 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.500028    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 13:16:44.500077 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.500043    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 13:16:44.500077 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.500048    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 13:16:44.500077 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.500053    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 13:16:44.500077 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.500061    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 13:16:44.500077 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.500066    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 13:16:44.500752 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.500742    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 13:16:44.500783 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.500753    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 13:16:44.500783 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.500760    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 13:16:44.500783 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.500766    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 13:16:44.500783 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.500775    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 13:16:44.500783 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.500783    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 13:16:44.501841 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.501831    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 13:16:44.501841 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.501842    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 13:16:44.505488 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.505448    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-211.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 13:16:44.506017 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.506000    2584 server.go:1268] "Started kubelet"
Sep 10 13:16:44.506104 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.506039    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 13:16:44.506156 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.506098    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 13:16:44.506216 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.506155    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 13:16:44.506270 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.506214    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 13:16:44.506270 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.506240    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 13:16:44.506854 ip-10-0-143-211 systemd[1]: Started Kubernetes Kubelet.
Sep 10 13:16:44.507831 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.507814    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 13:16:44.508457 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.508438    2584 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 13:16:44.510431 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.510412    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 13:16:44.512003 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.510903    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-211.ec2.internal.18d3f80b525442b9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-211.ec2.internal,UID:ip-10-0-143-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-211.ec2.internal,},FirstTimestamp:2026-09-10 13:16:44.505801401 +0000 UTC m=+0.405511341,LastTimestamp:2026-09-10 13:16:44.505801401 +0000 UTC m=+0.405511341,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-211.ec2.internal,}"
Sep 10 13:16:44.513609 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.513589    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 13:16:44.514266 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.514249    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 13:16:44.514362 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.514346    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:44.514991 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.514972    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 13:16:44.514991 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.514974    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 13:16:44.515145 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.515004    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 13:16:44.515145 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.515083    2584 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 13:16:44.515145 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.515092    2584 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 13:16:44.515508 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.515490    2584 factory.go:55] Registering systemd factory
Sep 10 13:16:44.515508 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.515509    2584 factory.go:223] Registration of the systemd container factory successfully
Sep 10 13:16:44.515726 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.515712    2584 factory.go:153] Registering CRI-O factory
Sep 10 13:16:44.515726 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.515728    2584 factory.go:223] Registration of the crio container factory successfully
Sep 10 13:16:44.515839 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.515771    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 13:16:44.515839 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.515787    2584 factory.go:103] Registering Raw factory
Sep 10 13:16:44.515839 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.515800    2584 manager.go:1196] Started watching for new ooms in manager
Sep 10 13:16:44.516202 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.516187    2584 manager.go:349] Starting recovery of all containers
Sep 10 13:16:44.527681 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.527592    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 13:16:44.527808 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.527707    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 13:16:44.529508 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.528872    2584 manager.go:354] Recovery completed
Sep 10 13:16:44.530730 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.530712    2584 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 10 13:16:44.532539 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.532521    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9hsdv"
Sep 10 13:16:44.533784 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.533770    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 13:16:44.535727 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.535712    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 13:16:44.535796 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.535745    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 13:16:44.535796 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.535756    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasSufficientPID"
Sep 10 13:16:44.536389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.536376    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 13:16:44.536389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.536387    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 13:16:44.536496 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.536396    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 13:16:44.536496 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.536403    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 13:16:44.537071 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.537055    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 13:16:44.537133 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.537082    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 13:16:44.537133 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.537092    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasSufficientPID"
Sep 10 13:16:44.538144 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.538129    2584 policy_none.go:49] "None policy: Start"
Sep 10 13:16:44.538223 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.538149    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 13:16:44.538223 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.538163    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 13:16:44.539415 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.539402    2584 policy_none.go:47] "Start"
Sep 10 13:16:44.539934 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.539919    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9hsdv"
Sep 10 13:16:44.581135 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.581111    2584 manager.go:337] "Starting Device Plugin manager"
Sep 10 13:16:44.594187 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.581158    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 13:16:44.594187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.581171    2584 server.go:87] "Starting device plugin registration server"
Sep 10 13:16:44.594187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.581497    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 13:16:44.594187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.581508    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 13:16:44.594187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.581686    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 13:16:44.594187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.581786    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 13:16:44.594187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.581796    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 13:16:44.594187 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.583608    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 13:16:44.594187 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.583663    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:44.594187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.591208    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 13:16:44.594187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.592599    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 13:16:44.594187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.592648    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 13:16:44.594187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.592673    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 13:16:44.594187 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.592718    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 13:16:44.594780 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.594767    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 13:16:44.682180 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.682093    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 13:16:44.683098 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.683076    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 13:16:44.683214 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.683127    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 13:16:44.683214 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.683151    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasSufficientPID"
Sep 10 13:16:44.683214 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.683190    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.692256 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.692235    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.692320 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.692265    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-211.ec2.internal\": node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:44.693237 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.693219    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-211.ec2.internal"]
Sep 10 13:16:44.693318 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.693306    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 13:16:44.694311 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.694276    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 13:16:44.694311 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.694307    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 13:16:44.694311 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.694317    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasSufficientPID"
Sep 10 13:16:44.695894 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.695876    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 13:16:44.696011 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.695996    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.696065 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.696030    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 13:16:44.696617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.696602    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 13:16:44.696702 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.696637    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 13:16:44.696702 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.696651    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasSufficientPID"
Sep 10 13:16:44.696702 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.696605    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 13:16:44.696702 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.696696    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 13:16:44.696887 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.696708    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasSufficientPID"
Sep 10 13:16:44.698074 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.698061    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.698126 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.698085    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 13:16:44.698865 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.698849    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 13:16:44.698964 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.698872    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 13:16:44.698964 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.698884    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeHasSufficientPID"
Sep 10 13:16:44.716884 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.716857    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a208b5b474ebb06a3ac14440dd0bc67-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal\" (UID: \"2a208b5b474ebb06a3ac14440dd0bc67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.716884 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.716886    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a208b5b474ebb06a3ac14440dd0bc67-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal\" (UID: \"2a208b5b474ebb06a3ac14440dd0bc67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.717039 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.716908    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9dd63382dd4a5b6596522a0ad956aab-config\") pod \"kube-apiserver-proxy-ip-10-0-143-211.ec2.internal\" (UID: \"c9dd63382dd4a5b6596522a0ad956aab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.719182 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.719162    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-211.ec2.internal\" not found" node="ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.722009 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.721850    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:44.723646 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.723629    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-211.ec2.internal\" not found" node="ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.817628 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.817593    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9dd63382dd4a5b6596522a0ad956aab-config\") pod \"kube-apiserver-proxy-ip-10-0-143-211.ec2.internal\" (UID: \"c9dd63382dd4a5b6596522a0ad956aab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.817628 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.817625    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a208b5b474ebb06a3ac14440dd0bc67-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal\" (UID: \"2a208b5b474ebb06a3ac14440dd0bc67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.817802 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.817651    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a208b5b474ebb06a3ac14440dd0bc67-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal\" (UID: \"2a208b5b474ebb06a3ac14440dd0bc67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.817802 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.817685    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9dd63382dd4a5b6596522a0ad956aab-config\") pod \"kube-apiserver-proxy-ip-10-0-143-211.ec2.internal\" (UID: \"c9dd63382dd4a5b6596522a0ad956aab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.817802 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.817699    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a208b5b474ebb06a3ac14440dd0bc67-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal\" (UID: \"2a208b5b474ebb06a3ac14440dd0bc67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.817802 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:44.817686    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a208b5b474ebb06a3ac14440dd0bc67-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal\" (UID: \"2a208b5b474ebb06a3ac14440dd0bc67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:44.822732 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.822708    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:44.923538 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:44.923493    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:45.023359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:45.023289    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:45.024379 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:45.024362    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:45.028143 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:45.027977    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:45.125219 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:45.125172    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:45.225662 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:45.225625    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:45.326271 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:45.326193    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:45.426701 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:45.426666    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:45.447830 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:45.447803    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 13:16:45.448001 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:45.447983    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 13:16:45.527254 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:45.527224    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:45.542624 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:45.542590    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 13:11:45 +0000 UTC" deadline="2028-03-23 08:25:43.793646079 +0000 UTC"
Sep 10 13:16:45.542624 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:45.542620    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13435h8m58.251028915s"
Sep 10 13:16:45.627538 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:45.627431    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:45.639343 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:45.639312    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 13:16:45.713784 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:45.713741    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9dd63382dd4a5b6596522a0ad956aab.slice/crio-14af34df116670dd9c3111ad5dff36ba8fee9519eeb8fb0333a816a4bc3e641a WatchSource:0}: Error finding container 14af34df116670dd9c3111ad5dff36ba8fee9519eeb8fb0333a816a4bc3e641a: Status 404 returned error can't find the container with id 14af34df116670dd9c3111ad5dff36ba8fee9519eeb8fb0333a816a4bc3e641a
Sep 10 13:16:45.718451 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:45.718433    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 13:16:45.727797 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:45.727773    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:45.828509 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:45.828452    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:45.929125 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:45.929060    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:46.029984 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:46.029938    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-211.ec2.internal\" not found"
Sep 10 13:16:47.078182 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.078153    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 13:16:47.103461 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.103431    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 13:16:47.129025 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.129000    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:47.147895 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.147872    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 13:16:47.148944 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.148932    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-211.ec2.internal"
Sep 10 13:16:47.159545 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.159528    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 13:16:47.507499 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.507473    2584 apiserver.go:52] "Watching apiserver"
Sep 10 13:16:47.518189 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.518164    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 13:16:47.519301 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.519273    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-wz6wg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal","openshift-multus/multus-kk7jh","openshift-multus/network-metrics-daemon-cd2hp","openshift-network-diagnostics/network-check-target-jhf84","kube-system/global-pull-secret-syncer-rtk5d","kube-system/konnectivity-agent-kkcx2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d","openshift-image-registry/node-ca-hvhhv","openshift-multus/multus-additional-cni-plugins-vpf7h","openshift-network-operator/iptables-alerter-nxv66","openshift-ovn-kubernetes/ovnkube-node-qngjl","kube-system/kube-apiserver-proxy-ip-10-0-143-211.ec2.internal"]
Sep 10 13:16:47.521879 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.521855    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kkcx2"
Sep 10 13:16:47.524022 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.524000    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.524819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.524799    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 13:16:47.525154 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.525135    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nkkrx\""
Sep 10 13:16:47.525243 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.525181    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 13:16:47.526328 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.526298    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:47.526425 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.526338    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 13:16:47.526425 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:47.526368    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:16:47.527384 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.527174    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 13:16:47.527384 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.527198    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 13:16:47.527384 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.527261    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-857rb\""
Sep 10 13:16:47.527384 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.527270    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 13:16:47.528163 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.528144    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 13:16:47.528604 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.528587    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:16:47.528694 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:47.528664    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:16:47.530991 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.530975    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:47.531082 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:47.531065    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:16:47.533195 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.533177    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.535446 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.535428    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.535755 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.535736    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nw6bg\""
Sep 10 13:16:47.535844 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.535820    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 13:16:47.536142 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.536123    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 13:16:47.537922 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.537696    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 13:16:47.537922 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.537841    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hvhhv"
Sep 10 13:16:47.538237 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.538076    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 13:16:47.538769 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.538632    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 13:16:47.538769 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.538632    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jcw6z\""
Sep 10 13:16:47.540365 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.540348    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 13:16:47.540502 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.540352    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.540629 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.540614    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 13:16:47.540725 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.540623    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dvrz6\""
Sep 10 13:16:47.541076 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541057    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 13:16:47.541190 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541173    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 13:16:47.541363 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541348    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/68deb1d1-ced7-4eec-90c7-1090a1a404ca-agent-certs\") pod \"konnectivity-agent-kkcx2\" (UID: \"68deb1d1-ced7-4eec-90c7-1090a1a404ca\") " pod="kube-system/konnectivity-agent-kkcx2"
Sep 10 13:16:47.541430 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541370    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-cnibin\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.541430 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541388    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c95c08b3-1e01-423d-ac6a-f438256f15e9-cni-binary-copy\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.541430 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541408    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-run-netns\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.541609 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541432    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-multus-conf-dir\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.541609 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541476    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-run-multus-certs\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.541609 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541530    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-etc-kubernetes\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.541760 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541668    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-system-cni-dir\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.541760 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541708    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-multus-cni-dir\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.541760 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541744    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-multus-socket-dir-parent\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.541851 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541770    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-run-k8s-cni-cncf-io\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.541851 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541818    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-var-lib-kubelet\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.541851 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541845    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqllm\" (UniqueName: \"kubernetes.io/projected/c9ca33a9-995c-4ea6-bd9f-d72442526915-kube-api-access-qqllm\") pod \"network-metrics-daemon-cd2hp\" (UID: \"c9ca33a9-995c-4ea6-bd9f-d72442526915\") " pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:47.541937 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541870    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jjlr\" (UniqueName: \"kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr\") pod \"network-check-target-jhf84\" (UID: \"1bd0f34f-3600-4a79-b5e7-49c86862890f\") " pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:16:47.541937 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541916    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ecc73e8-ab67-439d-a624-8950a0b2fabb-kubelet-config\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:47.541994 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541941    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ecc73e8-ab67-439d-a624-8950a0b2fabb-dbus\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:47.541994 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.541968    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/68deb1d1-ced7-4eec-90c7-1090a1a404ca-konnectivity-ca\") pod \"konnectivity-agent-kkcx2\" (UID: \"68deb1d1-ced7-4eec-90c7-1090a1a404ca\") " pod="kube-system/konnectivity-agent-kkcx2"
Sep 10 13:16:47.542053 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.542002    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-var-lib-cni-bin\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.542053 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.542026    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-hostroot\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.542109 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.542051    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxqtv\" (UniqueName: \"kubernetes.io/projected/c95c08b3-1e01-423d-ac6a-f438256f15e9-kube-api-access-fxqtv\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.542139 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.542121    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:47.542172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.542149    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-var-lib-cni-multus\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.542203 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.542181    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c95c08b3-1e01-423d-ac6a-f438256f15e9-multus-daemon-config\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.542235 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.542208    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs\") pod \"network-metrics-daemon-cd2hp\" (UID: \"c9ca33a9-995c-4ea6-bd9f-d72442526915\") " pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:47.543036 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.543015    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 13:16:47.543241 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.543226    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 13:16:47.543475 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.543460    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-86gg7\""
Sep 10 13:16:47.544329 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.544306    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nxv66"
Sep 10 13:16:47.546146 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.545410    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.546904 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.546884    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 13:16:47.547049 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.546938    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d7tsw\""
Sep 10 13:16:47.547049 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.546950    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 13:16:47.547212 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.547142    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 13:16:47.547752 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.547727    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4gngz\""
Sep 10 13:16:47.547866 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.547836    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 13:16:47.548204 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.548152    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 13:16:47.548204 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.548156    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 13:16:47.548927 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.548909    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 13:16:47.549139 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.549121    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 13:16:47.549217 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.549123    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 13:16:47.563867 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.563848    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-45bg9"
Sep 10 13:16:47.572195 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.572168    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-45bg9"
Sep 10 13:16:47.611863 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.611815    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal" event={"ID":"2a208b5b474ebb06a3ac14440dd0bc67","Type":"ContainerStarted","Data":"c928d3df07a58f93fcd325b8738606cda512e13cc70e5f9c5aeab202aef36bac"}
Sep 10 13:16:47.613054 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.613033    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-211.ec2.internal" event={"ID":"c9dd63382dd4a5b6596522a0ad956aab","Type":"ContainerStarted","Data":"14af34df116670dd9c3111ad5dff36ba8fee9519eeb8fb0333a816a4bc3e641a"}
Sep 10 13:16:47.629985 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.629964    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 13:16:47.643228 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643208    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-node-log\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.643313 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643239    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:47.643313 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643256    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-device-dir\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.643313 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643270    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-systemd-units\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.643313 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643290    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-run-ovn-kubernetes\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.643506 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643316    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-multus-conf-dir\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.643506 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643348    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-system-cni-dir\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.643506 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:47.643391    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 13:16:47.643506 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643406    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-system-cni-dir\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.643506 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643445    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-multus-conf-dir\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.643506 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:47.643462    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret podName:2ecc73e8-ab67-439d-a624-8950a0b2fabb nodeName:}" failed. No retries permitted until 2026-09-10 13:16:48.143441826 +0000 UTC m=+3.029068834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret") pod "global-pull-secret-syncer-rtk5d" (UID: "2ecc73e8-ab67-439d-a624-8950a0b2fabb") : object "kube-system"/"original-pull-secret" not registered
Sep 10 13:16:47.643847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643519    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-socket-dir\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.643847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643568    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-registration-dir\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.643847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643601    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbmg5\" (UniqueName: \"kubernetes.io/projected/f155f267-7387-4d17-9889-4563fe82d62c-kube-api-access-wbmg5\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.643847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643627    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-run-systemd\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.643847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643674    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jjlr\" (UniqueName: \"kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr\") pod \"network-check-target-jhf84\" (UID: \"1bd0f34f-3600-4a79-b5e7-49c86862890f\") " pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:16:47.643847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643700    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ecc73e8-ab67-439d-a624-8950a0b2fabb-dbus\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:47.643847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643720    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/68deb1d1-ced7-4eec-90c7-1090a1a404ca-konnectivity-ca\") pod \"konnectivity-agent-kkcx2\" (UID: \"68deb1d1-ced7-4eec-90c7-1090a1a404ca\") " pod="kube-system/konnectivity-agent-kkcx2"
Sep 10 13:16:47.643847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643740    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-hostroot\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.643847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643775    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-hostroot\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.643847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643797    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ecc73e8-ab67-439d-a624-8950a0b2fabb-dbus\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:47.643847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643808    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b81f7ba2-5295-427c-9907-4f8d192b48c2-cnibin\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.643847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643841    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b81f7ba2-5295-427c-9907-4f8d192b48c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643869    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-log-socket\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643892    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5n6r\" (UniqueName: \"kubernetes.io/projected/8b7d18c8-587e-48db-b362-f3282dcb53f2-kube-api-access-g5n6r\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643921    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-var-lib-cni-multus\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643951    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b81f7ba2-5295-427c-9907-4f8d192b48c2-system-cni-dir\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643974    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-run-openvswitch\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.643994    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-var-lib-cni-multus\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644013    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs\") pod \"network-metrics-daemon-cd2hp\" (UID: \"c9ca33a9-995c-4ea6-bd9f-d72442526915\") " pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644036    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c95c08b3-1e01-423d-ac6a-f438256f15e9-cni-binary-copy\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644064    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-lib-modules\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644090    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:47.644111    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644122    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b7d18c8-587e-48db-b362-f3282dcb53f2-ovnkube-script-lib\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644154    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-run-k8s-cni-cncf-io\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:47.644175    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs podName:c9ca33a9-995c-4ea6-bd9f-d72442526915 nodeName:}" failed. No retries permitted until 2026-09-10 13:16:48.144158256 +0000 UTC m=+3.029785263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs") pod "network-metrics-daemon-cd2hp" (UID: "c9ca33a9-995c-4ea6-bd9f-d72442526915") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644190    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-run-k8s-cni-cncf-io\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.644389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644205    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-sysctl-conf\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644231    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-sys-fs\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644255    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b81f7ba2-5295-427c-9907-4f8d192b48c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644280    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b81f7ba2-5295-427c-9907-4f8d192b48c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644305    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71e793f7-fd71-43c9-9d4a-373c219ac86b-iptables-alerter-script\") pod \"iptables-alerter-nxv66\" (UID: \"71e793f7-fd71-43c9-9d4a-373c219ac86b\") " pod="openshift-network-operator/iptables-alerter-nxv66"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644334    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-run-netns\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644362    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqllm\" (UniqueName: \"kubernetes.io/projected/c9ca33a9-995c-4ea6-bd9f-d72442526915-kube-api-access-qqllm\") pod \"network-metrics-daemon-cd2hp\" (UID: \"c9ca33a9-995c-4ea6-bd9f-d72442526915\") " pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644387    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-var-lib-cni-bin\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644408    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d79b1e28-04a7-41e5-a873-b68d7e76add7-tmp\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644431    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn9fr\" (UniqueName: \"kubernetes.io/projected/704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c-kube-api-access-fn9fr\") pod \"node-ca-hvhhv\" (UID: \"704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c\") " pod="openshift-image-registry/node-ca-hvhhv"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644441    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-var-lib-cni-bin\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644455    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71e793f7-fd71-43c9-9d4a-373c219ac86b-host-slash\") pod \"iptables-alerter-nxv66\" (UID: \"71e793f7-fd71-43c9-9d4a-373c219ac86b\") " pod="openshift-network-operator/iptables-alerter-nxv66"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644480    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c95c08b3-1e01-423d-ac6a-f438256f15e9-multus-daemon-config\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644505    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-systemd\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644542    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-run\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644672    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-tuned\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644706    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-kubelet\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.645175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644712    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c95c08b3-1e01-423d-ac6a-f438256f15e9-cni-binary-copy\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644728    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b7d18c8-587e-48db-b362-f3282dcb53f2-ovnkube-config\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644757    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-run-netns\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644784    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-run-multus-certs\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644806    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-etc-kubernetes\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644828    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-sysctl-d\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644851    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c-host\") pod \"node-ca-hvhhv\" (UID: \"704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c\") " pod="openshift-image-registry/node-ca-hvhhv"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644852    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-run-netns\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644853    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-run-multus-certs\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644875    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvbx7\" (UniqueName: \"kubernetes.io/projected/b81f7ba2-5295-427c-9907-4f8d192b48c2-kube-api-access-kvbx7\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644896    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-etc-kubernetes\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644916    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-multus-cni-dir\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644948    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-multus-socket-dir-parent\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.644973    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-var-lib-kubelet\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645001    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slct5\" (UniqueName: \"kubernetes.io/projected/d79b1e28-04a7-41e5-a873-b68d7e76add7-kube-api-access-slct5\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645014    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-multus-socket-dir-parent\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645020    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/68deb1d1-ced7-4eec-90c7-1090a1a404ca-konnectivity-ca\") pod \"konnectivity-agent-kkcx2\" (UID: \"68deb1d1-ced7-4eec-90c7-1090a1a404ca\") " pod="kube-system/konnectivity-agent-kkcx2"
Sep 10 13:16:47.645939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645027    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645026    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-multus-cni-dir\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645063    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-host-var-lib-kubelet\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645075    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-etc-openvswitch\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645108    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-cni-netd\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645134    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b7d18c8-587e-48db-b362-f3282dcb53f2-ovn-node-metrics-cert\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645168    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-modprobe-d\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645197    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxqtv\" (UniqueName: \"kubernetes.io/projected/c95c08b3-1e01-423d-ac6a-f438256f15e9-kube-api-access-fxqtv\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645229    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-kubernetes\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645254    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-host\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645280    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-cni-bin\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645318    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c-serviceca\") pod \"node-ca-hvhhv\" (UID: \"704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c\") " pod="openshift-image-registry/node-ca-hvhhv"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645359    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj6v2\" (UniqueName: \"kubernetes.io/projected/71e793f7-fd71-43c9-9d4a-373c219ac86b-kube-api-access-nj6v2\") pod \"iptables-alerter-nxv66\" (UID: \"71e793f7-fd71-43c9-9d4a-373c219ac86b\") " pod="openshift-network-operator/iptables-alerter-nxv66"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645387    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/68deb1d1-ced7-4eec-90c7-1090a1a404ca-agent-certs\") pod \"konnectivity-agent-kkcx2\" (UID: \"68deb1d1-ced7-4eec-90c7-1090a1a404ca\") " pod="kube-system/konnectivity-agent-kkcx2"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645409    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-cnibin\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645424    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-var-lib-kubelet\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645471    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-run-ovn\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.646543 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645484    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c95c08b3-1e01-423d-ac6a-f438256f15e9-cnibin\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.647107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645502    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b7d18c8-587e-48db-b362-f3282dcb53f2-env-overrides\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.647107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645529    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-etc-selinux\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.647107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645575    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-slash\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.647107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645615    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ecc73e8-ab67-439d-a624-8950a0b2fabb-kubelet-config\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:47.647107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645640    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-sysconfig\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.647107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645682    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-sys\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.647107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645693    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ecc73e8-ab67-439d-a624-8950a0b2fabb-kubelet-config\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:47.647107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645713    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b81f7ba2-5295-427c-9907-4f8d192b48c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.647107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645748    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-var-lib-openvswitch\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.647107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645761    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c95c08b3-1e01-423d-ac6a-f438256f15e9-multus-daemon-config\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.647107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.645855    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 13:16:47.649705 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.649686    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/68deb1d1-ced7-4eec-90c7-1090a1a404ca-agent-certs\") pod \"konnectivity-agent-kkcx2\" (UID: \"68deb1d1-ced7-4eec-90c7-1090a1a404ca\") " pod="kube-system/konnectivity-agent-kkcx2"
Sep 10 13:16:47.656786 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:47.656768    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 13:16:47.656859 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:47.656794    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 13:16:47.656859 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:47.656807    2584 projected.go:196] Error preparing data for projected volume kube-api-access-2jjlr for pod openshift-network-diagnostics/network-check-target-jhf84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 13:16:47.656939 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:47.656869    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr podName:1bd0f34f-3600-4a79-b5e7-49c86862890f nodeName:}" failed. No retries permitted until 2026-09-10 13:16:48.156851547 +0000 UTC m=+3.042478557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2jjlr" (UniqueName: "kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr") pod "network-check-target-jhf84" (UID: "1bd0f34f-3600-4a79-b5e7-49c86862890f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 13:16:47.659181 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.659158    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqllm\" (UniqueName: \"kubernetes.io/projected/c9ca33a9-995c-4ea6-bd9f-d72442526915-kube-api-access-qqllm\") pod \"network-metrics-daemon-cd2hp\" (UID: \"c9ca33a9-995c-4ea6-bd9f-d72442526915\") " pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:47.660584 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.660548    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxqtv\" (UniqueName: \"kubernetes.io/projected/c95c08b3-1e01-423d-ac6a-f438256f15e9-kube-api-access-fxqtv\") pod \"multus-kk7jh\" (UID: \"c95c08b3-1e01-423d-ac6a-f438256f15e9\") " pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.746507 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746480    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-etc-openvswitch\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.746675 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746519    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-cni-netd\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.746675 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746600    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-etc-openvswitch\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.746675 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746586    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-cni-netd\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.746675 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746640    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b7d18c8-587e-48db-b362-f3282dcb53f2-ovn-node-metrics-cert\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.746888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746678    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-modprobe-d\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.746888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746705    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-kubernetes\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.746888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746729    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-host\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.746888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746752    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-cni-bin\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.746888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746775    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c-serviceca\") pod \"node-ca-hvhhv\" (UID: \"704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c\") " pod="openshift-image-registry/node-ca-hvhhv"
Sep 10 13:16:47.746888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746799    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj6v2\" (UniqueName: \"kubernetes.io/projected/71e793f7-fd71-43c9-9d4a-373c219ac86b-kube-api-access-nj6v2\") pod \"iptables-alerter-nxv66\" (UID: \"71e793f7-fd71-43c9-9d4a-373c219ac86b\") " pod="openshift-network-operator/iptables-alerter-nxv66"
Sep 10 13:16:47.746888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746805    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-modprobe-d\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.746888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746826    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-var-lib-kubelet\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.746888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746850    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-run-ovn\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.746888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746852    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-cni-bin\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.746888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746873    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b7d18c8-587e-48db-b362-f3282dcb53f2-env-overrides\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.746888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746894    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-kubernetes\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.747470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746897    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-etc-selinux\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.747470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746921    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-slash\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.747470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746935    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-host\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.747470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-sysconfig\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.747470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746967    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-sys\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.747470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746976    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-run-ovn\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.747470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.746991    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b81f7ba2-5295-427c-9907-4f8d192b48c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.747470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747089    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-slash\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.747470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747144    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b81f7ba2-5295-427c-9907-4f8d192b48c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.747470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747208    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-sysconfig\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.747470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747253    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-sys\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.747470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747346    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-etc-selinux\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.747470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747426    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b7d18c8-587e-48db-b362-f3282dcb53f2-env-overrides\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.747470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747474    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-var-lib-kubelet\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747501    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-var-lib-openvswitch\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747519    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-node-log\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747543    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-var-lib-openvswitch\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747548    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-device-dir\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747590    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-systemd-units\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747597    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-node-log\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747603    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c-serviceca\") pod \"node-ca-hvhhv\" (UID: \"704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c\") " pod="openshift-image-registry/node-ca-hvhhv"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747609    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-run-ovn-kubernetes\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747632    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-socket-dir\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747645    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-device-dir\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747647    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-registration-dir\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747661    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-systemd-units\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747676    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-registration-dir\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747683    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbmg5\" (UniqueName: \"kubernetes.io/projected/f155f267-7387-4d17-9889-4563fe82d62c-kube-api-access-wbmg5\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747711    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-run-systemd\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747751    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b81f7ba2-5295-427c-9907-4f8d192b48c2-cnibin\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.748117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747740    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-socket-dir\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747775    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b81f7ba2-5295-427c-9907-4f8d192b48c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747790    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-run-ovn-kubernetes\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747820    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-log-socket\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747842    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5n6r\" (UniqueName: \"kubernetes.io/projected/8b7d18c8-587e-48db-b362-f3282dcb53f2-kube-api-access-g5n6r\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.747859    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b81f7ba2-5295-427c-9907-4f8d192b48c2-system-cni-dir\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748045    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-run-systemd\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748083    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b81f7ba2-5295-427c-9907-4f8d192b48c2-cnibin\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748115    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-log-socket\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748150    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-run-openvswitch\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748177    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b81f7ba2-5295-427c-9907-4f8d192b48c2-system-cni-dir\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748242    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-run-openvswitch\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748282    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-lib-modules\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748305    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748321    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b7d18c8-587e-48db-b362-f3282dcb53f2-ovnkube-script-lib\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748336    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-sysctl-conf\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748352    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-sys-fs\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.748819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748373    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b81f7ba2-5295-427c-9907-4f8d192b48c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748391    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b81f7ba2-5295-427c-9907-4f8d192b48c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748398    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-lib-modules\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748405    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71e793f7-fd71-43c9-9d4a-373c219ac86b-iptables-alerter-script\") pod \"iptables-alerter-nxv66\" (UID: \"71e793f7-fd71-43c9-9d4a-373c219ac86b\") " pod="openshift-network-operator/iptables-alerter-nxv66"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748422    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-run-netns\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748437    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d79b1e28-04a7-41e5-a873-b68d7e76add7-tmp\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748456    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-sys-fs\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn9fr\" (UniqueName: \"kubernetes.io/projected/704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c-kube-api-access-fn9fr\") pod \"node-ca-hvhhv\" (UID: \"704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c\") " pod="openshift-image-registry/node-ca-hvhhv"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748496    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71e793f7-fd71-43c9-9d4a-373c219ac86b-host-slash\") pod \"iptables-alerter-nxv66\" (UID: \"71e793f7-fd71-43c9-9d4a-373c219ac86b\") " pod="openshift-network-operator/iptables-alerter-nxv66"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748521    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-systemd\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748545    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-run\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748588    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-tuned\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748611    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-kubelet\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748633    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b7d18c8-587e-48db-b362-f3282dcb53f2-ovnkube-config\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748660    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-sysctl-d\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748685    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c-host\") pod \"node-ca-hvhhv\" (UID: \"704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c\") " pod="openshift-image-registry/node-ca-hvhhv"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748710    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvbx7\" (UniqueName: \"kubernetes.io/projected/b81f7ba2-5295-427c-9907-4f8d192b48c2-kube-api-access-kvbx7\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.749617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748741    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slct5\" (UniqueName: \"kubernetes.io/projected/d79b1e28-04a7-41e5-a873-b68d7e76add7-kube-api-access-slct5\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.750460 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748764    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.750460 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.749009    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-run-netns\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.750460 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.749147    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b81f7ba2-5295-427c-9907-4f8d192b48c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.750460 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.748838    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f155f267-7387-4d17-9889-4563fe82d62c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.750460 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.749255    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.750460 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.749812    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-sysctl-conf\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.750460 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.749884    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71e793f7-fd71-43c9-9d4a-373c219ac86b-host-slash\") pod \"iptables-alerter-nxv66\" (UID: \"71e793f7-fd71-43c9-9d4a-373c219ac86b\") " pod="openshift-network-operator/iptables-alerter-nxv66"
Sep 10 13:16:47.750460 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.749965    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-systemd\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.750460 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.750008    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71e793f7-fd71-43c9-9d4a-373c219ac86b-iptables-alerter-script\") pod \"iptables-alerter-nxv66\" (UID: \"71e793f7-fd71-43c9-9d4a-373c219ac86b\") " pod="openshift-network-operator/iptables-alerter-nxv66"
Sep 10 13:16:47.750460 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.750024    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-run\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.750460 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.750161    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b7d18c8-587e-48db-b362-f3282dcb53f2-ovn-node-metrics-cert\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.751009 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.750516    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b81f7ba2-5295-427c-9907-4f8d192b48c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.751009 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.750786    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b7d18c8-587e-48db-b362-f3282dcb53f2-ovnkube-script-lib\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.752038 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.752019    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-sysctl-d\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.752122 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.752077    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b7d18c8-587e-48db-b362-f3282dcb53f2-host-kubelet\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.752395 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.752370    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d79b1e28-04a7-41e5-a873-b68d7e76add7-etc-tuned\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.752504 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.752487    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c-host\") pod \"node-ca-hvhhv\" (UID: \"704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c\") " pod="openshift-image-registry/node-ca-hvhhv"
Sep 10 13:16:47.752621 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.752597    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b7d18c8-587e-48db-b362-f3282dcb53f2-ovnkube-config\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.753326 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.753240    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b81f7ba2-5295-427c-9907-4f8d192b48c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.755054 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.754987    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d79b1e28-04a7-41e5-a873-b68d7e76add7-tmp\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.757665 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.757593    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5n6r\" (UniqueName: \"kubernetes.io/projected/8b7d18c8-587e-48db-b362-f3282dcb53f2-kube-api-access-g5n6r\") pod \"ovnkube-node-qngjl\" (UID: \"8b7d18c8-587e-48db-b362-f3282dcb53f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.757867 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.757849    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn9fr\" (UniqueName: \"kubernetes.io/projected/704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c-kube-api-access-fn9fr\") pod \"node-ca-hvhhv\" (UID: \"704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c\") " pod="openshift-image-registry/node-ca-hvhhv"
Sep 10 13:16:47.758375 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.758319    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbmg5\" (UniqueName: \"kubernetes.io/projected/f155f267-7387-4d17-9889-4563fe82d62c-kube-api-access-wbmg5\") pod \"aws-ebs-csi-driver-node-8hw2d\" (UID: \"f155f267-7387-4d17-9889-4563fe82d62c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.760403 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.760381    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj6v2\" (UniqueName: \"kubernetes.io/projected/71e793f7-fd71-43c9-9d4a-373c219ac86b-kube-api-access-nj6v2\") pod \"iptables-alerter-nxv66\" (UID: \"71e793f7-fd71-43c9-9d4a-373c219ac86b\") " pod="openshift-network-operator/iptables-alerter-nxv66"
Sep 10 13:16:47.762449 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.762428    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvbx7\" (UniqueName: \"kubernetes.io/projected/b81f7ba2-5295-427c-9907-4f8d192b48c2-kube-api-access-kvbx7\") pod \"multus-additional-cni-plugins-vpf7h\" (UID: \"b81f7ba2-5295-427c-9907-4f8d192b48c2\") " pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.762966 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.762949    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slct5\" (UniqueName: \"kubernetes.io/projected/d79b1e28-04a7-41e5-a873-b68d7e76add7-kube-api-access-slct5\") pod \"tuned-wz6wg\" (UID: \"d79b1e28-04a7-41e5-a873-b68d7e76add7\") " pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.833777 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.833741    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kkcx2"
Sep 10 13:16:47.841193 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.841170    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kk7jh"
Sep 10 13:16:47.845223 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:47.844997    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68deb1d1_ced7_4eec_90c7_1090a1a404ca.slice/crio-d709e5a7b3bc0c2e63f81207b5384594f06f202a16f4f34e46472b5265901d52 WatchSource:0}: Error finding container d709e5a7b3bc0c2e63f81207b5384594f06f202a16f4f34e46472b5265901d52: Status 404 returned error can't find the container with id d709e5a7b3bc0c2e63f81207b5384594f06f202a16f4f34e46472b5265901d52
Sep 10 13:16:47.850630 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:47.850603    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc95c08b3_1e01_423d_ac6a_f438256f15e9.slice/crio-f52a14f6de02a2e2164b2aa248cfafbb1dfdadbe9c015aea850169c5ea583332 WatchSource:0}: Error finding container f52a14f6de02a2e2164b2aa248cfafbb1dfdadbe9c015aea850169c5ea583332: Status 404 returned error can't find the container with id f52a14f6de02a2e2164b2aa248cfafbb1dfdadbe9c015aea850169c5ea583332
Sep 10 13:16:47.854809 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.854790    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wz6wg"
Sep 10 13:16:47.858161 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.858142    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d"
Sep 10 13:16:47.865189 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:47.865137    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd79b1e28_04a7_41e5_a873_b68d7e76add7.slice/crio-f01414f1054e6d1b18623ce2940250f8421d21727ebc9cfd4d3202e3c114a38d WatchSource:0}: Error finding container f01414f1054e6d1b18623ce2940250f8421d21727ebc9cfd4d3202e3c114a38d: Status 404 returned error can't find the container with id f01414f1054e6d1b18623ce2940250f8421d21727ebc9cfd4d3202e3c114a38d
Sep 10 13:16:47.868213 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:47.868188    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf155f267_7387_4d17_9889_4563fe82d62c.slice/crio-dea701eaabe19ad293154dcc6b951695de6c63bf8aa7e6b3e67b294a26492ef5 WatchSource:0}: Error finding container dea701eaabe19ad293154dcc6b951695de6c63bf8aa7e6b3e67b294a26492ef5: Status 404 returned error can't find the container with id dea701eaabe19ad293154dcc6b951695de6c63bf8aa7e6b3e67b294a26492ef5
Sep 10 13:16:47.869297 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.869282    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hvhhv"
Sep 10 13:16:47.876493 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.876475    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vpf7h"
Sep 10 13:16:47.878463 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:47.878445    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704bb6a6_751c_47b7_9fd3_c2cc8fcbc82c.slice/crio-9adf03ec39edd98ceaa9bbdd2a021202a972f9d76de465584ffaeb092f24f69f WatchSource:0}: Error finding container 9adf03ec39edd98ceaa9bbdd2a021202a972f9d76de465584ffaeb092f24f69f: Status 404 returned error can't find the container with id 9adf03ec39edd98ceaa9bbdd2a021202a972f9d76de465584ffaeb092f24f69f
Sep 10 13:16:47.883722 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.883704    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nxv66"
Sep 10 13:16:47.889588 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.889543    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:16:47.953713 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:47.953684    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 13:16:48.152038 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:48.152000    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:48.152226 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:48.152061    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs\") pod \"network-metrics-daemon-cd2hp\" (UID: \"c9ca33a9-995c-4ea6-bd9f-d72442526915\") " pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:48.152226 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:48.152174    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 13:16:48.152340 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:48.152244    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret podName:2ecc73e8-ab67-439d-a624-8950a0b2fabb nodeName:}" failed. No retries permitted until 2026-09-10 13:16:49.152227621 +0000 UTC m=+4.037854628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret") pod "global-pull-secret-syncer-rtk5d" (UID: "2ecc73e8-ab67-439d-a624-8950a0b2fabb") : object "kube-system"/"original-pull-secret" not registered
Sep 10 13:16:48.152340 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:48.152182    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 13:16:48.152340 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:48.152312    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs podName:c9ca33a9-995c-4ea6-bd9f-d72442526915 nodeName:}" failed. No retries permitted until 2026-09-10 13:16:49.152293771 +0000 UTC m=+4.037920792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs") pod "network-metrics-daemon-cd2hp" (UID: "c9ca33a9-995c-4ea6-bd9f-d72442526915") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 13:16:48.252619 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:48.252590    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jjlr\" (UniqueName: \"kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr\") pod \"network-check-target-jhf84\" (UID: \"1bd0f34f-3600-4a79-b5e7-49c86862890f\") " pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:16:48.252842 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:48.252815    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 13:16:48.252880 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:48.252858    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 13:16:48.252880 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:48.252875    2584 projected.go:196] Error preparing data for projected volume kube-api-access-2jjlr for pod openshift-network-diagnostics/network-check-target-jhf84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 13:16:48.252969 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:48.252955    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr podName:1bd0f34f-3600-4a79-b5e7-49c86862890f nodeName:}" failed. No retries permitted until 2026-09-10 13:16:49.25293281 +0000 UTC m=+4.138559841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jjlr" (UniqueName: "kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr") pod "network-check-target-jhf84" (UID: "1bd0f34f-3600-4a79-b5e7-49c86862890f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 13:16:48.575459 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:48.575364    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 13:11:47 +0000 UTC" deadline="2028-04-26 14:39:19.410143583 +0000 UTC"
Sep 10 13:16:48.575459 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:48.575403    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14257h22m30.834745268s"
Sep 10 13:16:48.597975 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:48.597942    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81f7ba2_5295_427c_9907_4f8d192b48c2.slice/crio-ebf2e0062ae7e65a838f2df1a51bc77e4c9242810d3cb59c30cf8294b618ef79 WatchSource:0}: Error finding container ebf2e0062ae7e65a838f2df1a51bc77e4c9242810d3cb59c30cf8294b618ef79: Status 404 returned error can't find the container with id ebf2e0062ae7e65a838f2df1a51bc77e4c9242810d3cb59c30cf8294b618ef79
Sep 10 13:16:48.607149 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:48.606951    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:16:48.607149 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:48.607030    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:16:48.608397 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:16:48.608345    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b7d18c8_587e_48db_b362_f3282dcb53f2.slice/crio-c09ac59a930657abc982c4bf05ebf3ecbf7eb3f158e53fe42d305fd6e23e315b WatchSource:0}: Error finding container c09ac59a930657abc982c4bf05ebf3ecbf7eb3f158e53fe42d305fd6e23e315b: Status 404 returned error can't find the container with id c09ac59a930657abc982c4bf05ebf3ecbf7eb3f158e53fe42d305fd6e23e315b
Sep 10 13:16:48.616444 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:48.616417    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nxv66" event={"ID":"71e793f7-fd71-43c9-9d4a-373c219ac86b","Type":"ContainerStarted","Data":"b4b1712b54eb57abda7fd66122a4585c86656fe54450676183128df9775b9341"}
Sep 10 13:16:48.617681 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:48.617657    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kk7jh" event={"ID":"c95c08b3-1e01-423d-ac6a-f438256f15e9","Type":"ContainerStarted","Data":"f52a14f6de02a2e2164b2aa248cfafbb1dfdadbe9c015aea850169c5ea583332"}
Sep 10 13:16:48.621026 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:48.621000    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kkcx2" event={"ID":"68deb1d1-ced7-4eec-90c7-1090a1a404ca","Type":"ContainerStarted","Data":"d709e5a7b3bc0c2e63f81207b5384594f06f202a16f4f34e46472b5265901d52"}
Sep 10 13:16:48.622852 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:48.622824    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl" event={"ID":"8b7d18c8-587e-48db-b362-f3282dcb53f2","Type":"ContainerStarted","Data":"c09ac59a930657abc982c4bf05ebf3ecbf7eb3f158e53fe42d305fd6e23e315b"}
Sep 10 13:16:48.624200 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:48.624167    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpf7h" event={"ID":"b81f7ba2-5295-427c-9907-4f8d192b48c2","Type":"ContainerStarted","Data":"ebf2e0062ae7e65a838f2df1a51bc77e4c9242810d3cb59c30cf8294b618ef79"}
Sep 10 13:16:48.625437 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:48.625412    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hvhhv" event={"ID":"704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c","Type":"ContainerStarted","Data":"9adf03ec39edd98ceaa9bbdd2a021202a972f9d76de465584ffaeb092f24f69f"}
Sep 10 13:16:48.626569 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:48.626533    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d" event={"ID":"f155f267-7387-4d17-9889-4563fe82d62c","Type":"ContainerStarted","Data":"dea701eaabe19ad293154dcc6b951695de6c63bf8aa7e6b3e67b294a26492ef5"}
Sep 10 13:16:48.627754 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:48.627732    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wz6wg" event={"ID":"d79b1e28-04a7-41e5-a873-b68d7e76add7","Type":"ContainerStarted","Data":"f01414f1054e6d1b18623ce2940250f8421d21727ebc9cfd4d3202e3c114a38d"}
Sep 10 13:16:49.160335 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:49.159617    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:49.160335 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:49.159691    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs\") pod \"network-metrics-daemon-cd2hp\" (UID: \"c9ca33a9-995c-4ea6-bd9f-d72442526915\") " pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:49.160335 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:49.159820    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 13:16:49.160335 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:49.159877    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs podName:c9ca33a9-995c-4ea6-bd9f-d72442526915 nodeName:}" failed. No retries permitted until 2026-09-10 13:16:51.159858709 +0000 UTC m=+6.045485721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs") pod "network-metrics-daemon-cd2hp" (UID: "c9ca33a9-995c-4ea6-bd9f-d72442526915") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 13:16:49.160335 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:49.160255    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 13:16:49.160335 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:49.160309    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret podName:2ecc73e8-ab67-439d-a624-8950a0b2fabb nodeName:}" failed. No retries permitted until 2026-09-10 13:16:51.160291387 +0000 UTC m=+6.045918409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret") pod "global-pull-secret-syncer-rtk5d" (UID: "2ecc73e8-ab67-439d-a624-8950a0b2fabb") : object "kube-system"/"original-pull-secret" not registered
Sep 10 13:16:49.260060 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:49.260028    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jjlr\" (UniqueName: \"kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr\") pod \"network-check-target-jhf84\" (UID: \"1bd0f34f-3600-4a79-b5e7-49c86862890f\") " pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:16:49.260209 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:49.260193    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 13:16:49.260271 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:49.260221    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 13:16:49.260271 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:49.260235    2584 projected.go:196] Error preparing data for projected volume kube-api-access-2jjlr for pod openshift-network-diagnostics/network-check-target-jhf84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 13:16:49.260367 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:49.260303    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr podName:1bd0f34f-3600-4a79-b5e7-49c86862890f nodeName:}" failed. No retries permitted until 2026-09-10 13:16:51.26028405 +0000 UTC m=+6.145911055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jjlr" (UniqueName: "kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr") pod "network-check-target-jhf84" (UID: "1bd0f34f-3600-4a79-b5e7-49c86862890f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 13:16:49.575924 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:49.575646    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 13:11:47 +0000 UTC" deadline="2028-02-10 11:03:14.533348975 +0000 UTC"
Sep 10 13:16:49.575924 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:49.575900    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12429h46m24.957456177s"
Sep 10 13:16:49.609993 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:49.609962    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:49.610149 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:49.610100    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:16:49.610478 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:49.610459    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:49.610694 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:49.610669    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:16:49.643378 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:49.643349    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-211.ec2.internal" event={"ID":"c9dd63382dd4a5b6596522a0ad956aab","Type":"ContainerStarted","Data":"b66336d41f22d1dcc13b8cc065184790eb049ebcec9d4dac9d447cfc129461c1"}
Sep 10 13:16:49.662306 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:49.662254    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-211.ec2.internal" podStartSLOduration=2.662237873 podStartE2EDuration="2.662237873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:16:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:16:49.661940645 +0000 UTC m=+4.547567674" watchObservedRunningTime="2026-09-10 13:16:49.662237873 +0000 UTC m=+4.547864901"
Sep 10 13:16:50.608445 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:50.607953    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:16:50.608445 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:50.608077    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:16:50.652654 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:50.651443    2584 generic.go:356] "Generic (PLEG): container finished" podID="2a208b5b474ebb06a3ac14440dd0bc67" containerID="78bb84563b74d9adce6fbab4a7199ade3bc0f687b602ff510aef202231bc0678" exitCode=0
Sep 10 13:16:50.652654 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:50.652382    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal" event={"ID":"2a208b5b474ebb06a3ac14440dd0bc67","Type":"ContainerDied","Data":"78bb84563b74d9adce6fbab4a7199ade3bc0f687b602ff510aef202231bc0678"}
Sep 10 13:16:51.179304 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:51.179267    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:51.179477 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:51.179341    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs\") pod \"network-metrics-daemon-cd2hp\" (UID: \"c9ca33a9-995c-4ea6-bd9f-d72442526915\") " pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:51.179477 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:51.179471    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 13:16:51.179616 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:51.179532    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs podName:c9ca33a9-995c-4ea6-bd9f-d72442526915 nodeName:}" failed. No retries permitted until 2026-09-10 13:16:55.179512561 +0000 UTC m=+10.065139586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs") pod "network-metrics-daemon-cd2hp" (UID: "c9ca33a9-995c-4ea6-bd9f-d72442526915") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 13:16:51.179958 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:51.179919    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 13:16:51.180074 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:51.179981    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret podName:2ecc73e8-ab67-439d-a624-8950a0b2fabb nodeName:}" failed. No retries permitted until 2026-09-10 13:16:55.179966938 +0000 UTC m=+10.065593957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret") pod "global-pull-secret-syncer-rtk5d" (UID: "2ecc73e8-ab67-439d-a624-8950a0b2fabb") : object "kube-system"/"original-pull-secret" not registered
Sep 10 13:16:51.280041 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:51.280005    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jjlr\" (UniqueName: \"kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr\") pod \"network-check-target-jhf84\" (UID: \"1bd0f34f-3600-4a79-b5e7-49c86862890f\") " pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:16:51.280249 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:51.280229    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 13:16:51.280325 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:51.280257    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 13:16:51.280325 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:51.280271    2584 projected.go:196] Error preparing data for projected volume kube-api-access-2jjlr for pod openshift-network-diagnostics/network-check-target-jhf84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 13:16:51.280435 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:51.280329    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr podName:1bd0f34f-3600-4a79-b5e7-49c86862890f nodeName:}" failed. No retries permitted until 2026-09-10 13:16:55.28031032 +0000 UTC m=+10.165937327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jjlr" (UniqueName: "kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr") pod "network-check-target-jhf84" (UID: "1bd0f34f-3600-4a79-b5e7-49c86862890f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 13:16:51.607231 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:51.607200    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:51.607387 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:51.607341    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:16:51.607725 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:51.607704    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:51.607832 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:51.607812    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:16:52.607584 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:52.607217    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:16:52.607584 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:52.607358    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:16:53.608022 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:53.607525    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:53.608022 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:53.607677    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:16:53.608022 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:53.607716    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:53.608022 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:53.607852    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:16:54.607735 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:54.607694    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:16:54.607882 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:54.607827    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:16:55.213569 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:55.213509    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs\") pod \"network-metrics-daemon-cd2hp\" (UID: \"c9ca33a9-995c-4ea6-bd9f-d72442526915\") " pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:55.214013 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:55.213619    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:55.214013 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:55.213717    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 13:16:55.214013 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:55.213755    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 13:16:55.214013 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:55.213792    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs podName:c9ca33a9-995c-4ea6-bd9f-d72442526915 nodeName:}" failed. No retries permitted until 2026-09-10 13:17:03.213770756 +0000 UTC m=+18.099397775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs") pod "network-metrics-daemon-cd2hp" (UID: "c9ca33a9-995c-4ea6-bd9f-d72442526915") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 13:16:55.214013 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:55.213818    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret podName:2ecc73e8-ab67-439d-a624-8950a0b2fabb nodeName:}" failed. No retries permitted until 2026-09-10 13:17:03.213800812 +0000 UTC m=+18.099427821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret") pod "global-pull-secret-syncer-rtk5d" (UID: "2ecc73e8-ab67-439d-a624-8950a0b2fabb") : object "kube-system"/"original-pull-secret" not registered
Sep 10 13:16:55.314399 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:55.314366    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jjlr\" (UniqueName: \"kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr\") pod \"network-check-target-jhf84\" (UID: \"1bd0f34f-3600-4a79-b5e7-49c86862890f\") " pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:16:55.314586 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:55.314532    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 13:16:55.314642 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:55.314612    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 13:16:55.314642 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:55.314630    2584 projected.go:196] Error preparing data for projected volume kube-api-access-2jjlr for pod openshift-network-diagnostics/network-check-target-jhf84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 13:16:55.314725 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:55.314712    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr podName:1bd0f34f-3600-4a79-b5e7-49c86862890f nodeName:}" failed. No retries permitted until 2026-09-10 13:17:03.31469296 +0000 UTC m=+18.200319988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jjlr" (UniqueName: "kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr") pod "network-check-target-jhf84" (UID: "1bd0f34f-3600-4a79-b5e7-49c86862890f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 13:16:55.610172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:55.610146    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:55.612295 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:55.610908    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:55.612660 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:55.612636    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:16:55.612755 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:55.612712    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:16:56.607961 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:56.607919    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:16:56.608430 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:56.608068    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:16:57.607985 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:57.607333    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:57.607985 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:57.607471    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:16:57.608714 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:57.608569    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:57.608714 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:57.608675    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:16:58.606975 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:58.606945    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:16:58.607130 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:58.607054    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:16:59.607215 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:59.607176    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:16:59.607676 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:16:59.607192    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:16:59.607676 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:59.607313    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:16:59.607676 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:16:59.607413    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:17:00.607114 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:00.607080    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:00.607287 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:00.607204    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:17:01.607702 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:01.607664    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:01.608148 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:01.607817    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:17:01.608148 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:01.607874    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:01.608148 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:01.608026    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:17:02.607160 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:02.607133    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:02.607354 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:02.607252    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:17:03.275041 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:03.274998    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:03.275498 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:03.275074    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs\") pod \"network-metrics-daemon-cd2hp\" (UID: \"c9ca33a9-995c-4ea6-bd9f-d72442526915\") " pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:03.275498 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:03.275170    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 13:17:03.275498 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:03.275193    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 13:17:03.275498 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:03.275255    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret podName:2ecc73e8-ab67-439d-a624-8950a0b2fabb nodeName:}" failed. No retries permitted until 2026-09-10 13:17:19.275233642 +0000 UTC m=+34.160860674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret") pod "global-pull-secret-syncer-rtk5d" (UID: "2ecc73e8-ab67-439d-a624-8950a0b2fabb") : object "kube-system"/"original-pull-secret" not registered
Sep 10 13:17:03.275498 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:03.275277    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs podName:c9ca33a9-995c-4ea6-bd9f-d72442526915 nodeName:}" failed. No retries permitted until 2026-09-10 13:17:19.275266162 +0000 UTC m=+34.160893169 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs") pod "network-metrics-daemon-cd2hp" (UID: "c9ca33a9-995c-4ea6-bd9f-d72442526915") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 13:17:03.375609 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:03.375570    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jjlr\" (UniqueName: \"kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr\") pod \"network-check-target-jhf84\" (UID: \"1bd0f34f-3600-4a79-b5e7-49c86862890f\") " pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:03.375785 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:03.375762    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 13:17:03.375851 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:03.375789    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 13:17:03.375851 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:03.375799    2584 projected.go:196] Error preparing data for projected volume kube-api-access-2jjlr for pod openshift-network-diagnostics/network-check-target-jhf84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 13:17:03.375935 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:03.375868    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr podName:1bd0f34f-3600-4a79-b5e7-49c86862890f nodeName:}" failed. No retries permitted until 2026-09-10 13:17:19.375851544 +0000 UTC m=+34.261478568 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jjlr" (UniqueName: "kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr") pod "network-check-target-jhf84" (UID: "1bd0f34f-3600-4a79-b5e7-49c86862890f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 13:17:03.607026 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:03.606989    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:03.607199 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:03.607128    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:17:03.607199 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:03.607190    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:03.607345 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:03.607310    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:17:04.607295 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:04.607256    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:04.607785 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:04.607388    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:17:05.608544 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:05.608511    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:05.609035 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:05.608656    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:17:05.609035 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:05.608729    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:05.609035 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:05.608850    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:17:06.607497 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:06.607468    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:06.607644 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:06.607592    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:17:06.685117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:06.685082    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kkcx2" event={"ID":"68deb1d1-ced7-4eec-90c7-1090a1a404ca","Type":"ContainerStarted","Data":"534b0f1963988f6c4d1d993cc7a1a64c318384dbad4ded5b2b9218ba04e6bba2"}
Sep 10 13:17:06.687053 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:06.687026    2584 generic.go:356] "Generic (PLEG): container finished" podID="b81f7ba2-5295-427c-9907-4f8d192b48c2" containerID="0e142cfff6682bf47b8e2920abc377c1b46cbf704ba346746522f1f41dd75b68" exitCode=0
Sep 10 13:17:06.687176 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:06.687080    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpf7h" event={"ID":"b81f7ba2-5295-427c-9907-4f8d192b48c2","Type":"ContainerDied","Data":"0e142cfff6682bf47b8e2920abc377c1b46cbf704ba346746522f1f41dd75b68"}
Sep 10 13:17:06.689036 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:06.689001    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hvhhv" event={"ID":"704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c","Type":"ContainerStarted","Data":"04803c040a16195cad1451dacb0a94cc1447b67d1660bf4c3da8fb7b9f45325a"}
Sep 10 13:17:06.690510 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:06.690487    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d" event={"ID":"f155f267-7387-4d17-9889-4563fe82d62c","Type":"ContainerStarted","Data":"7d3fd4610f923430158948cfe4dc0e6d57354bb42def543c2a6b306a57c7a16c"}
Sep 10 13:17:06.692138 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:06.692109    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wz6wg" event={"ID":"d79b1e28-04a7-41e5-a873-b68d7e76add7","Type":"ContainerStarted","Data":"95159c38e886fc2802d4b3037ec35967d6d768eca735803e7f20540fcd12c396"}
Sep 10 13:17:06.694114 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:06.694091    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal" event={"ID":"2a208b5b474ebb06a3ac14440dd0bc67","Type":"ContainerStarted","Data":"6141689e83fbc3acd923f0355a61844f85b6e421cbbf14ffb2156eea4247f025"}
Sep 10 13:17:06.695595 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:06.695547    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kk7jh" event={"ID":"c95c08b3-1e01-423d-ac6a-f438256f15e9","Type":"ContainerStarted","Data":"e7de407bc64e490d5bd1f706cdfd66b57e390c66b782874b410fa1bef27926f6"}
Sep 10 13:17:06.753060 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:06.753021    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kkcx2" podStartSLOduration=3.3866540609999998 podStartE2EDuration="21.753004955s" totalImagesPullingTime="18.366350894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:06.727182699 +0000 UTC m=+21.612809726" watchObservedRunningTime="2026-09-10 13:17:06.753004955 +0000 UTC m=+21.638631982"
Sep 10 13:17:06.780749 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:06.780706    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wz6wg" podStartSLOduration=3.435054905 podStartE2EDuration="21.780690797s" totalImagesPullingTime="18.345635892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:06.753684255 +0000 UTC m=+21.639311282" watchObservedRunningTime="2026-09-10 13:17:06.780690797 +0000 UTC m=+21.666317818"
Sep 10 13:17:06.780870 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:06.780853    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kk7jh" podStartSLOduration=3.391533174 podStartE2EDuration="21.780848097s" totalImagesPullingTime="18.389314923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:06.78082093 +0000 UTC m=+21.666447939" watchObservedRunningTime="2026-09-10 13:17:06.780848097 +0000 UTC m=+21.666475124"
Sep 10 13:17:06.811712 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:06.811646    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hvhhv" podStartSLOduration=3.503080622 podStartE2EDuration="21.811631017s" totalImagesPullingTime="18.308550395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:06.81119951 +0000 UTC m=+21.696826537" watchObservedRunningTime="2026-09-10 13:17:06.811631017 +0000 UTC m=+21.697258044"
Sep 10 13:17:06.851638 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:06.851597    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-211.ec2.internal" podStartSLOduration=19.85158265 podStartE2EDuration="19.85158265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:16:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:06.85146929 +0000 UTC m=+21.737096321" watchObservedRunningTime="2026-09-10 13:17:06.85158265 +0000 UTC m=+21.737209677"
Sep 10 13:17:07.608159 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:07.607967    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:07.608416 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:07.608011    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:07.608416 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:07.608282    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:17:07.608416 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:07.608336    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:17:07.701578 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:07.701490    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:17:07.702380 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:07.701917    2584 generic.go:356] "Generic (PLEG): container finished" podID="8b7d18c8-587e-48db-b362-f3282dcb53f2" containerID="7a7de8c7b2ac5ca86878246f800ccb8e36c7a4d7575df6d12c93b43bcdf8ca0c" exitCode=1
Sep 10 13:17:07.702380 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:07.701995    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl" event={"ID":"8b7d18c8-587e-48db-b362-f3282dcb53f2","Type":"ContainerStarted","Data":"302192e27a03399ae74909bbc2c72249802d79984d774292554a750632ae33ff"}
Sep 10 13:17:07.702380 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:07.702084    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl" event={"ID":"8b7d18c8-587e-48db-b362-f3282dcb53f2","Type":"ContainerStarted","Data":"a2e122bcaedf1478d3a649d38daa85d5dc4d000b1eee5f99ef29aefb4257e179"}
Sep 10 13:17:07.702380 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:07.702136    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl" event={"ID":"8b7d18c8-587e-48db-b362-f3282dcb53f2","Type":"ContainerStarted","Data":"38fd29ed2fe3a82273e740e9a5155a2037b9638e60db90eb618d909b3b955327"}
Sep 10 13:17:07.702380 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:07.702185    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl" event={"ID":"8b7d18c8-587e-48db-b362-f3282dcb53f2","Type":"ContainerStarted","Data":"8c69ed93560152a4e45948271384108890e361d72ad2ea054cf8af4ea87e878e"}
Sep 10 13:17:07.702380 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:07.702232    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl" event={"ID":"8b7d18c8-587e-48db-b362-f3282dcb53f2","Type":"ContainerDied","Data":"7a7de8c7b2ac5ca86878246f800ccb8e36c7a4d7575df6d12c93b43bcdf8ca0c"}
Sep 10 13:17:07.702380 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:07.702281    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl" event={"ID":"8b7d18c8-587e-48db-b362-f3282dcb53f2","Type":"ContainerStarted","Data":"967a40796b23b2c72fd1557160f225b63f94c90e6fb2be7b88287f0d57be0f65"}
Sep 10 13:17:07.703771 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:07.703740    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nxv66" event={"ID":"71e793f7-fd71-43c9-9d4a-373c219ac86b","Type":"ContainerStarted","Data":"e6096a0efb95ed1024e380f58dfec16f0bb1cb890659143368befeaa111e3c01"}
Sep 10 13:17:07.734588 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:07.734544    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kkcx2"
Sep 10 13:17:07.735401 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:07.735374    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kkcx2"
Sep 10 13:17:07.752113 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:07.752062    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nxv66" podStartSLOduration=5.170244756 podStartE2EDuration="22.752044887s" totalImagesPullingTime="17.581800131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:07.723433362 +0000 UTC m=+22.609060390" watchObservedRunningTime="2026-09-10 13:17:07.752044887 +0000 UTC m=+22.637671915"
Sep 10 13:17:08.393723 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:08.393702    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 13:17:08.607659 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:08.607630    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:08.607826 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:08.607723    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:17:08.607888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:08.607818    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T13:17:08.393720018Z","UUID":"956ee20e-d2bf-421f-a799-f8aaf6becd3b","Handler":null,"Name":"","Endpoint":""}
Sep 10 13:17:08.609239 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:08.609221    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 13:17:08.609350 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:08.609250    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 13:17:08.708507 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:08.708472    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d" event={"ID":"f155f267-7387-4d17-9889-4563fe82d62c","Type":"ContainerStarted","Data":"19a8bbc55694f4e1c701fd98e4fb02f282de5a37295646a5dc7f0de8730b1408"}
Sep 10 13:17:08.708968 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:08.708738    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kkcx2"
Sep 10 13:17:08.709547 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:08.709509    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kkcx2"
Sep 10 13:17:09.607586 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:09.607542    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:09.607762 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:09.607674    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:17:09.609630 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:09.609609    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:09.609753 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:09.609738    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:17:09.715155 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:09.715124    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:17:09.715623 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:09.715592    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl" event={"ID":"8b7d18c8-587e-48db-b362-f3282dcb53f2","Type":"ContainerStarted","Data":"d47f00d57d0fc1fb0b564defdb6636c738d1890bbb16865f8adfb8be0b14d129"}
Sep 10 13:17:10.606915 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:10.606886    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:10.607068 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:10.606995    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:17:10.720461 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:10.720423    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d" event={"ID":"f155f267-7387-4d17-9889-4563fe82d62c","Type":"ContainerStarted","Data":"29d8c4f6f3857c3724aefbab3dcf60ab9c2c03132db531fac7fac690633eb396"}
Sep 10 13:17:10.743156 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:10.743102    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hw2d" podStartSLOduration=3.704287692 podStartE2EDuration="25.743084396s" totalImagesPullingTime="22.038796704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:16:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:10.742765601 +0000 UTC m=+25.628392628" watchObservedRunningTime="2026-09-10 13:17:10.743084396 +0000 UTC m=+25.628711420"
Sep 10 13:17:11.607437 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:11.607401    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:11.607437 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:11.607428    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:11.607700 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:11.607570    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:17:11.607700 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:11.607686    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:17:12.607571 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:12.607392    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:12.608152 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:12.607657    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:17:12.728080 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:12.728055    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:17:12.728455 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:12.728429    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl" event={"ID":"8b7d18c8-587e-48db-b362-f3282dcb53f2","Type":"ContainerStarted","Data":"6827aefc1040dc97c388837c6e2af2128fd52f717774abd77247172909400079"}
Sep 10 13:17:12.728797 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:12.728768    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:17:12.728921 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:12.728903    2584 scope.go:117] "RemoveContainer" containerID="7a7de8c7b2ac5ca86878246f800ccb8e36c7a4d7575df6d12c93b43bcdf8ca0c"
Sep 10 13:17:12.730428 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:12.730396    2584 generic.go:356] "Generic (PLEG): container finished" podID="b81f7ba2-5295-427c-9907-4f8d192b48c2" containerID="6b2b65c440479373b42d8aa9bee87cbe6486be6ea55284cc6d65d8e0827d918c" exitCode=0
Sep 10 13:17:12.730494 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:12.730455    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpf7h" event={"ID":"b81f7ba2-5295-427c-9907-4f8d192b48c2","Type":"ContainerDied","Data":"6b2b65c440479373b42d8aa9bee87cbe6486be6ea55284cc6d65d8e0827d918c"}
Sep 10 13:17:12.745539 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:12.745522    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:17:13.607681 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:13.607641    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:13.608147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:13.607652    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:13.608147 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:13.607796    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:17:13.608147 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:13.607823    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:17:13.738337 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:13.738313    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:17:13.740228 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:13.739638    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl" event={"ID":"8b7d18c8-587e-48db-b362-f3282dcb53f2","Type":"ContainerStarted","Data":"6832658632c5ab5589f024e0bf672067a37febc70836a0a77f40282fa6ea5400"}
Sep 10 13:17:13.740830 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:13.740810    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:17:13.740964 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:13.740877    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:17:13.757517 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:13.757495    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:17:13.776408 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:13.776367    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl" podStartSLOduration=9.702939984 podStartE2EDuration="27.776354268s" totalImagesPullingTime="18.073414284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:13.774654055 +0000 UTC m=+28.660281083" watchObservedRunningTime="2026-09-10 13:17:13.776354268 +0000 UTC m=+28.661981295"
Sep 10 13:17:14.358472 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:14.358285    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rtk5d"]
Sep 10 13:17:14.358690 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:14.358581    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:14.358690 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:14.358671    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:17:14.361095 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:14.361071    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cd2hp"]
Sep 10 13:17:14.361212 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:14.361189    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:14.361318 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:14.361299    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:17:14.364128 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:14.364108    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jhf84"]
Sep 10 13:17:14.364221 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:14.364204    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:14.364327 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:14.364293    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:17:14.743833 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:14.743745    2584 generic.go:356] "Generic (PLEG): container finished" podID="b81f7ba2-5295-427c-9907-4f8d192b48c2" containerID="82c94f0dfa2d822a428edff0d606084c6923349537d57c2961b1c6c9b135a376" exitCode=0
Sep 10 13:17:14.744163 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:14.743836    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpf7h" event={"ID":"b81f7ba2-5295-427c-9907-4f8d192b48c2","Type":"ContainerDied","Data":"82c94f0dfa2d822a428edff0d606084c6923349537d57c2961b1c6c9b135a376"}
Sep 10 13:17:15.608524 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:15.608503    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:15.608658 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:15.608610    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:17:16.607023 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:16.606998    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:16.607389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:16.606998    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:16.607389 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:16.607123    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:17:16.607389 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:16.607176    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:17:16.750702 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:16.750664    2584 generic.go:356] "Generic (PLEG): container finished" podID="b81f7ba2-5295-427c-9907-4f8d192b48c2" containerID="8c1bb8ab4323130d234c98ac280575fc11fce81d90dfaec3a22ef2c42472a867" exitCode=0
Sep 10 13:17:16.750843 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:16.750723    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpf7h" event={"ID":"b81f7ba2-5295-427c-9907-4f8d192b48c2","Type":"ContainerDied","Data":"8c1bb8ab4323130d234c98ac280575fc11fce81d90dfaec3a22ef2c42472a867"}
Sep 10 13:17:17.607252 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:17.607223    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:17.607724 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:17.607339    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:17:18.607000 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:18.606957    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:18.607281 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:18.606957    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:18.607281 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:18.607075    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd2hp" podUID="c9ca33a9-995c-4ea6-bd9f-d72442526915"
Sep 10 13:17:18.607281 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:18.607170    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtk5d" podUID="2ecc73e8-ab67-439d-a624-8950a0b2fabb"
Sep 10 13:17:19.300161 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:19.300123    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:19.300325 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:19.300177    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs\") pod \"network-metrics-daemon-cd2hp\" (UID: \"c9ca33a9-995c-4ea6-bd9f-d72442526915\") " pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:19.300325 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:19.300287    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 13:17:19.300325 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:19.300289    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 13:17:19.300426 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:19.300348    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret podName:2ecc73e8-ab67-439d-a624-8950a0b2fabb nodeName:}" failed. No retries permitted until 2026-09-10 13:17:51.300328438 +0000 UTC m=+66.185955456 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret") pod "global-pull-secret-syncer-rtk5d" (UID: "2ecc73e8-ab67-439d-a624-8950a0b2fabb") : object "kube-system"/"original-pull-secret" not registered
Sep 10 13:17:19.300426 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:19.300364    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs podName:c9ca33a9-995c-4ea6-bd9f-d72442526915 nodeName:}" failed. No retries permitted until 2026-09-10 13:17:51.300357071 +0000 UTC m=+66.185984076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs") pod "network-metrics-daemon-cd2hp" (UID: "c9ca33a9-995c-4ea6-bd9f-d72442526915") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 13:17:19.401371 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:19.401343    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jjlr\" (UniqueName: \"kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr\") pod \"network-check-target-jhf84\" (UID: \"1bd0f34f-3600-4a79-b5e7-49c86862890f\") " pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:19.401580 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:19.401496    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 13:17:19.401580 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:19.401512    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 13:17:19.401580 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:19.401527    2584 projected.go:196] Error preparing data for projected volume kube-api-access-2jjlr for pod openshift-network-diagnostics/network-check-target-jhf84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 13:17:19.401752 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:19.401608    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr podName:1bd0f34f-3600-4a79-b5e7-49c86862890f nodeName:}" failed. No retries permitted until 2026-09-10 13:17:51.401595619 +0000 UTC m=+66.287222624 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jjlr" (UniqueName: "kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr") pod "network-check-target-jhf84" (UID: "1bd0f34f-3600-4a79-b5e7-49c86862890f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 13:17:19.607956 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:19.607921    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:19.608398 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:19.608052    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhf84" podUID="1bd0f34f-3600-4a79-b5e7-49c86862890f"
Sep 10 13:17:19.961938 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:19.961863    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-211.ec2.internal" event="NodeReady"
Sep 10 13:17:19.962098 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:19.961994    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 13:17:20.002489 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.002456    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76687847b5-rlsk5"]
Sep 10 13:17:20.004651 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.004625    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.007501 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.007477    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 13:17:20.007640 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.007532    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 13:17:20.007640 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.007581    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hqw92\""
Sep 10 13:17:20.007876 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.007856    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 13:17:20.014296 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.014267    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pvgkz"]
Sep 10 13:17:20.014698 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.014680    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 13:17:20.016144 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.016127    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pvgkz"
Sep 10 13:17:20.018789 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.018772    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 13:17:20.018893 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.018799    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 13:17:20.018893 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.018813    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 13:17:20.019006 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.018901    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-74kfd\""
Sep 10 13:17:20.021095 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.021076    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76687847b5-rlsk5"]
Sep 10 13:17:20.027994 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.027971    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pvgkz"]
Sep 10 13:17:20.106847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.106813    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-installation-pull-secrets\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.106996 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.106851    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-ca-trust-extracted\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.106996 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.106878    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-bound-sa-token\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.106996 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.106906    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-image-registry-private-configuration\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.106996 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.106938    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1806c922-6bc4-4db8-83e8-15fdb1684b16-cert\") pod \"ingress-canary-pvgkz\" (UID: \"1806c922-6bc4-4db8-83e8-15fdb1684b16\") " pod="openshift-ingress-canary/ingress-canary-pvgkz"
Sep 10 13:17:20.106996 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.106986    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-trusted-ca\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.107157 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.107016    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-certificates\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.107157 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.107047    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57ngb\" (UniqueName: \"kubernetes.io/projected/1806c922-6bc4-4db8-83e8-15fdb1684b16-kube-api-access-57ngb\") pod \"ingress-canary-pvgkz\" (UID: \"1806c922-6bc4-4db8-83e8-15fdb1684b16\") " pod="openshift-ingress-canary/ingress-canary-pvgkz"
Sep 10 13:17:20.107157 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.107109    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg5lp\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-kube-api-access-xg5lp\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.107242 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.107176    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.127120 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.127092    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fqzp6"]
Sep 10 13:17:20.128954 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.128940    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:20.131778 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.131755    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 13:17:20.131894 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.131789    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 13:17:20.131894 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.131790    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 13:17:20.132071 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.132057    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 13:17:20.132133 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.132108    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fkjjg\""
Sep 10 13:17:20.143806 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.143781    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fqzp6"]
Sep 10 13:17:20.152136 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.152107    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkcx2_68deb1d1-ced7-4eec-90c7-1090a1a404ca/konnectivity-agent/0.log" limit=1024
Sep 10 13:17:20.207859 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.207822    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.208024 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.207875    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79818a02-d821-4a83-865c-240c44e4c5ec-tmp-dir\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:20.208024 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.207917    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-installation-pull-secrets\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.208024 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.207956    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-ca-trust-extracted\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.208024 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.207981    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-bound-sa-token\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.208024 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.208018    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-image-registry-private-configuration\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.208359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.208043    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1806c922-6bc4-4db8-83e8-15fdb1684b16-cert\") pod \"ingress-canary-pvgkz\" (UID: \"1806c922-6bc4-4db8-83e8-15fdb1684b16\") " pod="openshift-ingress-canary/ingress-canary-pvgkz"
Sep 10 13:17:20.208359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.208069    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-trusted-ca\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.208359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.208094    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79818a02-d821-4a83-865c-240c44e4c5ec-config-volume\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:20.208359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.208121    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-certificates\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.208359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.208157    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:20.208359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.208180    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tw7p\" (UniqueName: \"kubernetes.io/projected/79818a02-d821-4a83-865c-240c44e4c5ec-kube-api-access-8tw7p\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:20.208359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.208206    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57ngb\" (UniqueName: \"kubernetes.io/projected/1806c922-6bc4-4db8-83e8-15fdb1684b16-kube-api-access-57ngb\") pod \"ingress-canary-pvgkz\" (UID: \"1806c922-6bc4-4db8-83e8-15fdb1684b16\") " pod="openshift-ingress-canary/ingress-canary-pvgkz"
Sep 10 13:17:20.208359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.208237    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg5lp\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-kube-api-access-xg5lp\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.208359 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:20.207982    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 13:17:20.208359 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:20.208266    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76687847b5-rlsk5: secret "image-registry-tls" not found
Sep 10 13:17:20.208359 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:20.208337    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls podName:3f1d7a7a-4610-4436-b3ae-d89a45d99b2d nodeName:}" failed. No retries permitted until 2026-09-10 13:17:20.708317491 +0000 UTC m=+35.593944501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls") pod "image-registry-76687847b5-rlsk5" (UID: "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d") : secret "image-registry-tls" not found
Sep 10 13:17:20.208963 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.208389    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-ca-trust-extracted\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.208963 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.208945    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-certificates\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.209359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.209336    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-trusted-ca\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.213116 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.212933    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-installation-pull-secrets\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.213116 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.212991    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1806c922-6bc4-4db8-83e8-15fdb1684b16-cert\") pod \"ingress-canary-pvgkz\" (UID: \"1806c922-6bc4-4db8-83e8-15fdb1684b16\") " pod="openshift-ingress-canary/ingress-canary-pvgkz"
Sep 10 13:17:20.213281 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.213056    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-image-registry-private-configuration\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.218074 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.218052    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57ngb\" (UniqueName: \"kubernetes.io/projected/1806c922-6bc4-4db8-83e8-15fdb1684b16-kube-api-access-57ngb\") pod \"ingress-canary-pvgkz\" (UID: \"1806c922-6bc4-4db8-83e8-15fdb1684b16\") " pod="openshift-ingress-canary/ingress-canary-pvgkz"
Sep 10 13:17:20.218170 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.218052    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-bound-sa-token\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.218443 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.218424    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg5lp\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-kube-api-access-xg5lp\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.269078 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.269040    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkcx2_68deb1d1-ced7-4eec-90c7-1090a1a404ca/konnectivity-agent/0.log" limit=1024
Sep 10 13:17:20.308942 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.308903    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79818a02-d821-4a83-865c-240c44e4c5ec-config-volume\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:20.309095 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.308966    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:20.309095 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.308997    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tw7p\" (UniqueName: \"kubernetes.io/projected/79818a02-d821-4a83-865c-240c44e4c5ec-kube-api-access-8tw7p\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:20.309095 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.309052    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79818a02-d821-4a83-865c-240c44e4c5ec-tmp-dir\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:20.309095 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:20.309080    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 13:17:20.309285 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:20.309148    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls podName:79818a02-d821-4a83-865c-240c44e4c5ec nodeName:}" failed. No retries permitted until 2026-09-10 13:17:20.809129547 +0000 UTC m=+35.694756565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls") pod "dns-default-fqzp6" (UID: "79818a02-d821-4a83-865c-240c44e4c5ec") : secret "dns-default-metrics-tls" not found
Sep 10 13:17:20.309375 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.309347    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79818a02-d821-4a83-865c-240c44e4c5ec-tmp-dir\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:20.309614 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.309538    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79818a02-d821-4a83-865c-240c44e4c5ec-config-volume\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:20.322511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.322486    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tw7p\" (UniqueName: \"kubernetes.io/projected/79818a02-d821-4a83-865c-240c44e4c5ec-kube-api-access-8tw7p\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:20.327286 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.327264    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pvgkz"
Sep 10 13:17:20.363785 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.363745    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkcx2_68deb1d1-ced7-4eec-90c7-1090a1a404ca/konnectivity-agent/0.log" limit=1024
Sep 10 13:17:20.434775 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.434746    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-ccf52"]
Sep 10 13:17:20.436720 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.436699    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ccf52"
Sep 10 13:17:20.439952 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.439931    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9hbcs\""
Sep 10 13:17:20.467281 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.467205    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkcx2_68deb1d1-ced7-4eec-90c7-1090a1a404ca/konnectivity-agent/0.log" limit=1024
Sep 10 13:17:20.510960 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.510927    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9ce9b89-8697-4720-9e7e-bf40f89f9ceb-hosts-file\") pod \"node-resolver-ccf52\" (UID: \"f9ce9b89-8697-4720-9e7e-bf40f89f9ceb\") " pod="openshift-dns/node-resolver-ccf52"
Sep 10 13:17:20.511111 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.510970    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9ce9b89-8697-4720-9e7e-bf40f89f9ceb-tmp-dir\") pod \"node-resolver-ccf52\" (UID: \"f9ce9b89-8697-4720-9e7e-bf40f89f9ceb\") " pod="openshift-dns/node-resolver-ccf52"
Sep 10 13:17:20.511111 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.511047    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2nt5\" (UniqueName: \"kubernetes.io/projected/f9ce9b89-8697-4720-9e7e-bf40f89f9ceb-kube-api-access-k2nt5\") pod \"node-resolver-ccf52\" (UID: \"f9ce9b89-8697-4720-9e7e-bf40f89f9ceb\") " pod="openshift-dns/node-resolver-ccf52"
Sep 10 13:17:20.553792 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.553729    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkcx2_68deb1d1-ced7-4eec-90c7-1090a1a404ca/konnectivity-agent/0.log" limit=1024
Sep 10 13:17:20.607046 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.607013    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:20.607207 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.607014    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:20.610096 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.610064    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5vlq4\""
Sep 10 13:17:20.610762 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.610165    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 13:17:20.610762 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.610278    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 13:17:20.611968 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.611945    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9ce9b89-8697-4720-9e7e-bf40f89f9ceb-hosts-file\") pod \"node-resolver-ccf52\" (UID: \"f9ce9b89-8697-4720-9e7e-bf40f89f9ceb\") " pod="openshift-dns/node-resolver-ccf52"
Sep 10 13:17:20.612087 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.611997    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9ce9b89-8697-4720-9e7e-bf40f89f9ceb-tmp-dir\") pod \"node-resolver-ccf52\" (UID: \"f9ce9b89-8697-4720-9e7e-bf40f89f9ceb\") " pod="openshift-dns/node-resolver-ccf52"
Sep 10 13:17:20.612087 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.612051    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2nt5\" (UniqueName: \"kubernetes.io/projected/f9ce9b89-8697-4720-9e7e-bf40f89f9ceb-kube-api-access-k2nt5\") pod \"node-resolver-ccf52\" (UID: \"f9ce9b89-8697-4720-9e7e-bf40f89f9ceb\") " pod="openshift-dns/node-resolver-ccf52"
Sep 10 13:17:20.612437 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.612421    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9ce9b89-8697-4720-9e7e-bf40f89f9ceb-hosts-file\") pod \"node-resolver-ccf52\" (UID: \"f9ce9b89-8697-4720-9e7e-bf40f89f9ceb\") " pod="openshift-dns/node-resolver-ccf52"
Sep 10 13:17:20.612830 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.612810    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9ce9b89-8697-4720-9e7e-bf40f89f9ceb-tmp-dir\") pod \"node-resolver-ccf52\" (UID: \"f9ce9b89-8697-4720-9e7e-bf40f89f9ceb\") " pod="openshift-dns/node-resolver-ccf52"
Sep 10 13:17:20.615219 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.615190    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pvgkz"]
Sep 10 13:17:20.621997 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.621971    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2nt5\" (UniqueName: \"kubernetes.io/projected/f9ce9b89-8697-4720-9e7e-bf40f89f9ceb-kube-api-access-k2nt5\") pod \"node-resolver-ccf52\" (UID: \"f9ce9b89-8697-4720-9e7e-bf40f89f9ceb\") " pod="openshift-dns/node-resolver-ccf52"
Sep 10 13:17:20.713187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.713152    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:20.713374 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:20.713328    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 13:17:20.713374 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:20.713355    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76687847b5-rlsk5: secret "image-registry-tls" not found
Sep 10 13:17:20.713465 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:20.713432    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls podName:3f1d7a7a-4610-4436-b3ae-d89a45d99b2d nodeName:}" failed. No retries permitted until 2026-09-10 13:17:21.7134076 +0000 UTC m=+36.599034630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls") pod "image-registry-76687847b5-rlsk5" (UID: "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d") : secret "image-registry-tls" not found
Sep 10 13:17:20.737640 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.737526    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkcx2_68deb1d1-ced7-4eec-90c7-1090a1a404ca/konnectivity-agent/0.log" limit=1024
Sep 10 13:17:20.746476 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.746454    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ccf52"
Sep 10 13:17:20.814646 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.814610    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:20.814822 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:20.814783    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 13:17:20.814884 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:20.814872    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls podName:79818a02-d821-4a83-865c-240c44e4c5ec nodeName:}" failed. No retries permitted until 2026-09-10 13:17:21.814849886 +0000 UTC m=+36.700476898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls") pod "dns-default-fqzp6" (UID: "79818a02-d821-4a83-865c-240c44e4c5ec") : secret "dns-default-metrics-tls" not found
Sep 10 13:17:20.860980 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:20.860937    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkcx2_68deb1d1-ced7-4eec-90c7-1090a1a404ca/konnectivity-agent/0.log" limit=1024
Sep 10 13:17:21.607432 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.607395    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:21.611013 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.610988    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 13:17:21.612140 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.612120    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 13:17:21.612268 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.612120    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w47rx\""
Sep 10 13:17:21.721686 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.721648    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:21.721879 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:21.721815    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 13:17:21.721879 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:21.721836    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76687847b5-rlsk5: secret "image-registry-tls" not found
Sep 10 13:17:21.721979 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:21.721906    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls podName:3f1d7a7a-4610-4436-b3ae-d89a45d99b2d nodeName:}" failed. No retries permitted until 2026-09-10 13:17:23.721883923 +0000 UTC m=+38.607510943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls") pod "image-registry-76687847b5-rlsk5" (UID: "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d") : secret "image-registry-tls" not found
Sep 10 13:17:21.822651 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.822613    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:21.822837 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:21.822785    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 13:17:21.822897 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:21.822868    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls podName:79818a02-d821-4a83-865c-240c44e4c5ec nodeName:}" failed. No retries permitted until 2026-09-10 13:17:23.822847116 +0000 UTC m=+38.708474124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls") pod "dns-default-fqzp6" (UID: "79818a02-d821-4a83-865c-240c44e4c5ec") : secret "dns-default-metrics-tls" not found
Sep 10 13:17:21.932065 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:21.931978    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1806c922_6bc4_4db8_83e8_15fdb1684b16.slice/crio-681f227fecce54529345aeec2f381ef46fde46905515121b742ff2f1ac300bcc WatchSource:0}: Error finding container 681f227fecce54529345aeec2f381ef46fde46905515121b742ff2f1ac300bcc: Status 404 returned error can't find the container with id 681f227fecce54529345aeec2f381ef46fde46905515121b742ff2f1ac300bcc
Sep 10 13:17:21.937513 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:21.937486    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ce9b89_8697_4720_9e7e_bf40f89f9ceb.slice/crio-48dc9a71afe21e0b94861338a7aad2c9be9d3921064ddeefcbb0607f95822f3e WatchSource:0}: Error finding container 48dc9a71afe21e0b94861338a7aad2c9be9d3921064ddeefcbb0607f95822f3e: Status 404 returned error can't find the container with id 48dc9a71afe21e0b94861338a7aad2c9be9d3921064ddeefcbb0607f95822f3e
Sep 10 13:17:21.963486 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.963457    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc87c88d-ddz86"]
Sep 10 13:17:21.967948 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.967923    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"]
Sep 10 13:17:21.968639 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.968616    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc87c88d-ddz86"
Sep 10 13:17:21.971550 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.971530    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"
Sep 10 13:17:21.971674 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.971617    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 13:17:21.971674 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.971663    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vlzfn\""
Sep 10 13:17:21.971776 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.971696    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 13:17:21.971776 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.971707    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 10 13:17:21.971893 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.971827    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 13:17:21.974079 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.974030    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 10 13:17:21.977580 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.977003    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc87c88d-ddz86"]
Sep 10 13:17:21.980494 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:21.979960    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"]
Sep 10 13:17:22.009630 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.009588    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"]
Sep 10 13:17:22.025686 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.025651    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.027481 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.027454    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"]
Sep 10 13:17:22.028634 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.028584    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 10 13:17:22.028634 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.028632    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 10 13:17:22.028809 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.028588    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 10 13:17:22.028866 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.028834    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 10 13:17:22.125627 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.125448    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a9a79779-a597-4381-8997-171ece4d99e9-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b76c4448d-5w6f8\" (UID: \"a9a79779-a597-4381-8997-171ece4d99e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"
Sep 10 13:17:22.125713 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.125641    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5414969e-846d-4bd0-836b-30a1f454a912-hub\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.125713 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.125660    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z447f\" (UniqueName: \"kubernetes.io/projected/5414969e-846d-4bd0-836b-30a1f454a912-kube-api-access-z447f\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.125713 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.125711    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/916cdff4-9dca-4e7f-9ecb-5995081dc749-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85dc87c88d-ddz86\" (UID: \"916cdff4-9dca-4e7f-9ecb-5995081dc749\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc87c88d-ddz86"
Sep 10 13:17:22.125834 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.125772    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9a79779-a597-4381-8997-171ece4d99e9-tmp\") pod \"klusterlet-addon-workmgr-7b76c4448d-5w6f8\" (UID: \"a9a79779-a597-4381-8997-171ece4d99e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"
Sep 10 13:17:22.125834 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.125825    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5414969e-846d-4bd0-836b-30a1f454a912-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.125919 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.125845    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p755c\" (UniqueName: \"kubernetes.io/projected/a9a79779-a597-4381-8997-171ece4d99e9-kube-api-access-p755c\") pod \"klusterlet-addon-workmgr-7b76c4448d-5w6f8\" (UID: \"a9a79779-a597-4381-8997-171ece4d99e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"
Sep 10 13:17:22.125919 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.125866    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5414969e-846d-4bd0-836b-30a1f454a912-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.125987 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.125917    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mpns\" (UniqueName: \"kubernetes.io/projected/916cdff4-9dca-4e7f-9ecb-5995081dc749-kube-api-access-2mpns\") pod \"managed-serviceaccount-addon-agent-85dc87c88d-ddz86\" (UID: \"916cdff4-9dca-4e7f-9ecb-5995081dc749\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc87c88d-ddz86"
Sep 10 13:17:22.125987 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.125965    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5414969e-846d-4bd0-836b-30a1f454a912-ca\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.126057 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.125991    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5414969e-846d-4bd0-836b-30a1f454a912-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.226495 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.226469    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5414969e-846d-4bd0-836b-30a1f454a912-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.226624 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.226541    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mpns\" (UniqueName: \"kubernetes.io/projected/916cdff4-9dca-4e7f-9ecb-5995081dc749-kube-api-access-2mpns\") pod \"managed-serviceaccount-addon-agent-85dc87c88d-ddz86\" (UID: \"916cdff4-9dca-4e7f-9ecb-5995081dc749\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc87c88d-ddz86"
Sep 10 13:17:22.226624 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.226592    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5414969e-846d-4bd0-836b-30a1f454a912-ca\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.226624 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.226619    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5414969e-846d-4bd0-836b-30a1f454a912-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.226766 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.226662    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a9a79779-a597-4381-8997-171ece4d99e9-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b76c4448d-5w6f8\" (UID: \"a9a79779-a597-4381-8997-171ece4d99e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"
Sep 10 13:17:22.226766 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.226684    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5414969e-846d-4bd0-836b-30a1f454a912-hub\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.226766 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.226707    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z447f\" (UniqueName: \"kubernetes.io/projected/5414969e-846d-4bd0-836b-30a1f454a912-kube-api-access-z447f\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.226903 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.226765    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/916cdff4-9dca-4e7f-9ecb-5995081dc749-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85dc87c88d-ddz86\" (UID: \"916cdff4-9dca-4e7f-9ecb-5995081dc749\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc87c88d-ddz86"
Sep 10 13:17:22.226903 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.226792    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9a79779-a597-4381-8997-171ece4d99e9-tmp\") pod \"klusterlet-addon-workmgr-7b76c4448d-5w6f8\" (UID: \"a9a79779-a597-4381-8997-171ece4d99e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"
Sep 10 13:17:22.226903 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.226831    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5414969e-846d-4bd0-836b-30a1f454a912-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.226903 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.226861    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p755c\" (UniqueName: \"kubernetes.io/projected/a9a79779-a597-4381-8997-171ece4d99e9-kube-api-access-p755c\") pod \"klusterlet-addon-workmgr-7b76c4448d-5w6f8\" (UID: \"a9a79779-a597-4381-8997-171ece4d99e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"
Sep 10 13:17:22.228356 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.227618    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9a79779-a597-4381-8997-171ece4d99e9-tmp\") pod \"klusterlet-addon-workmgr-7b76c4448d-5w6f8\" (UID: \"a9a79779-a597-4381-8997-171ece4d99e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"
Sep 10 13:17:22.228356 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.228297    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5414969e-846d-4bd0-836b-30a1f454a912-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.230438 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.230387    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5414969e-846d-4bd0-836b-30a1f454a912-ca\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.230594 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.230549    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/916cdff4-9dca-4e7f-9ecb-5995081dc749-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85dc87c88d-ddz86\" (UID: \"916cdff4-9dca-4e7f-9ecb-5995081dc749\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc87c88d-ddz86"
Sep 10 13:17:22.230678 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.230633    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5414969e-846d-4bd0-836b-30a1f454a912-hub\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.230812 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.230789    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5414969e-846d-4bd0-836b-30a1f454a912-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.231213 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.231192    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5414969e-846d-4bd0-836b-30a1f454a912-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.231959 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.231930    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a9a79779-a597-4381-8997-171ece4d99e9-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b76c4448d-5w6f8\" (UID: \"a9a79779-a597-4381-8997-171ece4d99e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"
Sep 10 13:17:22.236190 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.236167    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mpns\" (UniqueName: \"kubernetes.io/projected/916cdff4-9dca-4e7f-9ecb-5995081dc749-kube-api-access-2mpns\") pod \"managed-serviceaccount-addon-agent-85dc87c88d-ddz86\" (UID: \"916cdff4-9dca-4e7f-9ecb-5995081dc749\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc87c88d-ddz86"
Sep 10 13:17:22.236648 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.236632    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z447f\" (UniqueName: \"kubernetes.io/projected/5414969e-846d-4bd0-836b-30a1f454a912-kube-api-access-z447f\") pod \"cluster-proxy-proxy-agent-6c94944759-hp68f\" (UID: \"5414969e-846d-4bd0-836b-30a1f454a912\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.236709 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.236690    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p755c\" (UniqueName: \"kubernetes.io/projected/a9a79779-a597-4381-8997-171ece4d99e9-kube-api-access-p755c\") pod \"klusterlet-addon-workmgr-7b76c4448d-5w6f8\" (UID: \"a9a79779-a597-4381-8997-171ece4d99e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"
Sep 10 13:17:22.292954 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.292929    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc87c88d-ddz86"
Sep 10 13:17:22.316015 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.315990    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"
Sep 10 13:17:22.339476 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.339442    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:17:22.583484 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.583461    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc87c88d-ddz86"]
Sep 10 13:17:22.588462 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:22.587251    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod916cdff4_9dca_4e7f_9ecb_5995081dc749.slice/crio-d163012950616a82b82ae191336aaac7707da5e4a6cc3dc0480e5eea9a40f606 WatchSource:0}: Error finding container d163012950616a82b82ae191336aaac7707da5e4a6cc3dc0480e5eea9a40f606: Status 404 returned error can't find the container with id d163012950616a82b82ae191336aaac7707da5e4a6cc3dc0480e5eea9a40f606
Sep 10 13:17:22.604743 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.604718    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"]
Sep 10 13:17:22.607976 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:22.607944    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a79779_a597_4381_8997_171ece4d99e9.slice/crio-09b478b9815aec8e4c0cbe97ee6f1cd41bca20a5819988061a4fdf4f23a9d95b WatchSource:0}: Error finding container 09b478b9815aec8e4c0cbe97ee6f1cd41bca20a5819988061a4fdf4f23a9d95b: Status 404 returned error can't find the container with id 09b478b9815aec8e4c0cbe97ee6f1cd41bca20a5819988061a4fdf4f23a9d95b
Sep 10 13:17:22.642208 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.642179    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"]
Sep 10 13:17:22.645626 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:22.645594    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5414969e_846d_4bd0_836b_30a1f454a912.slice/crio-37bbdb15fc773a00a641eea9b6a234533638f6b269a75c9189b8b84835df4513 WatchSource:0}: Error finding container 37bbdb15fc773a00a641eea9b6a234533638f6b269a75c9189b8b84835df4513: Status 404 returned error can't find the container with id 37bbdb15fc773a00a641eea9b6a234533638f6b269a75c9189b8b84835df4513
Sep 10 13:17:22.768389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.768343    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f" event={"ID":"5414969e-846d-4bd0-836b-30a1f454a912","Type":"ContainerStarted","Data":"37bbdb15fc773a00a641eea9b6a234533638f6b269a75c9189b8b84835df4513"}
Sep 10 13:17:22.769966 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.769938    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ccf52" event={"ID":"f9ce9b89-8697-4720-9e7e-bf40f89f9ceb","Type":"ContainerStarted","Data":"f8c124082d75aaef99efc30c1f5fa9c6d7c0774fa6903657366e4694450032d4"}
Sep 10 13:17:22.770104 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.769992    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ccf52" event={"ID":"f9ce9b89-8697-4720-9e7e-bf40f89f9ceb","Type":"ContainerStarted","Data":"48dc9a71afe21e0b94861338a7aad2c9be9d3921064ddeefcbb0607f95822f3e"}
Sep 10 13:17:22.771316 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.771273    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pvgkz" event={"ID":"1806c922-6bc4-4db8-83e8-15fdb1684b16","Type":"ContainerStarted","Data":"681f227fecce54529345aeec2f381ef46fde46905515121b742ff2f1ac300bcc"}
Sep 10 13:17:22.774696 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.774669    2584 generic.go:356] "Generic (PLEG): container finished" podID="b81f7ba2-5295-427c-9907-4f8d192b48c2" containerID="8ea83aebcdf2c7701b28335859ad760a9364b13fe4457ad98dfa1ea3cf8f618b" exitCode=0
Sep 10 13:17:22.774814 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.774764    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpf7h" event={"ID":"b81f7ba2-5295-427c-9907-4f8d192b48c2","Type":"ContainerDied","Data":"8ea83aebcdf2c7701b28335859ad760a9364b13fe4457ad98dfa1ea3cf8f618b"}
Sep 10 13:17:22.776141 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.776121    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8" event={"ID":"a9a79779-a597-4381-8997-171ece4d99e9","Type":"ContainerStarted","Data":"09b478b9815aec8e4c0cbe97ee6f1cd41bca20a5819988061a4fdf4f23a9d95b"}
Sep 10 13:17:22.777504 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.777482    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc87c88d-ddz86" event={"ID":"916cdff4-9dca-4e7f-9ecb-5995081dc749","Type":"ContainerStarted","Data":"d163012950616a82b82ae191336aaac7707da5e4a6cc3dc0480e5eea9a40f606"}
Sep 10 13:17:22.789301 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:22.789253    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ccf52" podStartSLOduration=2.789236208 podStartE2EDuration="2.789236208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:17:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:22.788513022 +0000 UTC m=+37.674140049" watchObservedRunningTime="2026-09-10 13:17:22.789236208 +0000 UTC m=+37.674863236"
Sep 10 13:17:23.738971 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:23.738932    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:23.739383 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:23.739121    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 13:17:23.739383 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:23.739136    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76687847b5-rlsk5: secret "image-registry-tls" not found
Sep 10 13:17:23.739383 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:23.739195    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls podName:3f1d7a7a-4610-4436-b3ae-d89a45d99b2d nodeName:}" failed. No retries permitted until 2026-09-10 13:17:27.739175261 +0000 UTC m=+42.624802288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls") pod "image-registry-76687847b5-rlsk5" (UID: "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d") : secret "image-registry-tls" not found
Sep 10 13:17:23.786203 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:23.786120    2584 generic.go:356] "Generic (PLEG): container finished" podID="b81f7ba2-5295-427c-9907-4f8d192b48c2" containerID="567da1254044712d3ff9a0f27f87cc034a8ea2887bb21c034daed29ab706e8a6" exitCode=0
Sep 10 13:17:23.786203 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:23.786172    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpf7h" event={"ID":"b81f7ba2-5295-427c-9907-4f8d192b48c2","Type":"ContainerDied","Data":"567da1254044712d3ff9a0f27f87cc034a8ea2887bb21c034daed29ab706e8a6"}
Sep 10 13:17:23.840752 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:23.840496    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:23.840884 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:23.840657    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 13:17:23.840884 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:23.840871    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls podName:79818a02-d821-4a83-865c-240c44e4c5ec nodeName:}" failed. No retries permitted until 2026-09-10 13:17:27.840849978 +0000 UTC m=+42.726477006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls") pod "dns-default-fqzp6" (UID: "79818a02-d821-4a83-865c-240c44e4c5ec") : secret "dns-default-metrics-tls" not found
Sep 10 13:17:24.796698 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:24.796661    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpf7h" event={"ID":"b81f7ba2-5295-427c-9907-4f8d192b48c2","Type":"ContainerStarted","Data":"a0e568b1d58a2a1bb20d3129f903fd840e0eb02ed7dde665fc83f91ca5a94c97"}
Sep 10 13:17:25.101953 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:25.101917    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkcx2_68deb1d1-ced7-4eec-90c7-1090a1a404ca/konnectivity-agent/0.log" limit=1024
Sep 10 13:17:25.163466 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:25.163370    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkcx2_68deb1d1-ced7-4eec-90c7-1090a1a404ca/konnectivity-agent/0.log" limit=1024
Sep 10 13:17:27.777789 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:27.777705    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:27.778202 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:27.777826    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 13:17:27.778202 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:27.777841    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76687847b5-rlsk5: secret "image-registry-tls" not found
Sep 10 13:17:27.778202 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:27.777901    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls podName:3f1d7a7a-4610-4436-b3ae-d89a45d99b2d nodeName:}" failed. No retries permitted until 2026-09-10 13:17:35.777886282 +0000 UTC m=+50.663513287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls") pod "image-registry-76687847b5-rlsk5" (UID: "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d") : secret "image-registry-tls" not found
Sep 10 13:17:27.878789 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:27.878745    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:27.878963 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:27.878904    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 13:17:27.879020 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:27.878985    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls podName:79818a02-d821-4a83-865c-240c44e4c5ec nodeName:}" failed. No retries permitted until 2026-09-10 13:17:35.878962019 +0000 UTC m=+50.764589090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls") pod "dns-default-fqzp6" (UID: "79818a02-d821-4a83-865c-240c44e4c5ec") : secret "dns-default-metrics-tls" not found
Sep 10 13:17:31.819756 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:31.819656    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8" event={"ID":"a9a79779-a597-4381-8997-171ece4d99e9","Type":"ContainerStarted","Data":"291d27f6795fa7a0d1c2fd13698553f7caab8dc70e2231f4a33e47445e54fb36"}
Sep 10 13:17:31.819756 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:31.819730    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"
Sep 10 13:17:31.821279 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:31.821255    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc87c88d-ddz86" event={"ID":"916cdff4-9dca-4e7f-9ecb-5995081dc749","Type":"ContainerStarted","Data":"724123de49ea4af1ed43e80e24ec7870a7f8d36c70dd8818783de0e4515efcb2"}
Sep 10 13:17:31.821807 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:31.821770    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8"
Sep 10 13:17:31.823447 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:31.823427    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f" event={"ID":"5414969e-846d-4bd0-836b-30a1f454a912","Type":"ContainerStarted","Data":"dfa7c3f594b78f0701282c3b9877026af095e510ff4d29816946540db689f8ec"}
Sep 10 13:17:31.823530 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:31.823456    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f" event={"ID":"5414969e-846d-4bd0-836b-30a1f454a912","Type":"ContainerStarted","Data":"fcd91491da4aee5b3e67e785a019cb586d99328a3cb247c94179e4577516bd7e"}
Sep 10 13:17:31.823530 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:31.823473    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f" event={"ID":"5414969e-846d-4bd0-836b-30a1f454a912","Type":"ContainerStarted","Data":"c1ea5bb5bcf6c839d8b20bed3aef165ac0c5ee52764463e86285ba67369bf2b0"}
Sep 10 13:17:31.824950 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:31.824931    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pvgkz" event={"ID":"1806c922-6bc4-4db8-83e8-15fdb1684b16","Type":"ContainerStarted","Data":"4c1bcd9e1b5ffc0fd9d6eae2c5cdd38ccf7d3fcdb65e9c7b5e0a9adcef889aaa"}
Sep 10 13:17:31.837887 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:31.837844    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76c4448d-5w6f8" podStartSLOduration=2.322329573 podStartE2EDuration="10.837831982s" totalImagesPullingTime="8.515502409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:31.83760695 +0000 UTC m=+46.723233977" watchObservedRunningTime="2026-09-10 13:17:31.837831982 +0000 UTC m=+46.723459010"
Sep 10 13:17:31.838079 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:31.838054    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vpf7h" podStartSLOduration=15.452579534 podStartE2EDuration="46.838047699s" totalImagesPullingTime="31.385468165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:16:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:24.848447716 +0000 UTC m=+39.734074745" watchObservedRunningTime="2026-09-10 13:17:31.838047699 +0000 UTC m=+46.723674750"
Sep 10 13:17:31.859467 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:31.859425    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f" podStartSLOduration=2.3819917520000002 podStartE2EDuration="10.859412556s" totalImagesPullingTime="8.477420804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:31.858177573 +0000 UTC m=+46.743804611" watchObservedRunningTime="2026-09-10 13:17:31.859412556 +0000 UTC m=+46.745039606"
Sep 10 13:17:31.874244 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:31.874209    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pvgkz" podStartSLOduration=3.704968096 podStartE2EDuration="12.874182107s" totalImagesPullingTime="9.169214011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:31.873675346 +0000 UTC m=+46.759302371" watchObservedRunningTime="2026-09-10 13:17:31.874182107 +0000 UTC m=+46.759809131"
Sep 10 13:17:31.891219 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:31.891170    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc87c88d-ddz86" podStartSLOduration=2.349145115 podStartE2EDuration="10.891153157s" totalImagesPullingTime="8.542008042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:31.890178813 +0000 UTC m=+46.775805837" watchObservedRunningTime="2026-09-10 13:17:31.891153157 +0000 UTC m=+46.776780185"
Sep 10 13:17:32.511518 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.511479    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5"]
Sep 10 13:17:32.527577 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.527529    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-pmk8q"]
Sep 10 13:17:32.527717 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.527654    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5"
Sep 10 13:17:32.530650 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.530618    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mbbx6\""
Sep 10 13:17:32.530650 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.530633    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 10 13:17:32.531004 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.530976    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 10 13:17:32.535442 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.531414    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 10 13:17:32.535442 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.532731    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 10 13:17:32.541703 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.541685    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2"]
Sep 10 13:17:32.541828 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.541811    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.544703 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.544685    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 10 13:17:32.544968 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.544953    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 10 13:17:32.545149 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.545133    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 13:17:32.545207 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.545166    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cf6km\""
Sep 10 13:17:32.545207 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.545189    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 13:17:32.552175 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.552157    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 10 13:17:32.564031 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.564009    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"]
Sep 10 13:17:32.564105 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.564090    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2"
Sep 10 13:17:32.567257 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.567238    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4kzmd\""
Sep 10 13:17:32.567513 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.567499    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 13:17:32.567732 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.567719    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 13:17:32.567824 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.567808    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 13:17:32.567902 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.567808    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 13:17:32.583962 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.583940    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5"]
Sep 10 13:17:32.583962 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.583967    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"]
Sep 10 13:17:32.584076 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.583991    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-pmk8q"]
Sep 10 13:17:32.584076 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.584015    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2"]
Sep 10 13:17:32.584076 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.584055    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"
Sep 10 13:17:32.587167 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.587143    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7djt6\""
Sep 10 13:17:32.587167 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.587158    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 10 13:17:32.587167 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.587162    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 10 13:17:32.587357 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.587161    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 10 13:17:32.625952 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.625926    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-6qc7l"]
Sep 10 13:17:32.650034 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.650004    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-clnsk"]
Sep 10 13:17:32.650229 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.650127    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:32.653547 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.653525    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 10 13:17:32.653783 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.653765    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lpb4l\""
Sep 10 13:17:32.653871 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.653856    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 10 13:17:32.654061 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.654048    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 10 13:17:32.655304 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.655288    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 10 13:17:32.661747 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.661728    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 10 13:17:32.670056 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.670038    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56cc659cd8-kmvzg"]
Sep 10 13:17:32.670168 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.670152    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-clnsk"
Sep 10 13:17:32.673532 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.673516    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-pqvzh\""
Sep 10 13:17:32.674008 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.673992    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 10 13:17:32.674093 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.673998    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 10 13:17:32.694188 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.694169    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-clnsk"]
Sep 10 13:17:32.694292 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.694197    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-6qc7l"]
Sep 10 13:17:32.694292 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.694212    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56cc659cd8-kmvzg"]
Sep 10 13:17:32.694292 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.694277    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:32.697574 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.697537    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 10 13:17:32.697681 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.697597    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 10 13:17:32.698323 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.698219    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 13:17:32.698537 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.698515    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 10 13:17:32.698537 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.698525    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 13:17:32.698731 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.698714    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zg849\""
Sep 10 13:17:32.698924 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.698523    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 10 13:17:32.717799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.717779    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-xn6zg\" (UID: \"cb11abd8-859b-4e77-85df-3938d94ea37f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"
Sep 10 13:17:32.717891 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.717804    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/eb360902-5133-4fb6-ab33-a7e16a4d2b16-snapshots\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.717891 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.717834    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb360902-5133-4fb6-ab33-a7e16a4d2b16-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.717891 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.717850    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf79g\" (UniqueName: \"kubernetes.io/projected/cb11abd8-859b-4e77-85df-3938d94ea37f-kube-api-access-kf79g\") pod \"cluster-samples-operator-7cdcfcf76c-xn6zg\" (UID: \"cb11abd8-859b-4e77-85df-3938d94ea37f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"
Sep 10 13:17:32.728192 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.717901    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4e29dab-505d-4fa5-b018-6392782ca848-config\") pod \"service-ca-operator-859f94c4b-wpxf5\" (UID: \"d4e29dab-505d-4fa5-b018-6392782ca848\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5"
Sep 10 13:17:32.728192 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.717944    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4e29dab-505d-4fa5-b018-6392782ca848-serving-cert\") pod \"service-ca-operator-859f94c4b-wpxf5\" (UID: \"d4e29dab-505d-4fa5-b018-6392782ca848\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5"
Sep 10 13:17:32.728192 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.717982    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb360902-5133-4fb6-ab33-a7e16a4d2b16-serving-cert\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.728192 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.718029    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5th5k\" (UniqueName: \"kubernetes.io/projected/d4e29dab-505d-4fa5-b018-6392782ca848-kube-api-access-5th5k\") pod \"service-ca-operator-859f94c4b-wpxf5\" (UID: \"d4e29dab-505d-4fa5-b018-6392782ca848\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5"
Sep 10 13:17:32.728192 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.718049    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb360902-5133-4fb6-ab33-a7e16a4d2b16-tmp\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.728192 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.718072    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2559\" (UniqueName: \"kubernetes.io/projected/eb360902-5133-4fb6-ab33-a7e16a4d2b16-kube-api-access-q2559\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.728192 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.718095    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z62sp\" (UniqueName: \"kubernetes.io/projected/a80ea425-e5a1-4f73-a52b-f579b6b75730-kube-api-access-z62sp\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qvzd2\" (UID: \"a80ea425-e5a1-4f73-a52b-f579b6b75730\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2"
Sep 10 13:17:32.728192 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.718112    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb360902-5133-4fb6-ab33-a7e16a4d2b16-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.728192 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.718126    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a80ea425-e5a1-4f73-a52b-f579b6b75730-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qvzd2\" (UID: \"a80ea425-e5a1-4f73-a52b-f579b6b75730\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2"
Sep 10 13:17:32.728192 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.718144    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a80ea425-e5a1-4f73-a52b-f579b6b75730-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qvzd2\" (UID: \"a80ea425-e5a1-4f73-a52b-f579b6b75730\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2"
Sep 10 13:17:32.728192 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.725067    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"]
Sep 10 13:17:32.740646 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.740623    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:17:32.741490 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.741470    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"]
Sep 10 13:17:32.746838 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.746819    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 10 13:17:32.746958 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.746938    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gd2f8\""
Sep 10 13:17:32.747066 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.746838    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 13:17:32.747066 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.746838    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 13:17:32.747066 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.746855    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 10 13:17:32.818845 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.818771    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4e29dab-505d-4fa5-b018-6392782ca848-serving-cert\") pod \"service-ca-operator-859f94c4b-wpxf5\" (UID: \"d4e29dab-505d-4fa5-b018-6392782ca848\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5"
Sep 10 13:17:32.818845 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.818816    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb360902-5133-4fb6-ab33-a7e16a4d2b16-serving-cert\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.819019 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.818844    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22ec15f1-c11d-4159-8edd-a8d3934bc4ca-trusted-ca\") pod \"console-operator-85b454874b-6qc7l\" (UID: \"22ec15f1-c11d-4159-8edd-a8d3934bc4ca\") " pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:32.819019 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.818917    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:32.819019 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.818945    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f54gb\" (UniqueName: \"kubernetes.io/projected/2d3008ed-6458-4c13-8e00-07c20b56a772-kube-api-access-f54gb\") pod \"volume-data-source-validator-695c895bd6-clnsk\" (UID: \"2d3008ed-6458-4c13-8e00-07c20b56a772\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-clnsk"
Sep 10 13:17:32.819019 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.818983    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5th5k\" (UniqueName: \"kubernetes.io/projected/d4e29dab-505d-4fa5-b018-6392782ca848-kube-api-access-5th5k\") pod \"service-ca-operator-859f94c4b-wpxf5\" (UID: \"d4e29dab-505d-4fa5-b018-6392782ca848\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5"
Sep 10 13:17:32.819168 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819041    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb360902-5133-4fb6-ab33-a7e16a4d2b16-tmp\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.819168 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819077    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2559\" (UniqueName: \"kubernetes.io/projected/eb360902-5133-4fb6-ab33-a7e16a4d2b16-kube-api-access-q2559\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.819168 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819107    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z62sp\" (UniqueName: \"kubernetes.io/projected/a80ea425-e5a1-4f73-a52b-f579b6b75730-kube-api-access-z62sp\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qvzd2\" (UID: \"a80ea425-e5a1-4f73-a52b-f579b6b75730\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2"
Sep 10 13:17:32.819168 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819141    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb360902-5133-4fb6-ab33-a7e16a4d2b16-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.819366 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819168    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a80ea425-e5a1-4f73-a52b-f579b6b75730-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qvzd2\" (UID: \"a80ea425-e5a1-4f73-a52b-f579b6b75730\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2"
Sep 10 13:17:32.819366 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819196    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a80ea425-e5a1-4f73-a52b-f579b6b75730-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qvzd2\" (UID: \"a80ea425-e5a1-4f73-a52b-f579b6b75730\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2"
Sep 10 13:17:32.819366 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819221    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:32.819366 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819255    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4d4n\" (UniqueName: \"kubernetes.io/projected/6f148377-3da6-4888-8b3d-70dd02ea46a6-kube-api-access-h4d4n\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:32.819366 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819299    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-xn6zg\" (UID: \"cb11abd8-859b-4e77-85df-3938d94ea37f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"
Sep 10 13:17:32.819366 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819326    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/eb360902-5133-4fb6-ab33-a7e16a4d2b16-snapshots\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.819679 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819376    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8wzn\" (UniqueName: \"kubernetes.io/projected/22ec15f1-c11d-4159-8edd-a8d3934bc4ca-kube-api-access-k8wzn\") pod \"console-operator-85b454874b-6qc7l\" (UID: \"22ec15f1-c11d-4159-8edd-a8d3934bc4ca\") " pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:32.819679 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819415    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb360902-5133-4fb6-ab33-a7e16a4d2b16-tmp\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.819679 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819418    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-default-certificate\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:32.819679 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819472    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-stats-auth\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:32.819679 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819502    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb360902-5133-4fb6-ab33-a7e16a4d2b16-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.819679 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf79g\" (UniqueName: \"kubernetes.io/projected/cb11abd8-859b-4e77-85df-3938d94ea37f-kube-api-access-kf79g\") pod \"cluster-samples-operator-7cdcfcf76c-xn6zg\" (UID: \"cb11abd8-859b-4e77-85df-3938d94ea37f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"
Sep 10 13:17:32.820277 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819550    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22ec15f1-c11d-4159-8edd-a8d3934bc4ca-serving-cert\") pod \"console-operator-85b454874b-6qc7l\" (UID: \"22ec15f1-c11d-4159-8edd-a8d3934bc4ca\") " pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:32.820277 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.820182    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4e29dab-505d-4fa5-b018-6392782ca848-config\") pod \"service-ca-operator-859f94c4b-wpxf5\" (UID: \"d4e29dab-505d-4fa5-b018-6392782ca848\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5"
Sep 10 13:17:32.820277 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.820207    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22ec15f1-c11d-4159-8edd-a8d3934bc4ca-config\") pod \"console-operator-85b454874b-6qc7l\" (UID: \"22ec15f1-c11d-4159-8edd-a8d3934bc4ca\") " pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:32.820277 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819943    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/eb360902-5133-4fb6-ab33-a7e16a4d2b16-snapshots\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.820277 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819991    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a80ea425-e5a1-4f73-a52b-f579b6b75730-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qvzd2\" (UID: \"a80ea425-e5a1-4f73-a52b-f579b6b75730\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2"
Sep 10 13:17:32.820484 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.819822    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb360902-5133-4fb6-ab33-a7e16a4d2b16-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.820484 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:32.819661    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 13:17:32.820484 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:32.820368    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls podName:cb11abd8-859b-4e77-85df-3938d94ea37f nodeName:}" failed. No retries permitted until 2026-09-10 13:17:33.320352442 +0000 UTC m=+48.205979448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-xn6zg" (UID: "cb11abd8-859b-4e77-85df-3938d94ea37f") : secret "samples-operator-tls" not found
Sep 10 13:17:32.820906 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.820884    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb360902-5133-4fb6-ab33-a7e16a4d2b16-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.820962 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.820915    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4e29dab-505d-4fa5-b018-6392782ca848-config\") pod \"service-ca-operator-859f94c4b-wpxf5\" (UID: \"d4e29dab-505d-4fa5-b018-6392782ca848\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5"
Sep 10 13:17:32.822746 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.822725    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a80ea425-e5a1-4f73-a52b-f579b6b75730-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qvzd2\" (UID: \"a80ea425-e5a1-4f73-a52b-f579b6b75730\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2"
Sep 10 13:17:32.822810 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.822781    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb360902-5133-4fb6-ab33-a7e16a4d2b16-serving-cert\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.822871 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.822783    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4e29dab-505d-4fa5-b018-6392782ca848-serving-cert\") pod \"service-ca-operator-859f94c4b-wpxf5\" (UID: \"d4e29dab-505d-4fa5-b018-6392782ca848\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5"
Sep 10 13:17:32.836790 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.836767    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5th5k\" (UniqueName: \"kubernetes.io/projected/d4e29dab-505d-4fa5-b018-6392782ca848-kube-api-access-5th5k\") pod \"service-ca-operator-859f94c4b-wpxf5\" (UID: \"d4e29dab-505d-4fa5-b018-6392782ca848\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5"
Sep 10 13:17:32.838441 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.838418    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z62sp\" (UniqueName: \"kubernetes.io/projected/a80ea425-e5a1-4f73-a52b-f579b6b75730-kube-api-access-z62sp\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qvzd2\" (UID: \"a80ea425-e5a1-4f73-a52b-f579b6b75730\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2"
Sep 10 13:17:32.838649 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.838631    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2559\" (UniqueName: \"kubernetes.io/projected/eb360902-5133-4fb6-ab33-a7e16a4d2b16-kube-api-access-q2559\") pod \"insights-operator-76bcd6ccf5-pmk8q\" (UID: \"eb360902-5133-4fb6-ab33-a7e16a4d2b16\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.838916 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.838899    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf79g\" (UniqueName: \"kubernetes.io/projected/cb11abd8-859b-4e77-85df-3938d94ea37f-kube-api-access-kf79g\") pod \"cluster-samples-operator-7cdcfcf76c-xn6zg\" (UID: \"cb11abd8-859b-4e77-85df-3938d94ea37f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"
Sep 10 13:17:32.841705 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.841684    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5"
Sep 10 13:17:32.849805 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.849790    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q"
Sep 10 13:17:32.858623 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.858601    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkcx2_68deb1d1-ced7-4eec-90c7-1090a1a404ca/konnectivity-agent/0.log" limit=1024
Sep 10 13:17:32.872006 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.871979    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2"
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.920976    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22ec15f1-c11d-4159-8edd-a8d3934bc4ca-trusted-ca\") pod \"console-operator-85b454874b-6qc7l\" (UID: \"22ec15f1-c11d-4159-8edd-a8d3934bc4ca\") " pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.921041    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.921071    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f54gb\" (UniqueName: \"kubernetes.io/projected/2d3008ed-6458-4c13-8e00-07c20b56a772-kube-api-access-f54gb\") pod \"volume-data-source-validator-695c895bd6-clnsk\" (UID: \"2d3008ed-6458-4c13-8e00-07c20b56a772\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-clnsk"
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.921109    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs946\" (UniqueName: \"kubernetes.io/projected/34d5e373-33e5-4c3a-b4f7-ceceea4767de-kube-api-access-hs946\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.921176    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/34d5e373-33e5-4c3a-b4f7-ceceea4767de-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.921221    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.921244    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.921276    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4d4n\" (UniqueName: \"kubernetes.io/projected/6f148377-3da6-4888-8b3d-70dd02ea46a6-kube-api-access-h4d4n\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.921352    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8wzn\" (UniqueName: \"kubernetes.io/projected/22ec15f1-c11d-4159-8edd-a8d3934bc4ca-kube-api-access-k8wzn\") pod \"console-operator-85b454874b-6qc7l\" (UID: \"22ec15f1-c11d-4159-8edd-a8d3934bc4ca\") " pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.921386    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-default-certificate\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.921412    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-stats-auth\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.921443    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22ec15f1-c11d-4159-8edd-a8d3934bc4ca-serving-cert\") pod \"console-operator-85b454874b-6qc7l\" (UID: \"22ec15f1-c11d-4159-8edd-a8d3934bc4ca\") " pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.921479    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22ec15f1-c11d-4159-8edd-a8d3934bc4ca-config\") pod \"console-operator-85b454874b-6qc7l\" (UID: \"22ec15f1-c11d-4159-8edd-a8d3934bc4ca\") " pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:32.921725    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 13:17:32.923320 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:32.921804    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs podName:6f148377-3da6-4888-8b3d-70dd02ea46a6 nodeName:}" failed. No retries permitted until 2026-09-10 13:17:33.421782769 +0000 UTC m=+48.307409979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs") pod "router-default-56cc659cd8-kmvzg" (UID: "6f148377-3da6-4888-8b3d-70dd02ea46a6") : secret "router-metrics-certs-default" not found
Sep 10 13:17:32.924203 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:32.922174    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle podName:6f148377-3da6-4888-8b3d-70dd02ea46a6 nodeName:}" failed. No retries permitted until 2026-09-10 13:17:33.422156344 +0000 UTC m=+48.307783372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle") pod "router-default-56cc659cd8-kmvzg" (UID: "6f148377-3da6-4888-8b3d-70dd02ea46a6") : configmap references non-existent config key: service-ca.crt
Sep 10 13:17:32.924203 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.922306    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22ec15f1-c11d-4159-8edd-a8d3934bc4ca-config\") pod \"console-operator-85b454874b-6qc7l\" (UID: \"22ec15f1-c11d-4159-8edd-a8d3934bc4ca\") " pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:32.924203 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.922750    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22ec15f1-c11d-4159-8edd-a8d3934bc4ca-trusted-ca\") pod \"console-operator-85b454874b-6qc7l\" (UID: \"22ec15f1-c11d-4159-8edd-a8d3934bc4ca\") " pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:32.926316 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.926291    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-default-certificate\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:32.927146 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.927100    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-stats-auth\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:32.927408 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.927375    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22ec15f1-c11d-4159-8edd-a8d3934bc4ca-serving-cert\") pod \"console-operator-85b454874b-6qc7l\" (UID: \"22ec15f1-c11d-4159-8edd-a8d3934bc4ca\") " pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:32.937221 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.937164    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4d4n\" (UniqueName: \"kubernetes.io/projected/6f148377-3da6-4888-8b3d-70dd02ea46a6-kube-api-access-h4d4n\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:32.937486 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.937462    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f54gb\" (UniqueName: \"kubernetes.io/projected/2d3008ed-6458-4c13-8e00-07c20b56a772-kube-api-access-f54gb\") pod \"volume-data-source-validator-695c895bd6-clnsk\" (UID: \"2d3008ed-6458-4c13-8e00-07c20b56a772\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-clnsk"
Sep 10 13:17:32.937847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.937826    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8wzn\" (UniqueName: \"kubernetes.io/projected/22ec15f1-c11d-4159-8edd-a8d3934bc4ca-kube-api-access-k8wzn\") pod \"console-operator-85b454874b-6qc7l\" (UID: \"22ec15f1-c11d-4159-8edd-a8d3934bc4ca\") " pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:32.960140 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.960042    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:32.961067 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.960999    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkcx2_68deb1d1-ced7-4eec-90c7-1090a1a404ca/konnectivity-agent/0.log" limit=1024
Sep 10 13:17:32.978310 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:32.978279    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-clnsk"
Sep 10 13:17:33.022802 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.022768    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs946\" (UniqueName: \"kubernetes.io/projected/34d5e373-33e5-4c3a-b4f7-ceceea4767de-kube-api-access-hs946\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:17:33.022932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.022869    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/34d5e373-33e5-4c3a-b4f7-ceceea4767de-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:17:33.023001 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.022950    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:17:33.024257 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:33.024101    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 13:17:33.024257 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:33.024179    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls podName:34d5e373-33e5-4c3a-b4f7-ceceea4767de nodeName:}" failed. No retries permitted until 2026-09-10 13:17:33.524157193 +0000 UTC m=+48.409784216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9f564" (UID: "34d5e373-33e5-4c3a-b4f7-ceceea4767de") : secret "cluster-monitoring-operator-tls" not found
Sep 10 13:17:33.026147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.026114    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/34d5e373-33e5-4c3a-b4f7-ceceea4767de-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:17:33.036086 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.036051    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs946\" (UniqueName: \"kubernetes.io/projected/34d5e373-33e5-4c3a-b4f7-ceceea4767de-kube-api-access-hs946\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:17:33.121059 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.121011    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5"]
Sep 10 13:17:33.123310 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:33.123284    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e29dab_505d_4fa5_b018_6392782ca848.slice/crio-fdc4025edae0c733706e7b1cfdd1acd9c7f8ad9077cda977dd07f079bc1bfd13 WatchSource:0}: Error finding container fdc4025edae0c733706e7b1cfdd1acd9c7f8ad9077cda977dd07f079bc1bfd13: Status 404 returned error can't find the container with id fdc4025edae0c733706e7b1cfdd1acd9c7f8ad9077cda977dd07f079bc1bfd13
Sep 10 13:17:33.145323 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.145300    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-pmk8q"]
Sep 10 13:17:33.147691 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:33.147664    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb360902_5133_4fb6_ab33_a7e16a4d2b16.slice/crio-5afe272e722e247b310dfbce9d7fd4207411364a334c69697215575eb8e8cda8 WatchSource:0}: Error finding container 5afe272e722e247b310dfbce9d7fd4207411364a334c69697215575eb8e8cda8: Status 404 returned error can't find the container with id 5afe272e722e247b310dfbce9d7fd4207411364a334c69697215575eb8e8cda8
Sep 10 13:17:33.165324 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.165300    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2"]
Sep 10 13:17:33.167836 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:33.167813    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80ea425_e5a1_4f73_a52b_f579b6b75730.slice/crio-cd61889978c212cb00d4e86f965f9dedd3b3858994e2e516fc98ff8dbf0b9756 WatchSource:0}: Error finding container cd61889978c212cb00d4e86f965f9dedd3b3858994e2e516fc98ff8dbf0b9756: Status 404 returned error can't find the container with id cd61889978c212cb00d4e86f965f9dedd3b3858994e2e516fc98ff8dbf0b9756
Sep 10 13:17:33.246887 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.246859    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-6qc7l"]
Sep 10 13:17:33.249962 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:33.249931    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ec15f1_c11d_4159_8edd_a8d3934bc4ca.slice/crio-74d06d3b2848cd702d7eb037a6ee813393d23416411460ae1185b70bdfab7a35 WatchSource:0}: Error finding container 74d06d3b2848cd702d7eb037a6ee813393d23416411460ae1185b70bdfab7a35: Status 404 returned error can't find the container with id 74d06d3b2848cd702d7eb037a6ee813393d23416411460ae1185b70bdfab7a35
Sep 10 13:17:33.268594 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.268573    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-clnsk"]
Sep 10 13:17:33.270879 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:33.270852    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3008ed_6458_4c13_8e00_07c20b56a772.slice/crio-edc54405c792d3bf8074a5b36c2c5d3272cddf90a29dfa985288f1623b29a213 WatchSource:0}: Error finding container edc54405c792d3bf8074a5b36c2c5d3272cddf90a29dfa985288f1623b29a213: Status 404 returned error can't find the container with id edc54405c792d3bf8074a5b36c2c5d3272cddf90a29dfa985288f1623b29a213
Sep 10 13:17:33.325611 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.325590    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-xn6zg\" (UID: \"cb11abd8-859b-4e77-85df-3938d94ea37f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"
Sep 10 13:17:33.325724 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:33.325700    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 13:17:33.325769 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:33.325751    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls podName:cb11abd8-859b-4e77-85df-3938d94ea37f nodeName:}" failed. No retries permitted until 2026-09-10 13:17:34.325738334 +0000 UTC m=+49.211365339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-xn6zg" (UID: "cb11abd8-859b-4e77-85df-3938d94ea37f") : secret "samples-operator-tls" not found
Sep 10 13:17:33.426518 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.426448    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:33.426658 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.426523    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:33.426658 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:33.426631    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle podName:6f148377-3da6-4888-8b3d-70dd02ea46a6 nodeName:}" failed. No retries permitted until 2026-09-10 13:17:34.426613133 +0000 UTC m=+49.312240138 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle") pod "router-default-56cc659cd8-kmvzg" (UID: "6f148377-3da6-4888-8b3d-70dd02ea46a6") : configmap references non-existent config key: service-ca.crt
Sep 10 13:17:33.426793 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:33.426696    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 13:17:33.426793 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:33.426768    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs podName:6f148377-3da6-4888-8b3d-70dd02ea46a6 nodeName:}" failed. No retries permitted until 2026-09-10 13:17:34.426749725 +0000 UTC m=+49.312376756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs") pod "router-default-56cc659cd8-kmvzg" (UID: "6f148377-3da6-4888-8b3d-70dd02ea46a6") : secret "router-metrics-certs-default" not found
Sep 10 13:17:33.527083 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.527051    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:17:33.527234 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:33.527216    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 13:17:33.527287 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:33.527278    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls podName:34d5e373-33e5-4c3a-b4f7-ceceea4767de nodeName:}" failed. No retries permitted until 2026-09-10 13:17:34.527263801 +0000 UTC m=+49.412890806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9f564" (UID: "34d5e373-33e5-4c3a-b4f7-ceceea4767de") : secret "cluster-monitoring-operator-tls" not found
Sep 10 13:17:33.836754 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.836657    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-clnsk" event={"ID":"2d3008ed-6458-4c13-8e00-07c20b56a772","Type":"ContainerStarted","Data":"edc54405c792d3bf8074a5b36c2c5d3272cddf90a29dfa985288f1623b29a213"}
Sep 10 13:17:33.838281 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.838258    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-6qc7l" event={"ID":"22ec15f1-c11d-4159-8edd-a8d3934bc4ca","Type":"ContainerStarted","Data":"74d06d3b2848cd702d7eb037a6ee813393d23416411460ae1185b70bdfab7a35"}
Sep 10 13:17:33.839500 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.839473    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2" event={"ID":"a80ea425-e5a1-4f73-a52b-f579b6b75730","Type":"ContainerStarted","Data":"cd61889978c212cb00d4e86f965f9dedd3b3858994e2e516fc98ff8dbf0b9756"}
Sep 10 13:17:33.840641 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.840620    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5" event={"ID":"d4e29dab-505d-4fa5-b018-6392782ca848","Type":"ContainerStarted","Data":"fdc4025edae0c733706e7b1cfdd1acd9c7f8ad9077cda977dd07f079bc1bfd13"}
Sep 10 13:17:33.841666 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:33.841647    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q" event={"ID":"eb360902-5133-4fb6-ab33-a7e16a4d2b16","Type":"ContainerStarted","Data":"5afe272e722e247b310dfbce9d7fd4207411364a334c69697215575eb8e8cda8"}
Sep 10 13:17:34.334892 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:34.334851    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-xn6zg\" (UID: \"cb11abd8-859b-4e77-85df-3938d94ea37f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"
Sep 10 13:17:34.335148 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:34.335122    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 13:17:34.335238 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:34.335202    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls podName:cb11abd8-859b-4e77-85df-3938d94ea37f nodeName:}" failed. No retries permitted until 2026-09-10 13:17:36.335182332 +0000 UTC m=+51.220809348 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-xn6zg" (UID: "cb11abd8-859b-4e77-85df-3938d94ea37f") : secret "samples-operator-tls" not found
Sep 10 13:17:34.436860 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:34.435954    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:34.436860 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:34.436105    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:34.436860 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:34.436326    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 13:17:34.436860 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:34.436391    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs podName:6f148377-3da6-4888-8b3d-70dd02ea46a6 nodeName:}" failed. No retries permitted until 2026-09-10 13:17:36.436371866 +0000 UTC m=+51.321999076 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs") pod "router-default-56cc659cd8-kmvzg" (UID: "6f148377-3da6-4888-8b3d-70dd02ea46a6") : secret "router-metrics-certs-default" not found
Sep 10 13:17:34.436860 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:34.436816    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle podName:6f148377-3da6-4888-8b3d-70dd02ea46a6 nodeName:}" failed. No retries permitted until 2026-09-10 13:17:36.436799485 +0000 UTC m=+51.322426507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle") pod "router-default-56cc659cd8-kmvzg" (UID: "6f148377-3da6-4888-8b3d-70dd02ea46a6") : configmap references non-existent config key: service-ca.crt
Sep 10 13:17:34.537624 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:34.536962    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:17:34.537624 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:34.537131    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 13:17:34.537624 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:34.537199    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls podName:34d5e373-33e5-4c3a-b4f7-ceceea4767de nodeName:}" failed. No retries permitted until 2026-09-10 13:17:36.537180632 +0000 UTC m=+51.422807660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9f564" (UID: "34d5e373-33e5-4c3a-b4f7-ceceea4767de") : secret "cluster-monitoring-operator-tls" not found
Sep 10 13:17:35.850296 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:35.850260    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:35.850775 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:35.850365    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 13:17:35.850775 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:35.850384    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76687847b5-rlsk5: secret "image-registry-tls" not found
Sep 10 13:17:35.850775 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:35.850446    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls podName:3f1d7a7a-4610-4436-b3ae-d89a45d99b2d nodeName:}" failed. No retries permitted until 2026-09-10 13:17:51.850429466 +0000 UTC m=+66.736056470 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls") pod "image-registry-76687847b5-rlsk5" (UID: "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d") : secret "image-registry-tls" not found
Sep 10 13:17:35.851757 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:35.851726    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-clnsk" event={"ID":"2d3008ed-6458-4c13-8e00-07c20b56a772","Type":"ContainerStarted","Data":"2e283394b14c71d3de3d4b684bf5b75159942bc438d3e4f7a3afe5efbdd25fc4"}
Sep 10 13:17:35.871398 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:35.871359    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-clnsk" podStartSLOduration=2.080848804 podStartE2EDuration="3.87134643s" totalImagesPullingTime="1.790497626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:35.870626027 +0000 UTC m=+50.756253054" watchObservedRunningTime="2026-09-10 13:17:35.87134643 +0000 UTC m=+50.756973448"
Sep 10 13:17:35.950793 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:35.950758    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:35.950971 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:35.950942    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 13:17:35.951047 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:35.951022    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls podName:79818a02-d821-4a83-865c-240c44e4c5ec nodeName:}" failed. No retries permitted until 2026-09-10 13:17:51.950999446 +0000 UTC m=+66.836626474 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls") pod "dns-default-fqzp6" (UID: "79818a02-d821-4a83-865c-240c44e4c5ec") : secret "dns-default-metrics-tls" not found
Sep 10 13:17:35.962218 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:35.962128    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkcx2_68deb1d1-ced7-4eec-90c7-1090a1a404ca/konnectivity-agent/0.log" limit=1024
Sep 10 13:17:36.159452 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:36.159376    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkcx2_68deb1d1-ced7-4eec-90c7-1090a1a404ca/konnectivity-agent/0.log" limit=1024
Sep 10 13:17:36.355585 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:36.355537    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-xn6zg\" (UID: \"cb11abd8-859b-4e77-85df-3938d94ea37f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"
Sep 10 13:17:36.355740 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:36.355707    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 13:17:36.355780 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:36.355768    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls podName:cb11abd8-859b-4e77-85df-3938d94ea37f nodeName:}" failed. No retries permitted until 2026-09-10 13:17:40.355752904 +0000 UTC m=+55.241379915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-xn6zg" (UID: "cb11abd8-859b-4e77-85df-3938d94ea37f") : secret "samples-operator-tls" not found
Sep 10 13:17:36.456243 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:36.456173    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:36.456401 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:36.456258    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:36.456401 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:36.456332    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle podName:6f148377-3da6-4888-8b3d-70dd02ea46a6 nodeName:}" failed. No retries permitted until 2026-09-10 13:17:40.456314347 +0000 UTC m=+55.341941355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle") pod "router-default-56cc659cd8-kmvzg" (UID: "6f148377-3da6-4888-8b3d-70dd02ea46a6") : configmap references non-existent config key: service-ca.crt
Sep 10 13:17:36.456401 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:36.456380    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 13:17:36.456585 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:36.456437    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs podName:6f148377-3da6-4888-8b3d-70dd02ea46a6 nodeName:}" failed. No retries permitted until 2026-09-10 13:17:40.456421524 +0000 UTC m=+55.342048531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs") pod "router-default-56cc659cd8-kmvzg" (UID: "6f148377-3da6-4888-8b3d-70dd02ea46a6") : secret "router-metrics-certs-default" not found
Sep 10 13:17:36.557493 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:36.557454    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:17:36.557640 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:36.557622    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 13:17:36.557698 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:36.557688    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls podName:34d5e373-33e5-4c3a-b4f7-ceceea4767de nodeName:}" failed. No retries permitted until 2026-09-10 13:17:40.557672829 +0000 UTC m=+55.443299834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9f564" (UID: "34d5e373-33e5-4c3a-b4f7-ceceea4767de") : secret "cluster-monitoring-operator-tls" not found
Sep 10 13:17:38.864244 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:38.864206    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q" event={"ID":"eb360902-5133-4fb6-ab33-a7e16a4d2b16","Type":"ContainerStarted","Data":"c6b0674ba389b307dadc9858f82e48d302513b4dc31188b2a414a115350ac818"}
Sep 10 13:17:38.866124 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:38.866102    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/0.log"
Sep 10 13:17:38.866257 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:38.866148    2584 generic.go:356] "Generic (PLEG): container finished" podID="22ec15f1-c11d-4159-8edd-a8d3934bc4ca" containerID="7d0050ee1d423b0d22d1df538724cb5604d7112e4b69bc126dd08029fb23765d" exitCode=255
Sep 10 13:17:38.866257 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:38.866239    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-6qc7l" event={"ID":"22ec15f1-c11d-4159-8edd-a8d3934bc4ca","Type":"ContainerDied","Data":"7d0050ee1d423b0d22d1df538724cb5604d7112e4b69bc126dd08029fb23765d"}
Sep 10 13:17:38.866471 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:38.866444    2584 scope.go:117] "RemoveContainer" containerID="7d0050ee1d423b0d22d1df538724cb5604d7112e4b69bc126dd08029fb23765d"
Sep 10 13:17:38.869949 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:38.869924    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2" event={"ID":"a80ea425-e5a1-4f73-a52b-f579b6b75730","Type":"ContainerStarted","Data":"2cf9b502278f67bad4d48165c5a2138e4e4fbfdced8d86a7c92ecc84076a4fcf"}
Sep 10 13:17:38.871654 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:38.871631    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5" event={"ID":"d4e29dab-505d-4fa5-b018-6392782ca848","Type":"ContainerStarted","Data":"c6038d89fc77f190124c2d7acd7a49dbd67cc7dadacfed9a604ab1a03ed77254"}
Sep 10 13:17:38.884956 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:38.884903    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q" podStartSLOduration=2.237660403 podStartE2EDuration="6.88488372s" totalImagesPullingTime="4.647223317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:38.884380073 +0000 UTC m=+53.770007100" watchObservedRunningTime="2026-09-10 13:17:38.88488372 +0000 UTC m=+53.770510747"
Sep 10 13:17:38.924643 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:38.924583    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5" podStartSLOduration=2.248318195 podStartE2EDuration="6.924542716s" totalImagesPullingTime="4.676224521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:38.924234401 +0000 UTC m=+53.809861442" watchObservedRunningTime="2026-09-10 13:17:38.924542716 +0000 UTC m=+53.810169744"
Sep 10 13:17:38.945031 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:38.944737    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2" podStartSLOduration=2.311083976 podStartE2EDuration="6.944715562s" totalImagesPullingTime="4.633631586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:38.943831024 +0000 UTC m=+53.829458052" watchObservedRunningTime="2026-09-10 13:17:38.944715562 +0000 UTC m=+53.830342589"
Sep 10 13:17:39.035239 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.035205    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c5sln"]
Sep 10 13:17:39.037570 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.037537    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c5sln"
Sep 10 13:17:39.040903 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.040884    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 10 13:17:39.041036 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.040946    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-n92g2\""
Sep 10 13:17:39.041104 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.041039    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 10 13:17:39.052007 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.051985    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c5sln"]
Sep 10 13:17:39.081803 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.081775    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzmgw\" (UniqueName: \"kubernetes.io/projected/2c64c340-0f5b-4349-98fc-b1f343df9394-kube-api-access-jzmgw\") pod \"migrator-fdbb8fdff-c5sln\" (UID: \"2c64c340-0f5b-4349-98fc-b1f343df9394\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c5sln"
Sep 10 13:17:39.182820 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.182744    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzmgw\" (UniqueName: \"kubernetes.io/projected/2c64c340-0f5b-4349-98fc-b1f343df9394-kube-api-access-jzmgw\") pod \"migrator-fdbb8fdff-c5sln\" (UID: \"2c64c340-0f5b-4349-98fc-b1f343df9394\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c5sln"
Sep 10 13:17:39.192028 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.192002    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzmgw\" (UniqueName: \"kubernetes.io/projected/2c64c340-0f5b-4349-98fc-b1f343df9394-kube-api-access-jzmgw\") pod \"migrator-fdbb8fdff-c5sln\" (UID: \"2c64c340-0f5b-4349-98fc-b1f343df9394\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c5sln"
Sep 10 13:17:39.373357 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.373312    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c5sln"
Sep 10 13:17:39.507353 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.507279    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vjggg"]
Sep 10 13:17:39.510430 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.510410    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:39.513606 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.513580    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 13:17:39.513783 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.513763    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rwkt7\""
Sep 10 13:17:39.513873 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.513798    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 13:17:39.523304 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.523279    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vjggg"]
Sep 10 13:17:39.587275 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.587246    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-crio-socket\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:39.587430 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.587306    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:39.587430 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.587326    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-645ck\" (UniqueName: \"kubernetes.io/projected/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-api-access-645ck\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:39.587430 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.587367    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:39.587430 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.587430    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-data-volume\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:39.649682 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.649647    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c5sln"]
Sep 10 13:17:39.652576 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:39.652524    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c64c340_0f5b_4349_98fc_b1f343df9394.slice/crio-9fdc08591ae680f4e1f5e366157e63ea9d447e26f505aad4a84e4ebf2e282ac0 WatchSource:0}: Error finding container 9fdc08591ae680f4e1f5e366157e63ea9d447e26f505aad4a84e4ebf2e282ac0: Status 404 returned error can't find the container with id 9fdc08591ae680f4e1f5e366157e63ea9d447e26f505aad4a84e4ebf2e282ac0
Sep 10 13:17:39.688653 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.688619    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-data-volume\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:39.688802 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.688684    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-crio-socket\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:39.688802 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.688740    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:39.688802 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.688766    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-645ck\" (UniqueName: \"kubernetes.io/projected/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-api-access-645ck\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:39.688953 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:39.688826    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 13:17:39.688953 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:39.688896    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm podName:1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf nodeName:}" failed. No retries permitted until 2026-09-10 13:17:40.188875967 +0000 UTC m=+55.074502995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjggg" (UID: "1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf") : configmap "kube-rbac-proxy" not found
Sep 10 13:17:39.688953 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:39.688922    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 13:17:39.689102 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.688831    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:39.689102 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:39.688974    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls podName:1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf nodeName:}" failed. No retries permitted until 2026-09-10 13:17:40.188958082 +0000 UTC m=+55.074585113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjggg" (UID: "1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf") : secret "insights-runtime-extractor-tls" not found
Sep 10 13:17:39.689102 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.689013    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-data-volume\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:39.689102 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.689034    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-crio-socket\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:39.704358 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.704334    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-645ck\" (UniqueName: \"kubernetes.io/projected/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-api-access-645ck\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:39.877151 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.877121    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:17:39.877722 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.877705    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/0.log"
Sep 10 13:17:39.877789 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.877748    2584 generic.go:356] "Generic (PLEG): container finished" podID="22ec15f1-c11d-4159-8edd-a8d3934bc4ca" containerID="4266d0a172b0c2acefb538a7defb8aa3812e30a7416e7b174ca53806ea63d41d" exitCode=255
Sep 10 13:17:39.877837 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.877816    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-6qc7l" event={"ID":"22ec15f1-c11d-4159-8edd-a8d3934bc4ca","Type":"ContainerDied","Data":"4266d0a172b0c2acefb538a7defb8aa3812e30a7416e7b174ca53806ea63d41d"}
Sep 10 13:17:39.877895 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.877881    2584 scope.go:117] "RemoveContainer" containerID="7d0050ee1d423b0d22d1df538724cb5604d7112e4b69bc126dd08029fb23765d"
Sep 10 13:17:39.878130 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.878108    2584 scope.go:117] "RemoveContainer" containerID="4266d0a172b0c2acefb538a7defb8aa3812e30a7416e7b174ca53806ea63d41d"
Sep 10 13:17:39.878348 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:39.878326    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-6qc7l_openshift-console-operator(22ec15f1-c11d-4159-8edd-a8d3934bc4ca)\"" pod="openshift-console-operator/console-operator-85b454874b-6qc7l" podUID="22ec15f1-c11d-4159-8edd-a8d3934bc4ca"
Sep 10 13:17:39.879342 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:39.879277    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c5sln" event={"ID":"2c64c340-0f5b-4349-98fc-b1f343df9394","Type":"ContainerStarted","Data":"9fdc08591ae680f4e1f5e366157e63ea9d447e26f505aad4a84e4ebf2e282ac0"}
Sep 10 13:17:40.195795 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:40.195709    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:40.195795 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:40.195771    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:40.196007 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:40.195835    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 13:17:40.196007 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:40.195913    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm podName:1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf nodeName:}" failed. No retries permitted until 2026-09-10 13:17:41.195896585 +0000 UTC m=+56.081523590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjggg" (UID: "1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf") : configmap "kube-rbac-proxy" not found
Sep 10 13:17:40.196007 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:40.195941    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 13:17:40.196007 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:40.195997    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls podName:1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf nodeName:}" failed. No retries permitted until 2026-09-10 13:17:41.195984267 +0000 UTC m=+56.081611272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjggg" (UID: "1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf") : secret "insights-runtime-extractor-tls" not found
Sep 10 13:17:40.396866 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:40.396834    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-xn6zg\" (UID: \"cb11abd8-859b-4e77-85df-3938d94ea37f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"
Sep 10 13:17:40.397069 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:40.397013    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 13:17:40.397137 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:40.397094    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls podName:cb11abd8-859b-4e77-85df-3938d94ea37f nodeName:}" failed. No retries permitted until 2026-09-10 13:17:48.397074482 +0000 UTC m=+63.282701507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-xn6zg" (UID: "cb11abd8-859b-4e77-85df-3938d94ea37f") : secret "samples-operator-tls" not found
Sep 10 13:17:40.498351 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:40.498258    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:40.498351 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:40.498333    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:40.498608 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:40.498423    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 13:17:40.498608 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:40.498464    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle podName:6f148377-3da6-4888-8b3d-70dd02ea46a6 nodeName:}" failed. No retries permitted until 2026-09-10 13:17:48.49844285 +0000 UTC m=+63.384069854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle") pod "router-default-56cc659cd8-kmvzg" (UID: "6f148377-3da6-4888-8b3d-70dd02ea46a6") : configmap references non-existent config key: service-ca.crt
Sep 10 13:17:40.498608 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:40.498601    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs podName:6f148377-3da6-4888-8b3d-70dd02ea46a6 nodeName:}" failed. No retries permitted until 2026-09-10 13:17:48.498581734 +0000 UTC m=+63.384208760 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs") pod "router-default-56cc659cd8-kmvzg" (UID: "6f148377-3da6-4888-8b3d-70dd02ea46a6") : secret "router-metrics-certs-default" not found
Sep 10 13:17:40.599257 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:40.599213    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:17:40.599432 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:40.599390    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 13:17:40.599512 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:40.599498    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls podName:34d5e373-33e5-4c3a-b4f7-ceceea4767de nodeName:}" failed. No retries permitted until 2026-09-10 13:17:48.599479358 +0000 UTC m=+63.485106363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9f564" (UID: "34d5e373-33e5-4c3a-b4f7-ceceea4767de") : secret "cluster-monitoring-operator-tls" not found
Sep 10 13:17:40.883858 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:40.883830    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:17:40.884234 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:40.884171    2584 scope.go:117] "RemoveContainer" containerID="4266d0a172b0c2acefb538a7defb8aa3812e30a7416e7b174ca53806ea63d41d"
Sep 10 13:17:40.884345 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:40.884326    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-6qc7l_openshift-console-operator(22ec15f1-c11d-4159-8edd-a8d3934bc4ca)\"" pod="openshift-console-operator/console-operator-85b454874b-6qc7l" podUID="22ec15f1-c11d-4159-8edd-a8d3934bc4ca"
Sep 10 13:17:41.205606 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.205481    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:41.205606 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.205591    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:41.205825 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:41.205648    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 13:17:41.205825 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:41.205725    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm podName:1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf nodeName:}" failed. No retries permitted until 2026-09-10 13:17:43.205703691 +0000 UTC m=+58.091330719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjggg" (UID: "1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf") : configmap "kube-rbac-proxy" not found
Sep 10 13:17:41.205825 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:41.205762    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 13:17:41.205927 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:41.205830    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls podName:1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf nodeName:}" failed. No retries permitted until 2026-09-10 13:17:43.205811097 +0000 UTC m=+58.091438105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjggg" (UID: "1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf") : secret "insights-runtime-extractor-tls" not found
Sep 10 13:17:41.335043 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.335002    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-cnwj5"]
Sep 10 13:17:41.337207 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.337190    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-cnwj5"
Sep 10 13:17:41.340101 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.340076    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 10 13:17:41.340424 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.340392    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-28kmg\""
Sep 10 13:17:41.340424 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.340414    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 10 13:17:41.340596 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.340443    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 10 13:17:41.341141 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.341124    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 10 13:17:41.352138 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.352109    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-cnwj5"]
Sep 10 13:17:41.407238 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.407202    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q828p\" (UniqueName: \"kubernetes.io/projected/214ec921-5ae1-4b28-8737-a7e10bfa827d-kube-api-access-q828p\") pod \"service-ca-75d99c484-cnwj5\" (UID: \"214ec921-5ae1-4b28-8737-a7e10bfa827d\") " pod="openshift-service-ca/service-ca-75d99c484-cnwj5"
Sep 10 13:17:41.407238 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.407274    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/214ec921-5ae1-4b28-8737-a7e10bfa827d-signing-key\") pod \"service-ca-75d99c484-cnwj5\" (UID: \"214ec921-5ae1-4b28-8737-a7e10bfa827d\") " pod="openshift-service-ca/service-ca-75d99c484-cnwj5"
Sep 10 13:17:41.407238 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.407378    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/214ec921-5ae1-4b28-8737-a7e10bfa827d-signing-cabundle\") pod \"service-ca-75d99c484-cnwj5\" (UID: \"214ec921-5ae1-4b28-8737-a7e10bfa827d\") " pod="openshift-service-ca/service-ca-75d99c484-cnwj5"
Sep 10 13:17:41.473692 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.473618    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ccf52_f9ce9b89-8697-4720-9e7e-bf40f89f9ceb/dns-node-resolver/0.log"
Sep 10 13:17:41.508138 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.508100    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q828p\" (UniqueName: \"kubernetes.io/projected/214ec921-5ae1-4b28-8737-a7e10bfa827d-kube-api-access-q828p\") pod \"service-ca-75d99c484-cnwj5\" (UID: \"214ec921-5ae1-4b28-8737-a7e10bfa827d\") " pod="openshift-service-ca/service-ca-75d99c484-cnwj5"
Sep 10 13:17:41.508138 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.508137    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/214ec921-5ae1-4b28-8737-a7e10bfa827d-signing-key\") pod \"service-ca-75d99c484-cnwj5\" (UID: \"214ec921-5ae1-4b28-8737-a7e10bfa827d\") " pod="openshift-service-ca/service-ca-75d99c484-cnwj5"
Sep 10 13:17:41.508446 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.508189    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/214ec921-5ae1-4b28-8737-a7e10bfa827d-signing-cabundle\") pod \"service-ca-75d99c484-cnwj5\" (UID: \"214ec921-5ae1-4b28-8737-a7e10bfa827d\") " pod="openshift-service-ca/service-ca-75d99c484-cnwj5"
Sep 10 13:17:41.508895 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.508872    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/214ec921-5ae1-4b28-8737-a7e10bfa827d-signing-cabundle\") pod \"service-ca-75d99c484-cnwj5\" (UID: \"214ec921-5ae1-4b28-8737-a7e10bfa827d\") " pod="openshift-service-ca/service-ca-75d99c484-cnwj5"
Sep 10 13:17:41.510579 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.510537    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/214ec921-5ae1-4b28-8737-a7e10bfa827d-signing-key\") pod \"service-ca-75d99c484-cnwj5\" (UID: \"214ec921-5ae1-4b28-8737-a7e10bfa827d\") " pod="openshift-service-ca/service-ca-75d99c484-cnwj5"
Sep 10 13:17:41.516951 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.516922    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q828p\" (UniqueName: \"kubernetes.io/projected/214ec921-5ae1-4b28-8737-a7e10bfa827d-kube-api-access-q828p\") pod \"service-ca-75d99c484-cnwj5\" (UID: \"214ec921-5ae1-4b28-8737-a7e10bfa827d\") " pod="openshift-service-ca/service-ca-75d99c484-cnwj5"
Sep 10 13:17:41.648903 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.648867    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-cnwj5"
Sep 10 13:17:41.888613 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:41.888580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c5sln" event={"ID":"2c64c340-0f5b-4349-98fc-b1f343df9394","Type":"ContainerStarted","Data":"90b7c889f1b3bdc6d4104fee45a7cd54e667ad0a61c02970a8bbe712df3998d7"}
Sep 10 13:17:42.007143 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:42.007118    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-cnwj5"]
Sep 10 13:17:42.009450 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:42.009425    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod214ec921_5ae1_4b28_8737_a7e10bfa827d.slice/crio-d7e9a925be3ee0e4373b90aa2b6578df28c22c7ea343a74f59e6fc9f7d5a72ac WatchSource:0}: Error finding container d7e9a925be3ee0e4373b90aa2b6578df28c22c7ea343a74f59e6fc9f7d5a72ac: Status 404 returned error can't find the container with id d7e9a925be3ee0e4373b90aa2b6578df28c22c7ea343a74f59e6fc9f7d5a72ac
Sep 10 13:17:42.072937 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:42.072915    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hvhhv_704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c/node-ca/0.log"
Sep 10 13:17:42.873074 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:42.873040    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pvgkz_1806c922-6bc4-4db8-83e8-15fdb1684b16/serve-healthcheck-canary/0.log"
Sep 10 13:17:42.893268 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:42.893232    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-cnwj5" event={"ID":"214ec921-5ae1-4b28-8737-a7e10bfa827d","Type":"ContainerStarted","Data":"fbcb890846fbc4c6d43954d38ed2caf935c65ffa6197cf50af0f515b2a835c52"}
Sep 10 13:17:42.893716 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:42.893333    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-cnwj5" event={"ID":"214ec921-5ae1-4b28-8737-a7e10bfa827d","Type":"ContainerStarted","Data":"d7e9a925be3ee0e4373b90aa2b6578df28c22c7ea343a74f59e6fc9f7d5a72ac"}
Sep 10 13:17:42.895064 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:42.895037    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c5sln" event={"ID":"2c64c340-0f5b-4349-98fc-b1f343df9394","Type":"ContainerStarted","Data":"e515479f0f76194317c5b6604ebf4841d4366a0ad79fa04e29daa5e1920fdd4d"}
Sep 10 13:17:42.918844 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:42.918800    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-cnwj5" podStartSLOduration=1.918783831 podStartE2EDuration="1.918783831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:42.917996242 +0000 UTC m=+57.803623270" watchObservedRunningTime="2026-09-10 13:17:42.918783831 +0000 UTC m=+57.804410914"
Sep 10 13:17:42.939528 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:42.939475    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-c5sln" podStartSLOduration=1.829194288 podStartE2EDuration="3.939459708s" totalImagesPullingTime="2.11026542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:42.938481227 +0000 UTC m=+57.824108255" watchObservedRunningTime="2026-09-10 13:17:42.939459708 +0000 UTC m=+57.825086735"
Sep 10 13:17:42.960706 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:42.960680    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:42.960828 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:42.960724    2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:42.961047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:42.961034    2584 scope.go:117] "RemoveContainer" containerID="4266d0a172b0c2acefb538a7defb8aa3812e30a7416e7b174ca53806ea63d41d"
Sep 10 13:17:42.961218 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:42.961199    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-6qc7l_openshift-console-operator(22ec15f1-c11d-4159-8edd-a8d3934bc4ca)\"" pod="openshift-console-operator/console-operator-85b454874b-6qc7l" podUID="22ec15f1-c11d-4159-8edd-a8d3934bc4ca"
Sep 10 13:17:43.073886 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:43.073853    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-c5sln_2c64c340-0f5b-4349-98fc-b1f343df9394/migrator/0.log"
Sep 10 13:17:43.225066 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:43.224978    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:43.225066 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:43.225045    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:43.225245 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:43.225110    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 13:17:43.225245 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:43.225184    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm podName:1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf nodeName:}" failed. No retries permitted until 2026-09-10 13:17:47.225167848 +0000 UTC m=+62.110794874 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjggg" (UID: "1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf") : configmap "kube-rbac-proxy" not found
Sep 10 13:17:43.225245 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:43.225231    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 13:17:43.225350 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:43.225301    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls podName:1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf nodeName:}" failed. No retries permitted until 2026-09-10 13:17:47.22528334 +0000 UTC m=+62.110910362 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjggg" (UID: "1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf") : secret "insights-runtime-extractor-tls" not found
Sep 10 13:17:43.272903 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:43.272876    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-c5sln_2c64c340-0f5b-4349-98fc-b1f343df9394/graceful-termination/0.log"
Sep 10 13:17:43.476745 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:43.476652    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-qvzd2_a80ea425-e5a1-4f73-a52b-f579b6b75730/kube-storage-version-migrator-operator/0.log"
Sep 10 13:17:45.757848 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:45.757819    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qngjl"
Sep 10 13:17:47.259819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:47.259783    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:47.260237 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:47.259842    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:47.260237 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:47.259902    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 13:17:47.260237 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:47.259967    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm podName:1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf nodeName:}" failed. No retries permitted until 2026-09-10 13:17:55.259951772 +0000 UTC m=+70.145578776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjggg" (UID: "1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf") : configmap "kube-rbac-proxy" not found
Sep 10 13:17:47.260237 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:47.260009    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 13:17:47.260237 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:47.260063    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls podName:1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf nodeName:}" failed. No retries permitted until 2026-09-10 13:17:55.260049888 +0000 UTC m=+70.145676893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjggg" (UID: "1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf") : secret "insights-runtime-extractor-tls" not found
Sep 10 13:17:48.470974 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:48.470928    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-xn6zg\" (UID: \"cb11abd8-859b-4e77-85df-3938d94ea37f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"
Sep 10 13:17:48.473494 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:48.473470    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb11abd8-859b-4e77-85df-3938d94ea37f-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-xn6zg\" (UID: \"cb11abd8-859b-4e77-85df-3938d94ea37f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"
Sep 10 13:17:48.495240 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:48.495216    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7djt6\""
Sep 10 13:17:48.502811 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:48.502791    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"
Sep 10 13:17:48.572645 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:48.572456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:48.572645 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:48.572522    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:48.572808 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:48.572645    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle podName:6f148377-3da6-4888-8b3d-70dd02ea46a6 nodeName:}" failed. No retries permitted until 2026-09-10 13:18:04.572625629 +0000 UTC m=+79.458252634 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle") pod "router-default-56cc659cd8-kmvzg" (UID: "6f148377-3da6-4888-8b3d-70dd02ea46a6") : configmap references non-existent config key: service-ca.crt
Sep 10 13:17:48.574991 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:48.574961    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f148377-3da6-4888-8b3d-70dd02ea46a6-metrics-certs\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:17:48.673602 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:48.673550    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:17:48.673787 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:48.673701    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 13:17:48.673787 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:17:48.673757    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls podName:34d5e373-33e5-4c3a-b4f7-ceceea4767de nodeName:}" failed. No retries permitted until 2026-09-10 13:18:04.673744965 +0000 UTC m=+79.559371969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9f564" (UID: "34d5e373-33e5-4c3a-b4f7-ceceea4767de") : secret "cluster-monitoring-operator-tls" not found
Sep 10 13:17:48.775818 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:48.775793    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg"]
Sep 10 13:17:48.923450 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:48.923407    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg" event={"ID":"cb11abd8-859b-4e77-85df-3938d94ea37f","Type":"ContainerStarted","Data":"5e4d7c98f2377e8be36d0fcfe26c5b27286326a5a054338c4f9852ea29f3cae3"}
Sep 10 13:17:51.400612 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.400576    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs\") pod \"network-metrics-daemon-cd2hp\" (UID: \"c9ca33a9-995c-4ea6-bd9f-d72442526915\") " pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:51.401066 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.400655    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:51.403758 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.403738    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 13:17:51.403838 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.403820    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 13:17:51.413640 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.413611    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ecc73e8-ab67-439d-a624-8950a0b2fabb-original-pull-secret\") pod \"global-pull-secret-syncer-rtk5d\" (UID: \"2ecc73e8-ab67-439d-a624-8950a0b2fabb\") " pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:51.413640 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.413638    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9ca33a9-995c-4ea6-bd9f-d72442526915-metrics-certs\") pod \"network-metrics-daemon-cd2hp\" (UID: \"c9ca33a9-995c-4ea6-bd9f-d72442526915\") " pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:51.501312 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.501277    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jjlr\" (UniqueName: \"kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr\") pod \"network-check-target-jhf84\" (UID: \"1bd0f34f-3600-4a79-b5e7-49c86862890f\") " pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:51.504318 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.504296    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 13:17:51.514702 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.514674    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 13:17:51.521023 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.521002    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtk5d"
Sep 10 13:17:51.524724 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.524698    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jjlr\" (UniqueName: \"kubernetes.io/projected/1bd0f34f-3600-4a79-b5e7-49c86862890f-kube-api-access-2jjlr\") pod \"network-check-target-jhf84\" (UID: \"1bd0f34f-3600-4a79-b5e7-49c86862890f\") " pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:51.529066 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.529026    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5vlq4\""
Sep 10 13:17:51.537402 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.537382    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd2hp"
Sep 10 13:17:51.621233 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.621203    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w47rx\""
Sep 10 13:17:51.628511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.628490    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:51.795836 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.795811    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rtk5d"]
Sep 10 13:17:51.798175 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:51.798145    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ecc73e8_ab67_439d_a624_8950a0b2fabb.slice/crio-89f43e65f20d285b6808ddd774ef9cc75f9b2a933bc09ff22fbe13ebc3a27277 WatchSource:0}: Error finding container 89f43e65f20d285b6808ddd774ef9cc75f9b2a933bc09ff22fbe13ebc3a27277: Status 404 returned error can't find the container with id 89f43e65f20d285b6808ddd774ef9cc75f9b2a933bc09ff22fbe13ebc3a27277
Sep 10 13:17:51.818992 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.818956    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cd2hp"]
Sep 10 13:17:51.821892 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:51.821867    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ca33a9_995c_4ea6_bd9f_d72442526915.slice/crio-a5de5d6d4f640c2752698d691fe12b3b780d7a5a42dfb592f4157d3350cbd32d WatchSource:0}: Error finding container a5de5d6d4f640c2752698d691fe12b3b780d7a5a42dfb592f4157d3350cbd32d: Status 404 returned error can't find the container with id a5de5d6d4f640c2752698d691fe12b3b780d7a5a42dfb592f4157d3350cbd32d
Sep 10 13:17:51.896404 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.896374    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jhf84"]
Sep 10 13:17:51.901062 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:51.901027    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd0f34f_3600_4a79_b5e7_49c86862890f.slice/crio-c6f105e3773fd9bf33c2dc3566a48e8dded1ee296ed4d3415345730f9465c831 WatchSource:0}: Error finding container c6f105e3773fd9bf33c2dc3566a48e8dded1ee296ed4d3415345730f9465c831: Status 404 returned error can't find the container with id c6f105e3773fd9bf33c2dc3566a48e8dded1ee296ed4d3415345730f9465c831
Sep 10 13:17:51.905997 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.905836    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:51.908601 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.908546    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls\") pod \"image-registry-76687847b5-rlsk5\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") " pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:51.936026 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.935915    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg" event={"ID":"cb11abd8-859b-4e77-85df-3938d94ea37f","Type":"ContainerStarted","Data":"4b561f564f287232faa9337874a43611b65d3ac4a798b87bbc88bd00109442d0"}
Sep 10 13:17:51.936026 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.936020    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg" event={"ID":"cb11abd8-859b-4e77-85df-3938d94ea37f","Type":"ContainerStarted","Data":"01c4c62afebb14e553a36a188a457f70a0479b0ae1ee09e21c3598eeb33bbec8"}
Sep 10 13:17:51.937391 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.937360    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rtk5d" event={"ID":"2ecc73e8-ab67-439d-a624-8950a0b2fabb","Type":"ContainerStarted","Data":"89f43e65f20d285b6808ddd774ef9cc75f9b2a933bc09ff22fbe13ebc3a27277"}
Sep 10 13:17:51.938690 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.938667    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jhf84" event={"ID":"1bd0f34f-3600-4a79-b5e7-49c86862890f","Type":"ContainerStarted","Data":"c6f105e3773fd9bf33c2dc3566a48e8dded1ee296ed4d3415345730f9465c831"}
Sep 10 13:17:51.939975 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.939951    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cd2hp" event={"ID":"c9ca33a9-995c-4ea6-bd9f-d72442526915","Type":"ContainerStarted","Data":"a5de5d6d4f640c2752698d691fe12b3b780d7a5a42dfb592f4157d3350cbd32d"}
Sep 10 13:17:51.960928 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:51.960879    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-xn6zg" podStartSLOduration=17.90122389 podStartE2EDuration="19.960860967s" totalImagesPullingTime="2.059637077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:51.959229741 +0000 UTC m=+66.844856768" watchObservedRunningTime="2026-09-10 13:17:51.960860967 +0000 UTC m=+66.846487994"
Sep 10 13:17:52.007162 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:52.007127    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:52.009705 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:52.009679    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79818a02-d821-4a83-865c-240c44e4c5ec-metrics-tls\") pod \"dns-default-fqzp6\" (UID: \"79818a02-d821-4a83-865c-240c44e4c5ec\") " pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:52.119516 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:52.119486    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hqw92\""
Sep 10 13:17:52.126920 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:52.126895    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:52.240412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:52.240340    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fkjjg\""
Sep 10 13:17:52.248739 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:52.248708    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:52.402535 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:52.402505    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76687847b5-rlsk5"]
Sep 10 13:17:52.404970 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:52.404938    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f1d7a7a_4610_4436_b3ae_d89a45d99b2d.slice/crio-3b3d8f9a708dec9539ebaa65fb082dfd464d38451af2490e274d01a635910e13 WatchSource:0}: Error finding container 3b3d8f9a708dec9539ebaa65fb082dfd464d38451af2490e274d01a635910e13: Status 404 returned error can't find the container with id 3b3d8f9a708dec9539ebaa65fb082dfd464d38451af2490e274d01a635910e13
Sep 10 13:17:52.530713 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:52.530624    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fqzp6"]
Sep 10 13:17:52.949298 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:52.948333    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76687847b5-rlsk5" event={"ID":"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d","Type":"ContainerStarted","Data":"cbba81d090e296fe50130828cb0619310745ba05d9208439bb7a05951980bf96"}
Sep 10 13:17:52.949298 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:52.948427    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76687847b5-rlsk5" event={"ID":"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d","Type":"ContainerStarted","Data":"3b3d8f9a708dec9539ebaa65fb082dfd464d38451af2490e274d01a635910e13"}
Sep 10 13:17:52.949298 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:52.949231    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:17:52.951635 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:52.951549    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fqzp6" event={"ID":"79818a02-d821-4a83-865c-240c44e4c5ec","Type":"ContainerStarted","Data":"2307e2da24dc66788697964aaf7d0f1ff14bb1b341676077d9710e61af4d4441"}
Sep 10 13:17:52.975591 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:52.975171    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76687847b5-rlsk5" podStartSLOduration=66.975152897 podStartE2EDuration="1m6.975152897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:16:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:52.97317203 +0000 UTC m=+67.858799057" watchObservedRunningTime="2026-09-10 13:17:52.975152897 +0000 UTC m=+67.860779926"
Sep 10 13:17:53.959154 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:53.959100    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cd2hp" event={"ID":"c9ca33a9-995c-4ea6-bd9f-d72442526915","Type":"ContainerStarted","Data":"e62f9cd4cba2d1e0499d4910745b19a069b571a852d6becf67a9cb85b007f1ca"}
Sep 10 13:17:53.959668 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:53.959174    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cd2hp" event={"ID":"c9ca33a9-995c-4ea6-bd9f-d72442526915","Type":"ContainerStarted","Data":"79574accd3a51eb6c36987659948b7d4ea21ec3907b944e17448171686d9d56d"}
Sep 10 13:17:53.979378 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:53.979284    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cd2hp" podStartSLOduration=67.456475866 podStartE2EDuration="1m8.9792649s" totalImagesPullingTime="1.522789034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:53.978341767 +0000 UTC m=+68.863968795" watchObservedRunningTime="2026-09-10 13:17:53.9792649 +0000 UTC m=+68.864891925"
Sep 10 13:17:55.346344 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:55.346305    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:55.346826 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:55.346353    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:55.346916 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:55.346886    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:55.349137 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:55.349115    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjggg\" (UID: \"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf\") " pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:55.424221 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:55.424181    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rwkt7\""
Sep 10 13:17:55.431176 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:55.431150    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vjggg"
Sep 10 13:17:56.607638 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:56.607603    2584 scope.go:117] "RemoveContainer" containerID="4266d0a172b0c2acefb538a7defb8aa3812e30a7416e7b174ca53806ea63d41d"
Sep 10 13:17:58.496025 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:58.495997    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vjggg"]
Sep 10 13:17:58.498773 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:17:58.498744    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b764ab5_f3b5_44b1_883c_ab3dc5c03cdf.slice/crio-39221b59093eadbf1e4b41650c4ab2f8c50290f28536b0d37aa23d22b995a988 WatchSource:0}: Error finding container 39221b59093eadbf1e4b41650c4ab2f8c50290f28536b0d37aa23d22b995a988: Status 404 returned error can't find the container with id 39221b59093eadbf1e4b41650c4ab2f8c50290f28536b0d37aa23d22b995a988
Sep 10 13:17:58.978477 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:58.978442    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jhf84" event={"ID":"1bd0f34f-3600-4a79-b5e7-49c86862890f","Type":"ContainerStarted","Data":"8e73c9533ff04a867aa694b9e2b1d26306d2150062159f3c96668cacdd83c1d8"}
Sep 10 13:17:58.978664 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:58.978572    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:17:58.980213 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:58.980186    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjggg" event={"ID":"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf","Type":"ContainerStarted","Data":"cc59e8c820098a48263c5bf32358151d72bf369b06b64be2076aa2fd8247a865"}
Sep 10 13:17:58.980309 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:58.980240    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjggg" event={"ID":"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf","Type":"ContainerStarted","Data":"39221b59093eadbf1e4b41650c4ab2f8c50290f28536b0d37aa23d22b995a988"}
Sep 10 13:17:58.982165 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:58.982147    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:17:58.982260 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:58.982229    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-6qc7l" event={"ID":"22ec15f1-c11d-4159-8edd-a8d3934bc4ca","Type":"ContainerStarted","Data":"f8a7efff290850b4564a6be238bcd0440483218239b05b9cb456edfe332e2a3d"}
Sep 10 13:17:58.982491 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:58.982477    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:17:58.984006 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:58.983981    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rtk5d" event={"ID":"2ecc73e8-ab67-439d-a624-8950a0b2fabb","Type":"ContainerStarted","Data":"02639f52f943be80d47d409a68a3daf768ff6eeef642cc3a1e832bff55dc2f95"}
Sep 10 13:17:58.986135 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:58.986117    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fqzp6" event={"ID":"79818a02-d821-4a83-865c-240c44e4c5ec","Type":"ContainerStarted","Data":"fd83baf8eafe233a13ac41f4d21ca0b4be00d9b26bfda2413834cae9aae76615"}
Sep 10 13:17:58.986230 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:58.986151    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fqzp6" event={"ID":"79818a02-d821-4a83-865c-240c44e4c5ec","Type":"ContainerStarted","Data":"dc70f12396f2af8bd307a840edb55386cdcf8f7fc976cbd3edf8a976eb4185f3"}
Sep 10 13:17:58.986230 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:58.986183    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:17:58.997626 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:58.997579    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jhf84" podStartSLOduration=67.681794129 podStartE2EDuration="1m13.997537562s" totalImagesPullingTime="6.315743433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:58.996399403 +0000 UTC m=+73.882026430" watchObservedRunningTime="2026-09-10 13:17:58.997537562 +0000 UTC m=+73.883164591"
Sep 10 13:17:59.014817 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:59.014776    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rtk5d" podStartSLOduration=67.59779915 podStartE2EDuration="1m14.014765244s" totalImagesPullingTime="6.416966094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:59.01429166 +0000 UTC m=+73.899918688" watchObservedRunningTime="2026-09-10 13:17:59.014765244 +0000 UTC m=+73.900392270"
Sep 10 13:17:59.033214 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:59.033174    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fqzp6" podStartSLOduration=33.354558975 podStartE2EDuration="39.033162567s" totalImagesPullingTime="5.678603592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:59.032412701 +0000 UTC m=+73.918039729" watchObservedRunningTime="2026-09-10 13:17:59.033162567 +0000 UTC m=+73.918789594"
Sep 10 13:17:59.052151 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:59.052115    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-6qc7l" podStartSLOduration=22.504357421999998 podStartE2EDuration="27.052107436s" totalImagesPullingTime="4.547750014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:17:59.051516427 +0000 UTC m=+73.937143453" watchObservedRunningTime="2026-09-10 13:17:59.052107436 +0000 UTC m=+73.937734463"
Sep 10 13:17:59.304460 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:17:59.304386    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-6qc7l"
Sep 10 13:18:00.996717 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:00.996678    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjggg" event={"ID":"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf","Type":"ContainerStarted","Data":"ca63e02890418f3e4583fc6159307eaa1e9e5b142f33b6859fa8bf72a9b4ecef"}
Sep 10 13:18:03.005384 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:03.005345    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjggg" event={"ID":"1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf","Type":"ContainerStarted","Data":"98fb0344a272c11a543934f4604cc3f5acf573aaaa74c86300ebd37fe22f4877"}
Sep 10 13:18:03.026772 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:03.026705    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vjggg" podStartSLOduration=20.604680669 podStartE2EDuration="24.026678887s" totalImagesPullingTime="3.421998218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:17:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:18:03.025614907 +0000 UTC m=+77.911241934" watchObservedRunningTime="2026-09-10 13:18:03.026678887 +0000 UTC m=+77.912305914"
Sep 10 13:18:04.635276 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:04.635238    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:18:04.635827 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:04.635808    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f148377-3da6-4888-8b3d-70dd02ea46a6-service-ca-bundle\") pod \"router-default-56cc659cd8-kmvzg\" (UID: \"6f148377-3da6-4888-8b3d-70dd02ea46a6\") " pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:18:04.735650 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:04.735612    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:18:04.738199 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:04.738178    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d5e373-33e5-4c3a-b4f7-ceceea4767de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9f564\" (UID: \"34d5e373-33e5-4c3a-b4f7-ceceea4767de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:18:04.807624 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:04.807597    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zg849\""
Sep 10 13:18:04.814912 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:04.814898    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:18:04.854248 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:04.854222    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gd2f8\""
Sep 10 13:18:04.862024 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:04.861997    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"
Sep 10 13:18:05.096835 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:05.096696    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56cc659cd8-kmvzg"]
Sep 10 13:18:05.099381 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:18:05.099357    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f148377_3da6_4888_8b3d_70dd02ea46a6.slice/crio-1239640208a030f74a16e30f1efabce3cd034ca8af2001697e643ab36b24de81 WatchSource:0}: Error finding container 1239640208a030f74a16e30f1efabce3cd034ca8af2001697e643ab36b24de81: Status 404 returned error can't find the container with id 1239640208a030f74a16e30f1efabce3cd034ca8af2001697e643ab36b24de81
Sep 10 13:18:05.145955 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:05.145916    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564"]
Sep 10 13:18:05.149428 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:18:05.149397    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d5e373_33e5_4c3a_b4f7_ceceea4767de.slice/crio-a0909052affa90b797d1d999744409272e4f3c5fba05457b5f01ff7fb46d29c8 WatchSource:0}: Error finding container a0909052affa90b797d1d999744409272e4f3c5fba05457b5f01ff7fb46d29c8: Status 404 returned error can't find the container with id a0909052affa90b797d1d999744409272e4f3c5fba05457b5f01ff7fb46d29c8
Sep 10 13:18:06.016649 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:06.016610    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564" event={"ID":"34d5e373-33e5-4c3a-b4f7-ceceea4767de","Type":"ContainerStarted","Data":"a0909052affa90b797d1d999744409272e4f3c5fba05457b5f01ff7fb46d29c8"}
Sep 10 13:18:06.018094 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:06.018066    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56cc659cd8-kmvzg" event={"ID":"6f148377-3da6-4888-8b3d-70dd02ea46a6","Type":"ContainerStarted","Data":"0d174ae27c14f2b76a116e17542d2824111701d66a87e5844bfa0795ccf98707"}
Sep 10 13:18:06.018211 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:06.018105    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56cc659cd8-kmvzg" event={"ID":"6f148377-3da6-4888-8b3d-70dd02ea46a6","Type":"ContainerStarted","Data":"1239640208a030f74a16e30f1efabce3cd034ca8af2001697e643ab36b24de81"}
Sep 10 13:18:06.048041 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:06.047972    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56cc659cd8-kmvzg" podStartSLOduration=34.047945193 podStartE2EDuration="34.047945193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:18:06.047031663 +0000 UTC m=+80.932658692" watchObservedRunningTime="2026-09-10 13:18:06.047945193 +0000 UTC m=+80.933572221"
Sep 10 13:18:06.815750 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:06.815623    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:18:06.817911 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:06.817889    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:18:07.022992 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:07.022958    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:18:07.024308 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:07.024286    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56cc659cd8-kmvzg"
Sep 10 13:18:08.028424 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:08.028388    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564" event={"ID":"34d5e373-33e5-4c3a-b4f7-ceceea4767de","Type":"ContainerStarted","Data":"cda3b3ecf42514f259b0e259e269798052f6a6cf10d78a1f40502419e9cf7f99"}
Sep 10 13:18:08.050961 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:08.050896    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9f564" podStartSLOduration=33.341425867 podStartE2EDuration="36.050873458s" totalImagesPullingTime="2.709447591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:18:08.048496605 +0000 UTC m=+82.934123634" watchObservedRunningTime="2026-09-10 13:18:08.050873458 +0000 UTC m=+82.936500488"
Sep 10 13:18:08.992287 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:08.992259    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fqzp6"
Sep 10 13:18:11.008948 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.008911    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-h9n7q"]
Sep 10 13:18:11.012154 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.012138    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-h9n7q"
Sep 10 13:18:11.018254 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.018156    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-4cd8z"]
Sep 10 13:18:11.020727 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.020707    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bvs7b\""
Sep 10 13:18:11.021468 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.021451    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-4cd8z"
Sep 10 13:18:11.031785 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.031759    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 10 13:18:11.033108 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.033086    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4rskh\""
Sep 10 13:18:11.033219 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.033185    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 10 13:18:11.052917 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.052887    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-h9n7q"]
Sep 10 13:18:11.054742 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.054713    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-4cd8z"]
Sep 10 13:18:11.123514 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.123475    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6drlm"]
Sep 10 13:18:11.125782 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.125760    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6drlm"
Sep 10 13:18:11.131120 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.131101    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-8ndmw\""
Sep 10 13:18:11.131228 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.131182    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 10 13:18:11.148835 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.148805    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6drlm"]
Sep 10 13:18:11.150994 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.150972    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-r7cdm"]
Sep 10 13:18:11.153126 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.153105    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-r7cdm"
Sep 10 13:18:11.156881 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.156858    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 13:18:11.157252 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.157236    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-dmv5v\""
Sep 10 13:18:11.158057 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.157771    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 13:18:11.175232 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.175203    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-r7cdm"]
Sep 10 13:18:11.186963 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.186936    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/032020fa-2542-42fc-a6ff-6750421c5665-nginx-conf\") pod \"networking-console-plugin-79977f9844-4cd8z\" (UID: \"032020fa-2542-42fc-a6ff-6750421c5665\") " pod="openshift-network-console/networking-console-plugin-79977f9844-4cd8z"
Sep 10 13:18:11.187107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.186979    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td5mz\" (UniqueName: \"kubernetes.io/projected/d4a89c64-63ca-4bed-96c3-4d056ca1c387-kube-api-access-td5mz\") pod \"network-check-source-685456655f-h9n7q\" (UID: \"d4a89c64-63ca-4bed-96c3-4d056ca1c387\") " pod="openshift-network-diagnostics/network-check-source-685456655f-h9n7q"
Sep 10 13:18:11.187107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.187019    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032020fa-2542-42fc-a6ff-6750421c5665-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-4cd8z\" (UID: \"032020fa-2542-42fc-a6ff-6750421c5665\") " pod="openshift-network-console/networking-console-plugin-79977f9844-4cd8z"
Sep 10 13:18:11.288123 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.288039    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/032020fa-2542-42fc-a6ff-6750421c5665-nginx-conf\") pod \"networking-console-plugin-79977f9844-4cd8z\" (UID: \"032020fa-2542-42fc-a6ff-6750421c5665\") " pod="openshift-network-console/networking-console-plugin-79977f9844-4cd8z"
Sep 10 13:18:11.288123 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.288078    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td5mz\" (UniqueName: \"kubernetes.io/projected/d4a89c64-63ca-4bed-96c3-4d056ca1c387-kube-api-access-td5mz\") pod \"network-check-source-685456655f-h9n7q\" (UID: \"d4a89c64-63ca-4bed-96c3-4d056ca1c387\") " pod="openshift-network-diagnostics/network-check-source-685456655f-h9n7q"
Sep 10 13:18:11.288123 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.288112    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hchz4\" (UniqueName: \"kubernetes.io/projected/b7f79949-c76d-4e86-b217-91e20c453acd-kube-api-access-hchz4\") pod \"downloads-85d98c998f-r7cdm\" (UID: \"b7f79949-c76d-4e86-b217-91e20c453acd\") " pod="openshift-console/downloads-85d98c998f-r7cdm"
Sep 10 13:18:11.288408 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.288139    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032020fa-2542-42fc-a6ff-6750421c5665-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-4cd8z\" (UID: \"032020fa-2542-42fc-a6ff-6750421c5665\") " pod="openshift-network-console/networking-console-plugin-79977f9844-4cd8z"
Sep 10 13:18:11.288408 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.288217    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/62194097-c08c-44b8-9ec9-16a723a6115a-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-6drlm\" (UID: \"62194097-c08c-44b8-9ec9-16a723a6115a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6drlm"
Sep 10 13:18:11.288759 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.288729    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/032020fa-2542-42fc-a6ff-6750421c5665-nginx-conf\") pod \"networking-console-plugin-79977f9844-4cd8z\" (UID: \"032020fa-2542-42fc-a6ff-6750421c5665\") " pod="openshift-network-console/networking-console-plugin-79977f9844-4cd8z"
Sep 10 13:18:11.290652 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.290631    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032020fa-2542-42fc-a6ff-6750421c5665-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-4cd8z\" (UID: \"032020fa-2542-42fc-a6ff-6750421c5665\") " pod="openshift-network-console/networking-console-plugin-79977f9844-4cd8z"
Sep 10 13:18:11.301661 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.301636    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td5mz\" (UniqueName: \"kubernetes.io/projected/d4a89c64-63ca-4bed-96c3-4d056ca1c387-kube-api-access-td5mz\") pod \"network-check-source-685456655f-h9n7q\" (UID: \"d4a89c64-63ca-4bed-96c3-4d056ca1c387\") " pod="openshift-network-diagnostics/network-check-source-685456655f-h9n7q"
Sep 10 13:18:11.320934 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.320907    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-h9n7q"
Sep 10 13:18:11.330996 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.330976    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-4cd8z"
Sep 10 13:18:11.390213 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.389531    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hchz4\" (UniqueName: \"kubernetes.io/projected/b7f79949-c76d-4e86-b217-91e20c453acd-kube-api-access-hchz4\") pod \"downloads-85d98c998f-r7cdm\" (UID: \"b7f79949-c76d-4e86-b217-91e20c453acd\") " pod="openshift-console/downloads-85d98c998f-r7cdm"
Sep 10 13:18:11.390213 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.389646    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/62194097-c08c-44b8-9ec9-16a723a6115a-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-6drlm\" (UID: \"62194097-c08c-44b8-9ec9-16a723a6115a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6drlm"
Sep 10 13:18:11.401407 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.401366    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/62194097-c08c-44b8-9ec9-16a723a6115a-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-6drlm\" (UID: \"62194097-c08c-44b8-9ec9-16a723a6115a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6drlm"
Sep 10 13:18:11.402748 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.402719    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hchz4\" (UniqueName: \"kubernetes.io/projected/b7f79949-c76d-4e86-b217-91e20c453acd-kube-api-access-hchz4\") pod \"downloads-85d98c998f-r7cdm\" (UID: \"b7f79949-c76d-4e86-b217-91e20c453acd\") " pod="openshift-console/downloads-85d98c998f-r7cdm"
Sep 10 13:18:11.435015 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.434987    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6drlm"
Sep 10 13:18:11.463439 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.463411    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-r7cdm"
Sep 10 13:18:11.613634 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.613570    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-h9n7q"]
Sep 10 13:18:11.614547 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:18:11.614508    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4a89c64_63ca_4bed_96c3_4d056ca1c387.slice/crio-92feed0b66caaeb5993f316becec3e1e08bbec8fb1b9176b92ce177e14e77bef WatchSource:0}: Error finding container 92feed0b66caaeb5993f316becec3e1e08bbec8fb1b9176b92ce177e14e77bef: Status 404 returned error can't find the container with id 92feed0b66caaeb5993f316becec3e1e08bbec8fb1b9176b92ce177e14e77bef
Sep 10 13:18:11.629017 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.628991    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-4cd8z"]
Sep 10 13:18:11.632777 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:18:11.632751    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032020fa_2542_42fc_a6ff_6750421c5665.slice/crio-ac2d2150f4dcda9bc48ff25cb85f7cc0de7cf8e847ce758aae7566b3bd23efdb WatchSource:0}: Error finding container ac2d2150f4dcda9bc48ff25cb85f7cc0de7cf8e847ce758aae7566b3bd23efdb: Status 404 returned error can't find the container with id ac2d2150f4dcda9bc48ff25cb85f7cc0de7cf8e847ce758aae7566b3bd23efdb
Sep 10 13:18:11.715435 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.715410    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6drlm"]
Sep 10 13:18:11.718385 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:18:11.718358    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62194097_c08c_44b8_9ec9_16a723a6115a.slice/crio-0e24437de029263c0460bb520c78c47aff45772af3ef66843bb7f6f9de4dfc46 WatchSource:0}: Error finding container 0e24437de029263c0460bb520c78c47aff45772af3ef66843bb7f6f9de4dfc46: Status 404 returned error can't find the container with id 0e24437de029263c0460bb520c78c47aff45772af3ef66843bb7f6f9de4dfc46
Sep 10 13:18:11.752718 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:11.752698    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-r7cdm"]
Sep 10 13:18:11.754546 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:18:11.754518    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f79949_c76d_4e86_b217_91e20c453acd.slice/crio-a60033a5b323712e28e402308764b165d466e5c9f54bdeb4213276951634fdf5 WatchSource:0}: Error finding container a60033a5b323712e28e402308764b165d466e5c9f54bdeb4213276951634fdf5: Status 404 returned error can't find the container with id a60033a5b323712e28e402308764b165d466e5c9f54bdeb4213276951634fdf5
Sep 10 13:18:12.050267 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.050153    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-h9n7q" event={"ID":"d4a89c64-63ca-4bed-96c3-4d056ca1c387","Type":"ContainerStarted","Data":"b50ce9aeef078e88b2fbe29235400d538e16be37c73cb91047a99a706f08a820"}
Sep 10 13:18:12.050267 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.050215    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-h9n7q" event={"ID":"d4a89c64-63ca-4bed-96c3-4d056ca1c387","Type":"ContainerStarted","Data":"92feed0b66caaeb5993f316becec3e1e08bbec8fb1b9176b92ce177e14e77bef"}
Sep 10 13:18:12.051525 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.051484    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6drlm" event={"ID":"62194097-c08c-44b8-9ec9-16a723a6115a","Type":"ContainerStarted","Data":"0e24437de029263c0460bb520c78c47aff45772af3ef66843bb7f6f9de4dfc46"}
Sep 10 13:18:12.052806 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.052773    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-r7cdm" event={"ID":"b7f79949-c76d-4e86-b217-91e20c453acd","Type":"ContainerStarted","Data":"a60033a5b323712e28e402308764b165d466e5c9f54bdeb4213276951634fdf5"}
Sep 10 13:18:12.054214 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.054190    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-4cd8z" event={"ID":"032020fa-2542-42fc-a6ff-6750421c5665","Type":"ContainerStarted","Data":"ac2d2150f4dcda9bc48ff25cb85f7cc0de7cf8e847ce758aae7566b3bd23efdb"}
Sep 10 13:18:12.069941 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.069896    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-h9n7q" podStartSLOduration=2.069882978 podStartE2EDuration="2.069882978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:18:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:18:12.068366206 +0000 UTC m=+86.953993247" watchObservedRunningTime="2026-09-10 13:18:12.069882978 +0000 UTC m=+86.955510005"
Sep 10 13:18:12.131908 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.131873    2584 patch_prober.go:28] interesting pod/image-registry-76687847b5-rlsk5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 10 13:18:12.132078 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.131930    2584 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76687847b5-rlsk5" podUID="3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 13:18:12.232407 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.232323    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-775b9fdcf4-sslmm"]
Sep 10 13:18:12.235427 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.235403    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.238578 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.238354    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 13:18:12.238578 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.238428    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 13:18:12.238578 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.238353    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 13:18:12.238578 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.238479    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 13:18:12.238578 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.238354    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 13:18:12.238897 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.238630    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vhx9c\""
Sep 10 13:18:12.247710 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.247689    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-775b9fdcf4-sslmm"]
Sep 10 13:18:12.399172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.399144    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-service-ca\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.399172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.399185    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-oauth-serving-cert\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.399415 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.399203    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-serving-cert\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.399415 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.399249    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-oauth-config\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.399415 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.399271    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-config\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.399415 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.399307    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9tmn\" (UniqueName: \"kubernetes.io/projected/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-kube-api-access-k9tmn\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.500326 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.500288    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-service-ca\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.500497 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.500352    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-oauth-serving-cert\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.500497 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.500382    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-serving-cert\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.500497 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.500440    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-oauth-config\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.500497 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.500475    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-config\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.500746 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.500524    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9tmn\" (UniqueName: \"kubernetes.io/projected/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-kube-api-access-k9tmn\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.501185 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.501151    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-service-ca\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.501328 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.501151    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-oauth-serving-cert\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.501609 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.501581    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-config\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.503641 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.503605    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-serving-cert\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.507367 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.507320    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-oauth-config\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.510654 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.510610    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9tmn\" (UniqueName: \"kubernetes.io/projected/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-kube-api-access-k9tmn\") pod \"console-775b9fdcf4-sslmm\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") " pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.545362 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.545326    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:12.853380 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:12.853308    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-775b9fdcf4-sslmm"]
Sep 10 13:18:12.858479 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:18:12.858449    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce108bb9_e4ec_47ee_84f4_13136d2f4ec2.slice/crio-c4e1e0f9a7c7ed4f2cebce3f3de9ecb8835a7869fb109a637699fcb04fe85813 WatchSource:0}: Error finding container c4e1e0f9a7c7ed4f2cebce3f3de9ecb8835a7869fb109a637699fcb04fe85813: Status 404 returned error can't find the container with id c4e1e0f9a7c7ed4f2cebce3f3de9ecb8835a7869fb109a637699fcb04fe85813
Sep 10 13:18:13.064914 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:13.064872    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775b9fdcf4-sslmm" event={"ID":"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2","Type":"ContainerStarted","Data":"c4e1e0f9a7c7ed4f2cebce3f3de9ecb8835a7869fb109a637699fcb04fe85813"}
Sep 10 13:18:14.072382 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.072258    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-4cd8z" event={"ID":"032020fa-2542-42fc-a6ff-6750421c5665","Type":"ContainerStarted","Data":"106a3f7c965b7e903c2ec4e0b3c38e23f56b8bb1694fa16c4bd3b4672fe9ae27"}
Sep 10 13:18:14.074817 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.074133    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6drlm" event={"ID":"62194097-c08c-44b8-9ec9-16a723a6115a","Type":"ContainerStarted","Data":"a575a752785b69819ad1ab091b3e5f3655100dae7e8fffbd2a190ebf5731c302"}
Sep 10 13:18:14.074817 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.074687    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6drlm"
Sep 10 13:18:14.081094 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.081071    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6drlm"
Sep 10 13:18:14.101087 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.101044    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-4cd8z" podStartSLOduration=2.149152694 podStartE2EDuration="4.101029679s" totalImagesPullingTime="1.951876985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:18:14.100252664 +0000 UTC m=+88.985879694" watchObservedRunningTime="2026-09-10 13:18:14.101029679 +0000 UTC m=+88.986656709"
Sep 10 13:18:14.128124 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.126332    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6drlm" podStartSLOduration=1.258177245 podStartE2EDuration="3.126313865s" totalImagesPullingTime="1.86813662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:18:14.125624848 +0000 UTC m=+89.011251885" watchObservedRunningTime="2026-09-10 13:18:14.126313865 +0000 UTC m=+89.011940893"
Sep 10 13:18:14.475686 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.474121    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-76d2s"]
Sep 10 13:18:14.479241 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.478460    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:14.481497 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.481462    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 10 13:18:14.481827 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.481800    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 13:18:14.482758 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.482738    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hbtln\""
Sep 10 13:18:14.482883 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.482769    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 10 13:18:14.488765 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.488547    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-76d2s"]
Sep 10 13:18:14.523113 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.522865    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0144f46b-341f-4305-88df-e33099b26f5e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-76d2s\" (UID: \"0144f46b-341f-4305-88df-e33099b26f5e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:14.523113 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.522911    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0144f46b-341f-4305-88df-e33099b26f5e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-76d2s\" (UID: \"0144f46b-341f-4305-88df-e33099b26f5e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:14.523113 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.523001    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0144f46b-341f-4305-88df-e33099b26f5e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-76d2s\" (UID: \"0144f46b-341f-4305-88df-e33099b26f5e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:14.523113 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.523030    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsbqg\" (UniqueName: \"kubernetes.io/projected/0144f46b-341f-4305-88df-e33099b26f5e-kube-api-access-jsbqg\") pod \"prometheus-operator-6f4946db56-76d2s\" (UID: \"0144f46b-341f-4305-88df-e33099b26f5e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:14.624176 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.624143    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0144f46b-341f-4305-88df-e33099b26f5e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-76d2s\" (UID: \"0144f46b-341f-4305-88df-e33099b26f5e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:14.624339 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.624190    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbqg\" (UniqueName: \"kubernetes.io/projected/0144f46b-341f-4305-88df-e33099b26f5e-kube-api-access-jsbqg\") pod \"prometheus-operator-6f4946db56-76d2s\" (UID: \"0144f46b-341f-4305-88df-e33099b26f5e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:14.624339 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.624237    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0144f46b-341f-4305-88df-e33099b26f5e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-76d2s\" (UID: \"0144f46b-341f-4305-88df-e33099b26f5e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:14.624339 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.624266    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0144f46b-341f-4305-88df-e33099b26f5e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-76d2s\" (UID: \"0144f46b-341f-4305-88df-e33099b26f5e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:14.624492 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:18:14.624403    2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 10 13:18:14.624539 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:18:14.624516    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0144f46b-341f-4305-88df-e33099b26f5e-prometheus-operator-tls podName:0144f46b-341f-4305-88df-e33099b26f5e nodeName:}" failed. No retries permitted until 2026-09-10 13:18:15.12449547 +0000 UTC m=+90.010122480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0144f46b-341f-4305-88df-e33099b26f5e-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-76d2s" (UID: "0144f46b-341f-4305-88df-e33099b26f5e") : secret "prometheus-operator-tls" not found
Sep 10 13:18:14.625279 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.625254    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0144f46b-341f-4305-88df-e33099b26f5e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-76d2s\" (UID: \"0144f46b-341f-4305-88df-e33099b26f5e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:14.627132 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.627090    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0144f46b-341f-4305-88df-e33099b26f5e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-76d2s\" (UID: \"0144f46b-341f-4305-88df-e33099b26f5e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:14.636379 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.636357    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsbqg\" (UniqueName: \"kubernetes.io/projected/0144f46b-341f-4305-88df-e33099b26f5e-kube-api-access-jsbqg\") pod \"prometheus-operator-6f4946db56-76d2s\" (UID: \"0144f46b-341f-4305-88df-e33099b26f5e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:14.968673 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:14.968642    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:18:15.129044 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:15.129008    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0144f46b-341f-4305-88df-e33099b26f5e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-76d2s\" (UID: \"0144f46b-341f-4305-88df-e33099b26f5e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:15.132244 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:15.132197    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0144f46b-341f-4305-88df-e33099b26f5e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-76d2s\" (UID: \"0144f46b-341f-4305-88df-e33099b26f5e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:15.392813 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:15.392775    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s"
Sep 10 13:18:15.678348 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:15.678322    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-76d2s"]
Sep 10 13:18:16.884649 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:18:16.884611    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0144f46b_341f_4305_88df_e33099b26f5e.slice/crio-4ee3666eab0f6d9ab5fd56fba13220ec29e650a3d3d3039ad489f0526c54a1e0 WatchSource:0}: Error finding container 4ee3666eab0f6d9ab5fd56fba13220ec29e650a3d3d3039ad489f0526c54a1e0: Status 404 returned error can't find the container with id 4ee3666eab0f6d9ab5fd56fba13220ec29e650a3d3d3039ad489f0526c54a1e0
Sep 10 13:18:17.092894 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:17.092846    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775b9fdcf4-sslmm" event={"ID":"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2","Type":"ContainerStarted","Data":"ba358a09dca5d2390bcb3b592b766ba018d4bd4bae8457e11aea1f7aed033ac4"}
Sep 10 13:18:17.094420 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:17.094385    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s" event={"ID":"0144f46b-341f-4305-88df-e33099b26f5e","Type":"ContainerStarted","Data":"4ee3666eab0f6d9ab5fd56fba13220ec29e650a3d3d3039ad489f0526c54a1e0"}
Sep 10 13:18:17.124910 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:17.124851    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-775b9fdcf4-sslmm" podStartSLOduration=1.06707785 podStartE2EDuration="5.124831553s" totalImagesPullingTime="4.057753703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:18:17.124096902 +0000 UTC m=+92.009723932" watchObservedRunningTime="2026-09-10 13:18:17.124831553 +0000 UTC m=+92.010458583"
Sep 10 13:18:19.108426 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:19.108385    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s" event={"ID":"0144f46b-341f-4305-88df-e33099b26f5e","Type":"ContainerStarted","Data":"7a9072e081fe131c11b84afbf9038f5499f7e76929d8e4494b0d1ee9ef6fba17"}
Sep 10 13:18:19.108924 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:19.108453    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s" event={"ID":"0144f46b-341f-4305-88df-e33099b26f5e","Type":"ContainerStarted","Data":"20abf82516bfc4bb025f81d2cda43398163e312a35611986c56493e11fa54c1f"}
Sep 10 13:18:19.136030 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:19.135960    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-76d2s" podStartSLOduration=3.668936943 podStartE2EDuration="5.135936777s" totalImagesPullingTime="1.466999834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:18:19.135102646 +0000 UTC m=+94.020729672" watchObservedRunningTime="2026-09-10 13:18:19.135936777 +0000 UTC m=+94.021563804"
Sep 10 13:18:20.870316 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.870272    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nwpns"]
Sep 10 13:18:20.873705 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.873676    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:20.876774 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.876741    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 13:18:20.876883 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.876769    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 13:18:20.876883 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.876813    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l4r8x\""
Sep 10 13:18:20.877591 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.876991    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 13:18:20.987975 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.987944    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:20.988147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.988005    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-tls\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:20.988147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.988024    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4cq5\" (UniqueName: \"kubernetes.io/projected/0565d65d-cfb1-47e2-a13a-9c37f939e84e-kube-api-access-f4cq5\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:20.988147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.988057    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0565d65d-cfb1-47e2-a13a-9c37f939e84e-metrics-client-ca\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:20.988147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.988078    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0565d65d-cfb1-47e2-a13a-9c37f939e84e-sys\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:20.988147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.988096    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-textfile\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:20.988147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.988117    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0565d65d-cfb1-47e2-a13a-9c37f939e84e-root\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:20.988147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.988131    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-wtmp\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:20.988479 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:20.988169    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.088725 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.088688    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.088906 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.088760    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.088906 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.088808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-tls\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.088906 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.088835    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4cq5\" (UniqueName: \"kubernetes.io/projected/0565d65d-cfb1-47e2-a13a-9c37f939e84e-kube-api-access-f4cq5\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.088906 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.088884    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0565d65d-cfb1-47e2-a13a-9c37f939e84e-metrics-client-ca\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.089121 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.089019    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0565d65d-cfb1-47e2-a13a-9c37f939e84e-sys\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.089121 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.089049    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-textfile\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.089121 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.089075    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0565d65d-cfb1-47e2-a13a-9c37f939e84e-root\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.089121 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.089089    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-wtmp\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.089321 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.089250    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-wtmp\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.090172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.089508    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0565d65d-cfb1-47e2-a13a-9c37f939e84e-sys\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.090172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.089895    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.090172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.089931    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0565d65d-cfb1-47e2-a13a-9c37f939e84e-metrics-client-ca\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.090172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.089965    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0565d65d-cfb1-47e2-a13a-9c37f939e84e-root\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.090528 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.090368    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-textfile\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.093672 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.093650    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.094537 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.094476    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0565d65d-cfb1-47e2-a13a-9c37f939e84e-node-exporter-tls\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.100976 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.100937    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4cq5\" (UniqueName: \"kubernetes.io/projected/0565d65d-cfb1-47e2-a13a-9c37f939e84e-kube-api-access-f4cq5\") pod \"node-exporter-nwpns\" (UID: \"0565d65d-cfb1-47e2-a13a-9c37f939e84e\") " pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.186709 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:21.186366    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nwpns"
Sep 10 13:18:21.208402 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:18:21.208354    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0565d65d_cfb1_47e2_a13a_9c37f939e84e.slice/crio-d39343817652f5f94e52e1cf0b8834aaf22d55209fe33031b9c5cc86a6a0af91 WatchSource:0}: Error finding container d39343817652f5f94e52e1cf0b8834aaf22d55209fe33031b9c5cc86a6a0af91: Status 404 returned error can't find the container with id d39343817652f5f94e52e1cf0b8834aaf22d55209fe33031b9c5cc86a6a0af91
Sep 10 13:18:22.125374 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:22.125308    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwpns" event={"ID":"0565d65d-cfb1-47e2-a13a-9c37f939e84e","Type":"ContainerStarted","Data":"d39343817652f5f94e52e1cf0b8834aaf22d55209fe33031b9c5cc86a6a0af91"}
Sep 10 13:18:22.545682 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:22.545592    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:22.545682 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:22.545651    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:22.550925 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:22.550904    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:23.133528 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:23.133485    2584 generic.go:356] "Generic (PLEG): container finished" podID="0565d65d-cfb1-47e2-a13a-9c37f939e84e" containerID="03f4956741b115f5b4f83bbd4ea18b4c57ab002d1abc17c98e8a9d5f689b4c11" exitCode=0
Sep 10 13:18:23.134000 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:23.133592    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwpns" event={"ID":"0565d65d-cfb1-47e2-a13a-9c37f939e84e","Type":"ContainerDied","Data":"03f4956741b115f5b4f83bbd4ea18b4c57ab002d1abc17c98e8a9d5f689b4c11"}
Sep 10 13:18:23.138587 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:23.138543    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:18:24.140182 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:24.140144    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwpns" event={"ID":"0565d65d-cfb1-47e2-a13a-9c37f939e84e","Type":"ContainerStarted","Data":"90f2f74c4a99ba5bb819c50269158f89c6dfd8f3ae84f2aa85c30d9dc30828d3"}
Sep 10 13:18:24.140593 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:24.140201    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwpns" event={"ID":"0565d65d-cfb1-47e2-a13a-9c37f939e84e","Type":"ContainerStarted","Data":"d3548f176ef73926fb511ce73529cb9d457c8dd26ea56d7a763fb1b1aa7cb748"}
Sep 10 13:18:24.166686 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:24.166633    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nwpns" podStartSLOduration=2.717359391 podStartE2EDuration="4.166605523s" totalImagesPullingTime="1.364547979s" totalInitContainerRuntime="84.698153ms" isStatefulPod=true podCreationTimestamp="2026-09-10 13:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:18:24.166220781 +0000 UTC m=+99.051847808" watchObservedRunningTime="2026-09-10 13:18:24.166605523 +0000 UTC m=+99.052232555"
Sep 10 13:18:29.992607 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:29.992572    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jhf84"
Sep 10 13:18:33.194003 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:33.193963    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-r7cdm" event={"ID":"b7f79949-c76d-4e86-b217-91e20c453acd","Type":"ContainerStarted","Data":"1507d385f023c3e7bc78dd6bf57cb467a315f7e972af73beac9f90573856ecb7"}
Sep 10 13:18:33.194495 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:33.194472    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-r7cdm"
Sep 10 13:18:33.207342 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:33.207303    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-r7cdm"
Sep 10 13:18:33.225907 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:33.225845    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-r7cdm" podStartSLOduration=1.808854224 podStartE2EDuration="22.225823006s" totalImagesPullingTime="20.416968782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:18:33.223187027 +0000 UTC m=+108.108814055" watchObservedRunningTime="2026-09-10 13:18:33.225823006 +0000 UTC m=+108.111450034"
Sep 10 13:18:38.559634 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:38.559595    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76687847b5-rlsk5"]
Sep 10 13:18:42.343133 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:42.343090    2584 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f" podUID="5414969e-846d-4bd0-836b-30a1f454a912" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 10 13:18:43.781788 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:43.781673    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-775b9fdcf4-sslmm"]
Sep 10 13:18:44.250529 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:44.250493    2584 generic.go:356] "Generic (PLEG): container finished" podID="d4e29dab-505d-4fa5-b018-6392782ca848" containerID="c6038d89fc77f190124c2d7acd7a49dbd67cc7dadacfed9a604ab1a03ed77254" exitCode=0
Sep 10 13:18:44.250859 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:44.250595    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5" event={"ID":"d4e29dab-505d-4fa5-b018-6392782ca848","Type":"ContainerDied","Data":"c6038d89fc77f190124c2d7acd7a49dbd67cc7dadacfed9a604ab1a03ed77254"}
Sep 10 13:18:44.250998 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:44.250974    2584 scope.go:117] "RemoveContainer" containerID="c6038d89fc77f190124c2d7acd7a49dbd67cc7dadacfed9a604ab1a03ed77254"
Sep 10 13:18:45.257187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:45.257151    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-wpxf5" event={"ID":"d4e29dab-505d-4fa5-b018-6392782ca848","Type":"ContainerStarted","Data":"a0307ea50cec7384beda68c04a7e4f0ed9090f31cc7dc35b10e27e13625330f1"}
Sep 10 13:18:52.340872 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:52.340834    2584 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f" podUID="5414969e-846d-4bd0-836b-30a1f454a912" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 10 13:18:54.302288 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:54.302253    2584 generic.go:356] "Generic (PLEG): container finished" podID="eb360902-5133-4fb6-ab33-a7e16a4d2b16" containerID="c6b0674ba389b307dadc9858f82e48d302513b4dc31188b2a414a115350ac818" exitCode=0
Sep 10 13:18:54.302701 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:54.302322    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q" event={"ID":"eb360902-5133-4fb6-ab33-a7e16a4d2b16","Type":"ContainerDied","Data":"c6b0674ba389b307dadc9858f82e48d302513b4dc31188b2a414a115350ac818"}
Sep 10 13:18:54.302748 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:54.302724    2584 scope.go:117] "RemoveContainer" containerID="c6b0674ba389b307dadc9858f82e48d302513b4dc31188b2a414a115350ac818"
Sep 10 13:18:55.308443 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:18:55.308409    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-pmk8q" event={"ID":"eb360902-5133-4fb6-ab33-a7e16a4d2b16","Type":"ContainerStarted","Data":"51a00a0a9d7343e638137dd0770e338e32f5db7e190c71f16ba8d0745f54b857"}
Sep 10 13:19:02.340838 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:02.340779    2584 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f" podUID="5414969e-846d-4bd0-836b-30a1f454a912" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 10 13:19:02.341330 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:02.340886    2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f"
Sep 10 13:19:02.341417 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:02.341369    2584 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"dfa7c3f594b78f0701282c3b9877026af095e510ff4d29816946540db689f8ec"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 10 13:19:02.341417 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:02.341413    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f" podUID="5414969e-846d-4bd0-836b-30a1f454a912" containerName="service-proxy" containerID="cri-o://dfa7c3f594b78f0701282c3b9877026af095e510ff4d29816946540db689f8ec" gracePeriod=30
Sep 10 13:19:03.350182 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.350147    2584 generic.go:356] "Generic (PLEG): container finished" podID="5414969e-846d-4bd0-836b-30a1f454a912" containerID="dfa7c3f594b78f0701282c3b9877026af095e510ff4d29816946540db689f8ec" exitCode=2
Sep 10 13:19:03.350576 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.350201    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f" event={"ID":"5414969e-846d-4bd0-836b-30a1f454a912","Type":"ContainerDied","Data":"dfa7c3f594b78f0701282c3b9877026af095e510ff4d29816946540db689f8ec"}
Sep 10 13:19:03.350576 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.350238    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c94944759-hp68f" event={"ID":"5414969e-846d-4bd0-836b-30a1f454a912","Type":"ContainerStarted","Data":"97933c757529a06bebfdc6862cbb1097b23f998996c6392c6d678bd33ea872ca"}
Sep 10 13:19:03.585082 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.585032    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76687847b5-rlsk5" podUID="3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" containerName="registry" containerID="cri-o://cbba81d090e296fe50130828cb0619310745ba05d9208439bb7a05951980bf96" gracePeriod=30
Sep 10 13:19:03.859187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.859158    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:19:03.881450 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.881370    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-ca-trust-extracted\") pod \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") "
Sep 10 13:19:03.881450 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.881407    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls\") pod \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") "
Sep 10 13:19:03.881450 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.881439    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-trusted-ca\") pod \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") "
Sep 10 13:19:03.881723 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.881471    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-image-registry-private-configuration\") pod \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") "
Sep 10 13:19:03.881723 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.881515    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg5lp\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-kube-api-access-xg5lp\") pod \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") "
Sep 10 13:19:03.881723 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.881571    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-certificates\") pod \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") "
Sep 10 13:19:03.881723 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.881613    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-installation-pull-secrets\") pod \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") "
Sep 10 13:19:03.881723 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.881661    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-bound-sa-token\") pod \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\" (UID: \"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d\") "
Sep 10 13:19:03.882038 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.881984    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" (UID: "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:19:03.882699 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.882438    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" (UID: "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:19:03.884488 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.884444    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" (UID: "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:19:03.884614 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.884486    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" (UID: "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:19:03.884614 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.884589    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" (UID: "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:19:03.884614 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.884602    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" (UID: "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:19:03.884763 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.884681    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-kube-api-access-xg5lp" (OuterVolumeSpecName: "kube-api-access-xg5lp") pod "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" (UID: "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d"). InnerVolumeSpecName "kube-api-access-xg5lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:19:03.890083 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.890059    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" (UID: "3f1d7a7a-4610-4436-b3ae-d89a45d99b2d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:19:03.982943 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.982905    2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-installation-pull-secrets\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:19:03.982943 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.982937    2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-bound-sa-token\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:19:03.982943 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.982946    2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-ca-trust-extracted\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:19:03.982943 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.982954    2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:19:03.983201 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.982962    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-trusted-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:19:03.983201 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.982970    2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-image-registry-private-configuration\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:19:03.983201 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.982980    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg5lp\" (UniqueName: \"kubernetes.io/projected/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-kube-api-access-xg5lp\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:19:03.983201 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:03.982991    2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d-registry-certificates\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:19:04.355796 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:04.355757    2584 generic.go:356] "Generic (PLEG): container finished" podID="3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" containerID="cbba81d090e296fe50130828cb0619310745ba05d9208439bb7a05951980bf96" exitCode=0
Sep 10 13:19:04.356217 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:04.355807    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76687847b5-rlsk5"
Sep 10 13:19:04.356217 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:04.355841    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76687847b5-rlsk5" event={"ID":"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d","Type":"ContainerDied","Data":"cbba81d090e296fe50130828cb0619310745ba05d9208439bb7a05951980bf96"}
Sep 10 13:19:04.356217 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:04.355896    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76687847b5-rlsk5" event={"ID":"3f1d7a7a-4610-4436-b3ae-d89a45d99b2d","Type":"ContainerDied","Data":"3b3d8f9a708dec9539ebaa65fb082dfd464d38451af2490e274d01a635910e13"}
Sep 10 13:19:04.356217 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:04.355918    2584 scope.go:117] "RemoveContainer" containerID="cbba81d090e296fe50130828cb0619310745ba05d9208439bb7a05951980bf96"
Sep 10 13:19:04.374099 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:04.374079    2584 scope.go:117] "RemoveContainer" containerID="cbba81d090e296fe50130828cb0619310745ba05d9208439bb7a05951980bf96"
Sep 10 13:19:04.374432 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:19:04.374407    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbba81d090e296fe50130828cb0619310745ba05d9208439bb7a05951980bf96\": container with ID starting with cbba81d090e296fe50130828cb0619310745ba05d9208439bb7a05951980bf96 not found: ID does not exist" containerID="cbba81d090e296fe50130828cb0619310745ba05d9208439bb7a05951980bf96"
Sep 10 13:19:04.374483 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:04.374440    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbba81d090e296fe50130828cb0619310745ba05d9208439bb7a05951980bf96"} err="failed to get container status \"cbba81d090e296fe50130828cb0619310745ba05d9208439bb7a05951980bf96\": rpc error: code = NotFound desc = could not find container \"cbba81d090e296fe50130828cb0619310745ba05d9208439bb7a05951980bf96\": container with ID starting with cbba81d090e296fe50130828cb0619310745ba05d9208439bb7a05951980bf96 not found: ID does not exist"
Sep 10 13:19:04.391645 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:04.391618    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76687847b5-rlsk5"]
Sep 10 13:19:04.396495 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:04.396470    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76687847b5-rlsk5"]
Sep 10 13:19:05.613687 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:05.613654    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" path="/var/lib/kubelet/pods/3f1d7a7a-4610-4436-b3ae-d89a45d99b2d/volumes"
Sep 10 13:19:08.384991 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:08.384957    2584 generic.go:356] "Generic (PLEG): container finished" podID="a80ea425-e5a1-4f73-a52b-f579b6b75730" containerID="2cf9b502278f67bad4d48165c5a2138e4e4fbfdced8d86a7c92ecc84076a4fcf" exitCode=0
Sep 10 13:19:08.385529 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:08.385026    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2" event={"ID":"a80ea425-e5a1-4f73-a52b-f579b6b75730","Type":"ContainerDied","Data":"2cf9b502278f67bad4d48165c5a2138e4e4fbfdced8d86a7c92ecc84076a4fcf"}
Sep 10 13:19:08.385529 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:08.385349    2584 scope.go:117] "RemoveContainer" containerID="2cf9b502278f67bad4d48165c5a2138e4e4fbfdced8d86a7c92ecc84076a4fcf"
Sep 10 13:19:08.804899 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:08.804846    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-775b9fdcf4-sslmm" podUID="ce108bb9-e4ec-47ee-84f4-13136d2f4ec2" containerName="console" containerID="cri-o://ba358a09dca5d2390bcb3b592b766ba018d4bd4bae8457e11aea1f7aed033ac4" gracePeriod=15
Sep 10 13:19:09.137430 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.137391    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:19:09.232757 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.232724    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-oauth-config\") pod \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") "
Sep 10 13:19:09.232939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.232768    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-serving-cert\") pod \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") "
Sep 10 13:19:09.232939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.232827    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-oauth-serving-cert\") pod \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") "
Sep 10 13:19:09.232939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.232875    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-service-ca\") pod \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") "
Sep 10 13:19:09.232939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.232922    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-config\") pod \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") "
Sep 10 13:19:09.233154 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.232955    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9tmn\" (UniqueName: \"kubernetes.io/projected/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-kube-api-access-k9tmn\") pod \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\" (UID: \"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2\") "
Sep 10 13:19:09.233275 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.233219    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ce108bb9-e4ec-47ee-84f4-13136d2f4ec2" (UID: "ce108bb9-e4ec-47ee-84f4-13136d2f4ec2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:19:09.233275 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.233219    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-service-ca" (OuterVolumeSpecName: "service-ca") pod "ce108bb9-e4ec-47ee-84f4-13136d2f4ec2" (UID: "ce108bb9-e4ec-47ee-84f4-13136d2f4ec2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:19:09.233731 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.233701    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-config" (OuterVolumeSpecName: "console-config") pod "ce108bb9-e4ec-47ee-84f4-13136d2f4ec2" (UID: "ce108bb9-e4ec-47ee-84f4-13136d2f4ec2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:19:09.235265 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.235244    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ce108bb9-e4ec-47ee-84f4-13136d2f4ec2" (UID: "ce108bb9-e4ec-47ee-84f4-13136d2f4ec2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:19:09.235360 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.235320    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-kube-api-access-k9tmn" (OuterVolumeSpecName: "kube-api-access-k9tmn") pod "ce108bb9-e4ec-47ee-84f4-13136d2f4ec2" (UID: "ce108bb9-e4ec-47ee-84f4-13136d2f4ec2"). InnerVolumeSpecName "kube-api-access-k9tmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:19:09.235412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.235355    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ce108bb9-e4ec-47ee-84f4-13136d2f4ec2" (UID: "ce108bb9-e4ec-47ee-84f4-13136d2f4ec2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:19:09.334119 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.334086    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:19:09.334119 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.334118    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-config\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:19:09.334317 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.334129    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9tmn\" (UniqueName: \"kubernetes.io/projected/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-kube-api-access-k9tmn\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:19:09.334317 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.334141    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-oauth-config\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:19:09.334317 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.334153    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-console-serving-cert\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:19:09.334317 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.334164    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2-oauth-serving-cert\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:19:09.394680 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.394642    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qvzd2" event={"ID":"a80ea425-e5a1-4f73-a52b-f579b6b75730","Type":"ContainerStarted","Data":"c7925e105e0143efe17237e3d540c8043583b9ac8780fc5ec23f43eb5ac20d19"}
Sep 10 13:19:09.395972 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.395944    2584 generic.go:356] "Generic (PLEG): container finished" podID="ce108bb9-e4ec-47ee-84f4-13136d2f4ec2" containerID="ba358a09dca5d2390bcb3b592b766ba018d4bd4bae8457e11aea1f7aed033ac4" exitCode=0
Sep 10 13:19:09.396090 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.395980    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775b9fdcf4-sslmm"
Sep 10 13:19:09.396090 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.396022    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775b9fdcf4-sslmm" event={"ID":"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2","Type":"ContainerDied","Data":"ba358a09dca5d2390bcb3b592b766ba018d4bd4bae8457e11aea1f7aed033ac4"}
Sep 10 13:19:09.396090 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.396080    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775b9fdcf4-sslmm" event={"ID":"ce108bb9-e4ec-47ee-84f4-13136d2f4ec2","Type":"ContainerDied","Data":"c4e1e0f9a7c7ed4f2cebce3f3de9ecb8835a7869fb109a637699fcb04fe85813"}
Sep 10 13:19:09.396253 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.396108    2584 scope.go:117] "RemoveContainer" containerID="ba358a09dca5d2390bcb3b592b766ba018d4bd4bae8457e11aea1f7aed033ac4"
Sep 10 13:19:09.405088 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.405065    2584 scope.go:117] "RemoveContainer" containerID="ba358a09dca5d2390bcb3b592b766ba018d4bd4bae8457e11aea1f7aed033ac4"
Sep 10 13:19:09.405355 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:19:09.405334    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba358a09dca5d2390bcb3b592b766ba018d4bd4bae8457e11aea1f7aed033ac4\": container with ID starting with ba358a09dca5d2390bcb3b592b766ba018d4bd4bae8457e11aea1f7aed033ac4 not found: ID does not exist" containerID="ba358a09dca5d2390bcb3b592b766ba018d4bd4bae8457e11aea1f7aed033ac4"
Sep 10 13:19:09.405405 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.405364    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba358a09dca5d2390bcb3b592b766ba018d4bd4bae8457e11aea1f7aed033ac4"} err="failed to get container status \"ba358a09dca5d2390bcb3b592b766ba018d4bd4bae8457e11aea1f7aed033ac4\": rpc error: code = NotFound desc = could not find container \"ba358a09dca5d2390bcb3b592b766ba018d4bd4bae8457e11aea1f7aed033ac4\": container with ID starting with ba358a09dca5d2390bcb3b592b766ba018d4bd4bae8457e11aea1f7aed033ac4 not found: ID does not exist"
Sep 10 13:19:09.443574 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.443527    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-775b9fdcf4-sslmm"]
Sep 10 13:19:09.450489 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.450459    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-775b9fdcf4-sslmm"]
Sep 10 13:19:09.613018 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:19:09.612943    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce108bb9-e4ec-47ee-84f4-13136d2f4ec2" path="/var/lib/kubelet/pods/ce108bb9-e4ec-47ee-84f4-13136d2f4ec2/volumes"
Sep 10 13:21:45.540395 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:21:45.540363    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:21:45.543113 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:21:45.543087    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:21:45.546811 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:21:45.546791    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:21:45.549918 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:21:45.549900    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:21:45.557457 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:21:45.557437    2584 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 13:22:02.199128 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.199094    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"]
Sep 10 13:22:02.200526 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.199404    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" containerName="registry"
Sep 10 13:22:02.200526 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.199484    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" containerName="registry"
Sep 10 13:22:02.200526 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.199495    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce108bb9-e4ec-47ee-84f4-13136d2f4ec2" containerName="console"
Sep 10 13:22:02.200526 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.199500    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce108bb9-e4ec-47ee-84f4-13136d2f4ec2" containerName="console"
Sep 10 13:22:02.200526 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.199584    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f1d7a7a-4610-4436-b3ae-d89a45d99b2d" containerName="registry"
Sep 10 13:22:02.200526 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.199600    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce108bb9-e4ec-47ee-84f4-13136d2f4ec2" containerName="console"
Sep 10 13:22:02.201705 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.201686    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.205718 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.205699    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 13:22:02.215108 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.215083    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 13:22:02.215376 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.215354    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 13:22:02.215464 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.215420    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 13:22:02.216292 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.216263    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lrcqt\""
Sep 10 13:22:02.237609 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.237583    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"]
Sep 10 13:22:02.248389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.248363    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a9a03e6-84f1-47b8-9434-d8b39a89b814-tmp\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.248516 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.248416    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a9a03e6-84f1-47b8-9434-d8b39a89b814-manifests\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.248516 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.248440    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb98j\" (UniqueName: \"kubernetes.io/projected/2a9a03e6-84f1-47b8-9434-d8b39a89b814-kube-api-access-cb98j\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.248617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.248518    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a9a03e6-84f1-47b8-9434-d8b39a89b814-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.248617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.248595    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a9a03e6-84f1-47b8-9434-d8b39a89b814-webhook-cert\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.348905 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.348875    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a9a03e6-84f1-47b8-9434-d8b39a89b814-tmp\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.349077 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.348915    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a9a03e6-84f1-47b8-9434-d8b39a89b814-manifests\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.349077 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.348938    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb98j\" (UniqueName: \"kubernetes.io/projected/2a9a03e6-84f1-47b8-9434-d8b39a89b814-kube-api-access-cb98j\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.349077 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.348961    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a9a03e6-84f1-47b8-9434-d8b39a89b814-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.349077 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.348986    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a9a03e6-84f1-47b8-9434-d8b39a89b814-webhook-cert\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.349272 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.349254    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a9a03e6-84f1-47b8-9434-d8b39a89b814-manifests\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.351412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.351384    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a9a03e6-84f1-47b8-9434-d8b39a89b814-tmp\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.351622 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.351600    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a9a03e6-84f1-47b8-9434-d8b39a89b814-webhook-cert\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.351707 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.351693    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a9a03e6-84f1-47b8-9434-d8b39a89b814-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.359676 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.359655    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb98j\" (UniqueName: \"kubernetes.io/projected/2a9a03e6-84f1-47b8-9434-d8b39a89b814-kube-api-access-cb98j\") pod \"opendatahub-operator-controller-manager-699db476d-hj8ts\" (UID: \"2a9a03e6-84f1-47b8-9434-d8b39a89b814\") " pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.511758 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.511668    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:02.809311 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.809285    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"]
Sep 10 13:22:02.811282 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:22:02.811249    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a9a03e6_84f1_47b8_9434_d8b39a89b814.slice/crio-c351e9babbd2ee2c85fcf76014ca94504412d9d88d1a037fa47bdc6fe768d0aa WatchSource:0}: Error finding container c351e9babbd2ee2c85fcf76014ca94504412d9d88d1a037fa47bdc6fe768d0aa: Status 404 returned error can't find the container with id c351e9babbd2ee2c85fcf76014ca94504412d9d88d1a037fa47bdc6fe768d0aa
Sep 10 13:22:02.813044 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:02.813025    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 13:22:03.114091 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:03.114056    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts" event={"ID":"2a9a03e6-84f1-47b8-9434-d8b39a89b814","Type":"ContainerStarted","Data":"c351e9babbd2ee2c85fcf76014ca94504412d9d88d1a037fa47bdc6fe768d0aa"}
Sep 10 13:22:06.132615 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:06.132524    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts" event={"ID":"2a9a03e6-84f1-47b8-9434-d8b39a89b814","Type":"ContainerStarted","Data":"3ab0d348d1bb0cbbbeb0c20c69ad48cdfa796cc062820f143effffb7a8bb61bf"}
Sep 10 13:22:07.145812 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:07.145768    2584 generic.go:356] "Generic (PLEG): container finished" podID="2a9a03e6-84f1-47b8-9434-d8b39a89b814" containerID="3ab0d348d1bb0cbbbeb0c20c69ad48cdfa796cc062820f143effffb7a8bb61bf" exitCode=0
Sep 10 13:22:07.146210 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:07.145849    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts" event={"ID":"2a9a03e6-84f1-47b8-9434-d8b39a89b814","Type":"ContainerDied","Data":"3ab0d348d1bb0cbbbeb0c20c69ad48cdfa796cc062820f143effffb7a8bb61bf"}
Sep 10 13:22:08.153603 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:08.153534    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts" event={"ID":"2a9a03e6-84f1-47b8-9434-d8b39a89b814","Type":"ContainerStarted","Data":"b3a65a39afa1b25388ea11efb1f8d76fa2411b227955b600c0a7051cd885b3b5"}
Sep 10 13:22:08.154091 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:08.153748    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:19.163568 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:19.163530    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts"
Sep 10 13:22:19.206641 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:19.206588    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-699db476d-hj8ts" podStartSLOduration=12.699215945 podStartE2EDuration="17.206541813s" totalImagesPullingTime="3.411567524s" totalInitContainerRuntime="1.095758344s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:22:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:22:08.208130341 +0000 UTC m=+323.093757366" watchObservedRunningTime="2026-09-10 13:22:19.206541813 +0000 UTC m=+334.092168866"
Sep 10 13:22:24.035338 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.035251    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j"]
Sep 10 13:22:24.048574 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.048538    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j"
Sep 10 13:22:24.052214 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.052190    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 13:22:24.052348 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.052290    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 13:22:24.072465 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.072440    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j"]
Sep 10 13:22:24.127871 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.127838    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dae98928-5004-42e9-ba6f-56a1701f564b-tmp\") pod \"kube-auth-proxy-69d5c84f88-kq52j\" (UID: \"dae98928-5004-42e9-ba6f-56a1701f564b\") " pod="openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j"
Sep 10 13:22:24.128047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.127919    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dae98928-5004-42e9-ba6f-56a1701f564b-tls-certs\") pod \"kube-auth-proxy-69d5c84f88-kq52j\" (UID: \"dae98928-5004-42e9-ba6f-56a1701f564b\") " pod="openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j"
Sep 10 13:22:24.128047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.127942    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc684\" (UniqueName: \"kubernetes.io/projected/dae98928-5004-42e9-ba6f-56a1701f564b-kube-api-access-hc684\") pod \"kube-auth-proxy-69d5c84f88-kq52j\" (UID: \"dae98928-5004-42e9-ba6f-56a1701f564b\") " pod="openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j"
Sep 10 13:22:24.228350 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.228319    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dae98928-5004-42e9-ba6f-56a1701f564b-tls-certs\") pod \"kube-auth-proxy-69d5c84f88-kq52j\" (UID: \"dae98928-5004-42e9-ba6f-56a1701f564b\") " pod="openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j"
Sep 10 13:22:24.228350 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.228355    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc684\" (UniqueName: \"kubernetes.io/projected/dae98928-5004-42e9-ba6f-56a1701f564b-kube-api-access-hc684\") pod \"kube-auth-proxy-69d5c84f88-kq52j\" (UID: \"dae98928-5004-42e9-ba6f-56a1701f564b\") " pod="openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j"
Sep 10 13:22:24.228623 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.228404    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dae98928-5004-42e9-ba6f-56a1701f564b-tmp\") pod \"kube-auth-proxy-69d5c84f88-kq52j\" (UID: \"dae98928-5004-42e9-ba6f-56a1701f564b\") " pod="openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j"
Sep 10 13:22:24.230869 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.230844    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dae98928-5004-42e9-ba6f-56a1701f564b-tmp\") pod \"kube-auth-proxy-69d5c84f88-kq52j\" (UID: \"dae98928-5004-42e9-ba6f-56a1701f564b\") " pod="openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j"
Sep 10 13:22:24.231370 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.231350    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dae98928-5004-42e9-ba6f-56a1701f564b-tls-certs\") pod \"kube-auth-proxy-69d5c84f88-kq52j\" (UID: \"dae98928-5004-42e9-ba6f-56a1701f564b\") " pod="openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j"
Sep 10 13:22:24.260137 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.260108    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc684\" (UniqueName: \"kubernetes.io/projected/dae98928-5004-42e9-ba6f-56a1701f564b-kube-api-access-hc684\") pod \"kube-auth-proxy-69d5c84f88-kq52j\" (UID: \"dae98928-5004-42e9-ba6f-56a1701f564b\") " pod="openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j"
Sep 10 13:22:24.359288 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.359254    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j"
Sep 10 13:22:24.677517 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:22:24.677484    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae98928_5004_42e9_ba6f_56a1701f564b.slice/crio-cd4c4388b09d6293b1e2db9cfb6491cab17bbe971dc38acf81d628d4ba479b2b WatchSource:0}: Error finding container cd4c4388b09d6293b1e2db9cfb6491cab17bbe971dc38acf81d628d4ba479b2b: Status 404 returned error can't find the container with id cd4c4388b09d6293b1e2db9cfb6491cab17bbe971dc38acf81d628d4ba479b2b
Sep 10 13:22:24.677690 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:24.677669    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j"]
Sep 10 13:22:25.237616 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:25.237584    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j" event={"ID":"dae98928-5004-42e9-ba6f-56a1701f564b","Type":"ContainerStarted","Data":"cd4c4388b09d6293b1e2db9cfb6491cab17bbe971dc38acf81d628d4ba479b2b"}
Sep 10 13:22:28.257202 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.257166    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j" event={"ID":"dae98928-5004-42e9-ba6f-56a1701f564b","Type":"ContainerStarted","Data":"09e1b84c013aebb4d13cfa84541f3afae4a8319b7c292b28b36724e0dd5cbbf7"}
Sep 10 13:22:28.300242 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.300195    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-69d5c84f88-kq52j" podStartSLOduration=2.546753495 podStartE2EDuration="5.300177887s" totalImagesPullingTime="2.753424392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:22:28.298986853 +0000 UTC m=+343.184613880" watchObservedRunningTime="2026-09-10 13:22:28.300177887 +0000 UTC m=+343.185804913"
Sep 10 13:22:28.611332 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.611294    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"]
Sep 10 13:22:28.613800 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.613784    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.619815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.619791    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 13:22:28.619815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.619806    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9466g\""
Sep 10 13:22:28.620016 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.619800    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 13:22:28.620016 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.619835    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 13:22:28.620016 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.619800    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 13:22:28.649595 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.649550    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"]
Sep 10 13:22:28.671118 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.671082    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.671274 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.671214    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.671327 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.671278    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7qhq\" (UniqueName: \"kubernetes.io/projected/3f49b81b-e07e-45b2-8616-5b46e091b8cb-kube-api-access-k7qhq\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.671393 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.671335    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.671466 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.671448    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.671576 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.671534    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f49b81b-e07e-45b2-8616-5b46e091b8cb-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.671639 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.671594    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.772375 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.772326    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.772375 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.772390    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7qhq\" (UniqueName: \"kubernetes.io/projected/3f49b81b-e07e-45b2-8616-5b46e091b8cb-kube-api-access-k7qhq\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.772705 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.772411    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.772705 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.772440    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.772705 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.772473    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f49b81b-e07e-45b2-8616-5b46e091b8cb-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.772705 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.772496    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.772705 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.772589    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.773115 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.773089    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.775070 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.775044    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.775197 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.775174    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.775415 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.775394    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f49b81b-e07e-45b2-8616-5b46e091b8cb-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.775459 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.775435    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.789413 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.789392    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7qhq\" (UniqueName: \"kubernetes.io/projected/3f49b81b-e07e-45b2-8616-5b46e091b8cb-kube-api-access-k7qhq\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.789604 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.789588    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-z8d49\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:28.922883 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:28.922794    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:29.229538 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:29.229516    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"]
Sep 10 13:22:29.231609 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:22:29.231578    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f49b81b_e07e_45b2_8616_5b46e091b8cb.slice/crio-6eb65956dae8ee622174df52f69e016844252502500b79a49ee9b3790c706b0a WatchSource:0}: Error finding container 6eb65956dae8ee622174df52f69e016844252502500b79a49ee9b3790c706b0a: Status 404 returned error can't find the container with id 6eb65956dae8ee622174df52f69e016844252502500b79a49ee9b3790c706b0a
Sep 10 13:22:29.270445 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:29.270399    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49" event={"ID":"3f49b81b-e07e-45b2-8616-5b46e091b8cb","Type":"ContainerStarted","Data":"6eb65956dae8ee622174df52f69e016844252502500b79a49ee9b3790c706b0a"}
Sep 10 13:22:31.658963 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:31.658859    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:22:31.659327 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:31.659007    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:22:32.288391 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:32.288352    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49" event={"ID":"3f49b81b-e07e-45b2-8616-5b46e091b8cb","Type":"ContainerStarted","Data":"4758794ce3f807db194c8cd06f606ee6993e4e310dae58d1b1d52539682c98cd"}
Sep 10 13:22:32.288614 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:32.288540    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:32.290227 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:32.290195    2584 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-z8d49 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 13:22:32.290341 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:32.290261    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49" podUID="3f49b81b-e07e-45b2-8616-5b46e091b8cb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 13:22:32.341016 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:32.340956    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49" podStartSLOduration=1.91607801 podStartE2EDuration="4.340937038s" totalImagesPullingTime="2.424859028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:22:32.340661125 +0000 UTC m=+347.226288152" watchObservedRunningTime="2026-09-10 13:22:32.340937038 +0000 UTC m=+347.226564067"
Sep 10 13:22:33.294038 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:33.293992    2584 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-z8d49 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 13:22:33.294498 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:33.294053    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49" podUID="3f49b81b-e07e-45b2-8616-5b46e091b8cb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 13:22:36.294622 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:36.294589    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:46.778532 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:46.778498    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz"]
Sep 10 13:22:46.783467 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:46.783443    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz"
Sep 10 13:22:46.786808 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:46.786781    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 13:22:46.787208 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:46.787193    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4kfpj\""
Sep 10 13:22:46.808168 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:46.808144    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz"]
Sep 10 13:22:46.934176 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:46.934145    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce742769-0b91-4d0b-802e-1b801d1a32bc-cert\") pod \"kserve-controller-manager-d6f4b65b8-5rtbz\" (UID: \"ce742769-0b91-4d0b-802e-1b801d1a32bc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz"
Sep 10 13:22:46.934324 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:46.934182    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jst62\" (UniqueName: \"kubernetes.io/projected/ce742769-0b91-4d0b-802e-1b801d1a32bc-kube-api-access-jst62\") pod \"kserve-controller-manager-d6f4b65b8-5rtbz\" (UID: \"ce742769-0b91-4d0b-802e-1b801d1a32bc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz"
Sep 10 13:22:47.035379 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:47.035292    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce742769-0b91-4d0b-802e-1b801d1a32bc-cert\") pod \"kserve-controller-manager-d6f4b65b8-5rtbz\" (UID: \"ce742769-0b91-4d0b-802e-1b801d1a32bc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz"
Sep 10 13:22:47.035379 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:47.035349    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jst62\" (UniqueName: \"kubernetes.io/projected/ce742769-0b91-4d0b-802e-1b801d1a32bc-kube-api-access-jst62\") pod \"kserve-controller-manager-d6f4b65b8-5rtbz\" (UID: \"ce742769-0b91-4d0b-802e-1b801d1a32bc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz"
Sep 10 13:22:47.035605 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:22:47.035459    2584 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 10 13:22:47.035605 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:22:47.035533    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce742769-0b91-4d0b-802e-1b801d1a32bc-cert podName:ce742769-0b91-4d0b-802e-1b801d1a32bc nodeName:}" failed. No retries permitted until 2026-09-10 13:22:47.535511513 +0000 UTC m=+362.421138533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ce742769-0b91-4d0b-802e-1b801d1a32bc-cert") pod "kserve-controller-manager-d6f4b65b8-5rtbz" (UID: "ce742769-0b91-4d0b-802e-1b801d1a32bc") : secret "kserve-webhook-server-cert" not found
Sep 10 13:22:47.054097 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:47.054063    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jst62\" (UniqueName: \"kubernetes.io/projected/ce742769-0b91-4d0b-802e-1b801d1a32bc-kube-api-access-jst62\") pod \"kserve-controller-manager-d6f4b65b8-5rtbz\" (UID: \"ce742769-0b91-4d0b-802e-1b801d1a32bc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz"
Sep 10 13:22:47.539913 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:47.539874    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce742769-0b91-4d0b-802e-1b801d1a32bc-cert\") pod \"kserve-controller-manager-d6f4b65b8-5rtbz\" (UID: \"ce742769-0b91-4d0b-802e-1b801d1a32bc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz"
Sep 10 13:22:47.542440 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:47.542419    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce742769-0b91-4d0b-802e-1b801d1a32bc-cert\") pod \"kserve-controller-manager-d6f4b65b8-5rtbz\" (UID: \"ce742769-0b91-4d0b-802e-1b801d1a32bc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz"
Sep 10 13:22:47.694238 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:47.694201    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz"
Sep 10 13:22:47.883168 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:47.883136    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"]
Sep 10 13:22:47.883521 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:47.883343    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49" podUID="3f49b81b-e07e-45b2-8616-5b46e091b8cb" containerName="discovery" containerID="cri-o://4758794ce3f807db194c8cd06f606ee6993e4e310dae58d1b1d52539682c98cd" gracePeriod=30
Sep 10 13:22:48.020100 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.019979    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz"]
Sep 10 13:22:48.024618 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:22:48.024492    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce742769_0b91_4d0b_802e_1b801d1a32bc.slice/crio-64a7917c5c867a9eb19a6df56a934cfb7a5856d24aff7f5f085f19f93d760abb WatchSource:0}: Error finding container 64a7917c5c867a9eb19a6df56a934cfb7a5856d24aff7f5f085f19f93d760abb: Status 404 returned error can't find the container with id 64a7917c5c867a9eb19a6df56a934cfb7a5856d24aff7f5f085f19f93d760abb
Sep 10 13:22:48.124499 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.124477    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:48.246883 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.246791    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-kubeconfig\") pod \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") "
Sep 10 13:22:48.246883 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.246832    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7qhq\" (UniqueName: \"kubernetes.io/projected/3f49b81b-e07e-45b2-8616-5b46e091b8cb-kube-api-access-k7qhq\") pod \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") "
Sep 10 13:22:48.246883 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.246857    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-csr-ca-configmap\") pod \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") "
Sep 10 13:22:48.246883 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.246883    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-cacerts\") pod \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") "
Sep 10 13:22:48.247205 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.246899    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f49b81b-e07e-45b2-8616-5b46e091b8cb-local-certs\") pod \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") "
Sep 10 13:22:48.247205 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.246927    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-csr-dns-cert\") pod \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") "
Sep 10 13:22:48.247205 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.246957    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-token\") pod \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\" (UID: \"3f49b81b-e07e-45b2-8616-5b46e091b8cb\") "
Sep 10 13:22:48.247832 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.247605    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "3f49b81b-e07e-45b2-8616-5b46e091b8cb" (UID: "3f49b81b-e07e-45b2-8616-5b46e091b8cb"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:22:48.249585 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.249539    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "3f49b81b-e07e-45b2-8616-5b46e091b8cb" (UID: "3f49b81b-e07e-45b2-8616-5b46e091b8cb"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:22:48.249692 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.249650    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-cacerts" (OuterVolumeSpecName: "cacerts") pod "3f49b81b-e07e-45b2-8616-5b46e091b8cb" (UID: "3f49b81b-e07e-45b2-8616-5b46e091b8cb"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:22:48.249759 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.249705    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f49b81b-e07e-45b2-8616-5b46e091b8cb-local-certs" (OuterVolumeSpecName: "local-certs") pod "3f49b81b-e07e-45b2-8616-5b46e091b8cb" (UID: "3f49b81b-e07e-45b2-8616-5b46e091b8cb"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:22:48.249759 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.249742    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f49b81b-e07e-45b2-8616-5b46e091b8cb-kube-api-access-k7qhq" (OuterVolumeSpecName: "kube-api-access-k7qhq") pod "3f49b81b-e07e-45b2-8616-5b46e091b8cb" (UID: "3f49b81b-e07e-45b2-8616-5b46e091b8cb"). InnerVolumeSpecName "kube-api-access-k7qhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:22:48.249890 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.249868    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "3f49b81b-e07e-45b2-8616-5b46e091b8cb" (UID: "3f49b81b-e07e-45b2-8616-5b46e091b8cb"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:22:48.249983 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.249968    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f49b81b-e07e-45b2-8616-5b46e091b8cb" (UID: "3f49b81b-e07e-45b2-8616-5b46e091b8cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:22:48.348411 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.348375    2584 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-kubeconfig\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:22:48.348411 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.348403    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7qhq\" (UniqueName: \"kubernetes.io/projected/3f49b81b-e07e-45b2-8616-5b46e091b8cb-kube-api-access-k7qhq\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:22:48.348411 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.348413    2584 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-csr-ca-configmap\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:22:48.348669 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.348423    2584 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-cacerts\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:22:48.348669 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.348432    2584 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f49b81b-e07e-45b2-8616-5b46e091b8cb-local-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:22:48.348669 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.348440    2584 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-csr-dns-cert\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:22:48.348669 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.348448    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f49b81b-e07e-45b2-8616-5b46e091b8cb-istio-token\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:22:48.361749 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.361715    2584 generic.go:356] "Generic (PLEG): container finished" podID="3f49b81b-e07e-45b2-8616-5b46e091b8cb" containerID="4758794ce3f807db194c8cd06f606ee6993e4e310dae58d1b1d52539682c98cd" exitCode=0
Sep 10 13:22:48.361900 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.361758    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"
Sep 10 13:22:48.361900 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.361795    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49" event={"ID":"3f49b81b-e07e-45b2-8616-5b46e091b8cb","Type":"ContainerDied","Data":"4758794ce3f807db194c8cd06f606ee6993e4e310dae58d1b1d52539682c98cd"}
Sep 10 13:22:48.361900 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.361843    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49" event={"ID":"3f49b81b-e07e-45b2-8616-5b46e091b8cb","Type":"ContainerDied","Data":"6eb65956dae8ee622174df52f69e016844252502500b79a49ee9b3790c706b0a"}
Sep 10 13:22:48.361900 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.361864    2584 scope.go:117] "RemoveContainer" containerID="4758794ce3f807db194c8cd06f606ee6993e4e310dae58d1b1d52539682c98cd"
Sep 10 13:22:48.363145 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.363124    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz" event={"ID":"ce742769-0b91-4d0b-802e-1b801d1a32bc","Type":"ContainerStarted","Data":"64a7917c5c867a9eb19a6df56a934cfb7a5856d24aff7f5f085f19f93d760abb"}
Sep 10 13:22:48.370576 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.370534    2584 scope.go:117] "RemoveContainer" containerID="4758794ce3f807db194c8cd06f606ee6993e4e310dae58d1b1d52539682c98cd"
Sep 10 13:22:48.370833 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:22:48.370814    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4758794ce3f807db194c8cd06f606ee6993e4e310dae58d1b1d52539682c98cd\": container with ID starting with 4758794ce3f807db194c8cd06f606ee6993e4e310dae58d1b1d52539682c98cd not found: ID does not exist" containerID="4758794ce3f807db194c8cd06f606ee6993e4e310dae58d1b1d52539682c98cd"
Sep 10 13:22:48.370876 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.370841    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4758794ce3f807db194c8cd06f606ee6993e4e310dae58d1b1d52539682c98cd"} err="failed to get container status \"4758794ce3f807db194c8cd06f606ee6993e4e310dae58d1b1d52539682c98cd\": rpc error: code = NotFound desc = could not find container \"4758794ce3f807db194c8cd06f606ee6993e4e310dae58d1b1d52539682c98cd\": container with ID starting with 4758794ce3f807db194c8cd06f606ee6993e4e310dae58d1b1d52539682c98cd not found: ID does not exist"
Sep 10 13:22:48.427236 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.427203    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"]
Sep 10 13:22:48.432419 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:48.432397    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z8d49"]
Sep 10 13:22:49.614258 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:49.614219    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f49b81b-e07e-45b2-8616-5b46e091b8cb" path="/var/lib/kubelet/pods/3f49b81b-e07e-45b2-8616-5b46e091b8cb/volumes"
Sep 10 13:22:52.388399 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:52.388361    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz" event={"ID":"ce742769-0b91-4d0b-802e-1b801d1a32bc","Type":"ContainerStarted","Data":"d16bf8ab13d1b2db9e279c7bef0c787769b7648169c87c875d16e62c1b7f854d"}
Sep 10 13:22:52.388780 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:52.388463    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz"
Sep 10 13:22:52.433802 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:22:52.433756    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz" podStartSLOduration=3.02122561 podStartE2EDuration="6.433738496s" totalImagesPullingTime="3.412512886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:22:52.433476325 +0000 UTC m=+367.319103352" watchObservedRunningTime="2026-09-10 13:22:52.433738496 +0000 UTC m=+367.319365523"
Sep 10 13:23:23.397610 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:23.397573    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5rtbz"
Sep 10 13:23:56.509058 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:56.509023    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"]
Sep 10 13:23:56.509524 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:56.509356    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f49b81b-e07e-45b2-8616-5b46e091b8cb" containerName="discovery"
Sep 10 13:23:56.509524 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:56.509367    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f49b81b-e07e-45b2-8616-5b46e091b8cb" containerName="discovery"
Sep 10 13:23:56.509524 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:56.509426    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f49b81b-e07e-45b2-8616-5b46e091b8cb" containerName="discovery"
Sep 10 13:23:56.512129 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:56.512112    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:23:56.521244 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:56.521226    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 13:23:56.521697 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:56.521681    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-w7tkv\""
Sep 10 13:23:56.523941 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:56.523903    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gwmr\" (UniqueName: \"kubernetes.io/projected/dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88-kube-api-access-4gwmr\") pod \"limitador-operator-controller-manager-74495c69f8-k5h77\" (UID: \"dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:23:56.533705 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:56.533688    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 13:23:56.539167 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:56.539143    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"]
Sep 10 13:23:56.625021 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:56.624983    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gwmr\" (UniqueName: \"kubernetes.io/projected/dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88-kube-api-access-4gwmr\") pod \"limitador-operator-controller-manager-74495c69f8-k5h77\" (UID: \"dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:23:56.638130 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:56.638090    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gwmr\" (UniqueName: \"kubernetes.io/projected/dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88-kube-api-access-4gwmr\") pod \"limitador-operator-controller-manager-74495c69f8-k5h77\" (UID: \"dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:23:56.822821 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:56.822731    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:23:57.108936 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:57.108909    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"]
Sep 10 13:23:57.111011 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:23:57.110984    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8ce8b0_c6a0_4b19_8dfd_f961b0b49e88.slice/crio-3b0afc7e0a97f460ac90dd410d2c6e3bb984b56d8f8ca93cee31ab1420e5040d WatchSource:0}: Error finding container 3b0afc7e0a97f460ac90dd410d2c6e3bb984b56d8f8ca93cee31ab1420e5040d: Status 404 returned error can't find the container with id 3b0afc7e0a97f460ac90dd410d2c6e3bb984b56d8f8ca93cee31ab1420e5040d
Sep 10 13:23:57.682039 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:57.682006    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77" event={"ID":"dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88","Type":"ContainerStarted","Data":"3b0afc7e0a97f460ac90dd410d2c6e3bb984b56d8f8ca93cee31ab1420e5040d"}
Sep 10 13:23:59.694199 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:59.694166    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77" event={"ID":"dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88","Type":"ContainerStarted","Data":"6479e1c9cc79928f6bb13c1ce52d82262554ae2f144889498795d6f105606c7b"}
Sep 10 13:23:59.694615 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:59.694291    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:23:59.728817 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:23:59.728679    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77" podStartSLOduration=1.219369305 podStartE2EDuration="3.728660339s" totalImagesPullingTime="2.509291034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:23:59.728283606 +0000 UTC m=+434.613910656" watchObservedRunningTime="2026-09-10 13:23:59.728660339 +0000 UTC m=+434.614287366"
Sep 10 13:24:01.447715 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:01.447683    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"]
Sep 10 13:24:01.455162 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:01.455144    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:01.458584 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:01.458568    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gbttt\""
Sep 10 13:24:01.479136 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:01.479107    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"]
Sep 10 13:24:01.572951 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:01.572918    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df09833a-6b26-4460-bf8e-8209269124ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" (UID: \"df09833a-6b26-4460-bf8e-8209269124ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:01.573168 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:01.572963    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw5lp\" (UniqueName: \"kubernetes.io/projected/df09833a-6b26-4460-bf8e-8209269124ac-kube-api-access-pw5lp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" (UID: \"df09833a-6b26-4460-bf8e-8209269124ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:01.673700 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:01.673662    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw5lp\" (UniqueName: \"kubernetes.io/projected/df09833a-6b26-4460-bf8e-8209269124ac-kube-api-access-pw5lp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" (UID: \"df09833a-6b26-4460-bf8e-8209269124ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:01.673889 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:01.673803    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df09833a-6b26-4460-bf8e-8209269124ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" (UID: \"df09833a-6b26-4460-bf8e-8209269124ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:01.674235 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:01.674215    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df09833a-6b26-4460-bf8e-8209269124ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" (UID: \"df09833a-6b26-4460-bf8e-8209269124ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:01.704425 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:01.704338    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw5lp\" (UniqueName: \"kubernetes.io/projected/df09833a-6b26-4460-bf8e-8209269124ac-kube-api-access-pw5lp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" (UID: \"df09833a-6b26-4460-bf8e-8209269124ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:01.765220 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:01.765187    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:02.066257 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:24:02.066224    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf09833a_6b26_4460_bf8e_8209269124ac.slice/crio-f3a9dd30b932059191c6b92a0e083171736ab56dd176818076b358d6fb35e0a9 WatchSource:0}: Error finding container f3a9dd30b932059191c6b92a0e083171736ab56dd176818076b358d6fb35e0a9: Status 404 returned error can't find the container with id f3a9dd30b932059191c6b92a0e083171736ab56dd176818076b358d6fb35e0a9
Sep 10 13:24:02.073451 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:02.073426    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"]
Sep 10 13:24:02.709177 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:02.709141    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc" event={"ID":"df09833a-6b26-4460-bf8e-8209269124ac","Type":"ContainerStarted","Data":"f3a9dd30b932059191c6b92a0e083171736ab56dd176818076b358d6fb35e0a9"}
Sep 10 13:24:03.830906 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:03.830867    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-fdhsn"]
Sep 10 13:24:03.833667 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:03.833642    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-fdhsn"
Sep 10 13:24:03.836838 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:03.836808    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-7jtmc\""
Sep 10 13:24:03.894904 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:03.894867    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6xdg\" (UniqueName: \"kubernetes.io/projected/ec980810-3bcb-46cd-8d11-1aff27c76bdf-kube-api-access-j6xdg\") pod \"authorino-operator-76b478bd78-fdhsn\" (UID: \"ec980810-3bcb-46cd-8d11-1aff27c76bdf\") " pod="kuadrant-system/authorino-operator-76b478bd78-fdhsn"
Sep 10 13:24:03.909231 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:03.909199    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-fdhsn"]
Sep 10 13:24:03.996182 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:03.996132    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6xdg\" (UniqueName: \"kubernetes.io/projected/ec980810-3bcb-46cd-8d11-1aff27c76bdf-kube-api-access-j6xdg\") pod \"authorino-operator-76b478bd78-fdhsn\" (UID: \"ec980810-3bcb-46cd-8d11-1aff27c76bdf\") " pod="kuadrant-system/authorino-operator-76b478bd78-fdhsn"
Sep 10 13:24:04.011126 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:04.011075    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6xdg\" (UniqueName: \"kubernetes.io/projected/ec980810-3bcb-46cd-8d11-1aff27c76bdf-kube-api-access-j6xdg\") pod \"authorino-operator-76b478bd78-fdhsn\" (UID: \"ec980810-3bcb-46cd-8d11-1aff27c76bdf\") " pod="kuadrant-system/authorino-operator-76b478bd78-fdhsn"
Sep 10 13:24:04.146800 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:04.146767    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-fdhsn"
Sep 10 13:24:04.463503 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:04.463469    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-fdhsn"]
Sep 10 13:24:04.464720 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:24:04.464685    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec980810_3bcb_46cd_8d11_1aff27c76bdf.slice/crio-6cdec979a5765a5ea3583b9d3ebc7744424f8cc4c965d22f989305b9ae5d6be8 WatchSource:0}: Error finding container 6cdec979a5765a5ea3583b9d3ebc7744424f8cc4c965d22f989305b9ae5d6be8: Status 404 returned error can't find the container with id 6cdec979a5765a5ea3583b9d3ebc7744424f8cc4c965d22f989305b9ae5d6be8
Sep 10 13:24:04.723578 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:04.723471    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-fdhsn" event={"ID":"ec980810-3bcb-46cd-8d11-1aff27c76bdf","Type":"ContainerStarted","Data":"6cdec979a5765a5ea3583b9d3ebc7744424f8cc4c965d22f989305b9ae5d6be8"}
Sep 10 13:24:06.491686 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.491603    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjmsd"]
Sep 10 13:24:06.494475 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.494453    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjmsd"
Sep 10 13:24:06.498919 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.498899    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lppgv\""
Sep 10 13:24:06.499548 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.499524    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 13:24:06.523196 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.523155    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjmsd"]
Sep 10 13:24:06.620660 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.620608    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwhv2\" (UniqueName: \"kubernetes.io/projected/71d9f156-f062-4769-8721-c2be23369712-kube-api-access-bwhv2\") pod \"dns-operator-controller-manager-7b84cd7c9c-wjmsd\" (UID: \"71d9f156-f062-4769-8721-c2be23369712\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjmsd"
Sep 10 13:24:06.722113 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.722080    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwhv2\" (UniqueName: \"kubernetes.io/projected/71d9f156-f062-4769-8721-c2be23369712-kube-api-access-bwhv2\") pod \"dns-operator-controller-manager-7b84cd7c9c-wjmsd\" (UID: \"71d9f156-f062-4769-8721-c2be23369712\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjmsd"
Sep 10 13:24:06.735267 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.735228    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc" event={"ID":"df09833a-6b26-4460-bf8e-8209269124ac","Type":"ContainerStarted","Data":"1728e4715e9dbf8a48ef1b70db19b160158149cbe26143c272e3fbfab5a11a6f"}
Sep 10 13:24:06.735416 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.735366    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:06.737125 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.737103    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-fdhsn" event={"ID":"ec980810-3bcb-46cd-8d11-1aff27c76bdf","Type":"ContainerStarted","Data":"885cbbdf4ab75f09c498debc4cc892dc0b682ceb6b35e4118b8e78ebd3a149d4"}
Sep 10 13:24:06.737236 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.737227    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-fdhsn"
Sep 10 13:24:06.751212 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.751149    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwhv2\" (UniqueName: \"kubernetes.io/projected/71d9f156-f062-4769-8721-c2be23369712-kube-api-access-bwhv2\") pod \"dns-operator-controller-manager-7b84cd7c9c-wjmsd\" (UID: \"71d9f156-f062-4769-8721-c2be23369712\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjmsd"
Sep 10 13:24:06.778659 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.778583    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc" podStartSLOduration=1.889607173 podStartE2EDuration="5.778539639s" totalImagesPullingTime="3.888932466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:24:06.777341424 +0000 UTC m=+441.662968451" watchObservedRunningTime="2026-09-10 13:24:06.778539639 +0000 UTC m=+441.664166670"
Sep 10 13:24:06.805810 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.805781    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjmsd"
Sep 10 13:24:06.809029 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:06.808981    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-fdhsn" podStartSLOduration=1.645023518 podStartE2EDuration="3.80896612s" totalImagesPullingTime="2.163942602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:24:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:24:06.808643739 +0000 UTC m=+441.694270769" watchObservedRunningTime="2026-09-10 13:24:06.80896612 +0000 UTC m=+441.694593147"
Sep 10 13:24:07.125307 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:07.125278    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjmsd"]
Sep 10 13:24:07.126859 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:24:07.126833    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d9f156_f062_4769_8721_c2be23369712.slice/crio-a74d4a200c7c1af5c71184f5085d58be9354c963a572299d8311a1e4ff7dcea2 WatchSource:0}: Error finding container a74d4a200c7c1af5c71184f5085d58be9354c963a572299d8311a1e4ff7dcea2: Status 404 returned error can't find the container with id a74d4a200c7c1af5c71184f5085d58be9354c963a572299d8311a1e4ff7dcea2
Sep 10 13:24:07.743337 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:07.743298    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjmsd" event={"ID":"71d9f156-f062-4769-8721-c2be23369712","Type":"ContainerStarted","Data":"a74d4a200c7c1af5c71184f5085d58be9354c963a572299d8311a1e4ff7dcea2"}
Sep 10 13:24:09.755071 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:09.755036    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjmsd" event={"ID":"71d9f156-f062-4769-8721-c2be23369712","Type":"ContainerStarted","Data":"1bc0eadcacecd410b1eae95ea42dfa4a8032bac0ddf52f99746f6f07370262e7"}
Sep 10 13:24:09.755503 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:09.755137    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjmsd"
Sep 10 13:24:09.809346 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:09.809288    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjmsd" podStartSLOduration=2.133742069 podStartE2EDuration="3.809271444s" totalImagesPullingTime="1.675529375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:24:09.807496122 +0000 UTC m=+444.693123161" watchObservedRunningTime="2026-09-10 13:24:09.809271444 +0000 UTC m=+444.694898470"
Sep 10 13:24:10.700696 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:10.700662    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:24:17.745838 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:17.745802    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-fdhsn"
Sep 10 13:24:17.746232 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:17.745985    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:19.891046 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:19.891007    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"]
Sep 10 13:24:19.894707 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:19.894683    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:19.917922 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:19.917891    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"]
Sep 10 13:24:20.052035 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.051998    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztnlf\" (UniqueName: \"kubernetes.io/projected/3255a0a6-f8f2-408e-9711-1536b3767bf0-kube-api-access-ztnlf\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-sf7g4\" (UID: \"3255a0a6-f8f2-408e-9711-1536b3767bf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:20.052212 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.052058    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3255a0a6-f8f2-408e-9711-1536b3767bf0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-sf7g4\" (UID: \"3255a0a6-f8f2-408e-9711-1536b3767bf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:20.153628 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.153527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztnlf\" (UniqueName: \"kubernetes.io/projected/3255a0a6-f8f2-408e-9711-1536b3767bf0-kube-api-access-ztnlf\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-sf7g4\" (UID: \"3255a0a6-f8f2-408e-9711-1536b3767bf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:20.153628 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.153618    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3255a0a6-f8f2-408e-9711-1536b3767bf0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-sf7g4\" (UID: \"3255a0a6-f8f2-408e-9711-1536b3767bf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:20.153996 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.153975    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3255a0a6-f8f2-408e-9711-1536b3767bf0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-sf7g4\" (UID: \"3255a0a6-f8f2-408e-9711-1536b3767bf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:20.163079 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.163054    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztnlf\" (UniqueName: \"kubernetes.io/projected/3255a0a6-f8f2-408e-9711-1536b3767bf0-kube-api-access-ztnlf\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-sf7g4\" (UID: \"3255a0a6-f8f2-408e-9711-1536b3767bf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:20.205770 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.205731    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:20.216525 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.216491    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"]
Sep 10 13:24:20.216754 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.216728    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc" podUID="df09833a-6b26-4460-bf8e-8209269124ac" containerName="manager" containerID="cri-o://1728e4715e9dbf8a48ef1b70db19b160158149cbe26143c272e3fbfab5a11a6f" gracePeriod=2
Sep 10 13:24:20.219884 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.219839    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="df09833a-6b26-4460-bf8e-8209269124ac" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:20.220816 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.220740    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"]
Sep 10 13:24:20.237732 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.237651    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"]
Sep 10 13:24:20.241688 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.241663    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"]
Sep 10 13:24:20.255371 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.255338    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"]
Sep 10 13:24:20.255754 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.255737    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df09833a-6b26-4460-bf8e-8209269124ac" containerName="manager"
Sep 10 13:24:20.255754 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.255753    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="df09833a-6b26-4460-bf8e-8209269124ac" containerName="manager"
Sep 10 13:24:20.255904 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.255814    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="df09833a-6b26-4460-bf8e-8209269124ac" containerName="manager"
Sep 10 13:24:20.259434 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.259391    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"
Sep 10 13:24:20.261983 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.261894    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"]
Sep 10 13:24:20.262698 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.262105    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77" podUID="dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" containerName="manager" containerID="cri-o://6479e1c9cc79928f6bb13c1ce52d82262554ae2f144889498795d6f105606c7b" gracePeriod=2
Sep 10 13:24:20.262949 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.262904    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="df09833a-6b26-4460-bf8e-8209269124ac" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:20.279470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.279400    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"]
Sep 10 13:24:20.282411 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.282365    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"]
Sep 10 13:24:20.315205 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.315173    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-tctlh"]
Sep 10 13:24:20.315618 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.315599    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" containerName="manager"
Sep 10 13:24:20.315709 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.315621    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" containerName="manager"
Sep 10 13:24:20.315709 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.315693    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" containerName="manager"
Sep 10 13:24:20.327681 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.327549    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tctlh"
Sep 10 13:24:20.332049 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.332011    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-k5h77\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:24:20.332890 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.332862    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"]
Sep 10 13:24:20.336497 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.336476    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"
Sep 10 13:24:20.355124 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.355090    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cdd02ea-4efe-49ef-9969-74abd59b7abc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9mcz6\" (UID: \"1cdd02ea-4efe-49ef-9969-74abd59b7abc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"
Sep 10 13:24:20.356007 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.355889    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkmzb\" (UniqueName: \"kubernetes.io/projected/1cdd02ea-4efe-49ef-9969-74abd59b7abc-kube-api-access-vkmzb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9mcz6\" (UID: \"1cdd02ea-4efe-49ef-9969-74abd59b7abc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"
Sep 10 13:24:20.361779 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.361750    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-tctlh"]
Sep 10 13:24:20.369835 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.369745    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"]
Sep 10 13:24:20.398951 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.398911    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="df09833a-6b26-4460-bf8e-8209269124ac" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:20.401534 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.401502    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="df09833a-6b26-4460-bf8e-8209269124ac" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:20.442495 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.442454    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-k5h77\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:24:20.456687 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.456655    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwmg2\" (UniqueName: \"kubernetes.io/projected/db150a17-6b6e-4855-bd95-f76e58d86cd6-kube-api-access-xwmg2\") pod \"limitador-operator-controller-manager-74495c69f8-tctlh\" (UID: \"db150a17-6b6e-4855-bd95-f76e58d86cd6\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tctlh"
Sep 10 13:24:20.456823 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.456704    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1589bc04-d671-4586-8a56-09ef7bbe23fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-gnrtz\" (UID: \"1589bc04-d671-4586-8a56-09ef7bbe23fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"
Sep 10 13:24:20.456823 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.456787    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkmzb\" (UniqueName: \"kubernetes.io/projected/1cdd02ea-4efe-49ef-9969-74abd59b7abc-kube-api-access-vkmzb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9mcz6\" (UID: \"1cdd02ea-4efe-49ef-9969-74abd59b7abc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"
Sep 10 13:24:20.456959 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.456835    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cdd02ea-4efe-49ef-9969-74abd59b7abc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9mcz6\" (UID: \"1cdd02ea-4efe-49ef-9969-74abd59b7abc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"
Sep 10 13:24:20.456959 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.456853    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42xw2\" (UniqueName: \"kubernetes.io/projected/1589bc04-d671-4586-8a56-09ef7bbe23fa-kube-api-access-42xw2\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-gnrtz\" (UID: \"1589bc04-d671-4586-8a56-09ef7bbe23fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"
Sep 10 13:24:20.457184 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.457166    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cdd02ea-4efe-49ef-9969-74abd59b7abc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9mcz6\" (UID: \"1cdd02ea-4efe-49ef-9969-74abd59b7abc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"
Sep 10 13:24:20.470450 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.470421    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkmzb\" (UniqueName: \"kubernetes.io/projected/1cdd02ea-4efe-49ef-9969-74abd59b7abc-kube-api-access-vkmzb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9mcz6\" (UID: \"1cdd02ea-4efe-49ef-9969-74abd59b7abc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"
Sep 10 13:24:20.478061 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.478037    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:20.482679 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.482649    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="df09833a-6b26-4460-bf8e-8209269124ac" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:20.486728 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.486701    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-k5h77\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:24:20.513196 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.513171    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:24:20.519512 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.519487    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-k5h77\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:24:20.522789 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.522765    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="df09833a-6b26-4460-bf8e-8209269124ac" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:20.558167 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.558134    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw5lp\" (UniqueName: \"kubernetes.io/projected/df09833a-6b26-4460-bf8e-8209269124ac-kube-api-access-pw5lp\") pod \"df09833a-6b26-4460-bf8e-8209269124ac\" (UID: \"df09833a-6b26-4460-bf8e-8209269124ac\") "
Sep 10 13:24:20.558327 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.558223    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df09833a-6b26-4460-bf8e-8209269124ac-extensions-socket-volume\") pod \"df09833a-6b26-4460-bf8e-8209269124ac\" (UID: \"df09833a-6b26-4460-bf8e-8209269124ac\") "
Sep 10 13:24:20.558393 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.558338    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwmg2\" (UniqueName: \"kubernetes.io/projected/db150a17-6b6e-4855-bd95-f76e58d86cd6-kube-api-access-xwmg2\") pod \"limitador-operator-controller-manager-74495c69f8-tctlh\" (UID: \"db150a17-6b6e-4855-bd95-f76e58d86cd6\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tctlh"
Sep 10 13:24:20.558393 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.558370    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1589bc04-d671-4586-8a56-09ef7bbe23fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-gnrtz\" (UID: \"1589bc04-d671-4586-8a56-09ef7bbe23fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"
Sep 10 13:24:20.558496 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.558420    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42xw2\" (UniqueName: \"kubernetes.io/projected/1589bc04-d671-4586-8a56-09ef7bbe23fa-kube-api-access-42xw2\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-gnrtz\" (UID: \"1589bc04-d671-4586-8a56-09ef7bbe23fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"
Sep 10 13:24:20.558786 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.558758    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df09833a-6b26-4460-bf8e-8209269124ac-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "df09833a-6b26-4460-bf8e-8209269124ac" (UID: "df09833a-6b26-4460-bf8e-8209269124ac"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:24:20.558889 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.558832    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1589bc04-d671-4586-8a56-09ef7bbe23fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-gnrtz\" (UID: \"1589bc04-d671-4586-8a56-09ef7bbe23fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"
Sep 10 13:24:20.560570 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.560536    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df09833a-6b26-4460-bf8e-8209269124ac-kube-api-access-pw5lp" (OuterVolumeSpecName: "kube-api-access-pw5lp") pod "df09833a-6b26-4460-bf8e-8209269124ac" (UID: "df09833a-6b26-4460-bf8e-8209269124ac"). InnerVolumeSpecName "kube-api-access-pw5lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:24:20.575882 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.575861    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwmg2\" (UniqueName: \"kubernetes.io/projected/db150a17-6b6e-4855-bd95-f76e58d86cd6-kube-api-access-xwmg2\") pod \"limitador-operator-controller-manager-74495c69f8-tctlh\" (UID: \"db150a17-6b6e-4855-bd95-f76e58d86cd6\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tctlh"
Sep 10 13:24:20.576774 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.576757    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42xw2\" (UniqueName: \"kubernetes.io/projected/1589bc04-d671-4586-8a56-09ef7bbe23fa-kube-api-access-42xw2\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-gnrtz\" (UID: \"1589bc04-d671-4586-8a56-09ef7bbe23fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"
Sep 10 13:24:20.653031 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.652988    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"
Sep 10 13:24:20.659591 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.659550    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gwmr\" (UniqueName: \"kubernetes.io/projected/dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88-kube-api-access-4gwmr\") pod \"dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88\" (UID: \"dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88\") "
Sep 10 13:24:20.659738 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.659725    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw5lp\" (UniqueName: \"kubernetes.io/projected/df09833a-6b26-4460-bf8e-8209269124ac-kube-api-access-pw5lp\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:24:20.659794 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.659740    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df09833a-6b26-4460-bf8e-8209269124ac-extensions-socket-volume\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:24:20.661800 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.661737    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88-kube-api-access-4gwmr" (OuterVolumeSpecName: "kube-api-access-4gwmr") pod "dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" (UID: "dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88"). InnerVolumeSpecName "kube-api-access-4gwmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:24:20.662817 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.662801    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tctlh"
Sep 10 13:24:20.672614 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.672592    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"
Sep 10 13:24:20.761249 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.761217    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gwmr\" (UniqueName: \"kubernetes.io/projected/dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88-kube-api-access-4gwmr\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:24:20.762354 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.762327    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjmsd"
Sep 10 13:24:20.764965 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.764939    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-k5h77\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:24:20.767127 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.767105    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="df09833a-6b26-4460-bf8e-8209269124ac" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:20.810995 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.810965    2584 generic.go:356] "Generic (PLEG): container finished" podID="df09833a-6b26-4460-bf8e-8209269124ac" containerID="1728e4715e9dbf8a48ef1b70db19b160158149cbe26143c272e3fbfab5a11a6f" exitCode=0
Sep 10 13:24:20.811147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.811018    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:20.811147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.811054    2584 scope.go:117] "RemoveContainer" containerID="1728e4715e9dbf8a48ef1b70db19b160158149cbe26143c272e3fbfab5a11a6f"
Sep 10 13:24:20.812760 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.812731    2584 generic.go:356] "Generic (PLEG): container finished" podID="dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" containerID="6479e1c9cc79928f6bb13c1ce52d82262554ae2f144889498795d6f105606c7b" exitCode=0
Sep 10 13:24:20.812885 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.812782    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:24:20.817597 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.817549    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-k5h77\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:24:20.821082 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.821057    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="df09833a-6b26-4460-bf8e-8209269124ac" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:20.825250 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.825228    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-k5h77\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:24:20.827370 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.827339    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="df09833a-6b26-4460-bf8e-8209269124ac" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:20.830774 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.830744    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-k5h77\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k5h77"
Sep 10 13:24:20.832926 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.832896    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-dwjhc\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="df09833a-6b26-4460-bf8e-8209269124ac" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dwjhc"
Sep 10 13:24:20.834465 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.834445    2584 scope.go:117] "RemoveContainer" containerID="1728e4715e9dbf8a48ef1b70db19b160158149cbe26143c272e3fbfab5a11a6f"
Sep 10 13:24:20.834905 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.834888    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1728e4715e9dbf8a48ef1b70db19b160158149cbe26143c272e3fbfab5a11a6f\": container with ID starting with 1728e4715e9dbf8a48ef1b70db19b160158149cbe26143c272e3fbfab5a11a6f not found: ID does not exist" containerID="1728e4715e9dbf8a48ef1b70db19b160158149cbe26143c272e3fbfab5a11a6f"
Sep 10 13:24:20.834984 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.834918    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1728e4715e9dbf8a48ef1b70db19b160158149cbe26143c272e3fbfab5a11a6f"} err="failed to get container status \"1728e4715e9dbf8a48ef1b70db19b160158149cbe26143c272e3fbfab5a11a6f\": rpc error: code = NotFound desc = could not find container \"1728e4715e9dbf8a48ef1b70db19b160158149cbe26143c272e3fbfab5a11a6f\": container with ID starting with 1728e4715e9dbf8a48ef1b70db19b160158149cbe26143c272e3fbfab5a11a6f not found: ID does not exist"
Sep 10 13:24:20.834984 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.834941    2584 scope.go:117] "RemoveContainer" containerID="6479e1c9cc79928f6bb13c1ce52d82262554ae2f144889498795d6f105606c7b"
Sep 10 13:24:20.844932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.844914    2584 scope.go:117] "RemoveContainer" containerID="6479e1c9cc79928f6bb13c1ce52d82262554ae2f144889498795d6f105606c7b"
Sep 10 13:24:20.845261 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:20.845243    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6479e1c9cc79928f6bb13c1ce52d82262554ae2f144889498795d6f105606c7b\": container with ID starting with 6479e1c9cc79928f6bb13c1ce52d82262554ae2f144889498795d6f105606c7b not found: ID does not exist" containerID="6479e1c9cc79928f6bb13c1ce52d82262554ae2f144889498795d6f105606c7b"
Sep 10 13:24:20.845318 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.845270    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6479e1c9cc79928f6bb13c1ce52d82262554ae2f144889498795d6f105606c7b"} err="failed to get container status \"6479e1c9cc79928f6bb13c1ce52d82262554ae2f144889498795d6f105606c7b\": rpc error: code = NotFound desc = could not find container \"6479e1c9cc79928f6bb13c1ce52d82262554ae2f144889498795d6f105606c7b\": container with ID starting with 6479e1c9cc79928f6bb13c1ce52d82262554ae2f144889498795d6f105606c7b not found: ID does not exist"
Sep 10 13:24:20.956635 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:24:20.956599    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cdd02ea_4efe_49ef_9969_74abd59b7abc.slice/crio-b0df18382e9dea358eb76dd4433b364d71be00cd4b410844071d6e67a5d4daaa WatchSource:0}: Error finding container b0df18382e9dea358eb76dd4433b364d71be00cd4b410844071d6e67a5d4daaa: Status 404 returned error can't find the container with id b0df18382e9dea358eb76dd4433b364d71be00cd4b410844071d6e67a5d4daaa
Sep 10 13:24:20.957949 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.957922    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"]
Sep 10 13:24:20.965115 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.965087    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-tctlh"]
Sep 10 13:24:20.967301 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:24:20.967277    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb150a17_6b6e_4855_bd95_f76e58d86cd6.slice/crio-49f925ff33459c98aedba4bc6a8375c5cd94b0f35f667818e3ce8b244f87268a WatchSource:0}: Error finding container 49f925ff33459c98aedba4bc6a8375c5cd94b0f35f667818e3ce8b244f87268a: Status 404 returned error can't find the container with id 49f925ff33459c98aedba4bc6a8375c5cd94b0f35f667818e3ce8b244f87268a
Sep 10 13:24:20.977206 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:20.977133    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"]
Sep 10 13:24:20.982876 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:24:20.982848    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1589bc04_d671_4586_8a56_09ef7bbe23fa.slice/crio-bb76e0f5a1202b25c0656d4af8906c1e40f0c9494f151cc23ca2879860ca6f3c WatchSource:0}: Error finding container bb76e0f5a1202b25c0656d4af8906c1e40f0c9494f151cc23ca2879860ca6f3c: Status 404 returned error can't find the container with id bb76e0f5a1202b25c0656d4af8906c1e40f0c9494f151cc23ca2879860ca6f3c
Sep 10 13:24:21.238844 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:21.238795    2584 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 10 13:24:21.238844 ip-10-0-143-211 kubenswrapper[2584]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-sf7g4_kuadrant-system_3255a0a6-f8f2-408e-9711-1536b3767bf0_0(ace821ebf581de29b3d83069e36db684b741e5ba10cbf4a3c5cc346d2662bcf6): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-sf7g4 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ace821ebf581de29b3d83069e36db684b741e5ba10cbf4a3c5cc346d2662bcf6" Netns:"/var/run/netns/510947f1-4ad2-434b-9287-7a52824efa10" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-sf7g4;K8S_POD_INFRA_CONTAINER_ID=ace821ebf581de29b3d83069e36db684b741e5ba10cbf4a3c5cc346d2662bcf6;K8S_POD_UID=3255a0a6-f8f2-408e-9711-1536b3767bf0" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4/3255a0a6-f8f2-408e-9711-1536b3767bf0:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4 ace821ebf581de29b3d83069e36db684b741e5ba10cbf4a3c5cc346d2662bcf6 network default NAD default NAD key default] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-7978cbdfbc-sf7g4" not found
Sep 10 13:24:21.238844 ip-10-0-143-211 kubenswrapper[2584]:         '
Sep 10 13:24:21.238844 ip-10-0-143-211 kubenswrapper[2584]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 10 13:24:21.238844 ip-10-0-143-211 kubenswrapper[2584]:  >
Sep 10 13:24:21.239108 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:21.238877    2584 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 10 13:24:21.239108 ip-10-0-143-211 kubenswrapper[2584]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-sf7g4_kuadrant-system_3255a0a6-f8f2-408e-9711-1536b3767bf0_0(ace821ebf581de29b3d83069e36db684b741e5ba10cbf4a3c5cc346d2662bcf6): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-sf7g4 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ace821ebf581de29b3d83069e36db684b741e5ba10cbf4a3c5cc346d2662bcf6" Netns:"/var/run/netns/510947f1-4ad2-434b-9287-7a52824efa10" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-sf7g4;K8S_POD_INFRA_CONTAINER_ID=ace821ebf581de29b3d83069e36db684b741e5ba10cbf4a3c5cc346d2662bcf6;K8S_POD_UID=3255a0a6-f8f2-408e-9711-1536b3767bf0" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4/3255a0a6-f8f2-408e-9711-1536b3767bf0:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4 ace821ebf581de29b3d83069e36db684b741e5ba10cbf4a3c5cc346d2662bcf6 network default NAD default NAD key default] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-7978cbdfbc-sf7g4" not found
Sep 10 13:24:21.239108 ip-10-0-143-211 kubenswrapper[2584]:         '
Sep 10 13:24:21.239108 ip-10-0-143-211 kubenswrapper[2584]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 10 13:24:21.239108 ip-10-0-143-211 kubenswrapper[2584]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:21.614706 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.614670    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88" path="/var/lib/kubelet/pods/dd8ce8b0-c6a0-4b19-8dfd-f961b0b49e88/volumes"
Sep 10 13:24:21.615021 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.615008    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df09833a-6b26-4460-bf8e-8209269124ac" path="/var/lib/kubelet/pods/df09833a-6b26-4460-bf8e-8209269124ac/volumes"
Sep 10 13:24:21.821079 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.821035    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tctlh" event={"ID":"db150a17-6b6e-4855-bd95-f76e58d86cd6","Type":"ContainerStarted","Data":"ff0d85ebb7d56d54878b4df90d5acf284ff4addcc6be6b9970deeb1566376c46"}
Sep 10 13:24:21.821278 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.821109    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tctlh" event={"ID":"db150a17-6b6e-4855-bd95-f76e58d86cd6","Type":"ContainerStarted","Data":"49f925ff33459c98aedba4bc6a8375c5cd94b0f35f667818e3ce8b244f87268a"}
Sep 10 13:24:21.821881 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.821852    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tctlh"
Sep 10 13:24:21.824510 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.824483    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz" event={"ID":"1589bc04-d671-4586-8a56-09ef7bbe23fa","Type":"ContainerStarted","Data":"fa39d6c271c8fd45f963d4bf7ef31a201fa72399f8b756042ac57522ee2e5c63"}
Sep 10 13:24:21.824725 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.824704    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz" event={"ID":"1589bc04-d671-4586-8a56-09ef7bbe23fa","Type":"ContainerStarted","Data":"bb76e0f5a1202b25c0656d4af8906c1e40f0c9494f151cc23ca2879860ca6f3c"}
Sep 10 13:24:21.824952 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.824907    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"
Sep 10 13:24:21.826757 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.826726    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6" event={"ID":"1cdd02ea-4efe-49ef-9969-74abd59b7abc","Type":"ContainerStarted","Data":"33956f302b9a5d402354fde2170cc924cb7bb67b5c5d79de01aff82ec8a88e8c"}
Sep 10 13:24:21.826875 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.826776    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6" event={"ID":"1cdd02ea-4efe-49ef-9969-74abd59b7abc","Type":"ContainerStarted","Data":"b0df18382e9dea358eb76dd4433b364d71be00cd4b410844071d6e67a5d4daaa"}
Sep 10 13:24:21.826875 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.826843    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"
Sep 10 13:24:21.829063 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.829046    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:21.837404 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.837385    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:21.851119 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.851076    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tctlh" podStartSLOduration=1.851063303 podStartE2EDuration="1.851063303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:24:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:24:21.849934435 +0000 UTC m=+456.735561461" watchObservedRunningTime="2026-09-10 13:24:21.851063303 +0000 UTC m=+456.736690332"
Sep 10 13:24:21.889965 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.889867    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz" podStartSLOduration=1.889848438 podStartE2EDuration="1.889848438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:24:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:24:21.889594002 +0000 UTC m=+456.775221029" watchObservedRunningTime="2026-09-10 13:24:21.889848438 +0000 UTC m=+456.775475466"
Sep 10 13:24:21.893244 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:21.893218    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-sf7g4\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="3255a0a6-f8f2-408e-9711-1536b3767bf0" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:21.932606 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.932532    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6" podStartSLOduration=1.932515552 podStartE2EDuration="1.932515552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:24:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:24:21.931780993 +0000 UTC m=+456.817408027" watchObservedRunningTime="2026-09-10 13:24:21.932515552 +0000 UTC m=+456.818142578"
Sep 10 13:24:21.974138 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.974108    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztnlf\" (UniqueName: \"kubernetes.io/projected/3255a0a6-f8f2-408e-9711-1536b3767bf0-kube-api-access-ztnlf\") pod \"3255a0a6-f8f2-408e-9711-1536b3767bf0\" (UID: \"3255a0a6-f8f2-408e-9711-1536b3767bf0\") "
Sep 10 13:24:21.974610 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.974177    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3255a0a6-f8f2-408e-9711-1536b3767bf0-extensions-socket-volume\") pod \"3255a0a6-f8f2-408e-9711-1536b3767bf0\" (UID: \"3255a0a6-f8f2-408e-9711-1536b3767bf0\") "
Sep 10 13:24:21.974610 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.974468    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3255a0a6-f8f2-408e-9711-1536b3767bf0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3255a0a6-f8f2-408e-9711-1536b3767bf0" (UID: "3255a0a6-f8f2-408e-9711-1536b3767bf0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:24:21.976492 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:21.976473    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3255a0a6-f8f2-408e-9711-1536b3767bf0-kube-api-access-ztnlf" (OuterVolumeSpecName: "kube-api-access-ztnlf") pod "3255a0a6-f8f2-408e-9711-1536b3767bf0" (UID: "3255a0a6-f8f2-408e-9711-1536b3767bf0"). InnerVolumeSpecName "kube-api-access-ztnlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:24:22.075194 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:22.075159    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztnlf\" (UniqueName: \"kubernetes.io/projected/3255a0a6-f8f2-408e-9711-1536b3767bf0-kube-api-access-ztnlf\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:24:22.075194 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:22.075186    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3255a0a6-f8f2-408e-9711-1536b3767bf0-extensions-socket-volume\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:24:22.834202 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:22.834174    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:22.837011 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:22.836983    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-sf7g4\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="3255a0a6-f8f2-408e-9711-1536b3767bf0" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:22.843347 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:22.843318    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-sf7g4\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="3255a0a6-f8f2-408e-9711-1536b3767bf0" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sf7g4"
Sep 10 13:24:23.614193 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:23.614153    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3255a0a6-f8f2-408e-9711-1536b3767bf0" path="/var/lib/kubelet/pods/3255a0a6-f8f2-408e-9711-1536b3767bf0/volumes"
Sep 10 13:24:32.836710 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:32.836675    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"
Sep 10 13:24:33.842614 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:33.842582    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"
Sep 10 13:24:33.843063 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:33.842656    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tctlh"
Sep 10 13:24:33.928167 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:33.928140    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"]
Sep 10 13:24:33.928385 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:33.928358    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6" podUID="1cdd02ea-4efe-49ef-9969-74abd59b7abc" containerName="manager" containerID="cri-o://33956f302b9a5d402354fde2170cc924cb7bb67b5c5d79de01aff82ec8a88e8c" gracePeriod=10
Sep 10 13:24:34.171950 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.171920    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"]
Sep 10 13:24:34.173461 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.173437    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"
Sep 10 13:24:34.174463 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.174445    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"
Sep 10 13:24:34.180143 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.180036    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cdd02ea-4efe-49ef-9969-74abd59b7abc-extensions-socket-volume\") pod \"1cdd02ea-4efe-49ef-9969-74abd59b7abc\" (UID: \"1cdd02ea-4efe-49ef-9969-74abd59b7abc\") "
Sep 10 13:24:34.180143 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.180084    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkmzb\" (UniqueName: \"kubernetes.io/projected/1cdd02ea-4efe-49ef-9969-74abd59b7abc-kube-api-access-vkmzb\") pod \"1cdd02ea-4efe-49ef-9969-74abd59b7abc\" (UID: \"1cdd02ea-4efe-49ef-9969-74abd59b7abc\") "
Sep 10 13:24:34.180299 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.180277    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2ef9454-8fb6-4787-8f11-c88f445ca901-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cr2dc\" (UID: \"c2ef9454-8fb6-4787-8f11-c88f445ca901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"
Sep 10 13:24:34.180371 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.180354    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpgn6\" (UniqueName: \"kubernetes.io/projected/c2ef9454-8fb6-4787-8f11-c88f445ca901-kube-api-access-gpgn6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cr2dc\" (UID: \"c2ef9454-8fb6-4787-8f11-c88f445ca901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"
Sep 10 13:24:34.180503 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.180482    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cdd02ea-4efe-49ef-9969-74abd59b7abc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1cdd02ea-4efe-49ef-9969-74abd59b7abc" (UID: "1cdd02ea-4efe-49ef-9969-74abd59b7abc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:24:34.191325 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.191255    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cdd02ea-4efe-49ef-9969-74abd59b7abc-kube-api-access-vkmzb" (OuterVolumeSpecName: "kube-api-access-vkmzb") pod "1cdd02ea-4efe-49ef-9969-74abd59b7abc" (UID: "1cdd02ea-4efe-49ef-9969-74abd59b7abc"). InnerVolumeSpecName "kube-api-access-vkmzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:24:34.194786 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.194764    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"]
Sep 10 13:24:34.281086 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.281049    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpgn6\" (UniqueName: \"kubernetes.io/projected/c2ef9454-8fb6-4787-8f11-c88f445ca901-kube-api-access-gpgn6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cr2dc\" (UID: \"c2ef9454-8fb6-4787-8f11-c88f445ca901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"
Sep 10 13:24:34.281267 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.281140    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2ef9454-8fb6-4787-8f11-c88f445ca901-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cr2dc\" (UID: \"c2ef9454-8fb6-4787-8f11-c88f445ca901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"
Sep 10 13:24:34.281267 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.281179    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cdd02ea-4efe-49ef-9969-74abd59b7abc-extensions-socket-volume\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:24:34.281267 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.281189    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkmzb\" (UniqueName: \"kubernetes.io/projected/1cdd02ea-4efe-49ef-9969-74abd59b7abc-kube-api-access-vkmzb\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:24:34.281474 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.281417    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2ef9454-8fb6-4787-8f11-c88f445ca901-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cr2dc\" (UID: \"c2ef9454-8fb6-4787-8f11-c88f445ca901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"
Sep 10 13:24:34.294501 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.294474    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpgn6\" (UniqueName: \"kubernetes.io/projected/c2ef9454-8fb6-4787-8f11-c88f445ca901-kube-api-access-gpgn6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cr2dc\" (UID: \"c2ef9454-8fb6-4787-8f11-c88f445ca901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"
Sep 10 13:24:34.491515 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.491428    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"
Sep 10 13:24:34.771384 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.769266    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"]
Sep 10 13:24:34.771384 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:24:34.769744    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ef9454_8fb6_4787_8f11_c88f445ca901.slice/crio-a66accbecd8ca1a283219498f2d5851b78161ac81955f8d20dcdc213a50b625f WatchSource:0}: Error finding container a66accbecd8ca1a283219498f2d5851b78161ac81955f8d20dcdc213a50b625f: Status 404 returned error can't find the container with id a66accbecd8ca1a283219498f2d5851b78161ac81955f8d20dcdc213a50b625f
Sep 10 13:24:34.902860 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.902828    2584 generic.go:356] "Generic (PLEG): container finished" podID="1cdd02ea-4efe-49ef-9969-74abd59b7abc" containerID="33956f302b9a5d402354fde2170cc924cb7bb67b5c5d79de01aff82ec8a88e8c" exitCode=0
Sep 10 13:24:34.903291 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.902890    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"
Sep 10 13:24:34.903291 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.902915    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6" event={"ID":"1cdd02ea-4efe-49ef-9969-74abd59b7abc","Type":"ContainerDied","Data":"33956f302b9a5d402354fde2170cc924cb7bb67b5c5d79de01aff82ec8a88e8c"}
Sep 10 13:24:34.903291 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.902968    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6" event={"ID":"1cdd02ea-4efe-49ef-9969-74abd59b7abc","Type":"ContainerDied","Data":"b0df18382e9dea358eb76dd4433b364d71be00cd4b410844071d6e67a5d4daaa"}
Sep 10 13:24:34.903291 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.902992    2584 scope.go:117] "RemoveContainer" containerID="33956f302b9a5d402354fde2170cc924cb7bb67b5c5d79de01aff82ec8a88e8c"
Sep 10 13:24:34.905094 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.905071    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc" event={"ID":"c2ef9454-8fb6-4787-8f11-c88f445ca901","Type":"ContainerStarted","Data":"e9e7a2dac83f4c55a515a3012ef4a0bce5efd861c0e848881fc63ad17e853e26"}
Sep 10 13:24:34.905273 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.905114    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc" event={"ID":"c2ef9454-8fb6-4787-8f11-c88f445ca901","Type":"ContainerStarted","Data":"a66accbecd8ca1a283219498f2d5851b78161ac81955f8d20dcdc213a50b625f"}
Sep 10 13:24:34.905273 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.905215    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"
Sep 10 13:24:34.912669 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.912654    2584 scope.go:117] "RemoveContainer" containerID="33956f302b9a5d402354fde2170cc924cb7bb67b5c5d79de01aff82ec8a88e8c"
Sep 10 13:24:34.912953 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:34.912929    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33956f302b9a5d402354fde2170cc924cb7bb67b5c5d79de01aff82ec8a88e8c\": container with ID starting with 33956f302b9a5d402354fde2170cc924cb7bb67b5c5d79de01aff82ec8a88e8c not found: ID does not exist" containerID="33956f302b9a5d402354fde2170cc924cb7bb67b5c5d79de01aff82ec8a88e8c"
Sep 10 13:24:34.913005 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.912962    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33956f302b9a5d402354fde2170cc924cb7bb67b5c5d79de01aff82ec8a88e8c"} err="failed to get container status \"33956f302b9a5d402354fde2170cc924cb7bb67b5c5d79de01aff82ec8a88e8c\": rpc error: code = NotFound desc = could not find container \"33956f302b9a5d402354fde2170cc924cb7bb67b5c5d79de01aff82ec8a88e8c\": container with ID starting with 33956f302b9a5d402354fde2170cc924cb7bb67b5c5d79de01aff82ec8a88e8c not found: ID does not exist"
Sep 10 13:24:34.933864 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.933836    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"]
Sep 10 13:24:34.945399 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.945373    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9mcz6"]
Sep 10 13:24:34.985131 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:34.985082    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc" podStartSLOduration=0.98506664 podStartE2EDuration="985.06664ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:24:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:24:34.984046933 +0000 UTC m=+469.869673961" watchObservedRunningTime="2026-09-10 13:24:34.98506664 +0000 UTC m=+469.870693666"
Sep 10 13:24:35.614182 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:35.614150    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cdd02ea-4efe-49ef-9969-74abd59b7abc" path="/var/lib/kubelet/pods/1cdd02ea-4efe-49ef-9969-74abd59b7abc/volumes"
Sep 10 13:24:45.913624 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:45.913591    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"
Sep 10 13:24:46.006934 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.006907    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"]
Sep 10 13:24:46.007154 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.007131    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz" podUID="1589bc04-d671-4586-8a56-09ef7bbe23fa" containerName="manager" containerID="cri-o://fa39d6c271c8fd45f963d4bf7ef31a201fa72399f8b756042ac57522ee2e5c63" gracePeriod=10
Sep 10 13:24:46.251872 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.251842    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"
Sep 10 13:24:46.283241 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.283210    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42xw2\" (UniqueName: \"kubernetes.io/projected/1589bc04-d671-4586-8a56-09ef7bbe23fa-kube-api-access-42xw2\") pod \"1589bc04-d671-4586-8a56-09ef7bbe23fa\" (UID: \"1589bc04-d671-4586-8a56-09ef7bbe23fa\") "
Sep 10 13:24:46.283430 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.283256    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1589bc04-d671-4586-8a56-09ef7bbe23fa-extensions-socket-volume\") pod \"1589bc04-d671-4586-8a56-09ef7bbe23fa\" (UID: \"1589bc04-d671-4586-8a56-09ef7bbe23fa\") "
Sep 10 13:24:46.283707 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.283678    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1589bc04-d671-4586-8a56-09ef7bbe23fa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1589bc04-d671-4586-8a56-09ef7bbe23fa" (UID: "1589bc04-d671-4586-8a56-09ef7bbe23fa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:24:46.285513 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.285483    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1589bc04-d671-4586-8a56-09ef7bbe23fa-kube-api-access-42xw2" (OuterVolumeSpecName: "kube-api-access-42xw2") pod "1589bc04-d671-4586-8a56-09ef7bbe23fa" (UID: "1589bc04-d671-4586-8a56-09ef7bbe23fa"). InnerVolumeSpecName "kube-api-access-42xw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:24:46.384302 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.384265    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42xw2\" (UniqueName: \"kubernetes.io/projected/1589bc04-d671-4586-8a56-09ef7bbe23fa-kube-api-access-42xw2\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:24:46.384302 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.384296    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1589bc04-d671-4586-8a56-09ef7bbe23fa-extensions-socket-volume\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:24:46.966481 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.966445    2584 generic.go:356] "Generic (PLEG): container finished" podID="1589bc04-d671-4586-8a56-09ef7bbe23fa" containerID="fa39d6c271c8fd45f963d4bf7ef31a201fa72399f8b756042ac57522ee2e5c63" exitCode=0
Sep 10 13:24:46.966481 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.966486    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"
Sep 10 13:24:46.966927 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.966532    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz" event={"ID":"1589bc04-d671-4586-8a56-09ef7bbe23fa","Type":"ContainerDied","Data":"fa39d6c271c8fd45f963d4bf7ef31a201fa72399f8b756042ac57522ee2e5c63"}
Sep 10 13:24:46.966927 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.966605    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz" event={"ID":"1589bc04-d671-4586-8a56-09ef7bbe23fa","Type":"ContainerDied","Data":"bb76e0f5a1202b25c0656d4af8906c1e40f0c9494f151cc23ca2879860ca6f3c"}
Sep 10 13:24:46.966927 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.966631    2584 scope.go:117] "RemoveContainer" containerID="fa39d6c271c8fd45f963d4bf7ef31a201fa72399f8b756042ac57522ee2e5c63"
Sep 10 13:24:46.975723 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.975707    2584 scope.go:117] "RemoveContainer" containerID="fa39d6c271c8fd45f963d4bf7ef31a201fa72399f8b756042ac57522ee2e5c63"
Sep 10 13:24:46.976010 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:24:46.975991    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa39d6c271c8fd45f963d4bf7ef31a201fa72399f8b756042ac57522ee2e5c63\": container with ID starting with fa39d6c271c8fd45f963d4bf7ef31a201fa72399f8b756042ac57522ee2e5c63 not found: ID does not exist" containerID="fa39d6c271c8fd45f963d4bf7ef31a201fa72399f8b756042ac57522ee2e5c63"
Sep 10 13:24:46.976052 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.976020    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa39d6c271c8fd45f963d4bf7ef31a201fa72399f8b756042ac57522ee2e5c63"} err="failed to get container status \"fa39d6c271c8fd45f963d4bf7ef31a201fa72399f8b756042ac57522ee2e5c63\": rpc error: code = NotFound desc = could not find container \"fa39d6c271c8fd45f963d4bf7ef31a201fa72399f8b756042ac57522ee2e5c63\": container with ID starting with fa39d6c271c8fd45f963d4bf7ef31a201fa72399f8b756042ac57522ee2e5c63 not found: ID does not exist"
Sep 10 13:24:46.989843 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:46.989817    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"]
Sep 10 13:24:47.001042 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:47.001020    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-gnrtz"]
Sep 10 13:24:47.614041 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:24:47.614010    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1589bc04-d671-4586-8a56-09ef7bbe23fa" path="/var/lib/kubelet/pods/1589bc04-d671-4586-8a56-09ef7bbe23fa/volumes"
Sep 10 13:25:03.605067 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.605034    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lf2rs"]
Sep 10 13:25:03.605600 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.605444    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cdd02ea-4efe-49ef-9969-74abd59b7abc" containerName="manager"
Sep 10 13:25:03.605600 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.605457    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cdd02ea-4efe-49ef-9969-74abd59b7abc" containerName="manager"
Sep 10 13:25:03.605600 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.605465    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1589bc04-d671-4586-8a56-09ef7bbe23fa" containerName="manager"
Sep 10 13:25:03.605600 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.605471    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1589bc04-d671-4586-8a56-09ef7bbe23fa" containerName="manager"
Sep 10 13:25:03.605600 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.605544    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1589bc04-d671-4586-8a56-09ef7bbe23fa" containerName="manager"
Sep 10 13:25:03.605600 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.605572    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cdd02ea-4efe-49ef-9969-74abd59b7abc" containerName="manager"
Sep 10 13:25:03.608052 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.608028    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-lf2rs"
Sep 10 13:25:03.611115 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.611084    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 13:25:03.611240 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.611116    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lpc9q\""
Sep 10 13:25:03.618784 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.618763    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lf2rs"]
Sep 10 13:25:03.703522 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.703485    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lf2rs"]
Sep 10 13:25:03.742041 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.742009    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2dfr\" (UniqueName: \"kubernetes.io/projected/ba639da4-8614-4f2c-b13d-181396561e5b-kube-api-access-h2dfr\") pod \"limitador-limitador-8588749977-lf2rs\" (UID: \"ba639da4-8614-4f2c-b13d-181396561e5b\") " pod="kuadrant-system/limitador-limitador-8588749977-lf2rs"
Sep 10 13:25:03.742213 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.742089    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba639da4-8614-4f2c-b13d-181396561e5b-config-file\") pod \"limitador-limitador-8588749977-lf2rs\" (UID: \"ba639da4-8614-4f2c-b13d-181396561e5b\") " pod="kuadrant-system/limitador-limitador-8588749977-lf2rs"
Sep 10 13:25:03.843288 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.843254    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba639da4-8614-4f2c-b13d-181396561e5b-config-file\") pod \"limitador-limitador-8588749977-lf2rs\" (UID: \"ba639da4-8614-4f2c-b13d-181396561e5b\") " pod="kuadrant-system/limitador-limitador-8588749977-lf2rs"
Sep 10 13:25:03.843463 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.843322    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2dfr\" (UniqueName: \"kubernetes.io/projected/ba639da4-8614-4f2c-b13d-181396561e5b-kube-api-access-h2dfr\") pod \"limitador-limitador-8588749977-lf2rs\" (UID: \"ba639da4-8614-4f2c-b13d-181396561e5b\") " pod="kuadrant-system/limitador-limitador-8588749977-lf2rs"
Sep 10 13:25:03.843900 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.843879    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba639da4-8614-4f2c-b13d-181396561e5b-config-file\") pod \"limitador-limitador-8588749977-lf2rs\" (UID: \"ba639da4-8614-4f2c-b13d-181396561e5b\") " pod="kuadrant-system/limitador-limitador-8588749977-lf2rs"
Sep 10 13:25:03.853057 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.853028    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2dfr\" (UniqueName: \"kubernetes.io/projected/ba639da4-8614-4f2c-b13d-181396561e5b-kube-api-access-h2dfr\") pod \"limitador-limitador-8588749977-lf2rs\" (UID: \"ba639da4-8614-4f2c-b13d-181396561e5b\") " pod="kuadrant-system/limitador-limitador-8588749977-lf2rs"
Sep 10 13:25:03.920217 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:03.920132    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-lf2rs"
Sep 10 13:25:04.197906 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:04.197883    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lf2rs"]
Sep 10 13:25:04.199737 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:25:04.199710    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba639da4_8614_4f2c_b13d_181396561e5b.slice/crio-9326d733d9b83c562ac28f541298cc92025be0dd3526aefb1f1447f7293e0b88 WatchSource:0}: Error finding container 9326d733d9b83c562ac28f541298cc92025be0dd3526aefb1f1447f7293e0b88: Status 404 returned error can't find the container with id 9326d733d9b83c562ac28f541298cc92025be0dd3526aefb1f1447f7293e0b88
Sep 10 13:25:04.421631 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:04.421596    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-zzwq5"]
Sep 10 13:25:04.425187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:04.425165    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-zzwq5"
Sep 10 13:25:04.428210 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:04.428193    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t652d\""
Sep 10 13:25:04.433522 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:04.433504    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-zzwq5"]
Sep 10 13:25:04.549989 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:04.549914    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdb4g\" (UniqueName: \"kubernetes.io/projected/9f04435a-5be3-469b-b254-e4241355ea70-kube-api-access-qdb4g\") pod \"authorino-7bcfd8f9cd-zzwq5\" (UID: \"9f04435a-5be3-469b-b254-e4241355ea70\") " pod="kuadrant-system/authorino-7bcfd8f9cd-zzwq5"
Sep 10 13:25:04.650585 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:04.650527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdb4g\" (UniqueName: \"kubernetes.io/projected/9f04435a-5be3-469b-b254-e4241355ea70-kube-api-access-qdb4g\") pod \"authorino-7bcfd8f9cd-zzwq5\" (UID: \"9f04435a-5be3-469b-b254-e4241355ea70\") " pod="kuadrant-system/authorino-7bcfd8f9cd-zzwq5"
Sep 10 13:25:04.660221 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:04.660195    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdb4g\" (UniqueName: \"kubernetes.io/projected/9f04435a-5be3-469b-b254-e4241355ea70-kube-api-access-qdb4g\") pod \"authorino-7bcfd8f9cd-zzwq5\" (UID: \"9f04435a-5be3-469b-b254-e4241355ea70\") " pod="kuadrant-system/authorino-7bcfd8f9cd-zzwq5"
Sep 10 13:25:04.736029 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:04.735990    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-zzwq5"
Sep 10 13:25:05.007947 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:05.007638    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-zzwq5"]
Sep 10 13:25:05.010330 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:25:05.010306    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f04435a_5be3_469b_b254_e4241355ea70.slice/crio-180e39dedb6c404f5ec2f79d991515939c495f22830f1a2d5a16706b6f151fb4 WatchSource:0}: Error finding container 180e39dedb6c404f5ec2f79d991515939c495f22830f1a2d5a16706b6f151fb4: Status 404 returned error can't find the container with id 180e39dedb6c404f5ec2f79d991515939c495f22830f1a2d5a16706b6f151fb4
Sep 10 13:25:05.055388 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:05.055357    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-zzwq5" event={"ID":"9f04435a-5be3-469b-b254-e4241355ea70","Type":"ContainerStarted","Data":"180e39dedb6c404f5ec2f79d991515939c495f22830f1a2d5a16706b6f151fb4"}
Sep 10 13:25:05.056549 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:05.056528    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-lf2rs" event={"ID":"ba639da4-8614-4f2c-b13d-181396561e5b","Type":"ContainerStarted","Data":"9326d733d9b83c562ac28f541298cc92025be0dd3526aefb1f1447f7293e0b88"}
Sep 10 13:25:06.063806 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:06.063713    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-lf2rs" event={"ID":"ba639da4-8614-4f2c-b13d-181396561e5b","Type":"ContainerStarted","Data":"e184e005212503299ddc2bbe5cb51cc7946cc9f10db38baa146999bd51f8efe3"}
Sep 10 13:25:06.064264 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:06.063839    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-lf2rs"
Sep 10 13:25:06.086207 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:06.086148    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-lf2rs" podStartSLOduration=1.5568895619999998 podStartE2EDuration="3.08612781s" totalImagesPullingTime="1.529238248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:25:06.084756041 +0000 UTC m=+500.970383103" watchObservedRunningTime="2026-09-10 13:25:06.08612781 +0000 UTC m=+500.971754838"
Sep 10 13:25:07.071826 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:07.071738    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-zzwq5" event={"ID":"9f04435a-5be3-469b-b254-e4241355ea70","Type":"ContainerStarted","Data":"ce95a2b1d7f7a84863555df716b08e7cc758a6762d0d7c491a285907c529907e"}
Sep 10 13:25:07.093782 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:07.093733    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-zzwq5" podStartSLOduration=1.372916018 podStartE2EDuration="3.093715655s" totalImagesPullingTime="1.720799637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:25:07.093006708 +0000 UTC m=+501.978633735" watchObservedRunningTime="2026-09-10 13:25:07.093715655 +0000 UTC m=+501.979342682"
Sep 10 13:25:09.164154 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:09.164118    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-zzwq5"]
Sep 10 13:25:09.164661 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:09.164268    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-zzwq5" podUID="9f04435a-5be3-469b-b254-e4241355ea70" containerName="authorino" containerID="cri-o://ce95a2b1d7f7a84863555df716b08e7cc758a6762d0d7c491a285907c529907e" gracePeriod=30
Sep 10 13:25:09.416308 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:09.416249    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-zzwq5"
Sep 10 13:25:09.491417 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:09.491383    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdb4g\" (UniqueName: \"kubernetes.io/projected/9f04435a-5be3-469b-b254-e4241355ea70-kube-api-access-qdb4g\") pod \"9f04435a-5be3-469b-b254-e4241355ea70\" (UID: \"9f04435a-5be3-469b-b254-e4241355ea70\") "
Sep 10 13:25:09.493663 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:09.493632    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f04435a-5be3-469b-b254-e4241355ea70-kube-api-access-qdb4g" (OuterVolumeSpecName: "kube-api-access-qdb4g") pod "9f04435a-5be3-469b-b254-e4241355ea70" (UID: "9f04435a-5be3-469b-b254-e4241355ea70"). InnerVolumeSpecName "kube-api-access-qdb4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:25:09.592388 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:09.592353    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdb4g\" (UniqueName: \"kubernetes.io/projected/9f04435a-5be3-469b-b254-e4241355ea70-kube-api-access-qdb4g\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:25:10.086879 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:10.086844    2584 generic.go:356] "Generic (PLEG): container finished" podID="9f04435a-5be3-469b-b254-e4241355ea70" containerID="ce95a2b1d7f7a84863555df716b08e7cc758a6762d0d7c491a285907c529907e" exitCode=0
Sep 10 13:25:10.086879 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:10.086886    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-zzwq5"
Sep 10 13:25:10.087116 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:10.086924    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-zzwq5" event={"ID":"9f04435a-5be3-469b-b254-e4241355ea70","Type":"ContainerDied","Data":"ce95a2b1d7f7a84863555df716b08e7cc758a6762d0d7c491a285907c529907e"}
Sep 10 13:25:10.087116 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:10.086968    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-zzwq5" event={"ID":"9f04435a-5be3-469b-b254-e4241355ea70","Type":"ContainerDied","Data":"180e39dedb6c404f5ec2f79d991515939c495f22830f1a2d5a16706b6f151fb4"}
Sep 10 13:25:10.087116 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:10.086985    2584 scope.go:117] "RemoveContainer" containerID="ce95a2b1d7f7a84863555df716b08e7cc758a6762d0d7c491a285907c529907e"
Sep 10 13:25:10.096160 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:10.096138    2584 scope.go:117] "RemoveContainer" containerID="ce95a2b1d7f7a84863555df716b08e7cc758a6762d0d7c491a285907c529907e"
Sep 10 13:25:10.096460 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:25:10.096417    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce95a2b1d7f7a84863555df716b08e7cc758a6762d0d7c491a285907c529907e\": container with ID starting with ce95a2b1d7f7a84863555df716b08e7cc758a6762d0d7c491a285907c529907e not found: ID does not exist" containerID="ce95a2b1d7f7a84863555df716b08e7cc758a6762d0d7c491a285907c529907e"
Sep 10 13:25:10.096460 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:10.096448    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce95a2b1d7f7a84863555df716b08e7cc758a6762d0d7c491a285907c529907e"} err="failed to get container status \"ce95a2b1d7f7a84863555df716b08e7cc758a6762d0d7c491a285907c529907e\": rpc error: code = NotFound desc = could not find container \"ce95a2b1d7f7a84863555df716b08e7cc758a6762d0d7c491a285907c529907e\": container with ID starting with ce95a2b1d7f7a84863555df716b08e7cc758a6762d0d7c491a285907c529907e not found: ID does not exist"
Sep 10 13:25:10.104803 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:10.104778    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-zzwq5"]
Sep 10 13:25:10.110980 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:10.110953    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-zzwq5"]
Sep 10 13:25:11.614569 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:11.614525    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f04435a-5be3-469b-b254-e4241355ea70" path="/var/lib/kubelet/pods/9f04435a-5be3-469b-b254-e4241355ea70/volumes"
Sep 10 13:25:17.073296 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:17.073262    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-lf2rs"
Sep 10 13:25:19.174946 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:19.174911    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lf2rs"]
Sep 10 13:25:19.175348 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:19.175159    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-lf2rs" podUID="ba639da4-8614-4f2c-b13d-181396561e5b" containerName="limitador" containerID="cri-o://e184e005212503299ddc2bbe5cb51cc7946cc9f10db38baa146999bd51f8efe3" gracePeriod=30
Sep 10 13:25:19.728243 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:19.728216    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-lf2rs"
Sep 10 13:25:19.874977 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:19.874944    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2dfr\" (UniqueName: \"kubernetes.io/projected/ba639da4-8614-4f2c-b13d-181396561e5b-kube-api-access-h2dfr\") pod \"ba639da4-8614-4f2c-b13d-181396561e5b\" (UID: \"ba639da4-8614-4f2c-b13d-181396561e5b\") "
Sep 10 13:25:19.875164 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:19.875030    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba639da4-8614-4f2c-b13d-181396561e5b-config-file\") pod \"ba639da4-8614-4f2c-b13d-181396561e5b\" (UID: \"ba639da4-8614-4f2c-b13d-181396561e5b\") "
Sep 10 13:25:19.875398 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:19.875363    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba639da4-8614-4f2c-b13d-181396561e5b-config-file" (OuterVolumeSpecName: "config-file") pod "ba639da4-8614-4f2c-b13d-181396561e5b" (UID: "ba639da4-8614-4f2c-b13d-181396561e5b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:25:19.877212 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:19.877187    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba639da4-8614-4f2c-b13d-181396561e5b-kube-api-access-h2dfr" (OuterVolumeSpecName: "kube-api-access-h2dfr") pod "ba639da4-8614-4f2c-b13d-181396561e5b" (UID: "ba639da4-8614-4f2c-b13d-181396561e5b"). InnerVolumeSpecName "kube-api-access-h2dfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:25:19.975943 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:19.975885    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2dfr\" (UniqueName: \"kubernetes.io/projected/ba639da4-8614-4f2c-b13d-181396561e5b-kube-api-access-h2dfr\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:25:19.975943 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:19.975936    2584 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba639da4-8614-4f2c-b13d-181396561e5b-config-file\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:25:20.144200 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:20.144111    2584 generic.go:356] "Generic (PLEG): container finished" podID="ba639da4-8614-4f2c-b13d-181396561e5b" containerID="e184e005212503299ddc2bbe5cb51cc7946cc9f10db38baa146999bd51f8efe3" exitCode=0
Sep 10 13:25:20.144200 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:20.144157    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-lf2rs"
Sep 10 13:25:20.144200 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:20.144191    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-lf2rs" event={"ID":"ba639da4-8614-4f2c-b13d-181396561e5b","Type":"ContainerDied","Data":"e184e005212503299ddc2bbe5cb51cc7946cc9f10db38baa146999bd51f8efe3"}
Sep 10 13:25:20.144434 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:20.144247    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-lf2rs" event={"ID":"ba639da4-8614-4f2c-b13d-181396561e5b","Type":"ContainerDied","Data":"9326d733d9b83c562ac28f541298cc92025be0dd3526aefb1f1447f7293e0b88"}
Sep 10 13:25:20.144434 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:20.144272    2584 scope.go:117] "RemoveContainer" containerID="e184e005212503299ddc2bbe5cb51cc7946cc9f10db38baa146999bd51f8efe3"
Sep 10 13:25:20.153545 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:20.153519    2584 scope.go:117] "RemoveContainer" containerID="e184e005212503299ddc2bbe5cb51cc7946cc9f10db38baa146999bd51f8efe3"
Sep 10 13:25:20.153906 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:25:20.153887    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e184e005212503299ddc2bbe5cb51cc7946cc9f10db38baa146999bd51f8efe3\": container with ID starting with e184e005212503299ddc2bbe5cb51cc7946cc9f10db38baa146999bd51f8efe3 not found: ID does not exist" containerID="e184e005212503299ddc2bbe5cb51cc7946cc9f10db38baa146999bd51f8efe3"
Sep 10 13:25:20.153979 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:20.153913    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e184e005212503299ddc2bbe5cb51cc7946cc9f10db38baa146999bd51f8efe3"} err="failed to get container status \"e184e005212503299ddc2bbe5cb51cc7946cc9f10db38baa146999bd51f8efe3\": rpc error: code = NotFound desc = could not find container \"e184e005212503299ddc2bbe5cb51cc7946cc9f10db38baa146999bd51f8efe3\": container with ID starting with e184e005212503299ddc2bbe5cb51cc7946cc9f10db38baa146999bd51f8efe3 not found: ID does not exist"
Sep 10 13:25:20.167331 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:20.167300    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lf2rs"]
Sep 10 13:25:20.173426 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:20.173396    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lf2rs"]
Sep 10 13:25:21.613579 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:21.613519    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba639da4-8614-4f2c-b13d-181396561e5b" path="/var/lib/kubelet/pods/ba639da4-8614-4f2c-b13d-181396561e5b/volumes"
Sep 10 13:25:24.595843 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.595804    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b"]
Sep 10 13:25:24.596511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.596165    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f04435a-5be3-469b-b254-e4241355ea70" containerName="authorino"
Sep 10 13:25:24.596511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.596176    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f04435a-5be3-469b-b254-e4241355ea70" containerName="authorino"
Sep 10 13:25:24.596511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.596194    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba639da4-8614-4f2c-b13d-181396561e5b" containerName="limitador"
Sep 10 13:25:24.596511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.596199    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba639da4-8614-4f2c-b13d-181396561e5b" containerName="limitador"
Sep 10 13:25:24.596511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.596268    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba639da4-8614-4f2c-b13d-181396561e5b" containerName="limitador"
Sep 10 13:25:24.596511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.596276    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f04435a-5be3-469b-b254-e4241355ea70" containerName="authorino"
Sep 10 13:25:24.600495 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.600470    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b"
Sep 10 13:25:24.603425 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.603396    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 13:25:24.603550 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.603406    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 13:25:24.603550 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.603407    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-q54j7\""
Sep 10 13:25:24.604486 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.604463    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 13:25:24.611386 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.611360    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b"]
Sep 10 13:25:24.715349 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.715305    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a53dab01-d766-44d5-961a-e4d85b40f372-data\") pod \"postgres-69fb4594cf-qvp5b\" (UID: \"a53dab01-d766-44d5-961a-e4d85b40f372\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b"
Sep 10 13:25:24.715538 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.715453    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljbzb\" (UniqueName: \"kubernetes.io/projected/a53dab01-d766-44d5-961a-e4d85b40f372-kube-api-access-ljbzb\") pod \"postgres-69fb4594cf-qvp5b\" (UID: \"a53dab01-d766-44d5-961a-e4d85b40f372\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b"
Sep 10 13:25:24.816080 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.816047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljbzb\" (UniqueName: \"kubernetes.io/projected/a53dab01-d766-44d5-961a-e4d85b40f372-kube-api-access-ljbzb\") pod \"postgres-69fb4594cf-qvp5b\" (UID: \"a53dab01-d766-44d5-961a-e4d85b40f372\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b"
Sep 10 13:25:24.816274 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.816090    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a53dab01-d766-44d5-961a-e4d85b40f372-data\") pod \"postgres-69fb4594cf-qvp5b\" (UID: \"a53dab01-d766-44d5-961a-e4d85b40f372\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b"
Sep 10 13:25:24.816499 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.816480    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a53dab01-d766-44d5-961a-e4d85b40f372-data\") pod \"postgres-69fb4594cf-qvp5b\" (UID: \"a53dab01-d766-44d5-961a-e4d85b40f372\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b"
Sep 10 13:25:24.825164 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.825144    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljbzb\" (UniqueName: \"kubernetes.io/projected/a53dab01-d766-44d5-961a-e4d85b40f372-kube-api-access-ljbzb\") pod \"postgres-69fb4594cf-qvp5b\" (UID: \"a53dab01-d766-44d5-961a-e4d85b40f372\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b"
Sep 10 13:25:24.911477 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:24.911441    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b"
Sep 10 13:25:25.186821 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:25.186771    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b"]
Sep 10 13:25:25.189086 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:25:25.189055    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53dab01_d766_44d5_961a_e4d85b40f372.slice/crio-372faead1f5adb40401169c2257ade377253d826bcd77baa81a19a404377aac7 WatchSource:0}: Error finding container 372faead1f5adb40401169c2257ade377253d826bcd77baa81a19a404377aac7: Status 404 returned error can't find the container with id 372faead1f5adb40401169c2257ade377253d826bcd77baa81a19a404377aac7
Sep 10 13:25:26.176982 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:26.176941    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b" event={"ID":"a53dab01-d766-44d5-961a-e4d85b40f372","Type":"ContainerStarted","Data":"372faead1f5adb40401169c2257ade377253d826bcd77baa81a19a404377aac7"}
Sep 10 13:25:31.212052 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:31.212013    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b" event={"ID":"a53dab01-d766-44d5-961a-e4d85b40f372","Type":"ContainerStarted","Data":"267ac012fb0bbae32c2be5e00e949362b361f3d15bafdadd29d7cdd9b4597392"}
Sep 10 13:25:31.212450 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:31.212074    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b"
Sep 10 13:25:31.230819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:31.230766    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b" podStartSLOduration=1.5816112690000002 podStartE2EDuration="7.230751818s" totalImagesPullingTime="5.649140549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:25:31.23018291 +0000 UTC m=+526.115809941" watchObservedRunningTime="2026-09-10 13:25:31.230751818 +0000 UTC m=+526.116378845"
Sep 10 13:25:37.247096 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:37.247027    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qvp5b"
Sep 10 13:25:37.880520 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:37.880490    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-cc84q"]
Sep 10 13:25:37.883753 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:37.883736    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-cc84q"
Sep 10 13:25:37.888292 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:37.888269    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t652d\""
Sep 10 13:25:37.900323 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:37.900293    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-cc84q"]
Sep 10 13:25:37.917658 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:37.917632    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khmz8\" (UniqueName: \"kubernetes.io/projected/d837d95c-fbd0-4f3c-8676-617c022d8a72-kube-api-access-khmz8\") pod \"authorino-557f876f69-cc84q\" (UID: \"d837d95c-fbd0-4f3c-8676-617c022d8a72\") " pod="kuadrant-system/authorino-557f876f69-cc84q"
Sep 10 13:25:38.018792 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.018756    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khmz8\" (UniqueName: \"kubernetes.io/projected/d837d95c-fbd0-4f3c-8676-617c022d8a72-kube-api-access-khmz8\") pod \"authorino-557f876f69-cc84q\" (UID: \"d837d95c-fbd0-4f3c-8676-617c022d8a72\") " pod="kuadrant-system/authorino-557f876f69-cc84q"
Sep 10 13:25:38.037648 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.037614    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khmz8\" (UniqueName: \"kubernetes.io/projected/d837d95c-fbd0-4f3c-8676-617c022d8a72-kube-api-access-khmz8\") pod \"authorino-557f876f69-cc84q\" (UID: \"d837d95c-fbd0-4f3c-8676-617c022d8a72\") " pod="kuadrant-system/authorino-557f876f69-cc84q"
Sep 10 13:25:38.065848 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.065811    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-cc84q"]
Sep 10 13:25:38.066069 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.066058    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-cc84q"
Sep 10 13:25:38.119730 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.119697    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hzsdk"]
Sep 10 13:25:38.138274 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.138200    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hzsdk"]
Sep 10 13:25:38.138587 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.138542    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-hzsdk"
Sep 10 13:25:38.142473 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.142444    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 10 13:25:38.193259 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.193211    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hzsdk"]
Sep 10 13:25:38.193524 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:25:38.193499    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jp5zs tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-jp5zs tls-cert]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-hzsdk" podUID="a96b7b2d-37cf-4379-aa20-c17e2d88b402"
Sep 10 13:25:38.220342 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.220307    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a96b7b2d-37cf-4379-aa20-c17e2d88b402-tls-cert\") pod \"authorino-6d4dfc649f-hzsdk\" (UID: \"a96b7b2d-37cf-4379-aa20-c17e2d88b402\") " pod="kuadrant-system/authorino-6d4dfc649f-hzsdk"
Sep 10 13:25:38.220502 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.220352    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp5zs\" (UniqueName: \"kubernetes.io/projected/a96b7b2d-37cf-4379-aa20-c17e2d88b402-kube-api-access-jp5zs\") pod \"authorino-6d4dfc649f-hzsdk\" (UID: \"a96b7b2d-37cf-4379-aa20-c17e2d88b402\") " pod="kuadrant-system/authorino-6d4dfc649f-hzsdk"
Sep 10 13:25:38.247796 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.247761    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-hzsdk"
Sep 10 13:25:38.254510 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.254483    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-hzsdk"
Sep 10 13:25:38.320786 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.320748    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a96b7b2d-37cf-4379-aa20-c17e2d88b402-tls-cert\") pod \"authorino-6d4dfc649f-hzsdk\" (UID: \"a96b7b2d-37cf-4379-aa20-c17e2d88b402\") " pod="kuadrant-system/authorino-6d4dfc649f-hzsdk"
Sep 10 13:25:38.320970 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.320820    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp5zs\" (UniqueName: \"kubernetes.io/projected/a96b7b2d-37cf-4379-aa20-c17e2d88b402-kube-api-access-jp5zs\") pod \"authorino-6d4dfc649f-hzsdk\" (UID: \"a96b7b2d-37cf-4379-aa20-c17e2d88b402\") " pod="kuadrant-system/authorino-6d4dfc649f-hzsdk"
Sep 10 13:25:38.323882 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.323856    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a96b7b2d-37cf-4379-aa20-c17e2d88b402-tls-cert\") pod \"authorino-6d4dfc649f-hzsdk\" (UID: \"a96b7b2d-37cf-4379-aa20-c17e2d88b402\") " pod="kuadrant-system/authorino-6d4dfc649f-hzsdk"
Sep 10 13:25:38.331938 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.331909    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp5zs\" (UniqueName: \"kubernetes.io/projected/a96b7b2d-37cf-4379-aa20-c17e2d88b402-kube-api-access-jp5zs\") pod \"authorino-6d4dfc649f-hzsdk\" (UID: \"a96b7b2d-37cf-4379-aa20-c17e2d88b402\") " pod="kuadrant-system/authorino-6d4dfc649f-hzsdk"
Sep 10 13:25:38.343956 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.343929    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-cc84q"]
Sep 10 13:25:38.346376 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:25:38.346352    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd837d95c_fbd0_4f3c_8676_617c022d8a72.slice/crio-6682faf9dfcb0f18a821c01a7218d3eee5fc2774b202a9727d70a5845ceefcd8 WatchSource:0}: Error finding container 6682faf9dfcb0f18a821c01a7218d3eee5fc2774b202a9727d70a5845ceefcd8: Status 404 returned error can't find the container with id 6682faf9dfcb0f18a821c01a7218d3eee5fc2774b202a9727d70a5845ceefcd8
Sep 10 13:25:38.421973 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.421876    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a96b7b2d-37cf-4379-aa20-c17e2d88b402-tls-cert\") pod \"a96b7b2d-37cf-4379-aa20-c17e2d88b402\" (UID: \"a96b7b2d-37cf-4379-aa20-c17e2d88b402\") "
Sep 10 13:25:38.421973 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.421930    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp5zs\" (UniqueName: \"kubernetes.io/projected/a96b7b2d-37cf-4379-aa20-c17e2d88b402-kube-api-access-jp5zs\") pod \"a96b7b2d-37cf-4379-aa20-c17e2d88b402\" (UID: \"a96b7b2d-37cf-4379-aa20-c17e2d88b402\") "
Sep 10 13:25:38.424137 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.424105    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96b7b2d-37cf-4379-aa20-c17e2d88b402-kube-api-access-jp5zs" (OuterVolumeSpecName: "kube-api-access-jp5zs") pod "a96b7b2d-37cf-4379-aa20-c17e2d88b402" (UID: "a96b7b2d-37cf-4379-aa20-c17e2d88b402"). InnerVolumeSpecName "kube-api-access-jp5zs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:25:38.424242 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.424201    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a96b7b2d-37cf-4379-aa20-c17e2d88b402-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a96b7b2d-37cf-4379-aa20-c17e2d88b402" (UID: "a96b7b2d-37cf-4379-aa20-c17e2d88b402"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:25:38.523418 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.523382    2584 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a96b7b2d-37cf-4379-aa20-c17e2d88b402-tls-cert\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:25:38.523418 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:38.523414    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp5zs\" (UniqueName: \"kubernetes.io/projected/a96b7b2d-37cf-4379-aa20-c17e2d88b402-kube-api-access-jp5zs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:25:39.255053 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:39.254959    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-hzsdk"
Sep 10 13:25:39.255053 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:39.254966    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-cc84q" event={"ID":"d837d95c-fbd0-4f3c-8676-617c022d8a72","Type":"ContainerStarted","Data":"22a6c6338f1c0035889ceb311f8ef49823599a64a8043211b44c07c401e55f0e"}
Sep 10 13:25:39.255053 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:39.255015    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-cc84q" event={"ID":"d837d95c-fbd0-4f3c-8676-617c022d8a72","Type":"ContainerStarted","Data":"6682faf9dfcb0f18a821c01a7218d3eee5fc2774b202a9727d70a5845ceefcd8"}
Sep 10 13:25:39.255053 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:39.255026    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-cc84q" podUID="d837d95c-fbd0-4f3c-8676-617c022d8a72" containerName="authorino" containerID="cri-o://22a6c6338f1c0035889ceb311f8ef49823599a64a8043211b44c07c401e55f0e" gracePeriod=30
Sep 10 13:25:39.279959 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:39.279917    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-cc84q" podStartSLOduration=1.738550549 podStartE2EDuration="2.279899119s" totalImagesPullingTime="541.34857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:25:39.279598121 +0000 UTC m=+534.165225147" watchObservedRunningTime="2026-09-10 13:25:39.279899119 +0000 UTC m=+534.165526147"
Sep 10 13:25:39.322685 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:39.322653    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hzsdk"]
Sep 10 13:25:39.324314 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:39.324287    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hzsdk"]
Sep 10 13:25:39.513733 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:39.513673    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-cc84q"
Sep 10 13:25:39.531716 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:39.531676    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khmz8\" (UniqueName: \"kubernetes.io/projected/d837d95c-fbd0-4f3c-8676-617c022d8a72-kube-api-access-khmz8\") pod \"d837d95c-fbd0-4f3c-8676-617c022d8a72\" (UID: \"d837d95c-fbd0-4f3c-8676-617c022d8a72\") "
Sep 10 13:25:39.534114 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:39.534078    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d837d95c-fbd0-4f3c-8676-617c022d8a72-kube-api-access-khmz8" (OuterVolumeSpecName: "kube-api-access-khmz8") pod "d837d95c-fbd0-4f3c-8676-617c022d8a72" (UID: "d837d95c-fbd0-4f3c-8676-617c022d8a72"). InnerVolumeSpecName "kube-api-access-khmz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:25:39.614035 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:39.614000    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a96b7b2d-37cf-4379-aa20-c17e2d88b402" path="/var/lib/kubelet/pods/a96b7b2d-37cf-4379-aa20-c17e2d88b402/volumes"
Sep 10 13:25:39.632324 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:39.632290    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khmz8\" (UniqueName: \"kubernetes.io/projected/d837d95c-fbd0-4f3c-8676-617c022d8a72-kube-api-access-khmz8\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:25:40.261286 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:40.261251    2584 generic.go:356] "Generic (PLEG): container finished" podID="d837d95c-fbd0-4f3c-8676-617c022d8a72" containerID="22a6c6338f1c0035889ceb311f8ef49823599a64a8043211b44c07c401e55f0e" exitCode=0
Sep 10 13:25:40.261783 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:40.261298    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-cc84q"
Sep 10 13:25:40.261783 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:40.261330    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-cc84q" event={"ID":"d837d95c-fbd0-4f3c-8676-617c022d8a72","Type":"ContainerDied","Data":"22a6c6338f1c0035889ceb311f8ef49823599a64a8043211b44c07c401e55f0e"}
Sep 10 13:25:40.261783 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:40.261376    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-cc84q" event={"ID":"d837d95c-fbd0-4f3c-8676-617c022d8a72","Type":"ContainerDied","Data":"6682faf9dfcb0f18a821c01a7218d3eee5fc2774b202a9727d70a5845ceefcd8"}
Sep 10 13:25:40.261783 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:40.261393    2584 scope.go:117] "RemoveContainer" containerID="22a6c6338f1c0035889ceb311f8ef49823599a64a8043211b44c07c401e55f0e"
Sep 10 13:25:40.270159 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:40.270141    2584 scope.go:117] "RemoveContainer" containerID="22a6c6338f1c0035889ceb311f8ef49823599a64a8043211b44c07c401e55f0e"
Sep 10 13:25:40.270436 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:25:40.270418    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22a6c6338f1c0035889ceb311f8ef49823599a64a8043211b44c07c401e55f0e\": container with ID starting with 22a6c6338f1c0035889ceb311f8ef49823599a64a8043211b44c07c401e55f0e not found: ID does not exist" containerID="22a6c6338f1c0035889ceb311f8ef49823599a64a8043211b44c07c401e55f0e"
Sep 10 13:25:40.270508 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:40.270449    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22a6c6338f1c0035889ceb311f8ef49823599a64a8043211b44c07c401e55f0e"} err="failed to get container status \"22a6c6338f1c0035889ceb311f8ef49823599a64a8043211b44c07c401e55f0e\": rpc error: code = NotFound desc = could not find container \"22a6c6338f1c0035889ceb311f8ef49823599a64a8043211b44c07c401e55f0e\": container with ID starting with 22a6c6338f1c0035889ceb311f8ef49823599a64a8043211b44c07c401e55f0e not found: ID does not exist"
Sep 10 13:25:40.291723 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:40.291689    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-cc84q"]
Sep 10 13:25:40.295933 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:40.295907    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-cc84q"]
Sep 10 13:25:41.613917 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:41.613881    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d837d95c-fbd0-4f3c-8676-617c022d8a72" path="/var/lib/kubelet/pods/d837d95c-fbd0-4f3c-8676-617c022d8a72/volumes"
Sep 10 13:25:45.599328 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.599276    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d4bfdbc8f-hmghs"]
Sep 10 13:25:45.600181 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.600154    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d837d95c-fbd0-4f3c-8676-617c022d8a72" containerName="authorino"
Sep 10 13:25:45.600181 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.600182    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d837d95c-fbd0-4f3c-8676-617c022d8a72" containerName="authorino"
Sep 10 13:25:45.600422 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.600406    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d837d95c-fbd0-4f3c-8676-617c022d8a72" containerName="authorino"
Sep 10 13:25:45.611209 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.611179    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:25:45.614738 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.614713    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jc6jm\""
Sep 10 13:25:45.615092 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.615075    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 13:25:45.615334 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.615102    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 13:25:45.615906 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.615888    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 13:25:45.623411 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.623031    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d4bfdbc8f-hmghs"]
Sep 10 13:25:45.683469 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.683428    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86sqk\" (UniqueName: \"kubernetes.io/projected/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-kube-api-access-86sqk\") pod \"maas-controller-6d4bfdbc8f-hmghs\" (UID: \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\") " pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:25:45.683664 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.683493    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-metrics-certs\") pod \"maas-controller-6d4bfdbc8f-hmghs\" (UID: \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\") " pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:25:45.683664 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.683626    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-webhook-cert\") pod \"maas-controller-6d4bfdbc8f-hmghs\" (UID: \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\") " pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:25:45.784307 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.784271    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86sqk\" (UniqueName: \"kubernetes.io/projected/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-kube-api-access-86sqk\") pod \"maas-controller-6d4bfdbc8f-hmghs\" (UID: \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\") " pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:25:45.784481 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.784319    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-metrics-certs\") pod \"maas-controller-6d4bfdbc8f-hmghs\" (UID: \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\") " pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:25:45.784481 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.784365    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-webhook-cert\") pod \"maas-controller-6d4bfdbc8f-hmghs\" (UID: \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\") " pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:25:45.784585 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:25:45.784500    2584 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 10 13:25:45.784585 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:25:45.784581    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-webhook-cert podName:a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd nodeName:}" failed. No retries permitted until 2026-09-10 13:25:46.284536609 +0000 UTC m=+541.170163613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-webhook-cert") pod "maas-controller-6d4bfdbc8f-hmghs" (UID: "a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd") : secret "maas-controller-webhook-cert" not found
Sep 10 13:25:45.786973 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.786942    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-metrics-certs\") pod \"maas-controller-6d4bfdbc8f-hmghs\" (UID: \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\") " pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:25:45.819099 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:45.819063    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86sqk\" (UniqueName: \"kubernetes.io/projected/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-kube-api-access-86sqk\") pod \"maas-controller-6d4bfdbc8f-hmghs\" (UID: \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\") " pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:25:46.289241 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:46.289203    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-webhook-cert\") pod \"maas-controller-6d4bfdbc8f-hmghs\" (UID: \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\") " pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:25:46.291852 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:46.291832    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-webhook-cert\") pod \"maas-controller-6d4bfdbc8f-hmghs\" (UID: \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\") " pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:25:46.528901 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:46.528863    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:25:46.815388 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:46.815362    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d4bfdbc8f-hmghs"]
Sep 10 13:25:46.816947 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:25:46.816924    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26860bf_f3cd_4a0f_8c0c_7f05d3cf80cd.slice/crio-c9d5fb27e7b62564df7b645f09aa1e789f8c562f02b6c1d09ce2bb2396c58b18 WatchSource:0}: Error finding container c9d5fb27e7b62564df7b645f09aa1e789f8c562f02b6c1d09ce2bb2396c58b18: Status 404 returned error can't find the container with id c9d5fb27e7b62564df7b645f09aa1e789f8c562f02b6c1d09ce2bb2396c58b18
Sep 10 13:25:47.306320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:47.306289    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs" event={"ID":"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd","Type":"ContainerStarted","Data":"c9d5fb27e7b62564df7b645f09aa1e789f8c562f02b6c1d09ce2bb2396c58b18"}
Sep 10 13:25:49.318889 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:49.318845    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs" event={"ID":"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd","Type":"ContainerStarted","Data":"1d1cbb1e9961fde2696186f42e025d5b56ad4aaa0a775327499ebc9290495e85"}
Sep 10 13:25:49.319274 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:49.318925    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:25:49.346976 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:25:49.346914    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs" podStartSLOduration=2.003612315 podStartE2EDuration="4.346889929s" totalImagesPullingTime="2.343277614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:25:49.343837314 +0000 UTC m=+544.229464351" watchObservedRunningTime="2026-09-10 13:25:49.346889929 +0000 UTC m=+544.232516958"
Sep 10 13:26:00.327132 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:00.327101    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:26:00.784193 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:00.784150    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d4bfdbc8f-hmghs"]
Sep 10 13:26:00.784429 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:00.784381    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs" podUID="a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd" containerName="manager" containerID="cri-o://1d1cbb1e9961fde2696186f42e025d5b56ad4aaa0a775327499ebc9290495e85" gracePeriod=30
Sep 10 13:26:01.037330 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.037261    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:26:01.116273 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.116241    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-metrics-certs\") pod \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\" (UID: \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\") "
Sep 10 13:26:01.116273 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.116292    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-webhook-cert\") pod \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\" (UID: \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\") "
Sep 10 13:26:01.116534 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.116330    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86sqk\" (UniqueName: \"kubernetes.io/projected/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-kube-api-access-86sqk\") pod \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\" (UID: \"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd\") "
Sep 10 13:26:01.118758 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.118715    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd" (UID: "a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:26:01.118758 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.118744    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd" (UID: "a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:26:01.118919 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.118768    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-kube-api-access-86sqk" (OuterVolumeSpecName: "kube-api-access-86sqk") pod "a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd" (UID: "a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd"). InnerVolumeSpecName "kube-api-access-86sqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:26:01.217374 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.217319    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:26:01.217374 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.217366    2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-webhook-cert\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:26:01.217374 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.217380    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86sqk\" (UniqueName: \"kubernetes.io/projected/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd-kube-api-access-86sqk\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:26:01.379444 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.379409    2584 generic.go:356] "Generic (PLEG): container finished" podID="a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd" containerID="1d1cbb1e9961fde2696186f42e025d5b56ad4aaa0a775327499ebc9290495e85" exitCode=0
Sep 10 13:26:01.379863 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.379452    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs"
Sep 10 13:26:01.379863 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.379509    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs" event={"ID":"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd","Type":"ContainerDied","Data":"1d1cbb1e9961fde2696186f42e025d5b56ad4aaa0a775327499ebc9290495e85"}
Sep 10 13:26:01.379863 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.379580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d4bfdbc8f-hmghs" event={"ID":"a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd","Type":"ContainerDied","Data":"c9d5fb27e7b62564df7b645f09aa1e789f8c562f02b6c1d09ce2bb2396c58b18"}
Sep 10 13:26:01.379863 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.379626    2584 scope.go:117] "RemoveContainer" containerID="1d1cbb1e9961fde2696186f42e025d5b56ad4aaa0a775327499ebc9290495e85"
Sep 10 13:26:01.393169 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.393151    2584 scope.go:117] "RemoveContainer" containerID="1d1cbb1e9961fde2696186f42e025d5b56ad4aaa0a775327499ebc9290495e85"
Sep 10 13:26:01.393431 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:26:01.393413    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d1cbb1e9961fde2696186f42e025d5b56ad4aaa0a775327499ebc9290495e85\": container with ID starting with 1d1cbb1e9961fde2696186f42e025d5b56ad4aaa0a775327499ebc9290495e85 not found: ID does not exist" containerID="1d1cbb1e9961fde2696186f42e025d5b56ad4aaa0a775327499ebc9290495e85"
Sep 10 13:26:01.393473 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.393440    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d1cbb1e9961fde2696186f42e025d5b56ad4aaa0a775327499ebc9290495e85"} err="failed to get container status \"1d1cbb1e9961fde2696186f42e025d5b56ad4aaa0a775327499ebc9290495e85\": rpc error: code = NotFound desc = could not find container \"1d1cbb1e9961fde2696186f42e025d5b56ad4aaa0a775327499ebc9290495e85\": container with ID starting with 1d1cbb1e9961fde2696186f42e025d5b56ad4aaa0a775327499ebc9290495e85 not found: ID does not exist"
Sep 10 13:26:01.406014 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.405990    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d4bfdbc8f-hmghs"]
Sep 10 13:26:01.410535 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.410513    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d4bfdbc8f-hmghs"]
Sep 10 13:26:01.613715 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:01.613679    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd" path="/var/lib/kubelet/pods/a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd/volumes"
Sep 10 13:26:22.280055 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.280017    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"]
Sep 10 13:26:22.280520 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.280375    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd" containerName="manager"
Sep 10 13:26:22.280520 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.280386    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd" containerName="manager"
Sep 10 13:26:22.280520 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.280460    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26860bf-f3cd-4a0f-8c0c-7f05d3cf80cd" containerName="manager"
Sep 10 13:26:22.286702 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.286684    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:22.289760 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.289729    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 13:26:22.289760 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.289749    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5fn9n\""
Sep 10 13:26:22.292437 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.292415    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 13:26:22.295213 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.295193    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"]
Sep 10 13:26:22.398505 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.398470    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240ead02-2167-4c1a-93e8-79d28cf962d4-maas-api-tls\") pod \"maas-api-85b6f7bf49-2wnlv\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") " pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:22.398693 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.398516    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240ead02-2167-4c1a-93e8-79d28cf962d4-openshift-service-ca\") pod \"maas-api-85b6f7bf49-2wnlv\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") " pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:22.398693 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.398586    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj4th\" (UniqueName: \"kubernetes.io/projected/240ead02-2167-4c1a-93e8-79d28cf962d4-kube-api-access-tj4th\") pod \"maas-api-85b6f7bf49-2wnlv\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") " pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:22.398693 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.398633    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/240ead02-2167-4c1a-93e8-79d28cf962d4-metrics-certs\") pod \"maas-api-85b6f7bf49-2wnlv\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") " pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:22.499083 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.499047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240ead02-2167-4c1a-93e8-79d28cf962d4-maas-api-tls\") pod \"maas-api-85b6f7bf49-2wnlv\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") " pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:22.499083 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.499087    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240ead02-2167-4c1a-93e8-79d28cf962d4-openshift-service-ca\") pod \"maas-api-85b6f7bf49-2wnlv\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") " pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:22.499321 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.499110    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj4th\" (UniqueName: \"kubernetes.io/projected/240ead02-2167-4c1a-93e8-79d28cf962d4-kube-api-access-tj4th\") pod \"maas-api-85b6f7bf49-2wnlv\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") " pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:22.499321 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.499159    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/240ead02-2167-4c1a-93e8-79d28cf962d4-metrics-certs\") pod \"maas-api-85b6f7bf49-2wnlv\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") " pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:22.499907 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.499878    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240ead02-2167-4c1a-93e8-79d28cf962d4-openshift-service-ca\") pod \"maas-api-85b6f7bf49-2wnlv\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") " pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:22.501738 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.501713    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240ead02-2167-4c1a-93e8-79d28cf962d4-maas-api-tls\") pod \"maas-api-85b6f7bf49-2wnlv\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") " pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:22.501873 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.501809    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/240ead02-2167-4c1a-93e8-79d28cf962d4-metrics-certs\") pod \"maas-api-85b6f7bf49-2wnlv\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") " pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:22.508835 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.508811    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj4th\" (UniqueName: \"kubernetes.io/projected/240ead02-2167-4c1a-93e8-79d28cf962d4-kube-api-access-tj4th\") pod \"maas-api-85b6f7bf49-2wnlv\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") " pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:22.598677 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.598646    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:22.866222 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.866142    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn"]
Sep 10 13:26:22.870474 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.870458    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn"
Sep 10 13:26:22.874991 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.874961    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5bw6l\""
Sep 10 13:26:22.874991 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.874978    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 13:26:22.884931 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.884906    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn"]
Sep 10 13:26:22.898971 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:22.898942    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"]
Sep 10 13:26:22.902519 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:26:22.902490    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240ead02_2167_4c1a_93e8_79d28cf962d4.slice/crio-a1f2494454af877310247aa86fc263548cbca7caf3981b9c7247565e5feb2f8a WatchSource:0}: Error finding container a1f2494454af877310247aa86fc263548cbca7caf3981b9c7247565e5feb2f8a: Status 404 returned error can't find the container with id a1f2494454af877310247aa86fc263548cbca7caf3981b9c7247565e5feb2f8a
Sep 10 13:26:23.003817 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:23.003781    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sqs5\" (UniqueName: \"kubernetes.io/projected/c413a9f4-c38f-40b7-a33c-84dfa1ad985e-kube-api-access-4sqs5\") pod \"payload-pre-processing-59fbc47bf8-nlccn\" (UID: \"c413a9f4-c38f-40b7-a33c-84dfa1ad985e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn"
Sep 10 13:26:23.003975 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:23.003837    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c413a9f4-c38f-40b7-a33c-84dfa1ad985e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nlccn\" (UID: \"c413a9f4-c38f-40b7-a33c-84dfa1ad985e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn"
Sep 10 13:26:23.105264 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:23.105228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sqs5\" (UniqueName: \"kubernetes.io/projected/c413a9f4-c38f-40b7-a33c-84dfa1ad985e-kube-api-access-4sqs5\") pod \"payload-pre-processing-59fbc47bf8-nlccn\" (UID: \"c413a9f4-c38f-40b7-a33c-84dfa1ad985e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn"
Sep 10 13:26:23.105426 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:23.105281    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c413a9f4-c38f-40b7-a33c-84dfa1ad985e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nlccn\" (UID: \"c413a9f4-c38f-40b7-a33c-84dfa1ad985e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn"
Sep 10 13:26:23.105937 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:23.105921    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c413a9f4-c38f-40b7-a33c-84dfa1ad985e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nlccn\" (UID: \"c413a9f4-c38f-40b7-a33c-84dfa1ad985e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn"
Sep 10 13:26:23.114910 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:23.114882    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sqs5\" (UniqueName: \"kubernetes.io/projected/c413a9f4-c38f-40b7-a33c-84dfa1ad985e-kube-api-access-4sqs5\") pod \"payload-pre-processing-59fbc47bf8-nlccn\" (UID: \"c413a9f4-c38f-40b7-a33c-84dfa1ad985e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn"
Sep 10 13:26:23.182784 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:23.182696    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn"
Sep 10 13:26:23.463453 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:23.463425    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn"]
Sep 10 13:26:23.465452 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:26:23.465425    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc413a9f4_c38f_40b7_a33c_84dfa1ad985e.slice/crio-3e8189e997662520ea4a82c4f5cbd7ccf1cf43ced61302360cf8cfe1780a790b WatchSource:0}: Error finding container 3e8189e997662520ea4a82c4f5cbd7ccf1cf43ced61302360cf8cfe1780a790b: Status 404 returned error can't find the container with id 3e8189e997662520ea4a82c4f5cbd7ccf1cf43ced61302360cf8cfe1780a790b
Sep 10 13:26:23.487325 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:23.487295    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn" event={"ID":"c413a9f4-c38f-40b7-a33c-84dfa1ad985e","Type":"ContainerStarted","Data":"3e8189e997662520ea4a82c4f5cbd7ccf1cf43ced61302360cf8cfe1780a790b"}
Sep 10 13:26:23.488601 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:23.488576    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv" event={"ID":"240ead02-2167-4c1a-93e8-79d28cf962d4","Type":"ContainerStarted","Data":"a1f2494454af877310247aa86fc263548cbca7caf3981b9c7247565e5feb2f8a"}
Sep 10 13:26:26.515585 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:26.515520    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn" event={"ID":"c413a9f4-c38f-40b7-a33c-84dfa1ad985e","Type":"ContainerStarted","Data":"46162121a913faecd41241b3443532a737e79a3fb2cbeb2216b06a231e92b638"}
Sep 10 13:26:26.516033 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:26.515641    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn"
Sep 10 13:26:26.517273 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:26.517249    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv" event={"ID":"240ead02-2167-4c1a-93e8-79d28cf962d4","Type":"ContainerStarted","Data":"075f41134e598a4e262d72ee0a5491d8791861ca0e639beca28c389195f43b53"}
Sep 10 13:26:26.517399 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:26.517383    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:26.536114 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:26.536059    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn" podStartSLOduration=2.006776309 podStartE2EDuration="4.536042982s" totalImagesPullingTime="2.529266673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:26:26.535862318 +0000 UTC m=+581.421489349" watchObservedRunningTime="2026-09-10 13:26:26.536042982 +0000 UTC m=+581.421670009"
Sep 10 13:26:26.558244 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:26.558185    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv" podStartSLOduration=1.5235390720000002 podStartE2EDuration="4.558166421s" totalImagesPullingTime="3.034627349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:26:26.556170255 +0000 UTC m=+581.441797278" watchObservedRunningTime="2026-09-10 13:26:26.558166421 +0000 UTC m=+581.443793448"
Sep 10 13:26:32.527419 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:32.527390    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:26:37.523963 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:37.523934    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nlccn"
Sep 10 13:26:43.309089 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.309052    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"]
Sep 10 13:26:43.312458 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.312425    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.315388 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.315361    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 13:26:43.316677 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.316655    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 13:26:43.316807 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.316685    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 10 13:26:43.317017 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.317003    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g6wbm\""
Sep 10 13:26:43.325663 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.325635    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"]
Sep 10 13:26:43.390463 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.390422    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55fkb\" (UniqueName: \"kubernetes.io/projected/8339b55c-4107-45ff-98da-2b3918de6250-kube-api-access-55fkb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.390463 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.390462    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8339b55c-4107-45ff-98da-2b3918de6250-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.390706 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.390496    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8339b55c-4107-45ff-98da-2b3918de6250-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.390706 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.390526    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8339b55c-4107-45ff-98da-2b3918de6250-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.390706 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.390585    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8339b55c-4107-45ff-98da-2b3918de6250-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.390706 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.390681    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8339b55c-4107-45ff-98da-2b3918de6250-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.491302 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.491270    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8339b55c-4107-45ff-98da-2b3918de6250-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.491473 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.491322    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55fkb\" (UniqueName: \"kubernetes.io/projected/8339b55c-4107-45ff-98da-2b3918de6250-kube-api-access-55fkb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.491473 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.491354    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8339b55c-4107-45ff-98da-2b3918de6250-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.491473 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.491387    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8339b55c-4107-45ff-98da-2b3918de6250-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.491676 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.491530    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8339b55c-4107-45ff-98da-2b3918de6250-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.491676 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.491592    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8339b55c-4107-45ff-98da-2b3918de6250-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.491784 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.491754    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8339b55c-4107-45ff-98da-2b3918de6250-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.491892 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.491866    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8339b55c-4107-45ff-98da-2b3918de6250-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.492006 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.491982    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8339b55c-4107-45ff-98da-2b3918de6250-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.493896 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.493873    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8339b55c-4107-45ff-98da-2b3918de6250-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.494137 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.494118    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8339b55c-4107-45ff-98da-2b3918de6250-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.501792 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.501767    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55fkb\" (UniqueName: \"kubernetes.io/projected/8339b55c-4107-45ff-98da-2b3918de6250-kube-api-access-55fkb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6g82\" (UID: \"8339b55c-4107-45ff-98da-2b3918de6250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.624957 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.624925    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:43.904145 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:43.904122    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"]
Sep 10 13:26:43.906248 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:26:43.906218    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8339b55c_4107_45ff_98da_2b3918de6250.slice/crio-04d13dad228d7f8ce5db29c967c6902c2e8184887e05b4165e1561f78f313bdf WatchSource:0}: Error finding container 04d13dad228d7f8ce5db29c967c6902c2e8184887e05b4165e1561f78f313bdf: Status 404 returned error can't find the container with id 04d13dad228d7f8ce5db29c967c6902c2e8184887e05b4165e1561f78f313bdf
Sep 10 13:26:44.606478 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:44.606434    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82" event={"ID":"8339b55c-4107-45ff-98da-2b3918de6250","Type":"ContainerStarted","Data":"04d13dad228d7f8ce5db29c967c6902c2e8184887e05b4165e1561f78f313bdf"}
Sep 10 13:26:45.580883 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:45.580853    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:26:45.582107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:45.582082    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:26:45.587410 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:45.587385    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:26:45.588589 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:45.588543    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:26:45.614389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:45.614362    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82" event={"ID":"8339b55c-4107-45ff-98da-2b3918de6250","Type":"ContainerStarted","Data":"40d558962716484355433d2a5deae32b9a60025a5c9f9626fb863265a3d9e2ef"}
Sep 10 13:26:45.638112 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:45.636055    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82" podStartSLOduration=1.649872708 podStartE2EDuration="2.635774043s" totalImagesPullingTime="985.901335ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:26:45.634490493 +0000 UTC m=+600.520117521" watchObservedRunningTime="2026-09-10 13:26:45.635774043 +0000 UTC m=+600.521401073"
Sep 10 13:26:50.511803 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.511771    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"]
Sep 10 13:26:50.515751 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.515726    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.518820 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.518791    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 10 13:26:50.525970 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.525944    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"]
Sep 10 13:26:50.554722 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.554687    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18dabf45-e370-489f-a903-d597ead2ad86-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.554901 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.554728    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18dabf45-e370-489f-a903-d597ead2ad86-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.554901 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.554819    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18dabf45-e370-489f-a903-d597ead2ad86-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.554901 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.554881    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktklg\" (UniqueName: \"kubernetes.io/projected/18dabf45-e370-489f-a903-d597ead2ad86-kube-api-access-ktklg\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.555017 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.554921    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18dabf45-e370-489f-a903-d597ead2ad86-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.555017 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.554952    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18dabf45-e370-489f-a903-d597ead2ad86-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.656259 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.656220    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18dabf45-e370-489f-a903-d597ead2ad86-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.656259 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.656274    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18dabf45-e370-489f-a903-d597ead2ad86-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.656511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.656337    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18dabf45-e370-489f-a903-d597ead2ad86-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.656511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.656392    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18dabf45-e370-489f-a903-d597ead2ad86-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.656837 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.656520    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18dabf45-e370-489f-a903-d597ead2ad86-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.656837 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.656602    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktklg\" (UniqueName: \"kubernetes.io/projected/18dabf45-e370-489f-a903-d597ead2ad86-kube-api-access-ktklg\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.656837 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.656739    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18dabf45-e370-489f-a903-d597ead2ad86-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.657014 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.656987    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18dabf45-e370-489f-a903-d597ead2ad86-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.657014 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.657003    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18dabf45-e370-489f-a903-d597ead2ad86-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.658880 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.658861    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18dabf45-e370-489f-a903-d597ead2ad86-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.659031 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.659014    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18dabf45-e370-489f-a903-d597ead2ad86-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.666126 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.666098    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktklg\" (UniqueName: \"kubernetes.io/projected/18dabf45-e370-489f-a903-d597ead2ad86-kube-api-access-ktklg\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg\" (UID: \"18dabf45-e370-489f-a903-d597ead2ad86\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:50.826911 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:50.826813    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:26:51.101241 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:51.101214    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"]
Sep 10 13:26:51.104034 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:26:51.104003    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18dabf45_e370_489f_a903_d597ead2ad86.slice/crio-a4e6c3325e9d12b6cf69713832a48e464fce4aa40abb1f1d1b86ee803fd54373 WatchSource:0}: Error finding container a4e6c3325e9d12b6cf69713832a48e464fce4aa40abb1f1d1b86ee803fd54373: Status 404 returned error can't find the container with id a4e6c3325e9d12b6cf69713832a48e464fce4aa40abb1f1d1b86ee803fd54373
Sep 10 13:26:51.645741 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:51.645692    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg" event={"ID":"18dabf45-e370-489f-a903-d597ead2ad86","Type":"ContainerStarted","Data":"aafc2d4bd3aa71cb71bfb56b2bdf27b0ec32f98c3e381233a1ccd69bc2362b67"}
Sep 10 13:26:51.645741 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:51.645750    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg" event={"ID":"18dabf45-e370-489f-a903-d597ead2ad86","Type":"ContainerStarted","Data":"a4e6c3325e9d12b6cf69713832a48e464fce4aa40abb1f1d1b86ee803fd54373"}
Sep 10 13:26:51.666867 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:51.666803    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg" podStartSLOduration=1.489627708 podStartE2EDuration="1.666756229s" totalImagesPullingTime="177.128521ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:26:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:26:51.666102634 +0000 UTC m=+606.551729659" watchObservedRunningTime="2026-09-10 13:26:51.666756229 +0000 UTC m=+606.552383260"
Sep 10 13:26:53.625753 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:53.625718    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:53.626373 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:53.625780    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:53.638954 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:53.638927    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:26:53.667246 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:26:53.667215    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6g82"
Sep 10 13:27:00.827967 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:00.827924    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:27:00.828378 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:00.827984    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:27:00.841022 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:00.840990    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:27:01.707104 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:01.707072    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg"
Sep 10 13:27:06.215049 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.215008    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"]
Sep 10 13:27:06.217809 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.217792    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.220629 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.220608    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 13:27:06.229613 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.229589    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"]
Sep 10 13:27:06.303294 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.303248    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c159b14a-163b-4dcc-86ab-e66043f810c3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.303294 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.303305    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c159b14a-163b-4dcc-86ab-e66043f810c3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.303571 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.303324    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx8xr\" (UniqueName: \"kubernetes.io/projected/c159b14a-163b-4dcc-86ab-e66043f810c3-kube-api-access-tx8xr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.303571 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.303350    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c159b14a-163b-4dcc-86ab-e66043f810c3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.303571 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.303410    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c159b14a-163b-4dcc-86ab-e66043f810c3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.303571 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.303458    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c159b14a-163b-4dcc-86ab-e66043f810c3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.404402 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.404363    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c159b14a-163b-4dcc-86ab-e66043f810c3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.404629 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.404428    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c159b14a-163b-4dcc-86ab-e66043f810c3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.404629 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.404601    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx8xr\" (UniqueName: \"kubernetes.io/projected/c159b14a-163b-4dcc-86ab-e66043f810c3-kube-api-access-tx8xr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.404779 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.404635    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c159b14a-163b-4dcc-86ab-e66043f810c3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.404779 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.404694    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c159b14a-163b-4dcc-86ab-e66043f810c3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.404779 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.404745    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c159b14a-163b-4dcc-86ab-e66043f810c3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.404931 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.404782    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c159b14a-163b-4dcc-86ab-e66043f810c3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.405048 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.405025    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c159b14a-163b-4dcc-86ab-e66043f810c3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.405048 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.405041    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c159b14a-163b-4dcc-86ab-e66043f810c3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.407031 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.407009    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c159b14a-163b-4dcc-86ab-e66043f810c3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.407164 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.407140    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c159b14a-163b-4dcc-86ab-e66043f810c3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.413513 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.413471    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx8xr\" (UniqueName: \"kubernetes.io/projected/c159b14a-163b-4dcc-86ab-e66043f810c3-kube-api-access-tx8xr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr\" (UID: \"c159b14a-163b-4dcc-86ab-e66043f810c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.528715 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.528629    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:06.804005 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.803972    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"]
Sep 10 13:27:06.805881 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:27:06.805854    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc159b14a_163b_4dcc_86ab_e66043f810c3.slice/crio-3b9e3c914c158647e0079e8b28f1eb5d7625280cb88b83520f313f840eada101 WatchSource:0}: Error finding container 3b9e3c914c158647e0079e8b28f1eb5d7625280cb88b83520f313f840eada101: Status 404 returned error can't find the container with id 3b9e3c914c158647e0079e8b28f1eb5d7625280cb88b83520f313f840eada101
Sep 10 13:27:06.807468 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:06.807448    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 13:27:07.728365 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:07.728326    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr" event={"ID":"c159b14a-163b-4dcc-86ab-e66043f810c3","Type":"ContainerStarted","Data":"a87efa001050436ee0ac75c4d082cd97a09b9cc0716c7bd0820904ac82f98ed7"}
Sep 10 13:27:07.728812 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:07.728379    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr" event={"ID":"c159b14a-163b-4dcc-86ab-e66043f810c3","Type":"ContainerStarted","Data":"3b9e3c914c158647e0079e8b28f1eb5d7625280cb88b83520f313f840eada101"}
Sep 10 13:27:07.748066 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:07.748014    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr" podStartSLOduration=1.579254733 podStartE2EDuration="1.747997895s" totalImagesPullingTime="168.743162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:27:07.746778017 +0000 UTC m=+622.632405054" watchObservedRunningTime="2026-09-10 13:27:07.747997895 +0000 UTC m=+622.633624899"
Sep 10 13:27:16.529039 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:16.528995    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:16.529467 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:16.529087    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:16.541538 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:16.541510    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:27:16.790576 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:27:16.790473    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr"
Sep 10 13:29:27.528045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.528011    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"]
Sep 10 13:29:27.532343 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.532319    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:27.535627 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.535604    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-39df6e-serving-cert\""
Sep 10 13:29:27.555902 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.555875    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"]
Sep 10 13:29:27.558033 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.558007    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cplg\" (UniqueName: \"kubernetes.io/projected/6f2004a6-30f1-4a8b-83ce-3243df0ab238-kube-api-access-7cplg\") pod \"maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:27.558196 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.558158    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f2004a6-30f1-4a8b-83ce-3243df0ab238-maas-api-tls\") pod \"maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:27.558328 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.558301    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2004a6-30f1-4a8b-83ce-3243df0ab238-openshift-service-ca\") pod \"maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:27.558413 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.558344    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f2004a6-30f1-4a8b-83ce-3243df0ab238-metrics-certs\") pod \"maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:27.659432 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.659400    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cplg\" (UniqueName: \"kubernetes.io/projected/6f2004a6-30f1-4a8b-83ce-3243df0ab238-kube-api-access-7cplg\") pod \"maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:27.659683 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.659455    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f2004a6-30f1-4a8b-83ce-3243df0ab238-maas-api-tls\") pod \"maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:27.659683 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.659506    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2004a6-30f1-4a8b-83ce-3243df0ab238-openshift-service-ca\") pod \"maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:27.659683 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.659524    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f2004a6-30f1-4a8b-83ce-3243df0ab238-metrics-certs\") pod \"maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:27.660198 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.660171    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2004a6-30f1-4a8b-83ce-3243df0ab238-openshift-service-ca\") pod \"maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:27.662229 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.662200    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f2004a6-30f1-4a8b-83ce-3243df0ab238-maas-api-tls\") pod \"maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:27.662321 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.662248    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f2004a6-30f1-4a8b-83ce-3243df0ab238-metrics-certs\") pod \"maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:27.679000 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.678975    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cplg\" (UniqueName: \"kubernetes.io/projected/6f2004a6-30f1-4a8b-83ce-3243df0ab238-kube-api-access-7cplg\") pod \"maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:27.845138 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:27.845059    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:28.132777 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:29:28.132749    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f2004a6_30f1_4a8b_83ce_3243df0ab238.slice/crio-1261e1be4eb48d66933499bab8b991db45cef44f3f7707fd7e7792a3258a14cb WatchSource:0}: Error finding container 1261e1be4eb48d66933499bab8b991db45cef44f3f7707fd7e7792a3258a14cb: Status 404 returned error can't find the container with id 1261e1be4eb48d66933499bab8b991db45cef44f3f7707fd7e7792a3258a14cb
Sep 10 13:29:28.133477 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:28.133449    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"]
Sep 10 13:29:28.470416 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:28.470319    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx" event={"ID":"6f2004a6-30f1-4a8b-83ce-3243df0ab238","Type":"ContainerStarted","Data":"1261e1be4eb48d66933499bab8b991db45cef44f3f7707fd7e7792a3258a14cb"}
Sep 10 13:29:29.477764 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:29.477728    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx" event={"ID":"6f2004a6-30f1-4a8b-83ce-3243df0ab238","Type":"ContainerStarted","Data":"cfbdc66f61f5ff783202a61796696e0ffd08e4c95adc132ebe56f98f69a5131d"}
Sep 10 13:29:29.478170 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:29.477867    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:29.513678 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:29.513599    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx" podStartSLOduration=1.890979909 podStartE2EDuration="2.513550113s" totalImagesPullingTime="622.570204ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:29:29.512546908 +0000 UTC m=+764.398173934" watchObservedRunningTime="2026-09-10 13:29:29.513550113 +0000 UTC m=+764.399177140"
Sep 10 13:29:35.489773 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.489742    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:29:35.787791 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.787696    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"]
Sep 10 13:29:35.791539 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.791514    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:35.796016 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.795973    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-af59ca-serving-cert\""
Sep 10 13:29:35.832365 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.832326    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"]
Sep 10 13:29:35.838627 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.838599    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-maas-api-tls\") pod \"maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:35.838781 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.838644    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvl28\" (UniqueName: \"kubernetes.io/projected/37e903c2-2201-40d9-9d9a-9a93b784dde0-kube-api-access-qvl28\") pod \"maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:35.838781 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.838675    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e903c2-2201-40d9-9d9a-9a93b784dde0-openshift-service-ca\") pod \"maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:35.838781 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.838773    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-metrics-certs\") pod \"maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:35.939467 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.939433    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-maas-api-tls\") pod \"maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:35.939694 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.939489    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvl28\" (UniqueName: \"kubernetes.io/projected/37e903c2-2201-40d9-9d9a-9a93b784dde0-kube-api-access-qvl28\") pod \"maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:35.939694 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.939521    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e903c2-2201-40d9-9d9a-9a93b784dde0-openshift-service-ca\") pod \"maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:35.939694 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:29:35.939619    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-serving-cert: secret "maas-api-e2e-autores-af59ca-serving-cert" not found
Sep 10 13:29:35.939870 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:29:35.939706    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-maas-api-tls podName:37e903c2-2201-40d9-9d9a-9a93b784dde0 nodeName:}" failed. No retries permitted until 2026-09-10 13:29:36.439688372 +0000 UTC m=+771.325315378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-maas-api-tls") pod "maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5" (UID: "37e903c2-2201-40d9-9d9a-9a93b784dde0") : secret "maas-api-e2e-autores-af59ca-serving-cert" not found
Sep 10 13:29:35.939870 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.939619    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-metrics-certs\") pod \"maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:35.940438 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.940414    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e903c2-2201-40d9-9d9a-9a93b784dde0-openshift-service-ca\") pod \"maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:35.942330 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.942310    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-metrics-certs\") pod \"maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:35.960306 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:35.960263    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvl28\" (UniqueName: \"kubernetes.io/projected/37e903c2-2201-40d9-9d9a-9a93b784dde0-kube-api-access-qvl28\") pod \"maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:36.444668 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:36.444628    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-maas-api-tls\") pod \"maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:36.447263 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:36.447238    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-maas-api-tls\") pod \"maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:36.706805 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:36.706711    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:36.994812 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:36.994790    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"]
Sep 10 13:29:36.997145 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:29:36.997120    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e903c2_2201_40d9_9d9a_9a93b784dde0.slice/crio-b37fe8fedb5ae4c4de8ce48f6d1ddc90a235c56d69af4005ee6bc7cb75be8e9d WatchSource:0}: Error finding container b37fe8fedb5ae4c4de8ce48f6d1ddc90a235c56d69af4005ee6bc7cb75be8e9d: Status 404 returned error can't find the container with id b37fe8fedb5ae4c4de8ce48f6d1ddc90a235c56d69af4005ee6bc7cb75be8e9d
Sep 10 13:29:37.528499 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:37.528408    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5" event={"ID":"37e903c2-2201-40d9-9d9a-9a93b784dde0","Type":"ContainerStarted","Data":"4fc5b68914ee4113c8c56e33d3c8fb2e156c41b42bb83623422d20eccfe1b7dd"}
Sep 10 13:29:37.528499 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:37.528472    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5" event={"ID":"37e903c2-2201-40d9-9d9a-9a93b784dde0","Type":"ContainerStarted","Data":"b37fe8fedb5ae4c4de8ce48f6d1ddc90a235c56d69af4005ee6bc7cb75be8e9d"}
Sep 10 13:29:37.528746 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:37.528604    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:37.561445 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:37.561395    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5" podStartSLOduration=2.284019699 podStartE2EDuration="2.56138045s" totalImagesPullingTime="277.360751ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:29:37.55902442 +0000 UTC m=+772.444651447" watchObservedRunningTime="2026-09-10 13:29:37.56138045 +0000 UTC m=+772.447007477"
Sep 10 13:29:38.807479 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.807442    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"]
Sep 10 13:29:38.811862 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.811838    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:38.815038 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.815015    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d2fb9c2a-serving-cert\""
Sep 10 13:29:38.826053 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.826029    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"]
Sep 10 13:29:38.867905 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.867870    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4znc7\" (UniqueName: \"kubernetes.io/projected/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-kube-api-access-4znc7\") pod \"maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:38.868109 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.868060    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-maas-api-tls\") pod \"maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:38.868109 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.868103    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-openshift-service-ca\") pod \"maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:38.868237 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.868161    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-metrics-certs\") pod \"maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:38.969076 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.969041    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-maas-api-tls\") pod \"maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:38.969279 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.969081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-openshift-service-ca\") pod \"maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:38.969279 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.969217    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-metrics-certs\") pod \"maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:38.969407 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.969286    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4znc7\" (UniqueName: \"kubernetes.io/projected/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-kube-api-access-4znc7\") pod \"maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:38.969882 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.969859    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-openshift-service-ca\") pod \"maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:38.971759 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.971742    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-maas-api-tls\") pod \"maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:38.971829 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.971765    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-metrics-certs\") pod \"maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:38.980641 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:38.980614    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4znc7\" (UniqueName: \"kubernetes.io/projected/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-kube-api-access-4znc7\") pod \"maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:39.127725 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:39.127687    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:39.409242 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:39.409212    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"]
Sep 10 13:29:39.411317 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:29:39.411292    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5778934_eef1_4ea4_9e6c_d51eccd3a4c3.slice/crio-e336c618a5f6ca5b65648d4e0c31e23f119379c3607c0f367a6625f897f79eb9 WatchSource:0}: Error finding container e336c618a5f6ca5b65648d4e0c31e23f119379c3607c0f367a6625f897f79eb9: Status 404 returned error can't find the container with id e336c618a5f6ca5b65648d4e0c31e23f119379c3607c0f367a6625f897f79eb9
Sep 10 13:29:39.539428 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:39.539392    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb" event={"ID":"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3","Type":"ContainerStarted","Data":"e336c618a5f6ca5b65648d4e0c31e23f119379c3607c0f367a6625f897f79eb9"}
Sep 10 13:29:40.545752 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:40.545716    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb" event={"ID":"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3","Type":"ContainerStarted","Data":"eb60a6fe70053fb9be5c51af0050b8e0cf531b6e5c7ad9e6f76e5803e4a9c2af"}
Sep 10 13:29:40.546112 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:40.545804    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:40.568968 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:40.568892    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb" podStartSLOduration=2.288966753 podStartE2EDuration="2.56887456s" totalImagesPullingTime="279.907807ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:29:40.567346561 +0000 UTC m=+775.452973602" watchObservedRunningTime="2026-09-10 13:29:40.56887456 +0000 UTC m=+775.454501586"
Sep 10 13:29:43.539098 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:43.539072    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:29:46.556899 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:46.556871    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:29:56.452834 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.452797    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"]
Sep 10 13:29:56.457947 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.457850    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:56.461296 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.461270    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6beee4-serving-cert\""
Sep 10 13:29:56.480052 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.480027    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"]
Sep 10 13:29:56.639715 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.639679    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/327528d0-0d99-431a-b063-74cf86ac9378-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:56.639715 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.639713    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/327528d0-0d99-431a-b063-74cf86ac9378-metrics-certs\") pod \"maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:56.639925 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.639765    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/327528d0-0d99-431a-b063-74cf86ac9378-maas-api-tls\") pod \"maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:56.639925 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.639798    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn9gs\" (UniqueName: \"kubernetes.io/projected/327528d0-0d99-431a-b063-74cf86ac9378-kube-api-access-pn9gs\") pod \"maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:56.741149 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.741052    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/327528d0-0d99-431a-b063-74cf86ac9378-maas-api-tls\") pod \"maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:56.741149 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.741096    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn9gs\" (UniqueName: \"kubernetes.io/projected/327528d0-0d99-431a-b063-74cf86ac9378-kube-api-access-pn9gs\") pod \"maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:56.741392 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.741202    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/327528d0-0d99-431a-b063-74cf86ac9378-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:56.741392 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.741222    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/327528d0-0d99-431a-b063-74cf86ac9378-metrics-certs\") pod \"maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:56.741960 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.741938    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/327528d0-0d99-431a-b063-74cf86ac9378-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:56.743729 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.743707    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/327528d0-0d99-431a-b063-74cf86ac9378-metrics-certs\") pod \"maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:56.743845 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.743760    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/327528d0-0d99-431a-b063-74cf86ac9378-maas-api-tls\") pod \"maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:56.756591 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.756546    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn9gs\" (UniqueName: \"kubernetes.io/projected/327528d0-0d99-431a-b063-74cf86ac9378-kube-api-access-pn9gs\") pod \"maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:56.770440 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:56.770419    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:57.069496 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:57.069472    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"]
Sep 10 13:29:57.071782 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:29:57.071751    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod327528d0_0d99_431a_b063_74cf86ac9378.slice/crio-7f8d06cc2597256e8a04d243c0140f4e26face2b90bbb353a902c5ea07a5bd04 WatchSource:0}: Error finding container 7f8d06cc2597256e8a04d243c0140f4e26face2b90bbb353a902c5ea07a5bd04: Status 404 returned error can't find the container with id 7f8d06cc2597256e8a04d243c0140f4e26face2b90bbb353a902c5ea07a5bd04
Sep 10 13:29:57.635319 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:57.635278    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c" event={"ID":"327528d0-0d99-431a-b063-74cf86ac9378","Type":"ContainerStarted","Data":"af4f32b84f1705a40e289dd18ab19646254f4028b1aed4508e6f582657ad163d"}
Sep 10 13:29:57.635752 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:57.635349    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c" event={"ID":"327528d0-0d99-431a-b063-74cf86ac9378","Type":"ContainerStarted","Data":"7f8d06cc2597256e8a04d243c0140f4e26face2b90bbb353a902c5ea07a5bd04"}
Sep 10 13:29:57.635752 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:57.635384    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:29:57.818055 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:29:57.817952    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c" podStartSLOduration=1.464401922 podStartE2EDuration="1.817935172s" totalImagesPullingTime="353.53325ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:29:57.814880023 +0000 UTC m=+792.700507049" watchObservedRunningTime="2026-09-10 13:29:57.817935172 +0000 UTC m=+792.703562200"
Sep 10 13:30:03.647518 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:03.647490    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:30:18.988014 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:18.987930    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"]
Sep 10 13:30:18.988426 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:18.988154    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb" podUID="a5778934-eef1-4ea4-9e6c-d51eccd3a4c3" containerName="maas-api" containerID="cri-o://eb60a6fe70053fb9be5c51af0050b8e0cf531b6e5c7ad9e6f76e5803e4a9c2af" gracePeriod=30
Sep 10 13:30:19.258401 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.258377    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:30:19.356008 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.355964    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-metrics-certs\") pod \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") "
Sep 10 13:30:19.356202 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.356048    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-openshift-service-ca\") pod \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") "
Sep 10 13:30:19.356202 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.356073    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-maas-api-tls\") pod \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") "
Sep 10 13:30:19.356202 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.356111    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4znc7\" (UniqueName: \"kubernetes.io/projected/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-kube-api-access-4znc7\") pod \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\" (UID: \"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3\") "
Sep 10 13:30:19.356447 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.356425    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a5778934-eef1-4ea4-9e6c-d51eccd3a4c3" (UID: "a5778934-eef1-4ea4-9e6c-d51eccd3a4c3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:30:19.356516 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.356502    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:30:19.358631 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.358585    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a5778934-eef1-4ea4-9e6c-d51eccd3a4c3" (UID: "a5778934-eef1-4ea4-9e6c-d51eccd3a4c3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:30:19.358768 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.358675    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a5778934-eef1-4ea4-9e6c-d51eccd3a4c3" (UID: "a5778934-eef1-4ea4-9e6c-d51eccd3a4c3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:30:19.358768 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.358736    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-kube-api-access-4znc7" (OuterVolumeSpecName: "kube-api-access-4znc7") pod "a5778934-eef1-4ea4-9e6c-d51eccd3a4c3" (UID: "a5778934-eef1-4ea4-9e6c-d51eccd3a4c3"). InnerVolumeSpecName "kube-api-access-4znc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:30:19.458453 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.458410    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:30:19.458453 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.458444    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:30:19.458453 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.458459    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4znc7\" (UniqueName: \"kubernetes.io/projected/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3-kube-api-access-4znc7\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:30:19.756412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.756378    2584 generic.go:356] "Generic (PLEG): container finished" podID="a5778934-eef1-4ea4-9e6c-d51eccd3a4c3" containerID="eb60a6fe70053fb9be5c51af0050b8e0cf531b6e5c7ad9e6f76e5803e4a9c2af" exitCode=0
Sep 10 13:30:19.756608 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.756425    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"
Sep 10 13:30:19.756608 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.756456    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb" event={"ID":"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3","Type":"ContainerDied","Data":"eb60a6fe70053fb9be5c51af0050b8e0cf531b6e5c7ad9e6f76e5803e4a9c2af"}
Sep 10 13:30:19.756608 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.756513    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb" event={"ID":"a5778934-eef1-4ea4-9e6c-d51eccd3a4c3","Type":"ContainerDied","Data":"e336c618a5f6ca5b65648d4e0c31e23f119379c3607c0f367a6625f897f79eb9"}
Sep 10 13:30:19.756608 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.756534    2584 scope.go:117] "RemoveContainer" containerID="eb60a6fe70053fb9be5c51af0050b8e0cf531b6e5c7ad9e6f76e5803e4a9c2af"
Sep 10 13:30:19.767653 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.767632    2584 scope.go:117] "RemoveContainer" containerID="eb60a6fe70053fb9be5c51af0050b8e0cf531b6e5c7ad9e6f76e5803e4a9c2af"
Sep 10 13:30:19.767978 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:30:19.767959    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb60a6fe70053fb9be5c51af0050b8e0cf531b6e5c7ad9e6f76e5803e4a9c2af\": container with ID starting with eb60a6fe70053fb9be5c51af0050b8e0cf531b6e5c7ad9e6f76e5803e4a9c2af not found: ID does not exist" containerID="eb60a6fe70053fb9be5c51af0050b8e0cf531b6e5c7ad9e6f76e5803e4a9c2af"
Sep 10 13:30:19.768036 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.767992    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb60a6fe70053fb9be5c51af0050b8e0cf531b6e5c7ad9e6f76e5803e4a9c2af"} err="failed to get container status \"eb60a6fe70053fb9be5c51af0050b8e0cf531b6e5c7ad9e6f76e5803e4a9c2af\": rpc error: code = NotFound desc = could not find container \"eb60a6fe70053fb9be5c51af0050b8e0cf531b6e5c7ad9e6f76e5803e4a9c2af\": container with ID starting with eb60a6fe70053fb9be5c51af0050b8e0cf531b6e5c7ad9e6f76e5803e4a9c2af not found: ID does not exist"
Sep 10 13:30:19.774132 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.774108    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"]
Sep 10 13:30:19.776377 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:19.776356    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d2fb9c2a-bcc5c5b8f-xb5zb"]
Sep 10 13:30:20.621413 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.621384    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"]
Sep 10 13:30:20.622050 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.622030    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5778934-eef1-4ea4-9e6c-d51eccd3a4c3" containerName="maas-api"
Sep 10 13:30:20.622144 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.622052    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5778934-eef1-4ea4-9e6c-d51eccd3a4c3" containerName="maas-api"
Sep 10 13:30:20.622198 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.622160    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5778934-eef1-4ea4-9e6c-d51eccd3a4c3" containerName="maas-api"
Sep 10 13:30:20.626944 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.626919    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.630167 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.630139    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 13:30:20.631252 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.631233    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-7b43a88f-gw-openshift-default-dockercfg-qnwtt\""
Sep 10 13:30:20.643821 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.643794    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"]
Sep 10 13:30:20.671534 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.671507    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-data\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.671699 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.671586    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-workload-certs\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.671699 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.671607    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istiod-ca-cert\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.671699 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.671643    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-podinfo\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.671699 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.671671    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-token\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.671699 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.671689    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-credential-socket\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.671986 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.671752    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj5zj\" (UniqueName: \"kubernetes.io/projected/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-kube-api-access-dj5zj\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.671986 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.671804    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-workload-socket\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.671986 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.671845    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-envoy\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.772829 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.772787    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-data\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.772999 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.772868    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-workload-certs\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.772999 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.772889    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istiod-ca-cert\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.772999 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.772950    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-podinfo\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.772999 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.772980    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-token\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.773240 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.773008    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-credential-socket\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.773240 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.773226    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-data\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.773347 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.773261    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-workload-certs\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.773448 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.773050    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj5zj\" (UniqueName: \"kubernetes.io/projected/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-kube-api-access-dj5zj\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.773448 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.773440    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-credential-socket\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.773661 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.773490    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-workload-socket\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.773661 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.773519    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-envoy\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.773741 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.773694    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istiod-ca-cert\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.773825 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.773806    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-workload-socket\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.775726 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.775706    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-envoy\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.776066 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.776046    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-podinfo\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.781936 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.781914    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj5zj\" (UniqueName: \"kubernetes.io/projected/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-kube-api-access-dj5zj\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.782049 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.781973    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-token\") pod \"e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") " pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:20.940329 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:20.940235    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:21.234448 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:21.234425    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"]
Sep 10 13:30:21.236760 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:30:21.236731    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da1a99c_c9e5_49c2_b0ed_c79641bda9b2.slice/crio-9bbd9bd38f6a32a96ed8c4190fdc2e9202512d215ba60aeaf0855d9b168a82b4 WatchSource:0}: Error finding container 9bbd9bd38f6a32a96ed8c4190fdc2e9202512d215ba60aeaf0855d9b168a82b4: Status 404 returned error can't find the container with id 9bbd9bd38f6a32a96ed8c4190fdc2e9202512d215ba60aeaf0855d9b168a82b4
Sep 10 13:30:21.614921 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:21.614885    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5778934-eef1-4ea4-9e6c-d51eccd3a4c3" path="/var/lib/kubelet/pods/a5778934-eef1-4ea4-9e6c-d51eccd3a4c3/volumes"
Sep 10 13:30:21.771425 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:21.771389    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" event={"ID":"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2","Type":"ContainerStarted","Data":"9bbd9bd38f6a32a96ed8c4190fdc2e9202512d215ba60aeaf0855d9b168a82b4"}
Sep 10 13:30:24.770185 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:24.770146    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:30:24.770417 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:24.770232    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:30:24.770417 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:24.770259    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:30:25.796500 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:25.796466    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" event={"ID":"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2","Type":"ContainerStarted","Data":"d5a75d4c2793a05de6d48b67c8cd5e873c37862e3852c108220ee48ec6f9ec17"}
Sep 10 13:30:25.824285 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:25.824229    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" podStartSLOduration=2.293525651 podStartE2EDuration="5.824212327s" totalImagesPullingTime="3.530686676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:30:25.821322728 +0000 UTC m=+820.706949777" watchObservedRunningTime="2026-09-10 13:30:25.824212327 +0000 UTC m=+820.709839375"
Sep 10 13:30:25.941388 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:25.941351    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:25.946942 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:25.946914    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:26.801592 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:26.801545    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:26.802639 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:26.802619    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:27.622919 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.622874    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"]
Sep 10 13:30:27.627083 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.627064    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:27.630236 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.630210    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-7b43a88f-serving-cert\""
Sep 10 13:30:27.656696 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.656668    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"]
Sep 10 13:30:27.739541 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.739506    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-metrics-certs\") pod \"maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:27.739778 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.739582    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-maas-api-tls\") pod \"maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:27.739778 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.739614    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlm98\" (UniqueName: \"kubernetes.io/projected/decc69ca-f435-4283-964f-02d47feb0dc2-kube-api-access-jlm98\") pod \"maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:27.739778 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.739657    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/decc69ca-f435-4283-964f-02d47feb0dc2-openshift-service-ca\") pod \"maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:27.841209 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.841178    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-metrics-certs\") pod \"maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:27.841709 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.841228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-maas-api-tls\") pod \"maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:27.841709 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.841269    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlm98\" (UniqueName: \"kubernetes.io/projected/decc69ca-f435-4283-964f-02d47feb0dc2-kube-api-access-jlm98\") pod \"maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:27.841709 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.841331    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/decc69ca-f435-4283-964f-02d47feb0dc2-openshift-service-ca\") pod \"maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:27.841709 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:30:27.841411    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-serving-cert: secret "maas-api-e2e-migrate-7b43a88f-serving-cert" not found
Sep 10 13:30:27.841709 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:30:27.841500    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-maas-api-tls podName:decc69ca-f435-4283-964f-02d47feb0dc2 nodeName:}" failed. No retries permitted until 2026-09-10 13:30:28.341479178 +0000 UTC m=+823.227106200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-maas-api-tls") pod "maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh" (UID: "decc69ca-f435-4283-964f-02d47feb0dc2") : secret "maas-api-e2e-migrate-7b43a88f-serving-cert" not found
Sep 10 13:30:27.842030 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.842012    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/decc69ca-f435-4283-964f-02d47feb0dc2-openshift-service-ca\") pod \"maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:27.843873 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.843850    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-metrics-certs\") pod \"maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:27.851682 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:27.851660    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlm98\" (UniqueName: \"kubernetes.io/projected/decc69ca-f435-4283-964f-02d47feb0dc2-kube-api-access-jlm98\") pod \"maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:28.346386 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:28.346347    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-maas-api-tls\") pod \"maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:28.349006 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:28.348983    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-maas-api-tls\") pod \"maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:28.538914 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:28.538885    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:28.836377 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:28.833267    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"]
Sep 10 13:30:28.839383 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:30:28.839344    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddecc69ca_f435_4283_964f_02d47feb0dc2.slice/crio-6370f63a78a9c88f51ab0b8fa97100d5e6487945631135f12957be4e90a3894f WatchSource:0}: Error finding container 6370f63a78a9c88f51ab0b8fa97100d5e6487945631135f12957be4e90a3894f: Status 404 returned error can't find the container with id 6370f63a78a9c88f51ab0b8fa97100d5e6487945631135f12957be4e90a3894f
Sep 10 13:30:29.820514 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:29.820419    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh" event={"ID":"decc69ca-f435-4283-964f-02d47feb0dc2","Type":"ContainerStarted","Data":"ee78adf0316a2525ebfad80d8a45237bc79264f878dbdb6f76928f7869bedaac"}
Sep 10 13:30:29.820514 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:29.820483    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh" event={"ID":"decc69ca-f435-4283-964f-02d47feb0dc2","Type":"ContainerStarted","Data":"6370f63a78a9c88f51ab0b8fa97100d5e6487945631135f12957be4e90a3894f"}
Sep 10 13:30:29.820959 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:29.820514    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:29.847317 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:29.847259    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh" podStartSLOduration=2.227034316 podStartE2EDuration="2.847242436s" totalImagesPullingTime="620.20812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:30:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:30:29.845443045 +0000 UTC m=+824.731070075" watchObservedRunningTime="2026-09-10 13:30:29.847242436 +0000 UTC m=+824.732869464"
Sep 10 13:30:35.841652 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:35.841622    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:42.842781 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:42.842735    2584 patch_prober.go:28] interesting pod/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 13:30:42.843169 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:42.842821    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 13:30:43.904829 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:43.904741    2584 generic.go:356] "Generic (PLEG): container finished" podID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerID="d5a75d4c2793a05de6d48b67c8cd5e873c37862e3852c108220ee48ec6f9ec17" exitCode=0
Sep 10 13:30:43.904829 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:43.904811    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" event={"ID":"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2","Type":"ContainerDied","Data":"d5a75d4c2793a05de6d48b67c8cd5e873c37862e3852c108220ee48ec6f9ec17"}
Sep 10 13:30:43.905326 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:43.905306    2584 scope.go:117] "RemoveContainer" containerID="d5a75d4c2793a05de6d48b67c8cd5e873c37862e3852c108220ee48ec6f9ec17"
Sep 10 13:30:43.907480 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:43.907448    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:30:43.907601 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:43.907530    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:30:43.907677 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:43.907607    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:30:44.912333 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:44.912298    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" event={"ID":"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2","Type":"ContainerStarted","Data":"6d313ecba0cf952893ebee377a0ffd4bfee2afbcea6084b46acc3b8d06f8451d"}
Sep 10 13:30:44.944621 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:44.944587    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:44.944874 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:44.944838    2584 patch_prober.go:28] interesting pod/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 10 13:30:44.945026 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:44.944898    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 10 13:30:45.941920 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:45.941817    2584 patch_prober.go:28] interesting pod/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 10 13:30:45.942708 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:45.942673    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 10 13:30:46.941515 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:46.941475    2584 patch_prober.go:28] interesting pod/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 10 13:30:46.942159 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:46.942127    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 10 13:30:47.941448 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:47.941409    2584 patch_prober.go:28] interesting pod/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 10 13:30:47.941816 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:47.941782    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 10 13:30:48.940894 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:48.940854    2584 patch_prober.go:28] interesting pod/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 10 13:30:48.941921 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:48.941482    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 10 13:30:49.940811 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:49.940773    2584 patch_prober.go:28] interesting pod/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 10 13:30:49.941109 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:49.941080    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 10 13:30:50.944436 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:50.944404    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:50.944937 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:50.944805    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:50.945500 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:50.945480    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:30:59.459697 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.459656    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"]
Sep 10 13:30:59.460247 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.459863    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh" podUID="decc69ca-f435-4283-964f-02d47feb0dc2" containerName="maas-api" containerID="cri-o://ee78adf0316a2525ebfad80d8a45237bc79264f878dbdb6f76928f7869bedaac" gracePeriod=30
Sep 10 13:30:59.734501 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.734466    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:30:59.760835 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.760809    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlm98\" (UniqueName: \"kubernetes.io/projected/decc69ca-f435-4283-964f-02d47feb0dc2-kube-api-access-jlm98\") pod \"decc69ca-f435-4283-964f-02d47feb0dc2\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") "
Sep 10 13:30:59.760991 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.760853    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/decc69ca-f435-4283-964f-02d47feb0dc2-openshift-service-ca\") pod \"decc69ca-f435-4283-964f-02d47feb0dc2\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") "
Sep 10 13:30:59.760991 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.760943    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-metrics-certs\") pod \"decc69ca-f435-4283-964f-02d47feb0dc2\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") "
Sep 10 13:30:59.760991 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.760971    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-maas-api-tls\") pod \"decc69ca-f435-4283-964f-02d47feb0dc2\" (UID: \"decc69ca-f435-4283-964f-02d47feb0dc2\") "
Sep 10 13:30:59.761238 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.761211    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/decc69ca-f435-4283-964f-02d47feb0dc2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "decc69ca-f435-4283-964f-02d47feb0dc2" (UID: "decc69ca-f435-4283-964f-02d47feb0dc2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:30:59.763144 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.763113    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "decc69ca-f435-4283-964f-02d47feb0dc2" (UID: "decc69ca-f435-4283-964f-02d47feb0dc2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:30:59.763242 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.763152    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "decc69ca-f435-4283-964f-02d47feb0dc2" (UID: "decc69ca-f435-4283-964f-02d47feb0dc2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:30:59.763242 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.763173    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/decc69ca-f435-4283-964f-02d47feb0dc2-kube-api-access-jlm98" (OuterVolumeSpecName: "kube-api-access-jlm98") pod "decc69ca-f435-4283-964f-02d47feb0dc2" (UID: "decc69ca-f435-4283-964f-02d47feb0dc2"). InnerVolumeSpecName "kube-api-access-jlm98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:30:59.861889 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.861855    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:30:59.861889 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.861883    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/decc69ca-f435-4283-964f-02d47feb0dc2-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:30:59.861889 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.861892    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlm98\" (UniqueName: \"kubernetes.io/projected/decc69ca-f435-4283-964f-02d47feb0dc2-kube-api-access-jlm98\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:30:59.862124 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:30:59.861903    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/decc69ca-f435-4283-964f-02d47feb0dc2-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:00.021940 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:00.021848    2584 generic.go:356] "Generic (PLEG): container finished" podID="decc69ca-f435-4283-964f-02d47feb0dc2" containerID="ee78adf0316a2525ebfad80d8a45237bc79264f878dbdb6f76928f7869bedaac" exitCode=0
Sep 10 13:31:00.021940 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:00.021902    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"
Sep 10 13:31:00.022172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:00.021942    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh" event={"ID":"decc69ca-f435-4283-964f-02d47feb0dc2","Type":"ContainerDied","Data":"ee78adf0316a2525ebfad80d8a45237bc79264f878dbdb6f76928f7869bedaac"}
Sep 10 13:31:00.022172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:00.022010    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh" event={"ID":"decc69ca-f435-4283-964f-02d47feb0dc2","Type":"ContainerDied","Data":"6370f63a78a9c88f51ab0b8fa97100d5e6487945631135f12957be4e90a3894f"}
Sep 10 13:31:00.022172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:00.022044    2584 scope.go:117] "RemoveContainer" containerID="ee78adf0316a2525ebfad80d8a45237bc79264f878dbdb6f76928f7869bedaac"
Sep 10 13:31:00.032464 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:00.032444    2584 scope.go:117] "RemoveContainer" containerID="ee78adf0316a2525ebfad80d8a45237bc79264f878dbdb6f76928f7869bedaac"
Sep 10 13:31:00.032817 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:31:00.032797    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee78adf0316a2525ebfad80d8a45237bc79264f878dbdb6f76928f7869bedaac\": container with ID starting with ee78adf0316a2525ebfad80d8a45237bc79264f878dbdb6f76928f7869bedaac not found: ID does not exist" containerID="ee78adf0316a2525ebfad80d8a45237bc79264f878dbdb6f76928f7869bedaac"
Sep 10 13:31:00.032894 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:00.032826    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee78adf0316a2525ebfad80d8a45237bc79264f878dbdb6f76928f7869bedaac"} err="failed to get container status \"ee78adf0316a2525ebfad80d8a45237bc79264f878dbdb6f76928f7869bedaac\": rpc error: code = NotFound desc = could not find container \"ee78adf0316a2525ebfad80d8a45237bc79264f878dbdb6f76928f7869bedaac\": container with ID starting with ee78adf0316a2525ebfad80d8a45237bc79264f878dbdb6f76928f7869bedaac not found: ID does not exist"
Sep 10 13:31:00.110017 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:00.109984    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"]
Sep 10 13:31:00.132481 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:00.132446    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7b43a88f-786ff47448-8cclh"]
Sep 10 13:31:00.792761 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:00.792727    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"]
Sep 10 13:31:00.793198 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:00.792936    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy" containerID="cri-o://6d313ecba0cf952893ebee377a0ffd4bfee2afbcea6084b46acc3b8d06f8451d" gracePeriod=30
Sep 10 13:31:01.614568 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:01.614532    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="decc69ca-f435-4283-964f-02d47feb0dc2" path="/var/lib/kubelet/pods/decc69ca-f435-4283-964f-02d47feb0dc2/volumes"
Sep 10 13:31:05.750854 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.750811    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"]
Sep 10 13:31:05.751841 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.751816    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="decc69ca-f435-4283-964f-02d47feb0dc2" containerName="maas-api"
Sep 10 13:31:05.751841 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.751841    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="decc69ca-f435-4283-964f-02d47feb0dc2" containerName="maas-api"
Sep 10 13:31:05.752076 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.752062    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="decc69ca-f435-4283-964f-02d47feb0dc2" containerName="maas-api"
Sep 10 13:31:05.756283 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.756259    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:05.759791 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.759771    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-300680f3-serving-cert\""
Sep 10 13:31:05.819636 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.819590    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac3eeaf-902d-468e-bc81-5cf1098c5735-openshift-service-ca\") pod \"maas-api-e2e-ait-300680f3-7955f787d-ppgxd\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:05.819788 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.819738    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rmxb\" (UniqueName: \"kubernetes.io/projected/0ac3eeaf-902d-468e-bc81-5cf1098c5735-kube-api-access-9rmxb\") pod \"maas-api-e2e-ait-300680f3-7955f787d-ppgxd\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:05.819874 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.819859    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ac3eeaf-902d-468e-bc81-5cf1098c5735-metrics-certs\") pod \"maas-api-e2e-ait-300680f3-7955f787d-ppgxd\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:05.819932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.819895    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac3eeaf-902d-468e-bc81-5cf1098c5735-maas-api-tls\") pod \"maas-api-e2e-ait-300680f3-7955f787d-ppgxd\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:05.823492 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.823468    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"]
Sep 10 13:31:05.920590 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.920529    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ac3eeaf-902d-468e-bc81-5cf1098c5735-metrics-certs\") pod \"maas-api-e2e-ait-300680f3-7955f787d-ppgxd\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:05.920782 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.920620    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac3eeaf-902d-468e-bc81-5cf1098c5735-maas-api-tls\") pod \"maas-api-e2e-ait-300680f3-7955f787d-ppgxd\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:05.920782 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.920702    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac3eeaf-902d-468e-bc81-5cf1098c5735-openshift-service-ca\") pod \"maas-api-e2e-ait-300680f3-7955f787d-ppgxd\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:05.920782 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.920762    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rmxb\" (UniqueName: \"kubernetes.io/projected/0ac3eeaf-902d-468e-bc81-5cf1098c5735-kube-api-access-9rmxb\") pod \"maas-api-e2e-ait-300680f3-7955f787d-ppgxd\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:05.921848 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.921792    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac3eeaf-902d-468e-bc81-5cf1098c5735-openshift-service-ca\") pod \"maas-api-e2e-ait-300680f3-7955f787d-ppgxd\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:05.923339 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.923313    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac3eeaf-902d-468e-bc81-5cf1098c5735-maas-api-tls\") pod \"maas-api-e2e-ait-300680f3-7955f787d-ppgxd\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:05.923520 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.923497    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ac3eeaf-902d-468e-bc81-5cf1098c5735-metrics-certs\") pod \"maas-api-e2e-ait-300680f3-7955f787d-ppgxd\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:05.938088 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.938054    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rmxb\" (UniqueName: \"kubernetes.io/projected/0ac3eeaf-902d-468e-bc81-5cf1098c5735-kube-api-access-9rmxb\") pod \"maas-api-e2e-ait-300680f3-7955f787d-ppgxd\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:05.946276 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.946233    2584 patch_prober.go:28] interesting pod/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 10 13:31:05.946428 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:05.946304    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 10 13:31:06.058130 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.058100    2584 generic.go:356] "Generic (PLEG): container finished" podID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerID="6d313ecba0cf952893ebee377a0ffd4bfee2afbcea6084b46acc3b8d06f8451d" exitCode=0
Sep 10 13:31:06.058276 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.058176    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" event={"ID":"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2","Type":"ContainerDied","Data":"6d313ecba0cf952893ebee377a0ffd4bfee2afbcea6084b46acc3b8d06f8451d"}
Sep 10 13:31:06.058276 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.058242    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62" event={"ID":"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2","Type":"ContainerDied","Data":"9bbd9bd38f6a32a96ed8c4190fdc2e9202512d215ba60aeaf0855d9b168a82b4"}
Sep 10 13:31:06.058276 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.058259    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bbd9bd38f6a32a96ed8c4190fdc2e9202512d215ba60aeaf0855d9b168a82b4"
Sep 10 13:31:06.058276 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.058273    2584 scope.go:117] "RemoveContainer" containerID="d5a75d4c2793a05de6d48b67c8cd5e873c37862e3852c108220ee48ec6f9ec17"
Sep 10 13:31:06.061018 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.060998    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:31:06.067499 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.067480    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.122217    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-workload-certs\") pod \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") "
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.122298    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj5zj\" (UniqueName: \"kubernetes.io/projected/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-kube-api-access-dj5zj\") pod \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") "
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.122328    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-envoy\") pod \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") "
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.122389    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-data\") pod \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") "
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.122437    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-credential-socket\") pod \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") "
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.122473    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-podinfo\") pod \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") "
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.122507    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-token\") pod \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") "
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.122583    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istiod-ca-cert\") pod \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") "
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.122608    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-workload-socket\") pod \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\" (UID: \"2da1a99c-c9e5-49c2-b0ed-c79641bda9b2\") "
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.123204    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" (UID: "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.123816    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" (UID: "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.123902    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-data" (OuterVolumeSpecName: "istio-data") pod "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" (UID: "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.124058    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" (UID: "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.124339    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" (UID: "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.127247    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" (UID: "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.127489    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" (UID: "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:31:06.130815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.129164    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" (UID: "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 13:31:06.132771 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.132740    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-kube-api-access-dj5zj" (OuterVolumeSpecName: "kube-api-access-dj5zj") pod "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" (UID: "2da1a99c-c9e5-49c2-b0ed-c79641bda9b2"). InnerVolumeSpecName "kube-api-access-dj5zj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:31:06.223863 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.223827    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj5zj\" (UniqueName: \"kubernetes.io/projected/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-kube-api-access-dj5zj\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:06.223863 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.223857    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-envoy\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:06.223863 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.223870    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-data\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:06.224117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.223878    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-credential-socket\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:06.224117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.223886    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-podinfo\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:06.224117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.223894    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istio-token\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:06.224117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.223902    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-istiod-ca-cert\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:06.224117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.223911    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-workload-socket\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:06.224117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.223918    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2-workload-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:06.374383 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:06.374302    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"]
Sep 10 13:31:06.376733 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:31:06.376705    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac3eeaf_902d_468e_bc81_5cf1098c5735.slice/crio-2fa4406de5ce69de41185ca4f68c3d3d74fa5043bb054a3ac45f214f9ea5d65b WatchSource:0}: Error finding container 2fa4406de5ce69de41185ca4f68c3d3d74fa5043bb054a3ac45f214f9ea5d65b: Status 404 returned error can't find the container with id 2fa4406de5ce69de41185ca4f68c3d3d74fa5043bb054a3ac45f214f9ea5d65b
Sep 10 13:31:07.065757 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:07.065728    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"
Sep 10 13:31:07.067078 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:07.067046    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd" event={"ID":"0ac3eeaf-902d-468e-bc81-5cf1098c5735","Type":"ContainerStarted","Data":"2fa4406de5ce69de41185ca4f68c3d3d74fa5043bb054a3ac45f214f9ea5d65b"}
Sep 10 13:31:07.139147 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:07.139115    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"]
Sep 10 13:31:07.160279 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:07.160246    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-7b43a88f-gw-openshift-default-79f5b46556-j9t62"]
Sep 10 13:31:07.614693 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:07.614656    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" path="/var/lib/kubelet/pods/2da1a99c-c9e5-49c2-b0ed-c79641bda9b2/volumes"
Sep 10 13:31:09.080671 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:09.080631    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd" event={"ID":"0ac3eeaf-902d-468e-bc81-5cf1098c5735","Type":"ContainerStarted","Data":"981593ca0a19422ce8cdce49eacf26884b6637e07120b11352d99d911f552d10"}
Sep 10 13:31:09.081142 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:09.080713    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:09.123817 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:09.123765    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd" podStartSLOduration=2.487472993 podStartE2EDuration="4.123746571s" totalImagesPullingTime="1.636273578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:31:09.122012224 +0000 UTC m=+864.007639252" watchObservedRunningTime="2026-09-10 13:31:09.123746571 +0000 UTC m=+864.009373598"
Sep 10 13:31:15.092015 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:15.091979    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:35.076541 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.076501    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"]
Sep 10 13:31:35.077197 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.076791    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5" podUID="37e903c2-2201-40d9-9d9a-9a93b784dde0" containerName="maas-api" containerID="cri-o://4fc5b68914ee4113c8c56e33d3c8fb2e156c41b42bb83623422d20eccfe1b7dd" gracePeriod=30
Sep 10 13:31:35.229365 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.229323    2584 generic.go:356] "Generic (PLEG): container finished" podID="37e903c2-2201-40d9-9d9a-9a93b784dde0" containerID="4fc5b68914ee4113c8c56e33d3c8fb2e156c41b42bb83623422d20eccfe1b7dd" exitCode=0
Sep 10 13:31:35.229575 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.229519    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5" event={"ID":"37e903c2-2201-40d9-9d9a-9a93b784dde0","Type":"ContainerDied","Data":"4fc5b68914ee4113c8c56e33d3c8fb2e156c41b42bb83623422d20eccfe1b7dd"}
Sep 10 13:31:35.362509 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.362480    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:31:35.403375 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.403342    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-metrics-certs\") pod \"37e903c2-2201-40d9-9d9a-9a93b784dde0\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") "
Sep 10 13:31:35.403588 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.403415    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvl28\" (UniqueName: \"kubernetes.io/projected/37e903c2-2201-40d9-9d9a-9a93b784dde0-kube-api-access-qvl28\") pod \"37e903c2-2201-40d9-9d9a-9a93b784dde0\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") "
Sep 10 13:31:35.403588 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.403451    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-maas-api-tls\") pod \"37e903c2-2201-40d9-9d9a-9a93b784dde0\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") "
Sep 10 13:31:35.403588 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.403576    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e903c2-2201-40d9-9d9a-9a93b784dde0-openshift-service-ca\") pod \"37e903c2-2201-40d9-9d9a-9a93b784dde0\" (UID: \"37e903c2-2201-40d9-9d9a-9a93b784dde0\") "
Sep 10 13:31:35.404137 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.404106    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37e903c2-2201-40d9-9d9a-9a93b784dde0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "37e903c2-2201-40d9-9d9a-9a93b784dde0" (UID: "37e903c2-2201-40d9-9d9a-9a93b784dde0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:31:35.405943 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.405906    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "37e903c2-2201-40d9-9d9a-9a93b784dde0" (UID: "37e903c2-2201-40d9-9d9a-9a93b784dde0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:31:35.406276 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.406252    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e903c2-2201-40d9-9d9a-9a93b784dde0-kube-api-access-qvl28" (OuterVolumeSpecName: "kube-api-access-qvl28") pod "37e903c2-2201-40d9-9d9a-9a93b784dde0" (UID: "37e903c2-2201-40d9-9d9a-9a93b784dde0"). InnerVolumeSpecName "kube-api-access-qvl28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:31:35.406387 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.406372    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "37e903c2-2201-40d9-9d9a-9a93b784dde0" (UID: "37e903c2-2201-40d9-9d9a-9a93b784dde0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:31:35.504906 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.504872    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e903c2-2201-40d9-9d9a-9a93b784dde0-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:35.504906 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.504900    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:35.504906 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.504911    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvl28\" (UniqueName: \"kubernetes.io/projected/37e903c2-2201-40d9-9d9a-9a93b784dde0-kube-api-access-qvl28\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:35.504906 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:35.504919    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37e903c2-2201-40d9-9d9a-9a93b784dde0-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:36.237262 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:36.237228    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"
Sep 10 13:31:36.237262 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:36.237252    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5" event={"ID":"37e903c2-2201-40d9-9d9a-9a93b784dde0","Type":"ContainerDied","Data":"b37fe8fedb5ae4c4de8ce48f6d1ddc90a235c56d69af4005ee6bc7cb75be8e9d"}
Sep 10 13:31:36.237842 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:36.237317    2584 scope.go:117] "RemoveContainer" containerID="4fc5b68914ee4113c8c56e33d3c8fb2e156c41b42bb83623422d20eccfe1b7dd"
Sep 10 13:31:36.263732 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:36.263700    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"]
Sep 10 13:31:36.269161 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:36.269132    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-af59ca-58bb86b7c4-8v4c5"]
Sep 10 13:31:36.653358 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:36.653327    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"]
Sep 10 13:31:36.653579 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:36.653543    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd" podUID="0ac3eeaf-902d-468e-bc81-5cf1098c5735" containerName="maas-api" containerID="cri-o://981593ca0a19422ce8cdce49eacf26884b6637e07120b11352d99d911f552d10" gracePeriod=30
Sep 10 13:31:36.913748 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:36.913680    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:37.019046 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.019018    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac3eeaf-902d-468e-bc81-5cf1098c5735-maas-api-tls\") pod \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") "
Sep 10 13:31:37.019211 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.019067    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rmxb\" (UniqueName: \"kubernetes.io/projected/0ac3eeaf-902d-468e-bc81-5cf1098c5735-kube-api-access-9rmxb\") pod \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") "
Sep 10 13:31:37.019211 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.019115    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ac3eeaf-902d-468e-bc81-5cf1098c5735-metrics-certs\") pod \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") "
Sep 10 13:31:37.019211 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.019162    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac3eeaf-902d-468e-bc81-5cf1098c5735-openshift-service-ca\") pod \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\" (UID: \"0ac3eeaf-902d-468e-bc81-5cf1098c5735\") "
Sep 10 13:31:37.019655 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.019625    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ac3eeaf-902d-468e-bc81-5cf1098c5735-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0ac3eeaf-902d-468e-bc81-5cf1098c5735" (UID: "0ac3eeaf-902d-468e-bc81-5cf1098c5735"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:31:37.022816 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.021648    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ac3eeaf-902d-468e-bc81-5cf1098c5735-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0ac3eeaf-902d-468e-bc81-5cf1098c5735" (UID: "0ac3eeaf-902d-468e-bc81-5cf1098c5735"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:31:37.022816 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.021773    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac3eeaf-902d-468e-bc81-5cf1098c5735-kube-api-access-9rmxb" (OuterVolumeSpecName: "kube-api-access-9rmxb") pod "0ac3eeaf-902d-468e-bc81-5cf1098c5735" (UID: "0ac3eeaf-902d-468e-bc81-5cf1098c5735"). InnerVolumeSpecName "kube-api-access-9rmxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:31:37.023343 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.023315    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ac3eeaf-902d-468e-bc81-5cf1098c5735-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0ac3eeaf-902d-468e-bc81-5cf1098c5735" (UID: "0ac3eeaf-902d-468e-bc81-5cf1098c5735"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:31:37.120817 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.120770    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac3eeaf-902d-468e-bc81-5cf1098c5735-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:37.120817 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.120810    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rmxb\" (UniqueName: \"kubernetes.io/projected/0ac3eeaf-902d-468e-bc81-5cf1098c5735-kube-api-access-9rmxb\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:37.120817 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.120826    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ac3eeaf-902d-468e-bc81-5cf1098c5735-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:37.121136 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.120838    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac3eeaf-902d-468e-bc81-5cf1098c5735-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:31:37.245904 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.245810    2584 generic.go:356] "Generic (PLEG): container finished" podID="0ac3eeaf-902d-468e-bc81-5cf1098c5735" containerID="981593ca0a19422ce8cdce49eacf26884b6637e07120b11352d99d911f552d10" exitCode=0
Sep 10 13:31:37.245904 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.245855    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"
Sep 10 13:31:37.245904 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.245890    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd" event={"ID":"0ac3eeaf-902d-468e-bc81-5cf1098c5735","Type":"ContainerDied","Data":"981593ca0a19422ce8cdce49eacf26884b6637e07120b11352d99d911f552d10"}
Sep 10 13:31:37.246449 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.245939    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd" event={"ID":"0ac3eeaf-902d-468e-bc81-5cf1098c5735","Type":"ContainerDied","Data":"2fa4406de5ce69de41185ca4f68c3d3d74fa5043bb054a3ac45f214f9ea5d65b"}
Sep 10 13:31:37.246449 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.245963    2584 scope.go:117] "RemoveContainer" containerID="981593ca0a19422ce8cdce49eacf26884b6637e07120b11352d99d911f552d10"
Sep 10 13:31:37.256042 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.256025    2584 scope.go:117] "RemoveContainer" containerID="981593ca0a19422ce8cdce49eacf26884b6637e07120b11352d99d911f552d10"
Sep 10 13:31:37.256310 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:31:37.256295    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"981593ca0a19422ce8cdce49eacf26884b6637e07120b11352d99d911f552d10\": container with ID starting with 981593ca0a19422ce8cdce49eacf26884b6637e07120b11352d99d911f552d10 not found: ID does not exist" containerID="981593ca0a19422ce8cdce49eacf26884b6637e07120b11352d99d911f552d10"
Sep 10 13:31:37.256361 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.256318    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"981593ca0a19422ce8cdce49eacf26884b6637e07120b11352d99d911f552d10"} err="failed to get container status \"981593ca0a19422ce8cdce49eacf26884b6637e07120b11352d99d911f552d10\": rpc error: code = NotFound desc = could not find container \"981593ca0a19422ce8cdce49eacf26884b6637e07120b11352d99d911f552d10\": container with ID starting with 981593ca0a19422ce8cdce49eacf26884b6637e07120b11352d99d911f552d10 not found: ID does not exist"
Sep 10 13:31:37.269736 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.269706    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"]
Sep 10 13:31:37.274024 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.273999    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-300680f3-7955f787d-ppgxd"]
Sep 10 13:31:37.613517 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.613483    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ac3eeaf-902d-468e-bc81-5cf1098c5735" path="/var/lib/kubelet/pods/0ac3eeaf-902d-468e-bc81-5cf1098c5735/volumes"
Sep 10 13:31:37.613886 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:37.613870    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37e903c2-2201-40d9-9d9a-9a93b784dde0" path="/var/lib/kubelet/pods/37e903c2-2201-40d9-9d9a-9a93b784dde0/volumes"
Sep 10 13:31:38.916109 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.916072    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"]
Sep 10 13:31:38.916789 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.916768    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy"
Sep 10 13:31:38.916874 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.916793    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy"
Sep 10 13:31:38.916874 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.916823    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e903c2-2201-40d9-9d9a-9a93b784dde0" containerName="maas-api"
Sep 10 13:31:38.916874 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.916832    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e903c2-2201-40d9-9d9a-9a93b784dde0" containerName="maas-api"
Sep 10 13:31:38.916874 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.916840    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac3eeaf-902d-468e-bc81-5cf1098c5735" containerName="maas-api"
Sep 10 13:31:38.916874 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.916849    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac3eeaf-902d-468e-bc81-5cf1098c5735" containerName="maas-api"
Sep 10 13:31:38.917142 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.916879    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy"
Sep 10 13:31:38.917142 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.916888    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy"
Sep 10 13:31:38.917142 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.916982    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e903c2-2201-40d9-9d9a-9a93b784dde0" containerName="maas-api"
Sep 10 13:31:38.917142 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.916994    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ac3eeaf-902d-468e-bc81-5cf1098c5735" containerName="maas-api"
Sep 10 13:31:38.917142 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.917006    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy"
Sep 10 13:31:38.917142 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.917018    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2da1a99c-c9e5-49c2-b0ed-c79641bda9b2" containerName="istio-proxy"
Sep 10 13:31:38.920901 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.920880    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:38.924688 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.924663    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-d46083cd-openshift-default-dockercfg-ddfn6\""
Sep 10 13:31:38.924859 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.924676    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 13:31:38.937016 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.936966    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-token\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:38.937172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.937038    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-workload-certs\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:38.937172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.937067    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn8hf\" (UniqueName: \"kubernetes.io/projected/9874f8ab-1fde-4be5-947b-64b8902c6914-kube-api-access-xn8hf\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:38.937293 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.937198    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-credential-socket\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:38.937349 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.937315    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-envoy\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:38.937408 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.937352    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-data\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:38.937408 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.937395    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9874f8ab-1fde-4be5-947b-64b8902c6914-istiod-ca-cert\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:38.937514 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.937423    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-workload-socket\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:38.937514 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.937452    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-podinfo\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:38.938169 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:38.938151    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"]
Sep 10 13:31:39.038477 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.038442    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-envoy\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.038477 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.038479    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-data\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.038760 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.038515    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9874f8ab-1fde-4be5-947b-64b8902c6914-istiod-ca-cert\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.038760 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.038541    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-workload-socket\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.038760 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.038585    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-podinfo\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.038760 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.038632    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-token\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.038760 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.038661    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-workload-certs\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.038760 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.038683    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn8hf\" (UniqueName: \"kubernetes.io/projected/9874f8ab-1fde-4be5-947b-64b8902c6914-kube-api-access-xn8hf\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.038760 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.038730    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-credential-socket\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.039115 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.038921    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-data\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.039115 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.039082    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-credential-socket\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.039228 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.039157    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-workload-certs\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.039608 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.039583    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9874f8ab-1fde-4be5-947b-64b8902c6914-istiod-ca-cert\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.039782 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.039762    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-workload-socket\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.041168 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.041143    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-envoy\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.041855 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.041836    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-podinfo\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.053717 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.053691    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-token\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.057976 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.057950    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn8hf\" (UniqueName: \"kubernetes.io/projected/9874f8ab-1fde-4be5-947b-64b8902c6914-kube-api-access-xn8hf\") pod \"e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") " pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.233882 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.233776    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:39.515186 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.515160    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"]
Sep 10 13:31:39.516681 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:31:39.516656    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9874f8ab_1fde_4be5_947b_64b8902c6914.slice/crio-1ac4946373a5da1035cecc70975572983e3bef4dc9a36a4ba330b08553821870 WatchSource:0}: Error finding container 1ac4946373a5da1035cecc70975572983e3bef4dc9a36a4ba330b08553821870: Status 404 returned error can't find the container with id 1ac4946373a5da1035cecc70975572983e3bef4dc9a36a4ba330b08553821870
Sep 10 13:31:39.518869 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.518834    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:31:39.518941 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.518910    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:31:39.518990 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:39.518939    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:31:40.265710 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:40.265678    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz" event={"ID":"9874f8ab-1fde-4be5-947b-64b8902c6914","Type":"ContainerStarted","Data":"d4d15f58a631c8a5731e7bcb4b7021cee916b2f3a7e4682ea3135f8129ad44d2"}
Sep 10 13:31:40.266116 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:40.265738    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz" event={"ID":"9874f8ab-1fde-4be5-947b-64b8902c6914","Type":"ContainerStarted","Data":"1ac4946373a5da1035cecc70975572983e3bef4dc9a36a4ba330b08553821870"}
Sep 10 13:31:40.298954 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:40.298894    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz" podStartSLOduration=2.298873264 podStartE2EDuration="2.298873264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:31:40.298644704 +0000 UTC m=+895.184271732" watchObservedRunningTime="2026-09-10 13:31:40.298873264 +0000 UTC m=+895.184500293"
Sep 10 13:31:41.234876 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:41.234845    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:41.240518 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:41.240493    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:41.271602 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:41.271541    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:41.272650 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:41.272631    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:42.972465 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:42.972422    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"]
Sep 10 13:31:42.976292 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:42.976267    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:42.980412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:42.980386    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-d46083cd-serving-cert\""
Sep 10 13:31:42.993475 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:42.993434    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"]
Sep 10 13:31:43.078157 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:43.078112    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-metrics-certs\") pod \"maas-api-e2e-derive-d46083cd-687c4965f-l6n9h\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:43.078350 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:43.078249    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-maas-api-tls\") pod \"maas-api-e2e-derive-d46083cd-687c4965f-l6n9h\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:43.078350 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:43.078286    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqlnc\" (UniqueName: \"kubernetes.io/projected/110114a1-730e-45c7-a207-9303147c4fb1-kube-api-access-lqlnc\") pod \"maas-api-e2e-derive-d46083cd-687c4965f-l6n9h\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:43.078350 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:43.078308    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/110114a1-730e-45c7-a207-9303147c4fb1-openshift-service-ca\") pod \"maas-api-e2e-derive-d46083cd-687c4965f-l6n9h\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:43.179712 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:43.179668    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-maas-api-tls\") pod \"maas-api-e2e-derive-d46083cd-687c4965f-l6n9h\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:43.179712 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:43.179721    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqlnc\" (UniqueName: \"kubernetes.io/projected/110114a1-730e-45c7-a207-9303147c4fb1-kube-api-access-lqlnc\") pod \"maas-api-e2e-derive-d46083cd-687c4965f-l6n9h\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:43.179993 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:43.179742    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/110114a1-730e-45c7-a207-9303147c4fb1-openshift-service-ca\") pod \"maas-api-e2e-derive-d46083cd-687c4965f-l6n9h\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:43.179993 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:43.179801    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-metrics-certs\") pod \"maas-api-e2e-derive-d46083cd-687c4965f-l6n9h\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:43.179993 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:31:43.179846    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-serving-cert: secret "maas-api-e2e-derive-d46083cd-serving-cert" not found
Sep 10 13:31:43.179993 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:31:43.179918    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-maas-api-tls podName:110114a1-730e-45c7-a207-9303147c4fb1 nodeName:}" failed. No retries permitted until 2026-09-10 13:31:43.679899249 +0000 UTC m=+898.565526262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-maas-api-tls") pod "maas-api-e2e-derive-d46083cd-687c4965f-l6n9h" (UID: "110114a1-730e-45c7-a207-9303147c4fb1") : secret "maas-api-e2e-derive-d46083cd-serving-cert" not found
Sep 10 13:31:43.180565 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:43.180525    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/110114a1-730e-45c7-a207-9303147c4fb1-openshift-service-ca\") pod \"maas-api-e2e-derive-d46083cd-687c4965f-l6n9h\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:43.182600 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:43.182575    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-metrics-certs\") pod \"maas-api-e2e-derive-d46083cd-687c4965f-l6n9h\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:43.191708 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:43.191686    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqlnc\" (UniqueName: \"kubernetes.io/projected/110114a1-730e-45c7-a207-9303147c4fb1-kube-api-access-lqlnc\") pod \"maas-api-e2e-derive-d46083cd-687c4965f-l6n9h\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:43.684638 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:43.684607    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-maas-api-tls\") pod \"maas-api-e2e-derive-d46083cd-687c4965f-l6n9h\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:43.687423 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:43.687395    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-maas-api-tls\") pod \"maas-api-e2e-derive-d46083cd-687c4965f-l6n9h\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:43.890078 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:43.890041    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:44.181450 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:44.181414    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"]
Sep 10 13:31:44.184895 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:31:44.184866    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod110114a1_730e_45c7_a207_9303147c4fb1.slice/crio-11c89fa213b1da2158b4aedcbecdae0f1b827cf2e349cabb12d4452cc1e8441d WatchSource:0}: Error finding container 11c89fa213b1da2158b4aedcbecdae0f1b827cf2e349cabb12d4452cc1e8441d: Status 404 returned error can't find the container with id 11c89fa213b1da2158b4aedcbecdae0f1b827cf2e349cabb12d4452cc1e8441d
Sep 10 13:31:44.292608 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:44.292490    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h" event={"ID":"110114a1-730e-45c7-a207-9303147c4fb1","Type":"ContainerStarted","Data":"11c89fa213b1da2158b4aedcbecdae0f1b827cf2e349cabb12d4452cc1e8441d"}
Sep 10 13:31:45.299723 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:45.299686    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h" event={"ID":"110114a1-730e-45c7-a207-9303147c4fb1","Type":"ContainerStarted","Data":"6abad44dc8a9738d338c874ff0fe8859afca7d4709e5a6cb91a1fc431a7c7570"}
Sep 10 13:31:45.300134 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:45.299749    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:45.372978 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:45.372926    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h" podStartSLOduration=2.858310577 podStartE2EDuration="3.372908978s" totalImagesPullingTime="514.598401ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:31:45.368395606 +0000 UTC m=+900.254022635" watchObservedRunningTime="2026-09-10 13:31:45.372908978 +0000 UTC m=+900.258536054"
Sep 10 13:31:45.617779 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:45.617753    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:31:45.618829 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:45.618807    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:31:45.624532 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:45.624509    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:31:45.625297 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:45.625276    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:31:51.311603 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.311569    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:31:51.488262 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.488224    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"]
Sep 10 13:31:51.492192 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.492168    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:51.494910 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.494883    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-a26db0-serving-cert\""
Sep 10 13:31:51.507617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.507589    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"]
Sep 10 13:31:51.571406 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.571309    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-maas-api-tls\") pod \"maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:51.571406 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.571365    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-metrics-certs\") pod \"maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:51.571648 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.571418    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw7rp\" (UniqueName: \"kubernetes.io/projected/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-kube-api-access-kw7rp\") pod \"maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:51.571648 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.571507    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-openshift-service-ca\") pod \"maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:51.672321 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.672279    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-maas-api-tls\") pod \"maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:51.672529 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.672330    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-metrics-certs\") pod \"maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:51.672529 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.672365    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw7rp\" (UniqueName: \"kubernetes.io/projected/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-kube-api-access-kw7rp\") pod \"maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:51.672529 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:31:51.672441    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-serving-cert: secret "maas-api-e2e-explicit-a26db0-serving-cert" not found
Sep 10 13:31:51.672529 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:31:51.672517    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-maas-api-tls podName:1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd nodeName:}" failed. No retries permitted until 2026-09-10 13:31:52.17249723 +0000 UTC m=+907.058124252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-maas-api-tls") pod "maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps" (UID: "1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd") : secret "maas-api-e2e-explicit-a26db0-serving-cert" not found
Sep 10 13:31:51.672785 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.672549    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-openshift-service-ca\") pod \"maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:51.673312 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.673286    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-openshift-service-ca\") pod \"maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:51.675033 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.675015    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-metrics-certs\") pod \"maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:51.684719 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:51.684695    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw7rp\" (UniqueName: \"kubernetes.io/projected/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-kube-api-access-kw7rp\") pod \"maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:52.179919 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:52.179885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-maas-api-tls\") pod \"maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:52.182509 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:52.182490    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-maas-api-tls\") pod \"maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:52.403381 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:52.403342    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:52.729592 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:52.729467    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"]
Sep 10 13:31:53.355539 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:53.355504    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps" event={"ID":"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd","Type":"ContainerStarted","Data":"b9da6af5a7ea8cbf3eaee181ce5d1c217dc55b64f176ac32587b31c8f10cc3f4"}
Sep 10 13:31:53.355742 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:53.355599    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps" event={"ID":"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd","Type":"ContainerStarted","Data":"ebb69036ceadf1bd7e9814ba0449b212d700f6f9252387d6d73bd6cc83eec766"}
Sep 10 13:31:53.355742 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:53.355702    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:31:53.383843 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:53.383736    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps" podStartSLOduration=2.013662678 podStartE2EDuration="2.383718397s" totalImagesPullingTime="370.055719ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:31:53.381302187 +0000 UTC m=+908.266929236" watchObservedRunningTime="2026-09-10 13:31:53.383718397 +0000 UTC m=+908.269345424"
Sep 10 13:31:57.248206 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:57.248073    2584 patch_prober.go:28] interesting pod/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": read tcp 10.132.0.2:58592->10.132.0.60:15021: read: connection reset by peer" start-of-body=
Sep 10 13:31:57.248206 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:57.248140    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz" podUID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": read tcp 10.132.0.2:58592->10.132.0.60:15021: read: connection reset by peer"
Sep 10 13:31:57.383132 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:57.383096    2584 generic.go:356] "Generic (PLEG): container finished" podID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerID="d4d15f58a631c8a5731e7bcb4b7021cee916b2f3a7e4682ea3135f8129ad44d2" exitCode=0
Sep 10 13:31:57.383328 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:57.383173    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz" event={"ID":"9874f8ab-1fde-4be5-947b-64b8902c6914","Type":"ContainerDied","Data":"d4d15f58a631c8a5731e7bcb4b7021cee916b2f3a7e4682ea3135f8129ad44d2"}
Sep 10 13:31:57.383681 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:57.383664    2584 scope.go:117] "RemoveContainer" containerID="d4d15f58a631c8a5731e7bcb4b7021cee916b2f3a7e4682ea3135f8129ad44d2"
Sep 10 13:31:57.384789 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:57.384761    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:31:57.384885 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:57.384847    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:31:57.384947 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:57.384896    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:31:58.390277 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:58.390243    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz" event={"ID":"9874f8ab-1fde-4be5-947b-64b8902c6914","Type":"ContainerStarted","Data":"64c191d5245bd580013bec37c7bbdf1b9747914a7d9a1fa8e0d96e6cbfef49ef"}
Sep 10 13:31:59.234646 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:59.234610    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:31:59.234959 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:59.234924    2584 patch_prober.go:28] interesting pod/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 13:31:59.235077 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:59.234994    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz" podUID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 13:31:59.367097 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:31:59.367069    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:32:00.235321 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:00.235274    2584 patch_prober.go:28] interesting pod/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 13:32:00.235862 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:00.235345    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz" podUID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 13:32:01.234751 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:01.234698    2584 patch_prober.go:28] interesting pod/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 13:32:01.234949 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:01.234782    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz" podUID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 13:32:02.235579 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:02.234965    2584 patch_prober.go:28] interesting pod/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 13:32:02.235579 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:02.235030    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz" podUID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 13:32:03.234308 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:03.234260    2584 patch_prober.go:28] interesting pod/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 13:32:03.234503 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:03.234351    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz" podUID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 13:32:04.238772 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:04.238737    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:32:04.239196 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:04.239006    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:32:04.239683 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:04.239662    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:32:24.381581 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.381530    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"]
Sep 10 13:32:24.382050 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.381774    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h" podUID="110114a1-730e-45c7-a207-9303147c4fb1" containerName="maas-api" containerID="cri-o://6abad44dc8a9738d338c874ff0fe8859afca7d4709e5a6cb91a1fc431a7c7570" gracePeriod=30
Sep 10 13:32:24.532924 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.532891    2584 generic.go:356] "Generic (PLEG): container finished" podID="110114a1-730e-45c7-a207-9303147c4fb1" containerID="6abad44dc8a9738d338c874ff0fe8859afca7d4709e5a6cb91a1fc431a7c7570" exitCode=0
Sep 10 13:32:24.533122 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.532970    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h" event={"ID":"110114a1-730e-45c7-a207-9303147c4fb1","Type":"ContainerDied","Data":"6abad44dc8a9738d338c874ff0fe8859afca7d4709e5a6cb91a1fc431a7c7570"}
Sep 10 13:32:24.648042 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.647965    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:32:24.714079 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.714037    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/110114a1-730e-45c7-a207-9303147c4fb1-openshift-service-ca\") pod \"110114a1-730e-45c7-a207-9303147c4fb1\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") "
Sep 10 13:32:24.714079 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.714078    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqlnc\" (UniqueName: \"kubernetes.io/projected/110114a1-730e-45c7-a207-9303147c4fb1-kube-api-access-lqlnc\") pod \"110114a1-730e-45c7-a207-9303147c4fb1\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") "
Sep 10 13:32:24.714350 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.714108    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-maas-api-tls\") pod \"110114a1-730e-45c7-a207-9303147c4fb1\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") "
Sep 10 13:32:24.714350 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.714170    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-metrics-certs\") pod \"110114a1-730e-45c7-a207-9303147c4fb1\" (UID: \"110114a1-730e-45c7-a207-9303147c4fb1\") "
Sep 10 13:32:24.714478 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.714449    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/110114a1-730e-45c7-a207-9303147c4fb1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "110114a1-730e-45c7-a207-9303147c4fb1" (UID: "110114a1-730e-45c7-a207-9303147c4fb1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:32:24.714598 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.714577    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/110114a1-730e-45c7-a207-9303147c4fb1-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:32:24.716383 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.716353    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/110114a1-730e-45c7-a207-9303147c4fb1-kube-api-access-lqlnc" (OuterVolumeSpecName: "kube-api-access-lqlnc") pod "110114a1-730e-45c7-a207-9303147c4fb1" (UID: "110114a1-730e-45c7-a207-9303147c4fb1"). InnerVolumeSpecName "kube-api-access-lqlnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:32:24.716513 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.716471    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "110114a1-730e-45c7-a207-9303147c4fb1" (UID: "110114a1-730e-45c7-a207-9303147c4fb1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:32:24.716599 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.716503    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "110114a1-730e-45c7-a207-9303147c4fb1" (UID: "110114a1-730e-45c7-a207-9303147c4fb1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:32:24.816230 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.816193    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqlnc\" (UniqueName: \"kubernetes.io/projected/110114a1-730e-45c7-a207-9303147c4fb1-kube-api-access-lqlnc\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:32:24.816408 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.816235    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:32:24.816408 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:24.816250    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/110114a1-730e-45c7-a207-9303147c4fb1-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:32:25.097197 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:25.097170    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"]
Sep 10 13:32:25.097411 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:25.097389    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz" podUID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerName="istio-proxy" containerID="cri-o://64c191d5245bd580013bec37c7bbdf1b9747914a7d9a1fa8e0d96e6cbfef49ef" gracePeriod=30
Sep 10 13:32:25.540036 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:25.539944    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"
Sep 10 13:32:25.540036 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:25.539966    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h" event={"ID":"110114a1-730e-45c7-a207-9303147c4fb1","Type":"ContainerDied","Data":"11c89fa213b1da2158b4aedcbecdae0f1b827cf2e349cabb12d4452cc1e8441d"}
Sep 10 13:32:25.540036 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:25.540032    2584 scope.go:117] "RemoveContainer" containerID="6abad44dc8a9738d338c874ff0fe8859afca7d4709e5a6cb91a1fc431a7c7570"
Sep 10 13:32:25.564880 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:25.564842    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"]
Sep 10 13:32:25.572737 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:25.572704    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d46083cd-687c4965f-l6n9h"]
Sep 10 13:32:25.614872 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:25.614838    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="110114a1-730e-45c7-a207-9303147c4fb1" path="/var/lib/kubelet/pods/110114a1-730e-45c7-a207-9303147c4fb1/volumes"
Sep 10 13:32:30.355126 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.355097    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:32:30.471865 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.471765    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-workload-certs\") pod \"9874f8ab-1fde-4be5-947b-64b8902c6914\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") "
Sep 10 13:32:30.471865 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.471821    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-podinfo\") pod \"9874f8ab-1fde-4be5-947b-64b8902c6914\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") "
Sep 10 13:32:30.471865 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.471843    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn8hf\" (UniqueName: \"kubernetes.io/projected/9874f8ab-1fde-4be5-947b-64b8902c6914-kube-api-access-xn8hf\") pod \"9874f8ab-1fde-4be5-947b-64b8902c6914\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") "
Sep 10 13:32:30.471865 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.471858    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-data\") pod \"9874f8ab-1fde-4be5-947b-64b8902c6914\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") "
Sep 10 13:32:30.472221 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.471935    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-credential-socket\") pod \"9874f8ab-1fde-4be5-947b-64b8902c6914\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") "
Sep 10 13:32:30.472221 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.471956    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-token\") pod \"9874f8ab-1fde-4be5-947b-64b8902c6914\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") "
Sep 10 13:32:30.472221 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.472003    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-envoy\") pod \"9874f8ab-1fde-4be5-947b-64b8902c6914\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") "
Sep 10 13:32:30.472221 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.472035    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9874f8ab-1fde-4be5-947b-64b8902c6914-istiod-ca-cert\") pod \"9874f8ab-1fde-4be5-947b-64b8902c6914\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") "
Sep 10 13:32:30.472221 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.472076    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-workload-socket\") pod \"9874f8ab-1fde-4be5-947b-64b8902c6914\" (UID: \"9874f8ab-1fde-4be5-947b-64b8902c6914\") "
Sep 10 13:32:30.472221 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.472171    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9874f8ab-1fde-4be5-947b-64b8902c6914" (UID: "9874f8ab-1fde-4be5-947b-64b8902c6914"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:32:30.472537 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.472231    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-data" (OuterVolumeSpecName: "istio-data") pod "9874f8ab-1fde-4be5-947b-64b8902c6914" (UID: "9874f8ab-1fde-4be5-947b-64b8902c6914"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:32:30.472537 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.472265    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9874f8ab-1fde-4be5-947b-64b8902c6914" (UID: "9874f8ab-1fde-4be5-947b-64b8902c6914"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:32:30.472537 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.472381    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9874f8ab-1fde-4be5-947b-64b8902c6914" (UID: "9874f8ab-1fde-4be5-947b-64b8902c6914"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:32:30.472537 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.472479    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-credential-socket\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:32:30.472537 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.472494    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-workload-socket\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:32:30.472537 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.472504    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-workload-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:32:30.472537 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.472512    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-data\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:32:30.472537 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.472533    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9874f8ab-1fde-4be5-947b-64b8902c6914-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9874f8ab-1fde-4be5-947b-64b8902c6914" (UID: "9874f8ab-1fde-4be5-947b-64b8902c6914"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:32:30.474281 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.474253    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9874f8ab-1fde-4be5-947b-64b8902c6914-kube-api-access-xn8hf" (OuterVolumeSpecName: "kube-api-access-xn8hf") pod "9874f8ab-1fde-4be5-947b-64b8902c6914" (UID: "9874f8ab-1fde-4be5-947b-64b8902c6914"). InnerVolumeSpecName "kube-api-access-xn8hf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:32:30.474395 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.474366    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9874f8ab-1fde-4be5-947b-64b8902c6914" (UID: "9874f8ab-1fde-4be5-947b-64b8902c6914"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:32:30.474457 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.474441    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9874f8ab-1fde-4be5-947b-64b8902c6914" (UID: "9874f8ab-1fde-4be5-947b-64b8902c6914"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 13:32:30.474508 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.474459    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-token" (OuterVolumeSpecName: "istio-token") pod "9874f8ab-1fde-4be5-947b-64b8902c6914" (UID: "9874f8ab-1fde-4be5-947b-64b8902c6914"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:32:30.570362 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.570330    2584 generic.go:356] "Generic (PLEG): container finished" podID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerID="64c191d5245bd580013bec37c7bbdf1b9747914a7d9a1fa8e0d96e6cbfef49ef" exitCode=0
Sep 10 13:32:30.570600 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.570376    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz" event={"ID":"9874f8ab-1fde-4be5-947b-64b8902c6914","Type":"ContainerDied","Data":"64c191d5245bd580013bec37c7bbdf1b9747914a7d9a1fa8e0d96e6cbfef49ef"}
Sep 10 13:32:30.570600 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.570392    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"
Sep 10 13:32:30.570600 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.570419    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz" event={"ID":"9874f8ab-1fde-4be5-947b-64b8902c6914","Type":"ContainerDied","Data":"1ac4946373a5da1035cecc70975572983e3bef4dc9a36a4ba330b08553821870"}
Sep 10 13:32:30.570600 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.570442    2584 scope.go:117] "RemoveContainer" containerID="64c191d5245bd580013bec37c7bbdf1b9747914a7d9a1fa8e0d96e6cbfef49ef"
Sep 10 13:32:30.573071 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.573050    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-token\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:32:30.573177 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.573072    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-envoy\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:32:30.573177 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.573091    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9874f8ab-1fde-4be5-947b-64b8902c6914-istiod-ca-cert\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:32:30.573177 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.573100    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9874f8ab-1fde-4be5-947b-64b8902c6914-istio-podinfo\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:32:30.573177 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.573108    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn8hf\" (UniqueName: \"kubernetes.io/projected/9874f8ab-1fde-4be5-947b-64b8902c6914-kube-api-access-xn8hf\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:32:30.580375 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.580359    2584 scope.go:117] "RemoveContainer" containerID="d4d15f58a631c8a5731e7bcb4b7021cee916b2f3a7e4682ea3135f8129ad44d2"
Sep 10 13:32:30.589252 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.589235    2584 scope.go:117] "RemoveContainer" containerID="64c191d5245bd580013bec37c7bbdf1b9747914a7d9a1fa8e0d96e6cbfef49ef"
Sep 10 13:32:30.589604 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:32:30.589585    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64c191d5245bd580013bec37c7bbdf1b9747914a7d9a1fa8e0d96e6cbfef49ef\": container with ID starting with 64c191d5245bd580013bec37c7bbdf1b9747914a7d9a1fa8e0d96e6cbfef49ef not found: ID does not exist" containerID="64c191d5245bd580013bec37c7bbdf1b9747914a7d9a1fa8e0d96e6cbfef49ef"
Sep 10 13:32:30.589665 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.589615    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64c191d5245bd580013bec37c7bbdf1b9747914a7d9a1fa8e0d96e6cbfef49ef"} err="failed to get container status \"64c191d5245bd580013bec37c7bbdf1b9747914a7d9a1fa8e0d96e6cbfef49ef\": rpc error: code = NotFound desc = could not find container \"64c191d5245bd580013bec37c7bbdf1b9747914a7d9a1fa8e0d96e6cbfef49ef\": container with ID starting with 64c191d5245bd580013bec37c7bbdf1b9747914a7d9a1fa8e0d96e6cbfef49ef not found: ID does not exist"
Sep 10 13:32:30.589665 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.589635    2584 scope.go:117] "RemoveContainer" containerID="d4d15f58a631c8a5731e7bcb4b7021cee916b2f3a7e4682ea3135f8129ad44d2"
Sep 10 13:32:30.589899 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:32:30.589880    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4d15f58a631c8a5731e7bcb4b7021cee916b2f3a7e4682ea3135f8129ad44d2\": container with ID starting with d4d15f58a631c8a5731e7bcb4b7021cee916b2f3a7e4682ea3135f8129ad44d2 not found: ID does not exist" containerID="d4d15f58a631c8a5731e7bcb4b7021cee916b2f3a7e4682ea3135f8129ad44d2"
Sep 10 13:32:30.589946 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.589906    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4d15f58a631c8a5731e7bcb4b7021cee916b2f3a7e4682ea3135f8129ad44d2"} err="failed to get container status \"d4d15f58a631c8a5731e7bcb4b7021cee916b2f3a7e4682ea3135f8129ad44d2\": rpc error: code = NotFound desc = could not find container \"d4d15f58a631c8a5731e7bcb4b7021cee916b2f3a7e4682ea3135f8129ad44d2\": container with ID starting with d4d15f58a631c8a5731e7bcb4b7021cee916b2f3a7e4682ea3135f8129ad44d2 not found: ID does not exist"
Sep 10 13:32:30.595054 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.595032    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"]
Sep 10 13:32:30.598270 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:30.598251    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-d46083cd-openshift-default-8c59fc5fb-zndbz"]
Sep 10 13:32:31.613568 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:32:31.613531    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9874f8ab-1fde-4be5-947b-64b8902c6914" path="/var/lib/kubelet/pods/9874f8ab-1fde-4be5-947b-64b8902c6914/volumes"
Sep 10 13:33:14.966304 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:14.966220    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"]
Sep 10 13:33:14.966818 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:14.966437    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps" podUID="1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd" containerName="maas-api" containerID="cri-o://b9da6af5a7ea8cbf3eaee181ce5d1c217dc55b64f176ac32587b31c8f10cc3f4" gracePeriod=30
Sep 10 13:33:15.235174 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.235148    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:33:15.282731 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.282693    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-openshift-service-ca\") pod \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") "
Sep 10 13:33:15.282907 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.282759    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-maas-api-tls\") pod \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") "
Sep 10 13:33:15.282907 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.282789    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw7rp\" (UniqueName: \"kubernetes.io/projected/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-kube-api-access-kw7rp\") pod \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") "
Sep 10 13:33:15.282907 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.282829    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-metrics-certs\") pod \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\" (UID: \"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd\") "
Sep 10 13:33:15.283133 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.283107    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd" (UID: "1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:33:15.285188 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.285153    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd" (UID: "1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:33:15.285278 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.285198    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-kube-api-access-kw7rp" (OuterVolumeSpecName: "kube-api-access-kw7rp") pod "1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd" (UID: "1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd"). InnerVolumeSpecName "kube-api-access-kw7rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:33:15.285327 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.285307    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd" (UID: "1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:33:15.384013 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.383968    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:33:15.384013 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.384009    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:33:15.384013 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.384019    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw7rp\" (UniqueName: \"kubernetes.io/projected/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-kube-api-access-kw7rp\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:33:15.384256 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.384027    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:33:15.821012 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.820977    2584 generic.go:356] "Generic (PLEG): container finished" podID="1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd" containerID="b9da6af5a7ea8cbf3eaee181ce5d1c217dc55b64f176ac32587b31c8f10cc3f4" exitCode=0
Sep 10 13:33:15.821207 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.821032    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"
Sep 10 13:33:15.821207 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.821065    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps" event={"ID":"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd","Type":"ContainerDied","Data":"b9da6af5a7ea8cbf3eaee181ce5d1c217dc55b64f176ac32587b31c8f10cc3f4"}
Sep 10 13:33:15.821207 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.821127    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps" event={"ID":"1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd","Type":"ContainerDied","Data":"ebb69036ceadf1bd7e9814ba0449b212d700f6f9252387d6d73bd6cc83eec766"}
Sep 10 13:33:15.821207 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.821156    2584 scope.go:117] "RemoveContainer" containerID="b9da6af5a7ea8cbf3eaee181ce5d1c217dc55b64f176ac32587b31c8f10cc3f4"
Sep 10 13:33:15.832795 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.832775    2584 scope.go:117] "RemoveContainer" containerID="b9da6af5a7ea8cbf3eaee181ce5d1c217dc55b64f176ac32587b31c8f10cc3f4"
Sep 10 13:33:15.833098 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:33:15.833077    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9da6af5a7ea8cbf3eaee181ce5d1c217dc55b64f176ac32587b31c8f10cc3f4\": container with ID starting with b9da6af5a7ea8cbf3eaee181ce5d1c217dc55b64f176ac32587b31c8f10cc3f4 not found: ID does not exist" containerID="b9da6af5a7ea8cbf3eaee181ce5d1c217dc55b64f176ac32587b31c8f10cc3f4"
Sep 10 13:33:15.833150 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.833108    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9da6af5a7ea8cbf3eaee181ce5d1c217dc55b64f176ac32587b31c8f10cc3f4"} err="failed to get container status \"b9da6af5a7ea8cbf3eaee181ce5d1c217dc55b64f176ac32587b31c8f10cc3f4\": rpc error: code = NotFound desc = could not find container \"b9da6af5a7ea8cbf3eaee181ce5d1c217dc55b64f176ac32587b31c8f10cc3f4\": container with ID starting with b9da6af5a7ea8cbf3eaee181ce5d1c217dc55b64f176ac32587b31c8f10cc3f4 not found: ID does not exist"
Sep 10 13:33:15.850548 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.850518    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"]
Sep 10 13:33:15.855172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:15.855145    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a26db0-767dc9bd69-qkhps"]
Sep 10 13:33:17.614924 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:17.614885    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd" path="/var/lib/kubelet/pods/1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd/volumes"
Sep 10 13:33:24.975851 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.975818    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"]
Sep 10 13:33:24.976273 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.976230    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerName="istio-proxy"
Sep 10 13:33:24.976273 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.976242    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerName="istio-proxy"
Sep 10 13:33:24.976273 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.976256    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="110114a1-730e-45c7-a207-9303147c4fb1" containerName="maas-api"
Sep 10 13:33:24.976273 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.976261    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="110114a1-730e-45c7-a207-9303147c4fb1" containerName="maas-api"
Sep 10 13:33:24.976273 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.976269    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerName="istio-proxy"
Sep 10 13:33:24.976273 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.976275    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerName="istio-proxy"
Sep 10 13:33:24.976461 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.976290    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd" containerName="maas-api"
Sep 10 13:33:24.976461 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.976295    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd" containerName="maas-api"
Sep 10 13:33:24.976461 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.976361    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerName="istio-proxy"
Sep 10 13:33:24.976461 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.976368    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb3b8a4-daee-43a2-9bf6-4b19d8084cdd" containerName="maas-api"
Sep 10 13:33:24.976461 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.976376    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="110114a1-730e-45c7-a207-9303147c4fb1" containerName="maas-api"
Sep 10 13:33:24.979743 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.979719    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:24.983823 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.983798    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 13:33:24.983823 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:24.983813    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-669b24-openshift-default-dockercfg-js56p\""
Sep 10 13:33:25.006911 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.006881    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"]
Sep 10 13:33:25.074598 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.074534    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-credential-socket\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.074813 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.074606    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-workload-socket\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.074813 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.074637    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l22c\" (UniqueName: \"kubernetes.io/projected/13d88336-e587-4947-b79d-8d9cadedef98-kube-api-access-5l22c\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.074813 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.074659    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13d88336-e587-4947-b79d-8d9cadedef98-istiod-ca-cert\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.074813 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.074731    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-workload-certs\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.074813 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.074773    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13d88336-e587-4947-b79d-8d9cadedef98-istio-podinfo\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.075092 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.074825    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-istio-envoy\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.075092 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.074906    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-istio-data\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.075092 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.074958    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13d88336-e587-4947-b79d-8d9cadedef98-istio-token\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.176323 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.176284    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13d88336-e587-4947-b79d-8d9cadedef98-istio-token\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.176323 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.176329    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-credential-socket\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.176618 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.176346    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-workload-socket\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.176618 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.176372    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l22c\" (UniqueName: \"kubernetes.io/projected/13d88336-e587-4947-b79d-8d9cadedef98-kube-api-access-5l22c\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.176618 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.176403    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13d88336-e587-4947-b79d-8d9cadedef98-istiod-ca-cert\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.176618 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.176444    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-workload-certs\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.176618 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.176475    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13d88336-e587-4947-b79d-8d9cadedef98-istio-podinfo\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.176618 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.176542    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-istio-envoy\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.176939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.176627    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-istio-data\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.176939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.176842    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-workload-socket\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.176939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.176884    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-credential-socket\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.177101 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.176968    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-workload-certs\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.177101 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.176988    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-istio-data\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.177293 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.177271    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13d88336-e587-4947-b79d-8d9cadedef98-istiod-ca-cert\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.179232 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.179200    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-istio-envoy\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.179398 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.179343    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13d88336-e587-4947-b79d-8d9cadedef98-istio-podinfo\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.196655 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.196622    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13d88336-e587-4947-b79d-8d9cadedef98-istio-token\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.211171 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.211141    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l22c\" (UniqueName: \"kubernetes.io/projected/13d88336-e587-4947-b79d-8d9cadedef98-kube-api-access-5l22c\") pod \"e2e-noten-669b24-openshift-default-85477cfdf4-srlbm\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") " pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.290022 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.289919    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:25.577427 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.577401    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"]
Sep 10 13:33:25.579958 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:33:25.579929    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d88336_e587_4947_b79d_8d9cadedef98.slice/crio-798f6f73af89d7a5708d71bf6ed4329f91cf6c6e95d3218961f9c4b8839f80ed WatchSource:0}: Error finding container 798f6f73af89d7a5708d71bf6ed4329f91cf6c6e95d3218961f9c4b8839f80ed: Status 404 returned error can't find the container with id 798f6f73af89d7a5708d71bf6ed4329f91cf6c6e95d3218961f9c4b8839f80ed
Sep 10 13:33:25.584882 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.584842    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:33:25.584989 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.584933    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:33:25.584989 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.584972    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:33:25.882345 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.882278    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm" event={"ID":"13d88336-e587-4947-b79d-8d9cadedef98","Type":"ContainerStarted","Data":"9496cfcacc70f4bc90da080e89f631faede4b7598dbcdd569d6f558be49d6e77"}
Sep 10 13:33:25.882583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.882360    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm" event={"ID":"13d88336-e587-4947-b79d-8d9cadedef98","Type":"ContainerStarted","Data":"798f6f73af89d7a5708d71bf6ed4329f91cf6c6e95d3218961f9c4b8839f80ed"}
Sep 10 13:33:25.913833 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:25.913770    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm" podStartSLOduration=1.913750479 podStartE2EDuration="1.913750479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:33:25.913456158 +0000 UTC m=+1000.799083185" watchObservedRunningTime="2026-09-10 13:33:25.913750479 +0000 UTC m=+1000.799377507"
Sep 10 13:33:26.290201 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:26.290108    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:26.295807 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:26.295772    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:26.887884 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:26.887857    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:26.888923 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:26.888903    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:39.211918 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:39.211879    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"]
Sep 10 13:33:39.212504 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:39.212152    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm" podUID="13d88336-e587-4947-b79d-8d9cadedef98" containerName="istio-proxy" containerID="cri-o://9496cfcacc70f4bc90da080e89f631faede4b7598dbcdd569d6f558be49d6e77" gracePeriod=30
Sep 10 13:33:41.890616 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:41.890550    2584 patch_prober.go:28] interesting pod/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 13:33:41.891009 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:41.890656    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm" podUID="13d88336-e587-4947-b79d-8d9cadedef98" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 13:33:44.476604 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.476519    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:44.558438 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.558400    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-credential-socket\") pod \"13d88336-e587-4947-b79d-8d9cadedef98\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") "
Sep 10 13:33:44.558438 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.558439    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l22c\" (UniqueName: \"kubernetes.io/projected/13d88336-e587-4947-b79d-8d9cadedef98-kube-api-access-5l22c\") pod \"13d88336-e587-4947-b79d-8d9cadedef98\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") "
Sep 10 13:33:44.558686 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.558460    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-workload-certs\") pod \"13d88336-e587-4947-b79d-8d9cadedef98\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") "
Sep 10 13:33:44.558686 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.558490    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-workload-socket\") pod \"13d88336-e587-4947-b79d-8d9cadedef98\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") "
Sep 10 13:33:44.558686 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.558619    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-istio-envoy\") pod \"13d88336-e587-4947-b79d-8d9cadedef98\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") "
Sep 10 13:33:44.558686 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.558678    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13d88336-e587-4947-b79d-8d9cadedef98-istio-podinfo\") pod \"13d88336-e587-4947-b79d-8d9cadedef98\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") "
Sep 10 13:33:44.558898 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.558703    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13d88336-e587-4947-b79d-8d9cadedef98-istio-token\") pod \"13d88336-e587-4947-b79d-8d9cadedef98\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") "
Sep 10 13:33:44.558898 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.558743    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13d88336-e587-4947-b79d-8d9cadedef98-istiod-ca-cert\") pod \"13d88336-e587-4947-b79d-8d9cadedef98\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") "
Sep 10 13:33:44.558898 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.558774    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-istio-data\") pod \"13d88336-e587-4947-b79d-8d9cadedef98\" (UID: \"13d88336-e587-4947-b79d-8d9cadedef98\") "
Sep 10 13:33:44.558898 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.558790    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "13d88336-e587-4947-b79d-8d9cadedef98" (UID: "13d88336-e587-4947-b79d-8d9cadedef98"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:33:44.558898 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.558792    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "13d88336-e587-4947-b79d-8d9cadedef98" (UID: "13d88336-e587-4947-b79d-8d9cadedef98"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:33:44.559144 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.559030    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-istio-data" (OuterVolumeSpecName: "istio-data") pod "13d88336-e587-4947-b79d-8d9cadedef98" (UID: "13d88336-e587-4947-b79d-8d9cadedef98"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:33:44.559144 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.559137    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13d88336-e587-4947-b79d-8d9cadedef98-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "13d88336-e587-4947-b79d-8d9cadedef98" (UID: "13d88336-e587-4947-b79d-8d9cadedef98"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:33:44.559259 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.559206    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "13d88336-e587-4947-b79d-8d9cadedef98" (UID: "13d88336-e587-4947-b79d-8d9cadedef98"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:33:44.559320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.559276    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-credential-socket\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:33:44.559320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.559293    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-workload-socket\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:33:44.559320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.559307    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13d88336-e587-4947-b79d-8d9cadedef98-istiod-ca-cert\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:33:44.559320 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.559320    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-istio-data\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:33:44.561006 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.560978    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d88336-e587-4947-b79d-8d9cadedef98-kube-api-access-5l22c" (OuterVolumeSpecName: "kube-api-access-5l22c") pod "13d88336-e587-4947-b79d-8d9cadedef98" (UID: "13d88336-e587-4947-b79d-8d9cadedef98"). InnerVolumeSpecName "kube-api-access-5l22c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:33:44.561205 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.561182    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "13d88336-e587-4947-b79d-8d9cadedef98" (UID: "13d88336-e587-4947-b79d-8d9cadedef98"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:33:44.561462 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.561443    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d88336-e587-4947-b79d-8d9cadedef98-istio-token" (OuterVolumeSpecName: "istio-token") pod "13d88336-e587-4947-b79d-8d9cadedef98" (UID: "13d88336-e587-4947-b79d-8d9cadedef98"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:33:44.561462 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.561444    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/13d88336-e587-4947-b79d-8d9cadedef98-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "13d88336-e587-4947-b79d-8d9cadedef98" (UID: "13d88336-e587-4947-b79d-8d9cadedef98"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 13:33:44.660411 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.660372    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-istio-envoy\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:33:44.660411 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.660402    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13d88336-e587-4947-b79d-8d9cadedef98-istio-podinfo\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:33:44.660411 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.660414    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13d88336-e587-4947-b79d-8d9cadedef98-istio-token\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:33:44.660694 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.660426    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l22c\" (UniqueName: \"kubernetes.io/projected/13d88336-e587-4947-b79d-8d9cadedef98-kube-api-access-5l22c\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:33:44.660694 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.660439    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13d88336-e587-4947-b79d-8d9cadedef98-workload-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:33:44.985196 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.985163    2584 generic.go:356] "Generic (PLEG): container finished" podID="13d88336-e587-4947-b79d-8d9cadedef98" containerID="9496cfcacc70f4bc90da080e89f631faede4b7598dbcdd569d6f558be49d6e77" exitCode=0
Sep 10 13:33:44.985511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.985223    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"
Sep 10 13:33:44.985511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.985258    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm" event={"ID":"13d88336-e587-4947-b79d-8d9cadedef98","Type":"ContainerDied","Data":"9496cfcacc70f4bc90da080e89f631faede4b7598dbcdd569d6f558be49d6e77"}
Sep 10 13:33:44.985511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.985318    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm" event={"ID":"13d88336-e587-4947-b79d-8d9cadedef98","Type":"ContainerDied","Data":"798f6f73af89d7a5708d71bf6ed4329f91cf6c6e95d3218961f9c4b8839f80ed"}
Sep 10 13:33:44.985511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.985341    2584 scope.go:117] "RemoveContainer" containerID="9496cfcacc70f4bc90da080e89f631faede4b7598dbcdd569d6f558be49d6e77"
Sep 10 13:33:44.995186 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.995169    2584 scope.go:117] "RemoveContainer" containerID="9496cfcacc70f4bc90da080e89f631faede4b7598dbcdd569d6f558be49d6e77"
Sep 10 13:33:44.995479 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:33:44.995458    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9496cfcacc70f4bc90da080e89f631faede4b7598dbcdd569d6f558be49d6e77\": container with ID starting with 9496cfcacc70f4bc90da080e89f631faede4b7598dbcdd569d6f558be49d6e77 not found: ID does not exist" containerID="9496cfcacc70f4bc90da080e89f631faede4b7598dbcdd569d6f558be49d6e77"
Sep 10 13:33:44.995540 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:44.995488    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9496cfcacc70f4bc90da080e89f631faede4b7598dbcdd569d6f558be49d6e77"} err="failed to get container status \"9496cfcacc70f4bc90da080e89f631faede4b7598dbcdd569d6f558be49d6e77\": rpc error: code = NotFound desc = could not find container \"9496cfcacc70f4bc90da080e89f631faede4b7598dbcdd569d6f558be49d6e77\": container with ID starting with 9496cfcacc70f4bc90da080e89f631faede4b7598dbcdd569d6f558be49d6e77 not found: ID does not exist"
Sep 10 13:33:45.010665 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:45.010637    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"]
Sep 10 13:33:45.017016 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:45.016995    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-669b24-openshift-default-85477cfdf4-srlbm"]
Sep 10 13:33:45.613910 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:33:45.613878    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13d88336-e587-4947-b79d-8d9cadedef98" path="/var/lib/kubelet/pods/13d88336-e587-4947-b79d-8d9cadedef98/volumes"
Sep 10 13:34:09.876286 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:09.876245    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"]
Sep 10 13:34:09.876675 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:09.876507    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx" podUID="6f2004a6-30f1-4a8b-83ce-3243df0ab238" containerName="maas-api" containerID="cri-o://cfbdc66f61f5ff783202a61796696e0ffd08e4c95adc132ebe56f98f69a5131d" gracePeriod=30
Sep 10 13:34:10.127481 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.126998    2584 generic.go:356] "Generic (PLEG): container finished" podID="6f2004a6-30f1-4a8b-83ce-3243df0ab238" containerID="cfbdc66f61f5ff783202a61796696e0ffd08e4c95adc132ebe56f98f69a5131d" exitCode=0
Sep 10 13:34:10.127481 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.127242    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx" event={"ID":"6f2004a6-30f1-4a8b-83ce-3243df0ab238","Type":"ContainerDied","Data":"cfbdc66f61f5ff783202a61796696e0ffd08e4c95adc132ebe56f98f69a5131d"}
Sep 10 13:34:10.157770 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.157742    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:34:10.306335 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.306289    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2004a6-30f1-4a8b-83ce-3243df0ab238-openshift-service-ca\") pod \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") "
Sep 10 13:34:10.306524 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.306358    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f2004a6-30f1-4a8b-83ce-3243df0ab238-metrics-certs\") pod \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") "
Sep 10 13:34:10.306524 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.306483    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f2004a6-30f1-4a8b-83ce-3243df0ab238-maas-api-tls\") pod \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") "
Sep 10 13:34:10.306691 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.306526    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cplg\" (UniqueName: \"kubernetes.io/projected/6f2004a6-30f1-4a8b-83ce-3243df0ab238-kube-api-access-7cplg\") pod \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\" (UID: \"6f2004a6-30f1-4a8b-83ce-3243df0ab238\") "
Sep 10 13:34:10.306776 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.306737    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f2004a6-30f1-4a8b-83ce-3243df0ab238-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6f2004a6-30f1-4a8b-83ce-3243df0ab238" (UID: "6f2004a6-30f1-4a8b-83ce-3243df0ab238"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:34:10.306889 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.306864    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2004a6-30f1-4a8b-83ce-3243df0ab238-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:34:10.308824 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.308791    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2004a6-30f1-4a8b-83ce-3243df0ab238-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6f2004a6-30f1-4a8b-83ce-3243df0ab238" (UID: "6f2004a6-30f1-4a8b-83ce-3243df0ab238"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:34:10.308932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.308874    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f2004a6-30f1-4a8b-83ce-3243df0ab238-kube-api-access-7cplg" (OuterVolumeSpecName: "kube-api-access-7cplg") pod "6f2004a6-30f1-4a8b-83ce-3243df0ab238" (UID: "6f2004a6-30f1-4a8b-83ce-3243df0ab238"). InnerVolumeSpecName "kube-api-access-7cplg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:34:10.309073 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.309052    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2004a6-30f1-4a8b-83ce-3243df0ab238-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6f2004a6-30f1-4a8b-83ce-3243df0ab238" (UID: "6f2004a6-30f1-4a8b-83ce-3243df0ab238"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:34:10.407776 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.407687    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f2004a6-30f1-4a8b-83ce-3243df0ab238-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:34:10.407776 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.407719    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f2004a6-30f1-4a8b-83ce-3243df0ab238-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:34:10.407776 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:10.407729    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cplg\" (UniqueName: \"kubernetes.io/projected/6f2004a6-30f1-4a8b-83ce-3243df0ab238-kube-api-access-7cplg\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:34:11.134602 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:11.134547    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx" event={"ID":"6f2004a6-30f1-4a8b-83ce-3243df0ab238","Type":"ContainerDied","Data":"1261e1be4eb48d66933499bab8b991db45cef44f3f7707fd7e7792a3258a14cb"}
Sep 10 13:34:11.135035 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:11.134611    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"
Sep 10 13:34:11.135035 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:11.134644    2584 scope.go:117] "RemoveContainer" containerID="cfbdc66f61f5ff783202a61796696e0ffd08e4c95adc132ebe56f98f69a5131d"
Sep 10 13:34:11.158076 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:11.158037    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"]
Sep 10 13:34:11.162254 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:11.162228    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-39df6e-85d4cc4b58-4ncqx"]
Sep 10 13:34:11.614322 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:11.614288    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f2004a6-30f1-4a8b-83ce-3243df0ab238" path="/var/lib/kubelet/pods/6f2004a6-30f1-4a8b-83ce-3243df0ab238/volumes"
Sep 10 13:34:14.236151 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.236115    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"]
Sep 10 13:34:14.236635 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.236623    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2004a6-30f1-4a8b-83ce-3243df0ab238" containerName="maas-api"
Sep 10 13:34:14.236635 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.236636    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2004a6-30f1-4a8b-83ce-3243df0ab238" containerName="maas-api"
Sep 10 13:34:14.236752 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.236651    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13d88336-e587-4947-b79d-8d9cadedef98" containerName="istio-proxy"
Sep 10 13:34:14.236752 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.236661    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="13d88336-e587-4947-b79d-8d9cadedef98" containerName="istio-proxy"
Sep 10 13:34:14.236752 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.236750    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f2004a6-30f1-4a8b-83ce-3243df0ab238" containerName="maas-api"
Sep 10 13:34:14.236914 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.236759    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="13d88336-e587-4947-b79d-8d9cadedef98" containerName="istio-proxy"
Sep 10 13:34:14.236914 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.236776    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9874f8ab-1fde-4be5-947b-64b8902c6914" containerName="istio-proxy"
Sep 10 13:34:14.239434 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.239415    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:14.243197 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.243176    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7f8babf4-serving-cert\""
Sep 10 13:34:14.260275 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.260248    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"]
Sep 10 13:34:14.346231 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.346198    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27c124ca-035d-4df4-8b86-714c54cd5d59-metrics-certs\") pod \"maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:14.346409 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.346263    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn4zv\" (UniqueName: \"kubernetes.io/projected/27c124ca-035d-4df4-8b86-714c54cd5d59-kube-api-access-wn4zv\") pod \"maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:14.346409 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.346308    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27c124ca-035d-4df4-8b86-714c54cd5d59-maas-api-tls\") pod \"maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:14.346492 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.346425    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c124ca-035d-4df4-8b86-714c54cd5d59-openshift-service-ca\") pod \"maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:14.446980 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.446931    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27c124ca-035d-4df4-8b86-714c54cd5d59-metrics-certs\") pod \"maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:14.447138 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.446990    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn4zv\" (UniqueName: \"kubernetes.io/projected/27c124ca-035d-4df4-8b86-714c54cd5d59-kube-api-access-wn4zv\") pod \"maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:14.447198 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.447169    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27c124ca-035d-4df4-8b86-714c54cd5d59-maas-api-tls\") pod \"maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:14.447309 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.447276    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c124ca-035d-4df4-8b86-714c54cd5d59-openshift-service-ca\") pod \"maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:14.450627 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.448352    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c124ca-035d-4df4-8b86-714c54cd5d59-openshift-service-ca\") pod \"maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:14.450790 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.450674    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27c124ca-035d-4df4-8b86-714c54cd5d59-maas-api-tls\") pod \"maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:14.454920 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.450606    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27c124ca-035d-4df4-8b86-714c54cd5d59-metrics-certs\") pod \"maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:14.460361 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.460331    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn4zv\" (UniqueName: \"kubernetes.io/projected/27c124ca-035d-4df4-8b86-714c54cd5d59-kube-api-access-wn4zv\") pod \"maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:14.550416 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.550330    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:14.837923 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.837887    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"]
Sep 10 13:34:14.845690 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:14.845649    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 13:34:15.159350 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:15.159311    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g" event={"ID":"27c124ca-035d-4df4-8b86-714c54cd5d59","Type":"ContainerStarted","Data":"47b7a7f90971e640d9f86cd4dc8c20a5479957e942794eb7c840ac0d65410bef"}
Sep 10 13:34:17.175117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:17.175079    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g" event={"ID":"27c124ca-035d-4df4-8b86-714c54cd5d59","Type":"ContainerStarted","Data":"4cb7c0a74780700f71aca526fc137f4ebfd1647cf4b9c13ef36c401c5caec007"}
Sep 10 13:34:17.175539 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:17.175190    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:17.216638 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:17.216579    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g" podStartSLOduration=1.373890719 podStartE2EDuration="3.216542114s" totalImagesPullingTime="1.842651395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:34:17.215483527 +0000 UTC m=+1052.101110555" watchObservedRunningTime="2026-09-10 13:34:17.216542114 +0000 UTC m=+1052.102169141"
Sep 10 13:34:23.186713 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:23.186683    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:30.037472 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.037434    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"]
Sep 10 13:34:30.037983 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.037713    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c" podUID="327528d0-0d99-431a-b063-74cf86ac9378" containerName="maas-api" containerID="cri-o://af4f32b84f1705a40e289dd18ab19646254f4028b1aed4508e6f582657ad163d" gracePeriod=30
Sep 10 13:34:30.245010 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.244974    2584 generic.go:356] "Generic (PLEG): container finished" podID="327528d0-0d99-431a-b063-74cf86ac9378" containerID="af4f32b84f1705a40e289dd18ab19646254f4028b1aed4508e6f582657ad163d" exitCode=0
Sep 10 13:34:30.245168 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.245043    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c" event={"ID":"327528d0-0d99-431a-b063-74cf86ac9378","Type":"ContainerDied","Data":"af4f32b84f1705a40e289dd18ab19646254f4028b1aed4508e6f582657ad163d"}
Sep 10 13:34:30.289362 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.289292    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:34:30.385961 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.385925    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/327528d0-0d99-431a-b063-74cf86ac9378-openshift-service-ca\") pod \"327528d0-0d99-431a-b063-74cf86ac9378\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") "
Sep 10 13:34:30.385961 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.385961    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/327528d0-0d99-431a-b063-74cf86ac9378-metrics-certs\") pod \"327528d0-0d99-431a-b063-74cf86ac9378\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") "
Sep 10 13:34:30.386180 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.386000    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/327528d0-0d99-431a-b063-74cf86ac9378-maas-api-tls\") pod \"327528d0-0d99-431a-b063-74cf86ac9378\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") "
Sep 10 13:34:30.386180 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.386059    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn9gs\" (UniqueName: \"kubernetes.io/projected/327528d0-0d99-431a-b063-74cf86ac9378-kube-api-access-pn9gs\") pod \"327528d0-0d99-431a-b063-74cf86ac9378\" (UID: \"327528d0-0d99-431a-b063-74cf86ac9378\") "
Sep 10 13:34:30.386361 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.386334    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/327528d0-0d99-431a-b063-74cf86ac9378-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "327528d0-0d99-431a-b063-74cf86ac9378" (UID: "327528d0-0d99-431a-b063-74cf86ac9378"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:34:30.388495 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.388465    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/327528d0-0d99-431a-b063-74cf86ac9378-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "327528d0-0d99-431a-b063-74cf86ac9378" (UID: "327528d0-0d99-431a-b063-74cf86ac9378"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:34:30.388647 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.388491    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/327528d0-0d99-431a-b063-74cf86ac9378-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "327528d0-0d99-431a-b063-74cf86ac9378" (UID: "327528d0-0d99-431a-b063-74cf86ac9378"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:34:30.388647 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.388505    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/327528d0-0d99-431a-b063-74cf86ac9378-kube-api-access-pn9gs" (OuterVolumeSpecName: "kube-api-access-pn9gs") pod "327528d0-0d99-431a-b063-74cf86ac9378" (UID: "327528d0-0d99-431a-b063-74cf86ac9378"). InnerVolumeSpecName "kube-api-access-pn9gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:34:30.487501 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.487456    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn9gs\" (UniqueName: \"kubernetes.io/projected/327528d0-0d99-431a-b063-74cf86ac9378-kube-api-access-pn9gs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:34:30.487501 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.487495    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/327528d0-0d99-431a-b063-74cf86ac9378-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:34:30.487501 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.487508    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/327528d0-0d99-431a-b063-74cf86ac9378-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:34:30.487781 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:30.487520    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/327528d0-0d99-431a-b063-74cf86ac9378-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:34:31.252203 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:31.252167    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c" event={"ID":"327528d0-0d99-431a-b063-74cf86ac9378","Type":"ContainerDied","Data":"7f8d06cc2597256e8a04d243c0140f4e26face2b90bbb353a902c5ea07a5bd04"}
Sep 10 13:34:31.252203 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:31.252194    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"
Sep 10 13:34:31.252703 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:31.252233    2584 scope.go:117] "RemoveContainer" containerID="af4f32b84f1705a40e289dd18ab19646254f4028b1aed4508e6f582657ad163d"
Sep 10 13:34:31.276797 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:31.276770    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"]
Sep 10 13:34:31.280498 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:31.280473    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6beee4-7c8fb5c66c-pdx5c"]
Sep 10 13:34:31.613902 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:31.613861    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="327528d0-0d99-431a-b063-74cf86ac9378" path="/var/lib/kubelet/pods/327528d0-0d99-431a-b063-74cf86ac9378/volumes"
Sep 10 13:34:43.465080 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.465039    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"]
Sep 10 13:34:43.466017 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.465992    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="327528d0-0d99-431a-b063-74cf86ac9378" containerName="maas-api"
Sep 10 13:34:43.466017 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.466017    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="327528d0-0d99-431a-b063-74cf86ac9378" containerName="maas-api"
Sep 10 13:34:43.466221 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.466167    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="327528d0-0d99-431a-b063-74cf86ac9378" containerName="maas-api"
Sep 10 13:34:43.468683 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.468666    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:43.471347 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.471327    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-7657ef-serving-cert\""
Sep 10 13:34:43.485653 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.485587    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"]
Sep 10 13:34:43.505889 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.505854    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bpbg\" (UniqueName: \"kubernetes.io/projected/709124a3-81d7-415e-9523-e1dc874eb3ed-kube-api-access-8bpbg\") pod \"maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:43.506055 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.505896    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/709124a3-81d7-415e-9523-e1dc874eb3ed-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:43.506055 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.506020    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/709124a3-81d7-415e-9523-e1dc874eb3ed-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:43.506172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.506068    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/709124a3-81d7-415e-9523-e1dc874eb3ed-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:43.606615 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.606542    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/709124a3-81d7-415e-9523-e1dc874eb3ed-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:43.606804 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.606640    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/709124a3-81d7-415e-9523-e1dc874eb3ed-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:43.606804 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.606679    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bpbg\" (UniqueName: \"kubernetes.io/projected/709124a3-81d7-415e-9523-e1dc874eb3ed-kube-api-access-8bpbg\") pod \"maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:43.606804 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.606698    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/709124a3-81d7-415e-9523-e1dc874eb3ed-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:43.607373 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.607348    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/709124a3-81d7-415e-9523-e1dc874eb3ed-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:43.609418 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.609395    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/709124a3-81d7-415e-9523-e1dc874eb3ed-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:43.609506 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.609438    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/709124a3-81d7-415e-9523-e1dc874eb3ed-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:43.617427 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.617403    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bpbg\" (UniqueName: \"kubernetes.io/projected/709124a3-81d7-415e-9523-e1dc874eb3ed-kube-api-access-8bpbg\") pod \"maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:43.780476 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:43.780384    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:44.066791 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:44.066761    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"]
Sep 10 13:34:44.069053 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:34:44.069026    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod709124a3_81d7_415e_9523_e1dc874eb3ed.slice/crio-c7a96f01f14bc22f22d14e549822ac9f617c4f1b0d31b6555e32dfec5324558f WatchSource:0}: Error finding container c7a96f01f14bc22f22d14e549822ac9f617c4f1b0d31b6555e32dfec5324558f: Status 404 returned error can't find the container with id c7a96f01f14bc22f22d14e549822ac9f617c4f1b0d31b6555e32dfec5324558f
Sep 10 13:34:44.326079 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:44.325992    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9" event={"ID":"709124a3-81d7-415e-9523-e1dc874eb3ed","Type":"ContainerStarted","Data":"c7a96f01f14bc22f22d14e549822ac9f617c4f1b0d31b6555e32dfec5324558f"}
Sep 10 13:34:45.333708 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:45.333674    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9" event={"ID":"709124a3-81d7-415e-9523-e1dc874eb3ed","Type":"ContainerStarted","Data":"eb653724af236d4975f02561a126c00c7738803ccfdf6a1eed63c6522b9b2012"}
Sep 10 13:34:45.334120 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:45.333749    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:45.359750 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:45.359697    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9" podStartSLOduration=2.048727365 podStartE2EDuration="2.359681749s" totalImagesPullingTime="310.954384ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:34:45.356392396 +0000 UTC m=+1080.242019423" watchObservedRunningTime="2026-09-10 13:34:45.359681749 +0000 UTC m=+1080.245308776"
Sep 10 13:34:51.345742 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:51.345711    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:34:57.754461 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:57.754426    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"]
Sep 10 13:34:57.754980 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:57.754691    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g" podUID="27c124ca-035d-4df4-8b86-714c54cd5d59" containerName="maas-api" containerID="cri-o://4cb7c0a74780700f71aca526fc137f4ebfd1647cf4b9c13ef36c401c5caec007" gracePeriod=30
Sep 10 13:34:58.039981 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.039956    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:58.149926 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.149887    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn4zv\" (UniqueName: \"kubernetes.io/projected/27c124ca-035d-4df4-8b86-714c54cd5d59-kube-api-access-wn4zv\") pod \"27c124ca-035d-4df4-8b86-714c54cd5d59\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") "
Sep 10 13:34:58.150105 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.149975    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27c124ca-035d-4df4-8b86-714c54cd5d59-maas-api-tls\") pod \"27c124ca-035d-4df4-8b86-714c54cd5d59\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") "
Sep 10 13:34:58.150105 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.150013    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c124ca-035d-4df4-8b86-714c54cd5d59-openshift-service-ca\") pod \"27c124ca-035d-4df4-8b86-714c54cd5d59\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") "
Sep 10 13:34:58.150105 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.150085    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27c124ca-035d-4df4-8b86-714c54cd5d59-metrics-certs\") pod \"27c124ca-035d-4df4-8b86-714c54cd5d59\" (UID: \"27c124ca-035d-4df4-8b86-714c54cd5d59\") "
Sep 10 13:34:58.150497 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.150445    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27c124ca-035d-4df4-8b86-714c54cd5d59-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "27c124ca-035d-4df4-8b86-714c54cd5d59" (UID: "27c124ca-035d-4df4-8b86-714c54cd5d59"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:34:58.152683 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.152652    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27c124ca-035d-4df4-8b86-714c54cd5d59-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "27c124ca-035d-4df4-8b86-714c54cd5d59" (UID: "27c124ca-035d-4df4-8b86-714c54cd5d59"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:34:58.152784 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.152659    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27c124ca-035d-4df4-8b86-714c54cd5d59-kube-api-access-wn4zv" (OuterVolumeSpecName: "kube-api-access-wn4zv") pod "27c124ca-035d-4df4-8b86-714c54cd5d59" (UID: "27c124ca-035d-4df4-8b86-714c54cd5d59"). InnerVolumeSpecName "kube-api-access-wn4zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:34:58.152892 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.152871    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27c124ca-035d-4df4-8b86-714c54cd5d59-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "27c124ca-035d-4df4-8b86-714c54cd5d59" (UID: "27c124ca-035d-4df4-8b86-714c54cd5d59"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:34:58.251992 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.251959    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn4zv\" (UniqueName: \"kubernetes.io/projected/27c124ca-035d-4df4-8b86-714c54cd5d59-kube-api-access-wn4zv\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:34:58.251992 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.251992    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27c124ca-035d-4df4-8b86-714c54cd5d59-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:34:58.252210 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.252015    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c124ca-035d-4df4-8b86-714c54cd5d59-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:34:58.252210 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.252027    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27c124ca-035d-4df4-8b86-714c54cd5d59-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:34:58.408971 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.408938    2584 generic.go:356] "Generic (PLEG): container finished" podID="27c124ca-035d-4df4-8b86-714c54cd5d59" containerID="4cb7c0a74780700f71aca526fc137f4ebfd1647cf4b9c13ef36c401c5caec007" exitCode=0
Sep 10 13:34:58.409141 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.409002    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"
Sep 10 13:34:58.409141 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.409028    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g" event={"ID":"27c124ca-035d-4df4-8b86-714c54cd5d59","Type":"ContainerDied","Data":"4cb7c0a74780700f71aca526fc137f4ebfd1647cf4b9c13ef36c401c5caec007"}
Sep 10 13:34:58.409141 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.409088    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g" event={"ID":"27c124ca-035d-4df4-8b86-714c54cd5d59","Type":"ContainerDied","Data":"47b7a7f90971e640d9f86cd4dc8c20a5479957e942794eb7c840ac0d65410bef"}
Sep 10 13:34:58.409141 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.409111    2584 scope.go:117] "RemoveContainer" containerID="4cb7c0a74780700f71aca526fc137f4ebfd1647cf4b9c13ef36c401c5caec007"
Sep 10 13:34:58.419685 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.419664    2584 scope.go:117] "RemoveContainer" containerID="4cb7c0a74780700f71aca526fc137f4ebfd1647cf4b9c13ef36c401c5caec007"
Sep 10 13:34:58.420050 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:34:58.420027    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cb7c0a74780700f71aca526fc137f4ebfd1647cf4b9c13ef36c401c5caec007\": container with ID starting with 4cb7c0a74780700f71aca526fc137f4ebfd1647cf4b9c13ef36c401c5caec007 not found: ID does not exist" containerID="4cb7c0a74780700f71aca526fc137f4ebfd1647cf4b9c13ef36c401c5caec007"
Sep 10 13:34:58.420160 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.420056    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cb7c0a74780700f71aca526fc137f4ebfd1647cf4b9c13ef36c401c5caec007"} err="failed to get container status \"4cb7c0a74780700f71aca526fc137f4ebfd1647cf4b9c13ef36c401c5caec007\": rpc error: code = NotFound desc = could not find container \"4cb7c0a74780700f71aca526fc137f4ebfd1647cf4b9c13ef36c401c5caec007\": container with ID starting with 4cb7c0a74780700f71aca526fc137f4ebfd1647cf4b9c13ef36c401c5caec007 not found: ID does not exist"
Sep 10 13:34:58.455289 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.455257    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"]
Sep 10 13:34:58.472905 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:58.472874    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7f8babf4-8687d8bd7f-pwl4g"]
Sep 10 13:34:59.614114 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:34:59.614079    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27c124ca-035d-4df4-8b86-714c54cd5d59" path="/var/lib/kubelet/pods/27c124ca-035d-4df4-8b86-714c54cd5d59/volumes"
Sep 10 13:35:12.951216 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:12.951177    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"]
Sep 10 13:35:12.951825 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:12.951701    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27c124ca-035d-4df4-8b86-714c54cd5d59" containerName="maas-api"
Sep 10 13:35:12.951825 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:12.951715    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c124ca-035d-4df4-8b86-714c54cd5d59" containerName="maas-api"
Sep 10 13:35:12.951825 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:12.951790    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="27c124ca-035d-4df4-8b86-714c54cd5d59" containerName="maas-api"
Sep 10 13:35:12.954801 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:12.954778    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:12.959158 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:12.959137    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-7739cb-serving-cert\""
Sep 10 13:35:12.990306 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:12.990276    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:12.990438 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:12.990336    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:12.990438 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:12.990415    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfvw9\" (UniqueName: \"kubernetes.io/projected/eaa1261b-2790-4b7e-8595-b1f302a00ace-kube-api-access-tfvw9\") pod \"maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:12.990538 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:12.990461    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa1261b-2790-4b7e-8595-b1f302a00ace-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:13.047605 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:13.047572    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"]
Sep 10 13:35:13.090994 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:13.090955    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfvw9\" (UniqueName: \"kubernetes.io/projected/eaa1261b-2790-4b7e-8595-b1f302a00ace-kube-api-access-tfvw9\") pod \"maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:13.091178 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:13.091031    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa1261b-2790-4b7e-8595-b1f302a00ace-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:13.091178 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:13.091083    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:13.091178 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:13.091110    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:13.091352 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:35:13.091228    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-serving-cert: secret "maas-api-e2e-shared-b-w3-7739cb-serving-cert" not found
Sep 10 13:35:13.091352 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:35:13.091331    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-maas-api-tls podName:eaa1261b-2790-4b7e-8595-b1f302a00ace nodeName:}" failed. No retries permitted until 2026-09-10 13:35:13.591297086 +0000 UTC m=+1108.476924096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-maas-api-tls") pod "maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69" (UID: "eaa1261b-2790-4b7e-8595-b1f302a00ace") : secret "maas-api-e2e-shared-b-w3-7739cb-serving-cert" not found
Sep 10 13:35:13.091720 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:13.091699    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa1261b-2790-4b7e-8595-b1f302a00ace-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:13.093741 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:13.093711    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:13.103854 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:13.103828    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfvw9\" (UniqueName: \"kubernetes.io/projected/eaa1261b-2790-4b7e-8595-b1f302a00ace-kube-api-access-tfvw9\") pod \"maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:13.596950 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:13.596909    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:13.597169 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:35:13.597074    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-serving-cert: secret "maas-api-e2e-shared-b-w3-7739cb-serving-cert" not found
Sep 10 13:35:13.597169 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:35:13.597153    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-maas-api-tls podName:eaa1261b-2790-4b7e-8595-b1f302a00ace nodeName:}" failed. No retries permitted until 2026-09-10 13:35:14.597133408 +0000 UTC m=+1109.482760426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-maas-api-tls") pod "maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69" (UID: "eaa1261b-2790-4b7e-8595-b1f302a00ace") : secret "maas-api-e2e-shared-b-w3-7739cb-serving-cert" not found
Sep 10 13:35:14.606052 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:14.606017    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:14.608848 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:14.608804    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:14.766619 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:14.766581    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:15.045964 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:15.045925    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"]
Sep 10 13:35:15.049656 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:35:15.048670    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa1261b_2790_4b7e_8595_b1f302a00ace.slice/crio-a45ec6fe59cf6426d5b1713aac1ea69e0740fdbb0ff71c9646a1281a5cd98750 WatchSource:0}: Error finding container a45ec6fe59cf6426d5b1713aac1ea69e0740fdbb0ff71c9646a1281a5cd98750: Status 404 returned error can't find the container with id a45ec6fe59cf6426d5b1713aac1ea69e0740fdbb0ff71c9646a1281a5cd98750
Sep 10 13:35:15.503880 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:15.503841    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69" event={"ID":"eaa1261b-2790-4b7e-8595-b1f302a00ace","Type":"ContainerStarted","Data":"a45ec6fe59cf6426d5b1713aac1ea69e0740fdbb0ff71c9646a1281a5cd98750"}
Sep 10 13:35:16.511438 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:16.511397    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69" event={"ID":"eaa1261b-2790-4b7e-8595-b1f302a00ace","Type":"ContainerStarted","Data":"2bf621c164a8e7e7146761e654e46fae81ae6762da0dfb0deb702b8210edeaf7"}
Sep 10 13:35:16.511918 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:16.511504    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:16.533656 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:16.533605    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69" podStartSLOduration=3.996222706 podStartE2EDuration="4.533588693s" totalImagesPullingTime="537.365987ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:35:16.532330941 +0000 UTC m=+1111.417957959" watchObservedRunningTime="2026-09-10 13:35:16.533588693 +0000 UTC m=+1111.419215731"
Sep 10 13:35:22.522170 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:22.522133    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:35:29.775383 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.775344    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"]
Sep 10 13:35:29.780025 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.779994    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:29.783661 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.783634    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-c165a4-serving-cert\""
Sep 10 13:35:29.795933 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.795901    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"]
Sep 10 13:35:29.851488 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.851451    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8631c39b-f119-47c3-9c4f-11b11e623aac-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:29.851686 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.851514    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zc59\" (UniqueName: \"kubernetes.io/projected/8631c39b-f119-47c3-9c4f-11b11e623aac-kube-api-access-6zc59\") pod \"maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:29.851686 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.851579    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8631c39b-f119-47c3-9c4f-11b11e623aac-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:29.851686 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.851604    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8631c39b-f119-47c3-9c4f-11b11e623aac-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:29.952371 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.952330    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8631c39b-f119-47c3-9c4f-11b11e623aac-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:29.952612 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.952389    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zc59\" (UniqueName: \"kubernetes.io/projected/8631c39b-f119-47c3-9c4f-11b11e623aac-kube-api-access-6zc59\") pod \"maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:29.952612 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.952422    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8631c39b-f119-47c3-9c4f-11b11e623aac-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:29.952612 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.952439    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8631c39b-f119-47c3-9c4f-11b11e623aac-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:29.953048 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.953017    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8631c39b-f119-47c3-9c4f-11b11e623aac-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:29.955108 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.955082    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8631c39b-f119-47c3-9c4f-11b11e623aac-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:29.955108 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.955109    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8631c39b-f119-47c3-9c4f-11b11e623aac-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:29.961969 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:29.961949    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zc59\" (UniqueName: \"kubernetes.io/projected/8631c39b-f119-47c3-9c4f-11b11e623aac-kube-api-access-6zc59\") pod \"maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:30.091497 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:30.091392    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:30.401158 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:30.400999    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"]
Sep 10 13:35:30.404165 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:35:30.404139    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8631c39b_f119_47c3_9c4f_11b11e623aac.slice/crio-e938f01195929b6300d9c0c8ae1a6402af033c2bb9cd8d49130e2634a92f3bfe WatchSource:0}: Error finding container e938f01195929b6300d9c0c8ae1a6402af033c2bb9cd8d49130e2634a92f3bfe: Status 404 returned error can't find the container with id e938f01195929b6300d9c0c8ae1a6402af033c2bb9cd8d49130e2634a92f3bfe
Sep 10 13:35:30.592257 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:30.592225    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl" event={"ID":"8631c39b-f119-47c3-9c4f-11b11e623aac","Type":"ContainerStarted","Data":"e938f01195929b6300d9c0c8ae1a6402af033c2bb9cd8d49130e2634a92f3bfe"}
Sep 10 13:35:31.599685 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:31.599646    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl" event={"ID":"8631c39b-f119-47c3-9c4f-11b11e623aac","Type":"ContainerStarted","Data":"1e46ecace14d6065b8670fc542e8047cd12b1b15182ac6f1b82e5e3fb99d7b53"}
Sep 10 13:35:31.600100 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:31.599750    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:31.627283 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:31.627221    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl" podStartSLOduration=1.871777393 podStartE2EDuration="2.627205061s" totalImagesPullingTime="755.427668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:35:31.625427736 +0000 UTC m=+1126.511054766" watchObservedRunningTime="2026-09-10 13:35:31.627205061 +0000 UTC m=+1126.512832170"
Sep 10 13:35:37.613619 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:37.613590    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:35:58.870569 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:58.870531    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"]
Sep 10 13:35:58.875650 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:58.875627    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:35:58.879706 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:58.879687    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-e65037-serving-cert\""
Sep 10 13:35:58.889337 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:58.889312    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"]
Sep 10 13:35:58.931136 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:58.931098    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:35:58.931332 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:58.931143    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:35:58.931332 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:58.931259    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5q7x\" (UniqueName: \"kubernetes.io/projected/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-kube-api-access-q5q7x\") pod \"maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:35:58.931332 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:58.931289    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:35:59.032389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:59.032354    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:35:59.032389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:59.032392    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:35:59.032707 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:59.032460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5q7x\" (UniqueName: \"kubernetes.io/projected/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-kube-api-access-q5q7x\") pod \"maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:35:59.032707 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:59.032479    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:35:59.033155 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:59.033132    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:35:59.035376 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:59.035354    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:35:59.035503 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:59.035396    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:35:59.041620 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:59.041598    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5q7x\" (UniqueName: \"kubernetes.io/projected/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-kube-api-access-q5q7x\") pod \"maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:35:59.187330 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:59.187236    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:35:59.483127 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:59.483098    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"]
Sep 10 13:35:59.484903 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:35:59.484877    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df11c5a_e03d_4b32_9c3f_5e1d43daaa5f.slice/crio-cc1c96a1d5f20a510599dee3c180c50bb6fafa86c9d03c96005587011c50eba5 WatchSource:0}: Error finding container cc1c96a1d5f20a510599dee3c180c50bb6fafa86c9d03c96005587011c50eba5: Status 404 returned error can't find the container with id cc1c96a1d5f20a510599dee3c180c50bb6fafa86c9d03c96005587011c50eba5
Sep 10 13:35:59.763266 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:35:59.763180    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5" event={"ID":"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f","Type":"ContainerStarted","Data":"cc1c96a1d5f20a510599dee3c180c50bb6fafa86c9d03c96005587011c50eba5"}
Sep 10 13:36:00.769956 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:00.769920    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5" event={"ID":"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f","Type":"ContainerStarted","Data":"c727ec614f330b99048bb05f066fbfa6260d1b8647a7a7e7f6d8f1d76c175202"}
Sep 10 13:36:00.770462 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:00.769990    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:36:00.793602 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:00.793530    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5" podStartSLOduration=2.066530612 podStartE2EDuration="2.793513545s" totalImagesPullingTime="726.982933ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:36:00.79216694 +0000 UTC m=+1155.677793972" watchObservedRunningTime="2026-09-10 13:36:00.793513545 +0000 UTC m=+1155.679140968"
Sep 10 13:36:06.781767 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:06.781681    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:36:29.254957 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:29.254915    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7833-844b84"]
Sep 10 13:36:29.258722 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:29.258696    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7833-844b84"
Sep 10 13:36:29.261723 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:29.261703    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tqk99\""
Sep 10 13:36:29.265150 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:29.265121    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7833-844b84"]
Sep 10 13:36:29.437600 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:29.437545    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g45r5\" (UniqueName: \"kubernetes.io/projected/700d1629-ff81-49c4-9d32-a685ccd883cb-kube-api-access-g45r5\") pod \"test-curl-7833-844b84\" (UID: \"700d1629-ff81-49c4-9d32-a685ccd883cb\") " pod="opendatahub/test-curl-7833-844b84"
Sep 10 13:36:29.538844 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:29.538747    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g45r5\" (UniqueName: \"kubernetes.io/projected/700d1629-ff81-49c4-9d32-a685ccd883cb-kube-api-access-g45r5\") pod \"test-curl-7833-844b84\" (UID: \"700d1629-ff81-49c4-9d32-a685ccd883cb\") " pod="opendatahub/test-curl-7833-844b84"
Sep 10 13:36:29.548745 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:29.548712    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g45r5\" (UniqueName: \"kubernetes.io/projected/700d1629-ff81-49c4-9d32-a685ccd883cb-kube-api-access-g45r5\") pod \"test-curl-7833-844b84\" (UID: \"700d1629-ff81-49c4-9d32-a685ccd883cb\") " pod="opendatahub/test-curl-7833-844b84"
Sep 10 13:36:29.569176 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:29.569147    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7833-844b84"
Sep 10 13:36:29.857274 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:29.857250    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7833-844b84"]
Sep 10 13:36:29.859217 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:36:29.859190    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod700d1629_ff81_49c4_9d32_a685ccd883cb.slice/crio-d3bd3aa4de2de804c5c9c8922e95626de6339f186a1ffe711bf8e2ac965b32b7 WatchSource:0}: Error finding container d3bd3aa4de2de804c5c9c8922e95626de6339f186a1ffe711bf8e2ac965b32b7: Status 404 returned error can't find the container with id d3bd3aa4de2de804c5c9c8922e95626de6339f186a1ffe711bf8e2ac965b32b7
Sep 10 13:36:29.936846 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:29.936810    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7833-844b84" event={"ID":"700d1629-ff81-49c4-9d32-a685ccd883cb","Type":"ContainerStarted","Data":"d3bd3aa4de2de804c5c9c8922e95626de6339f186a1ffe711bf8e2ac965b32b7"}
Sep 10 13:36:32.956805 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:32.956766    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7833-844b84" event={"ID":"700d1629-ff81-49c4-9d32-a685ccd883cb","Type":"ContainerStarted","Data":"c11aa4e54116f98b408ffade56e811271f12c3d8ea52558cf4d2269af6c94169"}
Sep 10 13:36:32.975062 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:32.975014    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7833-844b84" podStartSLOduration=1.60260456 podStartE2EDuration="3.974999784s" totalImagesPullingTime="2.372395224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:36:32.973812028 +0000 UTC m=+1187.859439055" watchObservedRunningTime="2026-09-10 13:36:32.974999784 +0000 UTC m=+1187.860626811"
Sep 10 13:36:33.640777 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:33.640733    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7833-844b84"]
Sep 10 13:36:33.645738 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:33.645641    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7833-844b84"]
Sep 10 13:36:33.962738 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:36:33.962653    2584 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7833-844b84" container="test-curl-7833-844b84"
Sep 10 13:36:34.589771 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.589732    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"]
Sep 10 13:36:34.590299 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.590268    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="700d1629-ff81-49c4-9d32-a685ccd883cb" containerName="test-curl-7833-844b84"
Sep 10 13:36:34.590299 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.590285    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="700d1629-ff81-49c4-9d32-a685ccd883cb" containerName="test-curl-7833-844b84"
Sep 10 13:36:34.590481 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.590409    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="700d1629-ff81-49c4-9d32-a685ccd883cb" containerName="test-curl-7833-844b84"
Sep 10 13:36:34.593901 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.593880    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.598138 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.598113    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 13:36:34.598270 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.598168    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3ca6fbf6-openshift-default-dockercfg-h9l4s\""
Sep 10 13:36:34.609388 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.609359    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"]
Sep 10 13:36:34.685981 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.685946    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istiod-ca-cert\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.685981 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.685992    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-token\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.686215 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.686049    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-workload-socket\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.686215 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.686087    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-workload-certs\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.686215 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.686147    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-podinfo\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.686215 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.686192    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-envoy\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.686344 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.686234    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vkbt\" (UniqueName: \"kubernetes.io/projected/9e6bba60-92fa-4be8-95da-f27fc727bd2f-kube-api-access-9vkbt\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.686344 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.686310    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-credential-socket\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.686344 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.686329    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-data\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.787865 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.787813    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-podinfo\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.787865 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.787881    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-envoy\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.788166 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.787921    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vkbt\" (UniqueName: \"kubernetes.io/projected/9e6bba60-92fa-4be8-95da-f27fc727bd2f-kube-api-access-9vkbt\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.788166 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.788044    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-credential-socket\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.788166 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.788079    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-data\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.788166 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.788116    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istiod-ca-cert\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.788390 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.788169    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-token\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.788390 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.788214    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-workload-socket\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.788390 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.788250    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-workload-certs\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.788545 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.788484    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-credential-socket\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.788545 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.788500    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-data\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.788680 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.788634    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-workload-certs\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.788767 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.788746    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-workload-socket\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.788886 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.788867    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istiod-ca-cert\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.790569 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.790533    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-envoy\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.790979 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.790963    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-podinfo\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.797884 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.797861    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-token\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.797884 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.797881    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vkbt\" (UniqueName: \"kubernetes.io/projected/9e6bba60-92fa-4be8-95da-f27fc727bd2f-kube-api-access-9vkbt\") pod \"e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") " pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.904894 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.904855    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:34.968246 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:34.968210    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7833-844b84" podUID="700d1629-ff81-49c4-9d32-a685ccd883cb" containerName="test-curl-7833-844b84" containerID="cri-o://c11aa4e54116f98b408ffade56e811271f12c3d8ea52558cf4d2269af6c94169" gracePeriod=2
Sep 10 13:36:34.970810 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:36:34.970759    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7833-844b84\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="700d1629-ff81-49c4-9d32-a685ccd883cb" pod="opendatahub/test-curl-7833-844b84"
Sep 10 13:36:35.188486 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:35.188449    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"]
Sep 10 13:36:35.190778 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:36:35.190752    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6bba60_92fa_4be8_95da_f27fc727bd2f.slice/crio-5f4ee2a7e5dc2f29b59b514408c0fedfd07d72c1c2d25f5ffe96c5a11e8908c5 WatchSource:0}: Error finding container 5f4ee2a7e5dc2f29b59b514408c0fedfd07d72c1c2d25f5ffe96c5a11e8908c5: Status 404 returned error can't find the container with id 5f4ee2a7e5dc2f29b59b514408c0fedfd07d72c1c2d25f5ffe96c5a11e8908c5
Sep 10 13:36:35.193203 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:35.193170    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:36:35.193275 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:35.193241    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:36:35.193275 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:35.193266    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:36:35.612642 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:36:35.612601    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7833-844b84\" is forbidden: User \"system:node:ip-10-0-143-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-211.ec2.internal' and this object" podUID="700d1629-ff81-49c4-9d32-a685ccd883cb" pod="opendatahub/test-curl-7833-844b84"
Sep 10 13:36:35.975975 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:35.975885    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k" event={"ID":"9e6bba60-92fa-4be8-95da-f27fc727bd2f","Type":"ContainerStarted","Data":"71b09b0eb96a15071b09b254d8b8aaf04ac5d346b0d010a8d5303f6912b37c87"}
Sep 10 13:36:35.975975 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:35.975934    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k" event={"ID":"9e6bba60-92fa-4be8-95da-f27fc727bd2f","Type":"ContainerStarted","Data":"5f4ee2a7e5dc2f29b59b514408c0fedfd07d72c1c2d25f5ffe96c5a11e8908c5"}
Sep 10 13:36:36.000034 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:35.999974    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k" podStartSLOduration=1.9999588130000001 podStartE2EDuration="1.999958813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:36:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:36:35.999125135 +0000 UTC m=+1190.884752187" watchObservedRunningTime="2026-09-10 13:36:35.999958813 +0000 UTC m=+1190.885585839"
Sep 10 13:36:36.905641 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:36.905603    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:36.911392 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:36.911367    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:36.981616 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:36.981592    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:36.982495 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:36.982477    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:37.163065 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:37.163001    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7833-844b84"
Sep 10 13:36:37.211261 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:37.211230    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g45r5\" (UniqueName: \"kubernetes.io/projected/700d1629-ff81-49c4-9d32-a685ccd883cb-kube-api-access-g45r5\") pod \"700d1629-ff81-49c4-9d32-a685ccd883cb\" (UID: \"700d1629-ff81-49c4-9d32-a685ccd883cb\") "
Sep 10 13:36:37.213593 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:37.213571    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/700d1629-ff81-49c4-9d32-a685ccd883cb-kube-api-access-g45r5" (OuterVolumeSpecName: "kube-api-access-g45r5") pod "700d1629-ff81-49c4-9d32-a685ccd883cb" (UID: "700d1629-ff81-49c4-9d32-a685ccd883cb"). InnerVolumeSpecName "kube-api-access-g45r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:36:37.312656 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:37.312621    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g45r5\" (UniqueName: \"kubernetes.io/projected/700d1629-ff81-49c4-9d32-a685ccd883cb-kube-api-access-g45r5\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:36:37.613893 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:37.613862    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="700d1629-ff81-49c4-9d32-a685ccd883cb" path="/var/lib/kubelet/pods/700d1629-ff81-49c4-9d32-a685ccd883cb/volumes"
Sep 10 13:36:37.988723 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:37.988628    2584 generic.go:356] "Generic (PLEG): container finished" podID="700d1629-ff81-49c4-9d32-a685ccd883cb" containerID="c11aa4e54116f98b408ffade56e811271f12c3d8ea52558cf4d2269af6c94169" exitCode=137
Sep 10 13:36:37.988723 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:37.988675    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7833-844b84"
Sep 10 13:36:37.989269 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:37.988747    2584 scope.go:117] "RemoveContainer" containerID="c11aa4e54116f98b408ffade56e811271f12c3d8ea52558cf4d2269af6c94169"
Sep 10 13:36:37.998103 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:37.998085    2584 scope.go:117] "RemoveContainer" containerID="c11aa4e54116f98b408ffade56e811271f12c3d8ea52558cf4d2269af6c94169"
Sep 10 13:36:37.998392 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:36:37.998373    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c11aa4e54116f98b408ffade56e811271f12c3d8ea52558cf4d2269af6c94169\": container with ID starting with c11aa4e54116f98b408ffade56e811271f12c3d8ea52558cf4d2269af6c94169 not found: ID does not exist" containerID="c11aa4e54116f98b408ffade56e811271f12c3d8ea52558cf4d2269af6c94169"
Sep 10 13:36:37.998457 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:37.998400    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c11aa4e54116f98b408ffade56e811271f12c3d8ea52558cf4d2269af6c94169"} err="failed to get container status \"c11aa4e54116f98b408ffade56e811271f12c3d8ea52558cf4d2269af6c94169\": rpc error: code = NotFound desc = could not find container \"c11aa4e54116f98b408ffade56e811271f12c3d8ea52558cf4d2269af6c94169\": container with ID starting with c11aa4e54116f98b408ffade56e811271f12c3d8ea52558cf4d2269af6c94169 not found: ID does not exist"
Sep 10 13:36:39.300014 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.299969    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"]
Sep 10 13:36:39.305619 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.305407    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:39.308478 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.308452    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3ca6fbf6-serving-cert\""
Sep 10 13:36:39.317332 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.317303    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"]
Sep 10 13:36:39.333579 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.333526    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-metrics-certs\") pod \"maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:39.333744 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.333591    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2flm5\" (UniqueName: \"kubernetes.io/projected/b21d94c8-35ac-4104-9784-b20c5ba4b51a-kube-api-access-2flm5\") pod \"maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:39.333815 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.333794    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-maas-api-tls\") pod \"maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:39.333898 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.333882    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b21d94c8-35ac-4104-9784-b20c5ba4b51a-openshift-service-ca\") pod \"maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:39.435459 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.435421    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-maas-api-tls\") pod \"maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:39.435700 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.435504    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b21d94c8-35ac-4104-9784-b20c5ba4b51a-openshift-service-ca\") pod \"maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:39.435700 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.435609    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-metrics-certs\") pod \"maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:39.435700 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:36:39.435628    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-serving-cert: secret "maas-api-e2e-mt-3ca6fbf6-serving-cert" not found
Sep 10 13:36:39.435871 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.435640    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2flm5\" (UniqueName: \"kubernetes.io/projected/b21d94c8-35ac-4104-9784-b20c5ba4b51a-kube-api-access-2flm5\") pod \"maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:39.435871 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:36:39.435710    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-maas-api-tls podName:b21d94c8-35ac-4104-9784-b20c5ba4b51a nodeName:}" failed. No retries permitted until 2026-09-10 13:36:39.935687876 +0000 UTC m=+1194.821314903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-maas-api-tls") pod "maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9" (UID: "b21d94c8-35ac-4104-9784-b20c5ba4b51a") : secret "maas-api-e2e-mt-3ca6fbf6-serving-cert" not found
Sep 10 13:36:39.436213 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.436192    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b21d94c8-35ac-4104-9784-b20c5ba4b51a-openshift-service-ca\") pod \"maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:39.438284 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.438262    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-metrics-certs\") pod \"maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:39.447201 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.447170    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2flm5\" (UniqueName: \"kubernetes.io/projected/b21d94c8-35ac-4104-9784-b20c5ba4b51a-kube-api-access-2flm5\") pod \"maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:39.941281 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.941237    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-maas-api-tls\") pod \"maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:39.943934 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:39.943915    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-maas-api-tls\") pod \"maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:40.219111 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:40.219020    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:40.494380 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:40.494354    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"]
Sep 10 13:36:40.496619 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:36:40.496590    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb21d94c8_35ac_4104_9784_b20c5ba4b51a.slice/crio-b46a64679c7651777f50383f652cefb89565266096930288af0fe6db2cf43e1a WatchSource:0}: Error finding container b46a64679c7651777f50383f652cefb89565266096930288af0fe6db2cf43e1a: Status 404 returned error can't find the container with id b46a64679c7651777f50383f652cefb89565266096930288af0fe6db2cf43e1a
Sep 10 13:36:41.007438 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:41.007403    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9" event={"ID":"b21d94c8-35ac-4104-9784-b20c5ba4b51a","Type":"ContainerStarted","Data":"b46a64679c7651777f50383f652cefb89565266096930288af0fe6db2cf43e1a"}
Sep 10 13:36:42.014722 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:42.014683    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9" event={"ID":"b21d94c8-35ac-4104-9784-b20c5ba4b51a","Type":"ContainerStarted","Data":"a97c964e1f515ac89626e9e8dc12caa1d8511ebc02c100d1511008e3d53392a3"}
Sep 10 13:36:42.015204 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:42.014800    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:42.035430 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:42.035381    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9" podStartSLOduration=2.162327577 podStartE2EDuration="3.035363406s" totalImagesPullingTime="873.035829ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:36:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:36:42.034062103 +0000 UTC m=+1196.919689131" watchObservedRunningTime="2026-09-10 13:36:42.035363406 +0000 UTC m=+1196.920990433"
Sep 10 13:36:45.654903 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:45.654872    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:36:45.655799 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:45.655774    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:36:45.661283 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:45.661257    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:36:45.662160 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:45.662143    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:36:45.779443 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:45.779407    2584 scope.go:117] "RemoveContainer" containerID="6d313ecba0cf952893ebee377a0ffd4bfee2afbcea6084b46acc3b8d06f8451d"
Sep 10 13:36:48.032331 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:48.032300    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:36:57.103439 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:57.103405    2584 generic.go:356] "Generic (PLEG): container finished" podID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" containerID="71b09b0eb96a15071b09b254d8b8aaf04ac5d346b0d010a8d5303f6912b37c87" exitCode=0
Sep 10 13:36:57.103916 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:57.103481    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k" event={"ID":"9e6bba60-92fa-4be8-95da-f27fc727bd2f","Type":"ContainerDied","Data":"71b09b0eb96a15071b09b254d8b8aaf04ac5d346b0d010a8d5303f6912b37c87"}
Sep 10 13:36:57.103962 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:57.103926    2584 scope.go:117] "RemoveContainer" containerID="71b09b0eb96a15071b09b254d8b8aaf04ac5d346b0d010a8d5303f6912b37c87"
Sep 10 13:36:57.105204 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:57.105177    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:36:57.105272 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:57.105250    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:36:57.105313 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:57.105280    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:36:58.111104 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:58.111073    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k" event={"ID":"9e6bba60-92fa-4be8-95da-f27fc727bd2f","Type":"ContainerStarted","Data":"94323caeeec21455033fd66856ee7ff6c7b04b1351c72dfe1882efcc599a5207"}
Sep 10 13:36:58.905630 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:58.905586    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:36:58.905821 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:58.905782    2584 patch_prober.go:28] interesting pod/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 10 13:36:58.905868 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:58.905831    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k" podUID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 10 13:36:59.905762 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:59.905723    2584 patch_prober.go:28] interesting pod/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 10 13:36:59.906138 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:36:59.905780    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k" podUID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 10 13:37:00.906229 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:00.906187    2584 patch_prober.go:28] interesting pod/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 10 13:37:00.906675 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:00.906260    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k" podUID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 10 13:37:01.906207 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:01.906165    2584 patch_prober.go:28] interesting pod/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 10 13:37:01.906414 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:01.906224    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k" podUID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 10 13:37:02.905897 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:02.905864    2584 patch_prober.go:28] interesting pod/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 10 13:37:02.906133 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:02.905925    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k" podUID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 10 13:37:03.909453 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:03.909422    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:37:03.909876 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:03.909785    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:37:03.910472 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:03.910454    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:37:58.637606 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:58.637544    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"]
Sep 10 13:37:58.638183 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:58.637798    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9" podUID="b21d94c8-35ac-4104-9784-b20c5ba4b51a" containerName="maas-api" containerID="cri-o://a97c964e1f515ac89626e9e8dc12caa1d8511ebc02c100d1511008e3d53392a3" gracePeriod=30
Sep 10 13:37:58.928448 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:58.928421    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:37:59.023568 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.023522    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-maas-api-tls\") pod \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") "
Sep 10 13:37:59.023754 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.023655    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b21d94c8-35ac-4104-9784-b20c5ba4b51a-openshift-service-ca\") pod \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") "
Sep 10 13:37:59.023754 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.023699    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2flm5\" (UniqueName: \"kubernetes.io/projected/b21d94c8-35ac-4104-9784-b20c5ba4b51a-kube-api-access-2flm5\") pod \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") "
Sep 10 13:37:59.023754 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.023727    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-metrics-certs\") pod \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\" (UID: \"b21d94c8-35ac-4104-9784-b20c5ba4b51a\") "
Sep 10 13:37:59.024098 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.024047    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b21d94c8-35ac-4104-9784-b20c5ba4b51a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b21d94c8-35ac-4104-9784-b20c5ba4b51a" (UID: "b21d94c8-35ac-4104-9784-b20c5ba4b51a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:37:59.024235 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.024218    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b21d94c8-35ac-4104-9784-b20c5ba4b51a-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:37:59.026437 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.026402    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b21d94c8-35ac-4104-9784-b20c5ba4b51a-kube-api-access-2flm5" (OuterVolumeSpecName: "kube-api-access-2flm5") pod "b21d94c8-35ac-4104-9784-b20c5ba4b51a" (UID: "b21d94c8-35ac-4104-9784-b20c5ba4b51a"). InnerVolumeSpecName "kube-api-access-2flm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:37:59.026603 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.026445    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b21d94c8-35ac-4104-9784-b20c5ba4b51a" (UID: "b21d94c8-35ac-4104-9784-b20c5ba4b51a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:37:59.026603 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.026466    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b21d94c8-35ac-4104-9784-b20c5ba4b51a" (UID: "b21d94c8-35ac-4104-9784-b20c5ba4b51a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:37:59.125562 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.125530    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2flm5\" (UniqueName: \"kubernetes.io/projected/b21d94c8-35ac-4104-9784-b20c5ba4b51a-kube-api-access-2flm5\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:37:59.125740 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.125596    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:37:59.125740 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.125613    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b21d94c8-35ac-4104-9784-b20c5ba4b51a-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:37:59.467760 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.467726    2584 generic.go:356] "Generic (PLEG): container finished" podID="b21d94c8-35ac-4104-9784-b20c5ba4b51a" containerID="a97c964e1f515ac89626e9e8dc12caa1d8511ebc02c100d1511008e3d53392a3" exitCode=0
Sep 10 13:37:59.467939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.467779    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"
Sep 10 13:37:59.467939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.467812    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9" event={"ID":"b21d94c8-35ac-4104-9784-b20c5ba4b51a","Type":"ContainerDied","Data":"a97c964e1f515ac89626e9e8dc12caa1d8511ebc02c100d1511008e3d53392a3"}
Sep 10 13:37:59.467939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.467875    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9" event={"ID":"b21d94c8-35ac-4104-9784-b20c5ba4b51a","Type":"ContainerDied","Data":"b46a64679c7651777f50383f652cefb89565266096930288af0fe6db2cf43e1a"}
Sep 10 13:37:59.467939 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.467905    2584 scope.go:117] "RemoveContainer" containerID="a97c964e1f515ac89626e9e8dc12caa1d8511ebc02c100d1511008e3d53392a3"
Sep 10 13:37:59.478152 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.478133    2584 scope.go:117] "RemoveContainer" containerID="a97c964e1f515ac89626e9e8dc12caa1d8511ebc02c100d1511008e3d53392a3"
Sep 10 13:37:59.478425 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:37:59.478402    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a97c964e1f515ac89626e9e8dc12caa1d8511ebc02c100d1511008e3d53392a3\": container with ID starting with a97c964e1f515ac89626e9e8dc12caa1d8511ebc02c100d1511008e3d53392a3 not found: ID does not exist" containerID="a97c964e1f515ac89626e9e8dc12caa1d8511ebc02c100d1511008e3d53392a3"
Sep 10 13:37:59.478526 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.478433    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a97c964e1f515ac89626e9e8dc12caa1d8511ebc02c100d1511008e3d53392a3"} err="failed to get container status \"a97c964e1f515ac89626e9e8dc12caa1d8511ebc02c100d1511008e3d53392a3\": rpc error: code = NotFound desc = could not find container \"a97c964e1f515ac89626e9e8dc12caa1d8511ebc02c100d1511008e3d53392a3\": container with ID starting with a97c964e1f515ac89626e9e8dc12caa1d8511ebc02c100d1511008e3d53392a3 not found: ID does not exist"
Sep 10 13:37:59.492186 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.492163    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"]
Sep 10 13:37:59.500058 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.500037    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3ca6fbf6-75bd85f4bb-nxsw9"]
Sep 10 13:37:59.614872 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:37:59.614839    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b21d94c8-35ac-4104-9784-b20c5ba4b51a" path="/var/lib/kubelet/pods/b21d94c8-35ac-4104-9784-b20c5ba4b51a/volumes"
Sep 10 13:39:08.861840 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:08.861758    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"]
Sep 10 13:39:08.862352 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:08.862033    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k" podUID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" containerName="istio-proxy" containerID="cri-o://94323caeeec21455033fd66856ee7ff6c7b04b1351c72dfe1882efcc599a5207" gracePeriod=30
Sep 10 13:39:14.117031 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.117004    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:39:14.260149 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260064    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-credential-socket\") pod \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") "
Sep 10 13:39:14.260149 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260103    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istiod-ca-cert\") pod \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") "
Sep 10 13:39:14.260149 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260123    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-workload-socket\") pod \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") "
Sep 10 13:39:14.260427 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260170    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-token\") pod \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") "
Sep 10 13:39:14.260427 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260202    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-workload-certs\") pod \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") "
Sep 10 13:39:14.260427 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260218    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-data\") pod \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") "
Sep 10 13:39:14.260427 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260249    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vkbt\" (UniqueName: \"kubernetes.io/projected/9e6bba60-92fa-4be8-95da-f27fc727bd2f-kube-api-access-9vkbt\") pod \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") "
Sep 10 13:39:14.260427 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260303    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-envoy\") pod \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") "
Sep 10 13:39:14.260427 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260347    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-podinfo\") pod \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\" (UID: \"9e6bba60-92fa-4be8-95da-f27fc727bd2f\") "
Sep 10 13:39:14.260427 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260372    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e6bba60-92fa-4be8-95da-f27fc727bd2f" (UID: "9e6bba60-92fa-4be8-95da-f27fc727bd2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:39:14.260843 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260638    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e6bba60-92fa-4be8-95da-f27fc727bd2f" (UID: "9e6bba60-92fa-4be8-95da-f27fc727bd2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:39:14.260843 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260663    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e6bba60-92fa-4be8-95da-f27fc727bd2f" (UID: "9e6bba60-92fa-4be8-95da-f27fc727bd2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:39:14.260843 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260682    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-credential-socket\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:39:14.260843 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260683    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e6bba60-92fa-4be8-95da-f27fc727bd2f" (UID: "9e6bba60-92fa-4be8-95da-f27fc727bd2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:39:14.260843 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.260809    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e6bba60-92fa-4be8-95da-f27fc727bd2f" (UID: "9e6bba60-92fa-4be8-95da-f27fc727bd2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:39:14.262744 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.262713    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e6bba60-92fa-4be8-95da-f27fc727bd2f" (UID: "9e6bba60-92fa-4be8-95da-f27fc727bd2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:39:14.262864 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.262758    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e6bba60-92fa-4be8-95da-f27fc727bd2f-kube-api-access-9vkbt" (OuterVolumeSpecName: "kube-api-access-9vkbt") pod "9e6bba60-92fa-4be8-95da-f27fc727bd2f" (UID: "9e6bba60-92fa-4be8-95da-f27fc727bd2f"). InnerVolumeSpecName "kube-api-access-9vkbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:39:14.262864 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.262808    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e6bba60-92fa-4be8-95da-f27fc727bd2f" (UID: "9e6bba60-92fa-4be8-95da-f27fc727bd2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:39:14.262864 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.262843    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e6bba60-92fa-4be8-95da-f27fc727bd2f" (UID: "9e6bba60-92fa-4be8-95da-f27fc727bd2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 13:39:14.361901 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.361862    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vkbt\" (UniqueName: \"kubernetes.io/projected/9e6bba60-92fa-4be8-95da-f27fc727bd2f-kube-api-access-9vkbt\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:39:14.361901 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.361896    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-envoy\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:39:14.361901 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.361905    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-podinfo\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:39:14.362142 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.361913    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istiod-ca-cert\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:39:14.362142 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.361921    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-workload-socket\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:39:14.362142 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.361933    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-token\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:39:14.362142 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.361945    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-workload-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:39:14.362142 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.361955    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e6bba60-92fa-4be8-95da-f27fc727bd2f-istio-data\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:39:14.890968 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.890933    2584 generic.go:356] "Generic (PLEG): container finished" podID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" containerID="94323caeeec21455033fd66856ee7ff6c7b04b1351c72dfe1882efcc599a5207" exitCode=0
Sep 10 13:39:14.891188 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.890992    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"
Sep 10 13:39:14.891188 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.891002    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k" event={"ID":"9e6bba60-92fa-4be8-95da-f27fc727bd2f","Type":"ContainerDied","Data":"94323caeeec21455033fd66856ee7ff6c7b04b1351c72dfe1882efcc599a5207"}
Sep 10 13:39:14.891188 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.891060    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k" event={"ID":"9e6bba60-92fa-4be8-95da-f27fc727bd2f","Type":"ContainerDied","Data":"5f4ee2a7e5dc2f29b59b514408c0fedfd07d72c1c2d25f5ffe96c5a11e8908c5"}
Sep 10 13:39:14.891188 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.891090    2584 scope.go:117] "RemoveContainer" containerID="94323caeeec21455033fd66856ee7ff6c7b04b1351c72dfe1882efcc599a5207"
Sep 10 13:39:14.900978 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.900960    2584 scope.go:117] "RemoveContainer" containerID="71b09b0eb96a15071b09b254d8b8aaf04ac5d346b0d010a8d5303f6912b37c87"
Sep 10 13:39:14.909489 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.909467    2584 scope.go:117] "RemoveContainer" containerID="94323caeeec21455033fd66856ee7ff6c7b04b1351c72dfe1882efcc599a5207"
Sep 10 13:39:14.909783 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:39:14.909760    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94323caeeec21455033fd66856ee7ff6c7b04b1351c72dfe1882efcc599a5207\": container with ID starting with 94323caeeec21455033fd66856ee7ff6c7b04b1351c72dfe1882efcc599a5207 not found: ID does not exist" containerID="94323caeeec21455033fd66856ee7ff6c7b04b1351c72dfe1882efcc599a5207"
Sep 10 13:39:14.909856 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.909792    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94323caeeec21455033fd66856ee7ff6c7b04b1351c72dfe1882efcc599a5207"} err="failed to get container status \"94323caeeec21455033fd66856ee7ff6c7b04b1351c72dfe1882efcc599a5207\": rpc error: code = NotFound desc = could not find container \"94323caeeec21455033fd66856ee7ff6c7b04b1351c72dfe1882efcc599a5207\": container with ID starting with 94323caeeec21455033fd66856ee7ff6c7b04b1351c72dfe1882efcc599a5207 not found: ID does not exist"
Sep 10 13:39:14.909856 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.909813    2584 scope.go:117] "RemoveContainer" containerID="71b09b0eb96a15071b09b254d8b8aaf04ac5d346b0d010a8d5303f6912b37c87"
Sep 10 13:39:14.910050 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:39:14.910034    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71b09b0eb96a15071b09b254d8b8aaf04ac5d346b0d010a8d5303f6912b37c87\": container with ID starting with 71b09b0eb96a15071b09b254d8b8aaf04ac5d346b0d010a8d5303f6912b37c87 not found: ID does not exist" containerID="71b09b0eb96a15071b09b254d8b8aaf04ac5d346b0d010a8d5303f6912b37c87"
Sep 10 13:39:14.910093 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.910054    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71b09b0eb96a15071b09b254d8b8aaf04ac5d346b0d010a8d5303f6912b37c87"} err="failed to get container status \"71b09b0eb96a15071b09b254d8b8aaf04ac5d346b0d010a8d5303f6912b37c87\": rpc error: code = NotFound desc = could not find container \"71b09b0eb96a15071b09b254d8b8aaf04ac5d346b0d010a8d5303f6912b37c87\": container with ID starting with 71b09b0eb96a15071b09b254d8b8aaf04ac5d346b0d010a8d5303f6912b37c87 not found: ID does not exist"
Sep 10 13:39:14.920690 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.920665    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"]
Sep 10 13:39:14.924576 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:14.924538    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3ca6fbf6-openshift-default-5c47867c88-nfn9k"]
Sep 10 13:39:15.614634 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:39:15.614604    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" path="/var/lib/kubelet/pods/9e6bba60-92fa-4be8-95da-f27fc727bd2f/volumes"
Sep 10 13:40:11.827671 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.827637    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"]
Sep 10 13:40:11.828394 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.828371    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" containerName="istio-proxy"
Sep 10 13:40:11.828578 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.828419    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" containerName="istio-proxy"
Sep 10 13:40:11.828578 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.828437    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" containerName="istio-proxy"
Sep 10 13:40:11.828578 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.828446    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" containerName="istio-proxy"
Sep 10 13:40:11.828578 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.828470    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b21d94c8-35ac-4104-9784-b20c5ba4b51a" containerName="maas-api"
Sep 10 13:40:11.828578 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.828478    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b21d94c8-35ac-4104-9784-b20c5ba4b51a" containerName="maas-api"
Sep 10 13:40:11.828857 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.828635    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b21d94c8-35ac-4104-9784-b20c5ba4b51a" containerName="maas-api"
Sep 10 13:40:11.828857 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.828651    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" containerName="istio-proxy"
Sep 10 13:40:11.833418 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.833396    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:11.836693 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.836672    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-559bdf-serving-cert\""
Sep 10 13:40:11.848934 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.848898    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"]
Sep 10 13:40:11.892580 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.892527    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-metrics-certs\") pod \"maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:11.892779 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.892704    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-maas-api-tls\") pod \"maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:11.892779 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.892762    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb3907e-a8e6-4b6c-a842-464898e0513e-openshift-service-ca\") pod \"maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:11.892889 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.892812    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82mrv\" (UniqueName: \"kubernetes.io/projected/ebb3907e-a8e6-4b6c-a842-464898e0513e-kube-api-access-82mrv\") pod \"maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:11.993961 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.993931    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-metrics-certs\") pod \"maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:11.994172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.993977    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-maas-api-tls\") pod \"maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:11.994172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.994015    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb3907e-a8e6-4b6c-a842-464898e0513e-openshift-service-ca\") pod \"maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:11.994172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.994052    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82mrv\" (UniqueName: \"kubernetes.io/projected/ebb3907e-a8e6-4b6c-a842-464898e0513e-kube-api-access-82mrv\") pod \"maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:11.994359 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:40:11.994167    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-serving-cert: secret "maas-api-e2e-api-a-559bdf-serving-cert" not found
Sep 10 13:40:11.994359 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:40:11.994254    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-maas-api-tls podName:ebb3907e-a8e6-4b6c-a842-464898e0513e nodeName:}" failed. No retries permitted until 2026-09-10 13:40:12.494230809 +0000 UTC m=+1407.379857834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-maas-api-tls") pod "maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl" (UID: "ebb3907e-a8e6-4b6c-a842-464898e0513e") : secret "maas-api-e2e-api-a-559bdf-serving-cert" not found
Sep 10 13:40:11.994764 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.994743    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb3907e-a8e6-4b6c-a842-464898e0513e-openshift-service-ca\") pod \"maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:11.996665 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:11.996645    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-metrics-certs\") pod \"maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:12.003516 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:12.003491    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82mrv\" (UniqueName: \"kubernetes.io/projected/ebb3907e-a8e6-4b6c-a842-464898e0513e-kube-api-access-82mrv\") pod \"maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:12.497934 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:12.497897    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-maas-api-tls\") pod \"maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:12.500620 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:12.500594    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-maas-api-tls\") pod \"maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:12.747187 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:12.747158    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:13.025024 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:13.024993    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"]
Sep 10 13:40:13.025914 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:40:13.025889    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb3907e_a8e6_4b6c_a842_464898e0513e.slice/crio-b95795217adb5995dccd594ea8d37a42d3a285a39d761e0e760cc0fea45737dd WatchSource:0}: Error finding container b95795217adb5995dccd594ea8d37a42d3a285a39d761e0e760cc0fea45737dd: Status 404 returned error can't find the container with id b95795217adb5995dccd594ea8d37a42d3a285a39d761e0e760cc0fea45737dd
Sep 10 13:40:13.027511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:13.027489    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 13:40:13.198617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:13.198582    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl" event={"ID":"ebb3907e-a8e6-4b6c-a842-464898e0513e","Type":"ContainerStarted","Data":"b95795217adb5995dccd594ea8d37a42d3a285a39d761e0e760cc0fea45737dd"}
Sep 10 13:40:14.206299 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:14.206266    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl" event={"ID":"ebb3907e-a8e6-4b6c-a842-464898e0513e","Type":"ContainerStarted","Data":"6d91155def9aca0da09609f365aaf4f78266f6f47852c5254aaf913a6b42c621"}
Sep 10 13:40:14.206732 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:14.206401    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:14.239775 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:14.239696    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl" podStartSLOduration=2.704671087 podStartE2EDuration="3.23967988s" totalImagesPullingTime="535.008793ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:40:14.236570829 +0000 UTC m=+1409.122197850" watchObservedRunningTime="2026-09-10 13:40:14.23967988 +0000 UTC m=+1409.125306906"
Sep 10 13:40:20.218070 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:20.218036    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:40:40.593632 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.593535    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"]
Sep 10 13:40:40.594366 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.594350    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e6bba60-92fa-4be8-95da-f27fc727bd2f" containerName="istio-proxy"
Sep 10 13:40:40.597814 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.597793    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:40.600872 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.600852    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-fa4d53-serving-cert\""
Sep 10 13:40:40.616300 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.616275    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"]
Sep 10 13:40:40.675417 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.675384    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5p9j\" (UniqueName: \"kubernetes.io/projected/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-kube-api-access-c5p9j\") pod \"maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:40.675641 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.675432    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-metrics-certs\") pod \"maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:40.675641 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.675612    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-maas-api-tls\") pod \"maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:40.675763 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.675659    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-openshift-service-ca\") pod \"maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:40.776967 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.776930    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5p9j\" (UniqueName: \"kubernetes.io/projected/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-kube-api-access-c5p9j\") pod \"maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:40.777157 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.776980    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-metrics-certs\") pod \"maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:40.777157 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.777050    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-maas-api-tls\") pod \"maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:40.777157 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.777066    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-openshift-service-ca\") pod \"maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:40.777319 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:40:40.777171    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-serving-cert: secret "maas-api-e2e-api-b-fa4d53-serving-cert" not found
Sep 10 13:40:40.777319 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:40:40.777273    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-maas-api-tls podName:26a88db3-03b8-45bf-bf2c-bb946bcc5bee nodeName:}" failed. No retries permitted until 2026-09-10 13:40:41.277247931 +0000 UTC m=+1436.162874956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-maas-api-tls") pod "maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7" (UID: "26a88db3-03b8-45bf-bf2c-bb946bcc5bee") : secret "maas-api-e2e-api-b-fa4d53-serving-cert" not found
Sep 10 13:40:40.777889 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.777863    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-openshift-service-ca\") pod \"maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:40.779699 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.779680    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-metrics-certs\") pod \"maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:40.789117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:40.789095    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5p9j\" (UniqueName: \"kubernetes.io/projected/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-kube-api-access-c5p9j\") pod \"maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:41.282581 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:41.282510    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-maas-api-tls\") pod \"maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:41.285157 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:41.285129    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-maas-api-tls\") pod \"maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:41.510821 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:41.510781    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:41.795253 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:41.795226    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"]
Sep 10 13:40:41.797453 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:40:41.797405    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26a88db3_03b8_45bf_bf2c_bb946bcc5bee.slice/crio-7bc602a500b2d16a3afaf0225cc885eaca890bb9a9e85f01d1ef6c785d0f5b10 WatchSource:0}: Error finding container 7bc602a500b2d16a3afaf0225cc885eaca890bb9a9e85f01d1ef6c785d0f5b10: Status 404 returned error can't find the container with id 7bc602a500b2d16a3afaf0225cc885eaca890bb9a9e85f01d1ef6c785d0f5b10
Sep 10 13:40:42.372282 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:42.372248    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7" event={"ID":"26a88db3-03b8-45bf-bf2c-bb946bcc5bee","Type":"ContainerStarted","Data":"be12554319d07b47f0d7cf2cf96a59660cb8310b8af36115c600c9783f9c1772"}
Sep 10 13:40:42.372477 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:42.372310    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7" event={"ID":"26a88db3-03b8-45bf-bf2c-bb946bcc5bee","Type":"ContainerStarted","Data":"7bc602a500b2d16a3afaf0225cc885eaca890bb9a9e85f01d1ef6c785d0f5b10"}
Sep 10 13:40:42.372477 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:42.372409    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:40:42.399163 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:42.399116    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7" podStartSLOduration=1.919443708 podStartE2EDuration="2.39910118s" totalImagesPullingTime="479.657472ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:40:42.396530992 +0000 UTC m=+1437.282158019" watchObservedRunningTime="2026-09-10 13:40:42.39910118 +0000 UTC m=+1437.284728240"
Sep 10 13:40:48.383244 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:40:48.383216    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:41:23.789517 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:23.789484    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"]
Sep 10 13:41:23.789993 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:23.789709    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl" podUID="ebb3907e-a8e6-4b6c-a842-464898e0513e" containerName="maas-api" containerID="cri-o://6d91155def9aca0da09609f365aaf4f78266f6f47852c5254aaf913a6b42c621" gracePeriod=30
Sep 10 13:41:24.056412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.056382    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:41:24.206086 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.206048    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82mrv\" (UniqueName: \"kubernetes.io/projected/ebb3907e-a8e6-4b6c-a842-464898e0513e-kube-api-access-82mrv\") pod \"ebb3907e-a8e6-4b6c-a842-464898e0513e\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") "
Sep 10 13:41:24.206284 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.206139    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-metrics-certs\") pod \"ebb3907e-a8e6-4b6c-a842-464898e0513e\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") "
Sep 10 13:41:24.206284 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.206160    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-maas-api-tls\") pod \"ebb3907e-a8e6-4b6c-a842-464898e0513e\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") "
Sep 10 13:41:24.206284 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.206252    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb3907e-a8e6-4b6c-a842-464898e0513e-openshift-service-ca\") pod \"ebb3907e-a8e6-4b6c-a842-464898e0513e\" (UID: \"ebb3907e-a8e6-4b6c-a842-464898e0513e\") "
Sep 10 13:41:24.206696 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.206662    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebb3907e-a8e6-4b6c-a842-464898e0513e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ebb3907e-a8e6-4b6c-a842-464898e0513e" (UID: "ebb3907e-a8e6-4b6c-a842-464898e0513e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:41:24.208667 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.208639    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ebb3907e-a8e6-4b6c-a842-464898e0513e" (UID: "ebb3907e-a8e6-4b6c-a842-464898e0513e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:41:24.208835 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.208806    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebb3907e-a8e6-4b6c-a842-464898e0513e-kube-api-access-82mrv" (OuterVolumeSpecName: "kube-api-access-82mrv") pod "ebb3907e-a8e6-4b6c-a842-464898e0513e" (UID: "ebb3907e-a8e6-4b6c-a842-464898e0513e"). InnerVolumeSpecName "kube-api-access-82mrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:41:24.209022 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.208997    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ebb3907e-a8e6-4b6c-a842-464898e0513e" (UID: "ebb3907e-a8e6-4b6c-a842-464898e0513e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:41:24.307692 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.307600    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb3907e-a8e6-4b6c-a842-464898e0513e-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:41:24.307692 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.307632    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82mrv\" (UniqueName: \"kubernetes.io/projected/ebb3907e-a8e6-4b6c-a842-464898e0513e-kube-api-access-82mrv\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:41:24.307692 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.307642    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:41:24.307692 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.307650    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebb3907e-a8e6-4b6c-a842-464898e0513e-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:41:24.621958 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.621922    2584 generic.go:356] "Generic (PLEG): container finished" podID="ebb3907e-a8e6-4b6c-a842-464898e0513e" containerID="6d91155def9aca0da09609f365aaf4f78266f6f47852c5254aaf913a6b42c621" exitCode=0
Sep 10 13:41:24.622112 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.621981    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"
Sep 10 13:41:24.622112 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.622011    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl" event={"ID":"ebb3907e-a8e6-4b6c-a842-464898e0513e","Type":"ContainerDied","Data":"6d91155def9aca0da09609f365aaf4f78266f6f47852c5254aaf913a6b42c621"}
Sep 10 13:41:24.622112 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.622072    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl" event={"ID":"ebb3907e-a8e6-4b6c-a842-464898e0513e","Type":"ContainerDied","Data":"b95795217adb5995dccd594ea8d37a42d3a285a39d761e0e760cc0fea45737dd"}
Sep 10 13:41:24.622112 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.622102    2584 scope.go:117] "RemoveContainer" containerID="6d91155def9aca0da09609f365aaf4f78266f6f47852c5254aaf913a6b42c621"
Sep 10 13:41:24.632946 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.632927    2584 scope.go:117] "RemoveContainer" containerID="6d91155def9aca0da09609f365aaf4f78266f6f47852c5254aaf913a6b42c621"
Sep 10 13:41:24.633273 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:41:24.633254    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d91155def9aca0da09609f365aaf4f78266f6f47852c5254aaf913a6b42c621\": container with ID starting with 6d91155def9aca0da09609f365aaf4f78266f6f47852c5254aaf913a6b42c621 not found: ID does not exist" containerID="6d91155def9aca0da09609f365aaf4f78266f6f47852c5254aaf913a6b42c621"
Sep 10 13:41:24.633342 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.633282    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d91155def9aca0da09609f365aaf4f78266f6f47852c5254aaf913a6b42c621"} err="failed to get container status \"6d91155def9aca0da09609f365aaf4f78266f6f47852c5254aaf913a6b42c621\": rpc error: code = NotFound desc = could not find container \"6d91155def9aca0da09609f365aaf4f78266f6f47852c5254aaf913a6b42c621\": container with ID starting with 6d91155def9aca0da09609f365aaf4f78266f6f47852c5254aaf913a6b42c621 not found: ID does not exist"
Sep 10 13:41:24.672980 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.672947    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"]
Sep 10 13:41:24.682318 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:24.682292    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-559bdf-76bbd646b9-k6qwl"]
Sep 10 13:41:25.615012 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:25.614979    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebb3907e-a8e6-4b6c-a842-464898e0513e" path="/var/lib/kubelet/pods/ebb3907e-a8e6-4b6c-a842-464898e0513e/volumes"
Sep 10 13:41:45.690006 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:45.689976    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:41:45.691845 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:45.691821    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:41:45.696347 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:45.696321    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:41:45.698121 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:45.698097    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:41:49.963263 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:49.963229    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"]
Sep 10 13:41:49.963758 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:49.963520    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7" podUID="26a88db3-03b8-45bf-bf2c-bb946bcc5bee" containerName="maas-api" containerID="cri-o://be12554319d07b47f0d7cf2cf96a59660cb8310b8af36115c600c9783f9c1772" gracePeriod=30
Sep 10 13:41:50.217057 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.216998    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:41:50.344709 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.344679    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5p9j\" (UniqueName: \"kubernetes.io/projected/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-kube-api-access-c5p9j\") pod \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") "
Sep 10 13:41:50.344875 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.344751    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-metrics-certs\") pod \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") "
Sep 10 13:41:50.344959 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.344925    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-maas-api-tls\") pod \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") "
Sep 10 13:41:50.345034 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.345017    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-openshift-service-ca\") pod \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\" (UID: \"26a88db3-03b8-45bf-bf2c-bb946bcc5bee\") "
Sep 10 13:41:50.345401 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.345356    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "26a88db3-03b8-45bf-bf2c-bb946bcc5bee" (UID: "26a88db3-03b8-45bf-bf2c-bb946bcc5bee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:41:50.347106 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.347078    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "26a88db3-03b8-45bf-bf2c-bb946bcc5bee" (UID: "26a88db3-03b8-45bf-bf2c-bb946bcc5bee"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:41:50.347606 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.347581    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "26a88db3-03b8-45bf-bf2c-bb946bcc5bee" (UID: "26a88db3-03b8-45bf-bf2c-bb946bcc5bee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:41:50.347696 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.347679    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-kube-api-access-c5p9j" (OuterVolumeSpecName: "kube-api-access-c5p9j") pod "26a88db3-03b8-45bf-bf2c-bb946bcc5bee" (UID: "26a88db3-03b8-45bf-bf2c-bb946bcc5bee"). InnerVolumeSpecName "kube-api-access-c5p9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:41:50.413054 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.413022    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"]
Sep 10 13:41:50.413492 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.413455    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebb3907e-a8e6-4b6c-a842-464898e0513e" containerName="maas-api"
Sep 10 13:41:50.413537 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.413497    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebb3907e-a8e6-4b6c-a842-464898e0513e" containerName="maas-api"
Sep 10 13:41:50.413537 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.413516    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26a88db3-03b8-45bf-bf2c-bb946bcc5bee" containerName="maas-api"
Sep 10 13:41:50.413537 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.413521    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="26a88db3-03b8-45bf-bf2c-bb946bcc5bee" containerName="maas-api"
Sep 10 13:41:50.413668 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.413606    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="26a88db3-03b8-45bf-bf2c-bb946bcc5bee" containerName="maas-api"
Sep 10 13:41:50.413668 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.413616    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebb3907e-a8e6-4b6c-a842-464898e0513e" containerName="maas-api"
Sep 10 13:41:50.416895 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.416876    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.419829 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.419803    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 13:41:50.420116 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.420094    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-56b405-openshift-default-dockercfg-lrlcj\""
Sep 10 13:41:50.432462 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.432437    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"]
Sep 10 13:41:50.446387 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.446361    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5p9j\" (UniqueName: \"kubernetes.io/projected/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-kube-api-access-c5p9j\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:41:50.446387 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.446387    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:41:50.446661 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.446398    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:41:50.446661 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.446406    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26a88db3-03b8-45bf-bf2c-bb946bcc5bee-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:41:50.547730 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.547636    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-credential-socket\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.547730 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.547676    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-data\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.547730 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.547697    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istiod-ca-cert\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.548019 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.547764    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjh86\" (UniqueName: \"kubernetes.io/projected/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-kube-api-access-xjh86\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.548019 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.547812    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-envoy\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.548019 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.547837    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-workload-socket\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.548019 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.547917    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-token\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.548019 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.547935    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-podinfo\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.548019 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.548004    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-workload-certs\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.649161 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.649120    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-envoy\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.649359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.649175    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-workload-socket\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.649359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.649247    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-token\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.649359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.649271    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-podinfo\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.649359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.649342    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-workload-certs\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.649726 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.649388    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-credential-socket\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.649726 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.649414    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-data\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.649726 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.649438    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istiod-ca-cert\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.649726 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.649468    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjh86\" (UniqueName: \"kubernetes.io/projected/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-kube-api-access-xjh86\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.649952 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.649850    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-credential-socket\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.649952 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.649924    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-workload-socket\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.650241 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.650212    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istiod-ca-cert\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.650241 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.650238    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-workload-certs\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.650418 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.650294    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-data\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.651819 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.651794    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-envoy\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.652063 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.652041    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-podinfo\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.659122 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.659095    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-token\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.659277 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.659256    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjh86\" (UniqueName: \"kubernetes.io/projected/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-kube-api-access-xjh86\") pod \"e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") " pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.731162 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.731129    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:50.768753 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.768720    2584 generic.go:356] "Generic (PLEG): container finished" podID="26a88db3-03b8-45bf-bf2c-bb946bcc5bee" containerID="be12554319d07b47f0d7cf2cf96a59660cb8310b8af36115c600c9783f9c1772" exitCode=0
Sep 10 13:41:50.768919 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.768772    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"
Sep 10 13:41:50.768919 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.768782    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7" event={"ID":"26a88db3-03b8-45bf-bf2c-bb946bcc5bee","Type":"ContainerDied","Data":"be12554319d07b47f0d7cf2cf96a59660cb8310b8af36115c600c9783f9c1772"}
Sep 10 13:41:50.768919 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.768834    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7" event={"ID":"26a88db3-03b8-45bf-bf2c-bb946bcc5bee","Type":"ContainerDied","Data":"7bc602a500b2d16a3afaf0225cc885eaca890bb9a9e85f01d1ef6c785d0f5b10"}
Sep 10 13:41:50.768919 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.768869    2584 scope.go:117] "RemoveContainer" containerID="be12554319d07b47f0d7cf2cf96a59660cb8310b8af36115c600c9783f9c1772"
Sep 10 13:41:50.780210 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.780185    2584 scope.go:117] "RemoveContainer" containerID="be12554319d07b47f0d7cf2cf96a59660cb8310b8af36115c600c9783f9c1772"
Sep 10 13:41:50.780533 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:41:50.780513    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be12554319d07b47f0d7cf2cf96a59660cb8310b8af36115c600c9783f9c1772\": container with ID starting with be12554319d07b47f0d7cf2cf96a59660cb8310b8af36115c600c9783f9c1772 not found: ID does not exist" containerID="be12554319d07b47f0d7cf2cf96a59660cb8310b8af36115c600c9783f9c1772"
Sep 10 13:41:50.780625 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.780546    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be12554319d07b47f0d7cf2cf96a59660cb8310b8af36115c600c9783f9c1772"} err="failed to get container status \"be12554319d07b47f0d7cf2cf96a59660cb8310b8af36115c600c9783f9c1772\": rpc error: code = NotFound desc = could not find container \"be12554319d07b47f0d7cf2cf96a59660cb8310b8af36115c600c9783f9c1772\": container with ID starting with be12554319d07b47f0d7cf2cf96a59660cb8310b8af36115c600c9783f9c1772 not found: ID does not exist"
Sep 10 13:41:50.833626 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.833522    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"]
Sep 10 13:41:50.855647 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:50.855612    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fa4d53-77c8ffdc8b-k6vn7"]
Sep 10 13:41:51.022168 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:51.022087    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"]
Sep 10 13:41:51.022509 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:41:51.022395    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ddefe2_7ba3_4a47_a8e4_e65bfdb9fc2d.slice/crio-1f4cfece3d4bed5960733dcd3c72b8897a63f797af477582e1e6913adf0fb0e4 WatchSource:0}: Error finding container 1f4cfece3d4bed5960733dcd3c72b8897a63f797af477582e1e6913adf0fb0e4: Status 404 returned error can't find the container with id 1f4cfece3d4bed5960733dcd3c72b8897a63f797af477582e1e6913adf0fb0e4
Sep 10 13:41:51.024989 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:51.024957    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:41:51.025075 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:51.025024    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:41:51.025075 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:51.025054    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:41:51.620606 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:51.620549    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26a88db3-03b8-45bf-bf2c-bb946bcc5bee" path="/var/lib/kubelet/pods/26a88db3-03b8-45bf-bf2c-bb946bcc5bee/volumes"
Sep 10 13:41:51.777225 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:51.777189    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7" event={"ID":"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d","Type":"ContainerStarted","Data":"f00292dcecb345611dcde91a12f7a9813edad90c7e7df61ab91d28ff70ba41df"}
Sep 10 13:41:51.777432 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:51.777245    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7" event={"ID":"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d","Type":"ContainerStarted","Data":"1f4cfece3d4bed5960733dcd3c72b8897a63f797af477582e1e6913adf0fb0e4"}
Sep 10 13:41:51.800981 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:51.800915    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7" podStartSLOduration=1.800900969 podStartE2EDuration="1.800900969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:41:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:41:51.799098374 +0000 UTC m=+1506.684725411" watchObservedRunningTime="2026-09-10 13:41:51.800900969 +0000 UTC m=+1506.686527996"
Sep 10 13:41:52.731753 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:52.731722    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:52.738709 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:52.738674    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:52.783279 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:52.783246    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:52.784327 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:52.784307    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:41:55.016959 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.016919    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"]
Sep 10 13:41:55.021891 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.021864    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:55.025573 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.025531    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-56b405-serving-cert\""
Sep 10 13:41:55.039505 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.039470    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"]
Sep 10 13:41:55.095308 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.095270    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c36ded-14ee-49fd-b25d-c5a64debbc46-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:55.095698 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.095654    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49c36ded-14ee-49fd-b25d-c5a64debbc46-maas-api-tls\") pod \"maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:55.095806 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.095723    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9vws\" (UniqueName: \"kubernetes.io/projected/49c36ded-14ee-49fd-b25d-c5a64debbc46-kube-api-access-z9vws\") pod \"maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:55.095806 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.095748    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c36ded-14ee-49fd-b25d-c5a64debbc46-metrics-certs\") pod \"maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:55.197099 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.197065    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9vws\" (UniqueName: \"kubernetes.io/projected/49c36ded-14ee-49fd-b25d-c5a64debbc46-kube-api-access-z9vws\") pod \"maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:55.197099 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.197108    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c36ded-14ee-49fd-b25d-c5a64debbc46-metrics-certs\") pod \"maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:55.197439 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.197190    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c36ded-14ee-49fd-b25d-c5a64debbc46-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:55.197439 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.197247    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49c36ded-14ee-49fd-b25d-c5a64debbc46-maas-api-tls\") pod \"maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:55.197900 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.197875    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c36ded-14ee-49fd-b25d-c5a64debbc46-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:55.199738 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.199711    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c36ded-14ee-49fd-b25d-c5a64debbc46-metrics-certs\") pod \"maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:55.199832 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.199790    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49c36ded-14ee-49fd-b25d-c5a64debbc46-maas-api-tls\") pod \"maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:55.207065 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.207000    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9vws\" (UniqueName: \"kubernetes.io/projected/49c36ded-14ee-49fd-b25d-c5a64debbc46-kube-api-access-z9vws\") pod \"maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:55.333747 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.333649    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:55.629898 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.629859    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"]
Sep 10 13:41:55.630588 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:41:55.630540    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c36ded_14ee_49fd_b25d_c5a64debbc46.slice/crio-16bef9da4c76babbed36b3b22ca1589324cb02924ffc835dd0ff811fcf8fa057 WatchSource:0}: Error finding container 16bef9da4c76babbed36b3b22ca1589324cb02924ffc835dd0ff811fcf8fa057: Status 404 returned error can't find the container with id 16bef9da4c76babbed36b3b22ca1589324cb02924ffc835dd0ff811fcf8fa057
Sep 10 13:41:55.802069 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:55.802017    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k" event={"ID":"49c36ded-14ee-49fd-b25d-c5a64debbc46","Type":"ContainerStarted","Data":"16bef9da4c76babbed36b3b22ca1589324cb02924ffc835dd0ff811fcf8fa057"}
Sep 10 13:41:56.809788 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:56.809753    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k" event={"ID":"49c36ded-14ee-49fd-b25d-c5a64debbc46","Type":"ContainerStarted","Data":"8abe4569048de526b7844dd6b0245c0714f60f0b2723ad06c76ed6e56ba8f137"}
Sep 10 13:41:56.811823 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:56.809903    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:41:56.834922 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:41:56.834861    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k" podStartSLOduration=2.369438174 podStartE2EDuration="2.834839365s" totalImagesPullingTime="465.401191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:41:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:41:56.833654845 +0000 UTC m=+1511.719281872" watchObservedRunningTime="2026-09-10 13:41:56.834839365 +0000 UTC m=+1511.720466392"
Sep 10 13:42:02.820362 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:02.820327    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:42:10.078889 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.078839    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"]
Sep 10 13:42:10.079407 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.079144    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl" podUID="8631c39b-f119-47c3-9c4f-11b11e623aac" containerName="maas-api" containerID="cri-o://1e46ecace14d6065b8670fc542e8047cd12b1b15182ac6f1b82e5e3fb99d7b53" gracePeriod=30
Sep 10 13:42:10.349690 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.349661    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:42:10.450412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.450375    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zc59\" (UniqueName: \"kubernetes.io/projected/8631c39b-f119-47c3-9c4f-11b11e623aac-kube-api-access-6zc59\") pod \"8631c39b-f119-47c3-9c4f-11b11e623aac\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") "
Sep 10 13:42:10.450608 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.450438    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8631c39b-f119-47c3-9c4f-11b11e623aac-metrics-certs\") pod \"8631c39b-f119-47c3-9c4f-11b11e623aac\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") "
Sep 10 13:42:10.450608 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.450540    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8631c39b-f119-47c3-9c4f-11b11e623aac-maas-api-tls\") pod \"8631c39b-f119-47c3-9c4f-11b11e623aac\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") "
Sep 10 13:42:10.450699 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.450627    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8631c39b-f119-47c3-9c4f-11b11e623aac-openshift-service-ca\") pod \"8631c39b-f119-47c3-9c4f-11b11e623aac\" (UID: \"8631c39b-f119-47c3-9c4f-11b11e623aac\") "
Sep 10 13:42:10.451286 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.451254    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8631c39b-f119-47c3-9c4f-11b11e623aac-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8631c39b-f119-47c3-9c4f-11b11e623aac" (UID: "8631c39b-f119-47c3-9c4f-11b11e623aac"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:42:10.451574 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.451530    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8631c39b-f119-47c3-9c4f-11b11e623aac-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:42:10.452957 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.452922    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8631c39b-f119-47c3-9c4f-11b11e623aac-kube-api-access-6zc59" (OuterVolumeSpecName: "kube-api-access-6zc59") pod "8631c39b-f119-47c3-9c4f-11b11e623aac" (UID: "8631c39b-f119-47c3-9c4f-11b11e623aac"). InnerVolumeSpecName "kube-api-access-6zc59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:42:10.453446 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.453421    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8631c39b-f119-47c3-9c4f-11b11e623aac-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8631c39b-f119-47c3-9c4f-11b11e623aac" (UID: "8631c39b-f119-47c3-9c4f-11b11e623aac"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:42:10.453683 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.453658    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8631c39b-f119-47c3-9c4f-11b11e623aac-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8631c39b-f119-47c3-9c4f-11b11e623aac" (UID: "8631c39b-f119-47c3-9c4f-11b11e623aac"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:42:10.552650 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.552611    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zc59\" (UniqueName: \"kubernetes.io/projected/8631c39b-f119-47c3-9c4f-11b11e623aac-kube-api-access-6zc59\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:42:10.552650 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.552643    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8631c39b-f119-47c3-9c4f-11b11e623aac-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:42:10.552650 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.552653    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8631c39b-f119-47c3-9c4f-11b11e623aac-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:42:10.889069 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.889031    2584 generic.go:356] "Generic (PLEG): container finished" podID="8631c39b-f119-47c3-9c4f-11b11e623aac" containerID="1e46ecace14d6065b8670fc542e8047cd12b1b15182ac6f1b82e5e3fb99d7b53" exitCode=0
Sep 10 13:42:10.889279 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.889085    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"
Sep 10 13:42:10.889279 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.889121    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl" event={"ID":"8631c39b-f119-47c3-9c4f-11b11e623aac","Type":"ContainerDied","Data":"1e46ecace14d6065b8670fc542e8047cd12b1b15182ac6f1b82e5e3fb99d7b53"}
Sep 10 13:42:10.889279 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.889188    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl" event={"ID":"8631c39b-f119-47c3-9c4f-11b11e623aac","Type":"ContainerDied","Data":"e938f01195929b6300d9c0c8ae1a6402af033c2bb9cd8d49130e2634a92f3bfe"}
Sep 10 13:42:10.889279 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.889218    2584 scope.go:117] "RemoveContainer" containerID="1e46ecace14d6065b8670fc542e8047cd12b1b15182ac6f1b82e5e3fb99d7b53"
Sep 10 13:42:10.899445 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.899424    2584 scope.go:117] "RemoveContainer" containerID="1e46ecace14d6065b8670fc542e8047cd12b1b15182ac6f1b82e5e3fb99d7b53"
Sep 10 13:42:10.899792 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:42:10.899772    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e46ecace14d6065b8670fc542e8047cd12b1b15182ac6f1b82e5e3fb99d7b53\": container with ID starting with 1e46ecace14d6065b8670fc542e8047cd12b1b15182ac6f1b82e5e3fb99d7b53 not found: ID does not exist" containerID="1e46ecace14d6065b8670fc542e8047cd12b1b15182ac6f1b82e5e3fb99d7b53"
Sep 10 13:42:10.899895 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.899808    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e46ecace14d6065b8670fc542e8047cd12b1b15182ac6f1b82e5e3fb99d7b53"} err="failed to get container status \"1e46ecace14d6065b8670fc542e8047cd12b1b15182ac6f1b82e5e3fb99d7b53\": rpc error: code = NotFound desc = could not find container \"1e46ecace14d6065b8670fc542e8047cd12b1b15182ac6f1b82e5e3fb99d7b53\": container with ID starting with 1e46ecace14d6065b8670fc542e8047cd12b1b15182ac6f1b82e5e3fb99d7b53 not found: ID does not exist"
Sep 10 13:42:10.919756 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.919729    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"]
Sep 10 13:42:10.923186 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:10.923158    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c165a4-7c8c79dc57-2jjrl"]
Sep 10 13:42:11.614494 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:11.614458    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8631c39b-f119-47c3-9c4f-11b11e623aac" path="/var/lib/kubelet/pods/8631c39b-f119-47c3-9c4f-11b11e623aac/volumes"
Sep 10 13:42:12.902161 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:12.902126    2584 generic.go:356] "Generic (PLEG): container finished" podID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" containerID="f00292dcecb345611dcde91a12f7a9813edad90c7e7df61ab91d28ff70ba41df" exitCode=0
Sep 10 13:42:12.902602 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:12.902185    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7" event={"ID":"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d","Type":"ContainerDied","Data":"f00292dcecb345611dcde91a12f7a9813edad90c7e7df61ab91d28ff70ba41df"}
Sep 10 13:42:12.902654 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:12.902618    2584 scope.go:117] "RemoveContainer" containerID="f00292dcecb345611dcde91a12f7a9813edad90c7e7df61ab91d28ff70ba41df"
Sep 10 13:42:12.903786 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:12.903757    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:42:12.903847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:12.903831    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:42:12.903883 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:12.903863    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 13:42:13.909751 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:13.909714    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7" event={"ID":"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d","Type":"ContainerStarted","Data":"fc5f7c5593bce41970e3d336f4344a6b1d032f313614ab5310280c3ba0aab959"}
Sep 10 13:42:14.732418 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:14.732379    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:42:14.732774 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:14.732746    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 13:42:14.732894 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:14.732808    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7" podUID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 13:42:15.732269 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:15.732220    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 13:42:15.732822 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:15.732295    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7" podUID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 13:42:16.732610 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:16.732545    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 13:42:16.733131 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:16.732646    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7" podUID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 13:42:17.733182 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:17.733135    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 13:42:17.733726 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:17.733213    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7" podUID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 13:42:18.732770 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:18.732693    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 13:42:18.732989 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:18.732808    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7" podUID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 13:42:19.735657 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:19.735627    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:42:19.736077 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:19.736053    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:42:19.736834 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:19.736812    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:42:27.629923 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.629874    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"]
Sep 10 13:42:27.630677 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.630650    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8631c39b-f119-47c3-9c4f-11b11e623aac" containerName="maas-api"
Sep 10 13:42:27.630677 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.630675    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8631c39b-f119-47c3-9c4f-11b11e623aac" containerName="maas-api"
Sep 10 13:42:27.630908 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.630747    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8631c39b-f119-47c3-9c4f-11b11e623aac" containerName="maas-api"
Sep 10 13:42:27.634179 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.634158    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:27.637887 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.637866    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-08b85c-serving-cert\""
Sep 10 13:42:27.645675 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.645655    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"]
Sep 10 13:42:27.739265 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.739229    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ec4151-4122-47d9-977d-c5ae2f89f801-metrics-certs\") pod \"maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:27.739482 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.739288    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ec4151-4122-47d9-977d-c5ae2f89f801-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:27.739482 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.739360    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97ec4151-4122-47d9-977d-c5ae2f89f801-maas-api-tls\") pod \"maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:27.739634 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.739510    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pwwg\" (UniqueName: \"kubernetes.io/projected/97ec4151-4122-47d9-977d-c5ae2f89f801-kube-api-access-5pwwg\") pod \"maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:27.840188 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.840146    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ec4151-4122-47d9-977d-c5ae2f89f801-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:27.840395 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.840197    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97ec4151-4122-47d9-977d-c5ae2f89f801-maas-api-tls\") pod \"maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:27.840395 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.840302    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pwwg\" (UniqueName: \"kubernetes.io/projected/97ec4151-4122-47d9-977d-c5ae2f89f801-kube-api-access-5pwwg\") pod \"maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:27.840395 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.840349    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ec4151-4122-47d9-977d-c5ae2f89f801-metrics-certs\") pod \"maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:27.840996 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.840973    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ec4151-4122-47d9-977d-c5ae2f89f801-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:27.842903 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.842870    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ec4151-4122-47d9-977d-c5ae2f89f801-metrics-certs\") pod \"maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:27.843054 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.843032    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97ec4151-4122-47d9-977d-c5ae2f89f801-maas-api-tls\") pod \"maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:27.851178 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.851154    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pwwg\" (UniqueName: \"kubernetes.io/projected/97ec4151-4122-47d9-977d-c5ae2f89f801-kube-api-access-5pwwg\") pod \"maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:27.946726 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:27.946626    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:28.236872 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:28.236845    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"]
Sep 10 13:42:29.002321 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.002288    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv" event={"ID":"97ec4151-4122-47d9-977d-c5ae2f89f801","Type":"ContainerStarted","Data":"ebca294414ff2d8eaeca3f72354130eb1129c994f494c86d75c2f3b80ffde360"}
Sep 10 13:42:29.309172 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.309142    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"]
Sep 10 13:42:29.309436 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.309384    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5" podUID="5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f" containerName="maas-api" containerID="cri-o://c727ec614f330b99048bb05f066fbfa6260d1b8647a7a7e7f6d8f1d76c175202" gracePeriod=30
Sep 10 13:42:29.597862 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.597837    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:42:29.759116 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.759082    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-maas-api-tls\") pod \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") "
Sep 10 13:42:29.759116 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.759121    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-openshift-service-ca\") pod \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") "
Sep 10 13:42:29.759378 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.759169    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5q7x\" (UniqueName: \"kubernetes.io/projected/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-kube-api-access-q5q7x\") pod \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") "
Sep 10 13:42:29.759378 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.759286    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-metrics-certs\") pod \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\" (UID: \"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f\") "
Sep 10 13:42:29.759576 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.759531    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f" (UID: "5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:42:29.760253 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.760231    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:42:29.761615 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.761583    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f" (UID: "5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:42:29.762073 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.762051    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-kube-api-access-q5q7x" (OuterVolumeSpecName: "kube-api-access-q5q7x") pod "5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f" (UID: "5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f"). InnerVolumeSpecName "kube-api-access-q5q7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:42:29.762073 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.762050    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f" (UID: "5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:42:29.861290 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.861255    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:42:29.861290 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.861298    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5q7x\" (UniqueName: \"kubernetes.io/projected/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-kube-api-access-q5q7x\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:42:29.861507 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:29.861307    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:42:30.009145 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:30.009102    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv" event={"ID":"97ec4151-4122-47d9-977d-c5ae2f89f801","Type":"ContainerStarted","Data":"abc39792fe1b634d75277e2ff1ec8c312efefae977024ea4c29f6d41756e9205"}
Sep 10 13:42:30.009635 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:30.009191    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:42:30.010539 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:30.010517    2584 generic.go:356] "Generic (PLEG): container finished" podID="5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f" containerID="c727ec614f330b99048bb05f066fbfa6260d1b8647a7a7e7f6d8f1d76c175202" exitCode=0
Sep 10 13:42:30.010696 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:30.010547    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5" event={"ID":"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f","Type":"ContainerDied","Data":"c727ec614f330b99048bb05f066fbfa6260d1b8647a7a7e7f6d8f1d76c175202"}
Sep 10 13:42:30.010696 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:30.010586    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"
Sep 10 13:42:30.010696 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:30.010598    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5" event={"ID":"5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f","Type":"ContainerDied","Data":"cc1c96a1d5f20a510599dee3c180c50bb6fafa86c9d03c96005587011c50eba5"}
Sep 10 13:42:30.010696 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:30.010620    2584 scope.go:117] "RemoveContainer" containerID="c727ec614f330b99048bb05f066fbfa6260d1b8647a7a7e7f6d8f1d76c175202"
Sep 10 13:42:30.020724 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:30.020707    2584 scope.go:117] "RemoveContainer" containerID="c727ec614f330b99048bb05f066fbfa6260d1b8647a7a7e7f6d8f1d76c175202"
Sep 10 13:42:30.021018 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:42:30.020996    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c727ec614f330b99048bb05f066fbfa6260d1b8647a7a7e7f6d8f1d76c175202\": container with ID starting with c727ec614f330b99048bb05f066fbfa6260d1b8647a7a7e7f6d8f1d76c175202 not found: ID does not exist" containerID="c727ec614f330b99048bb05f066fbfa6260d1b8647a7a7e7f6d8f1d76c175202"
Sep 10 13:42:30.021118 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:30.021024    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c727ec614f330b99048bb05f066fbfa6260d1b8647a7a7e7f6d8f1d76c175202"} err="failed to get container status \"c727ec614f330b99048bb05f066fbfa6260d1b8647a7a7e7f6d8f1d76c175202\": rpc error: code = NotFound desc = could not find container \"c727ec614f330b99048bb05f066fbfa6260d1b8647a7a7e7f6d8f1d76c175202\": container with ID starting with c727ec614f330b99048bb05f066fbfa6260d1b8647a7a7e7f6d8f1d76c175202 not found: ID does not exist"
Sep 10 13:42:30.036118 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:30.036067    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv" podStartSLOduration=1.990194517 podStartE2EDuration="3.036050612s" totalImagesPullingTime="1.045856095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:42:30.035090131 +0000 UTC m=+1544.920717160" watchObservedRunningTime="2026-09-10 13:42:30.036050612 +0000 UTC m=+1544.921677638"
Sep 10 13:42:30.068780 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:30.068721    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"]
Sep 10 13:42:30.072618 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:30.072594    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e65037-8c87b776b-d9wl5"]
Sep 10 13:42:31.614973 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:31.614939    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f" path="/var/lib/kubelet/pods/5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f/volumes"
Sep 10 13:42:36.029872 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:42:36.029840    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:43:37.755155 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.754968    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"]
Sep 10 13:43:37.756004 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.755983    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f" containerName="maas-api"
Sep 10 13:43:37.756004 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.756005    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f" containerName="maas-api"
Sep 10 13:43:37.756114 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.756102    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5df11c5a-e03d-4b32-9c3f-5e1d43daaa5f" containerName="maas-api"
Sep 10 13:43:37.759529 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.759510    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:37.762045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.762020    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-37280b-serving-cert\""
Sep 10 13:43:37.770503 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.770478    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"]
Sep 10 13:43:37.807822 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.807792    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:37.808012 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.807858    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fskm\" (UniqueName: \"kubernetes.io/projected/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-kube-api-access-6fskm\") pod \"maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:37.808012 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.807916    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:37.808012 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.807955    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:37.909317 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.909277    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:37.909509 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.909375    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fskm\" (UniqueName: \"kubernetes.io/projected/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-kube-api-access-6fskm\") pod \"maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:37.909509 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.909407    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:37.909509 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.909435    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:37.909699 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:43:37.909634    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-serving-cert: secret "maas-api-e2e-ipp-cleanup-37280b-serving-cert" not found
Sep 10 13:43:37.909746 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:43:37.909738    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-maas-api-tls podName:d9bc486e-dee5-4363-9900-9dd1b44bc8a5 nodeName:}" failed. No retries permitted until 2026-09-10 13:43:38.409712182 +0000 UTC m=+1613.295339207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc" (UID: "d9bc486e-dee5-4363-9900-9dd1b44bc8a5") : secret "maas-api-e2e-ipp-cleanup-37280b-serving-cert" not found
Sep 10 13:43:37.910241 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.910221    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:37.912080 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.912056    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:37.922200 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:37.922169    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fskm\" (UniqueName: \"kubernetes.io/projected/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-kube-api-access-6fskm\") pod \"maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:38.414978 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:38.414945    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:38.417849 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:38.417816    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:38.673833 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:38.673737    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:38.954964 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:38.954929    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"]
Sep 10 13:43:38.955740 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:43:38.955711    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9bc486e_dee5_4363_9900_9dd1b44bc8a5.slice/crio-f6ab2e8066a7316f36e46998a60ff87f535b713309ec8073c6e8fa2de92fbcdf WatchSource:0}: Error finding container f6ab2e8066a7316f36e46998a60ff87f535b713309ec8073c6e8fa2de92fbcdf: Status 404 returned error can't find the container with id f6ab2e8066a7316f36e46998a60ff87f535b713309ec8073c6e8fa2de92fbcdf
Sep 10 13:43:39.395255 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:39.395223    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc" event={"ID":"d9bc486e-dee5-4363-9900-9dd1b44bc8a5","Type":"ContainerStarted","Data":"f6ab2e8066a7316f36e46998a60ff87f535b713309ec8073c6e8fa2de92fbcdf"}
Sep 10 13:43:40.402649 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:40.402613    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc" event={"ID":"d9bc486e-dee5-4363-9900-9dd1b44bc8a5","Type":"ContainerStarted","Data":"3dc6a2ec221c4862df431410881c7d52d960c05504625a339fa5e6c6983658d3"}
Sep 10 13:43:40.403043 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:40.402694    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:43:40.425179 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:40.425122    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc" podStartSLOduration=2.794804137 podStartE2EDuration="3.425104256s" totalImagesPullingTime="630.300119ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:43:40.423291464 +0000 UTC m=+1615.308918492" watchObservedRunningTime="2026-09-10 13:43:40.425104256 +0000 UTC m=+1615.310731284"
Sep 10 13:43:46.414740 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:43:46.414707    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:44:08.635177 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:08.635132    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"]
Sep 10 13:44:08.635674 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:08.635350    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc" podUID="d9bc486e-dee5-4363-9900-9dd1b44bc8a5" containerName="maas-api" containerID="cri-o://3dc6a2ec221c4862df431410881c7d52d960c05504625a339fa5e6c6983658d3" gracePeriod=30
Sep 10 13:44:08.903961 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:08.903925    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:44:08.920326 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:08.920294    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-metrics-certs\") pod \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") "
Sep 10 13:44:08.920492 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:08.920353    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fskm\" (UniqueName: \"kubernetes.io/projected/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-kube-api-access-6fskm\") pod \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") "
Sep 10 13:44:08.920492 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:08.920424    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-openshift-service-ca\") pod \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") "
Sep 10 13:44:08.920492 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:08.920464    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-maas-api-tls\") pod \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\" (UID: \"d9bc486e-dee5-4363-9900-9dd1b44bc8a5\") "
Sep 10 13:44:08.920900 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:08.920857    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d9bc486e-dee5-4363-9900-9dd1b44bc8a5" (UID: "d9bc486e-dee5-4363-9900-9dd1b44bc8a5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:44:08.922825 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:08.922799    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d9bc486e-dee5-4363-9900-9dd1b44bc8a5" (UID: "d9bc486e-dee5-4363-9900-9dd1b44bc8a5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:44:08.923003 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:08.922977    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-kube-api-access-6fskm" (OuterVolumeSpecName: "kube-api-access-6fskm") pod "d9bc486e-dee5-4363-9900-9dd1b44bc8a5" (UID: "d9bc486e-dee5-4363-9900-9dd1b44bc8a5"). InnerVolumeSpecName "kube-api-access-6fskm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:44:08.923096 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:08.923030    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d9bc486e-dee5-4363-9900-9dd1b44bc8a5" (UID: "d9bc486e-dee5-4363-9900-9dd1b44bc8a5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:44:09.021962 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:09.021927    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:44:09.021962 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:09.021954    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:44:09.021962 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:09.021963    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:44:09.021962 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:09.021973    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fskm\" (UniqueName: \"kubernetes.io/projected/d9bc486e-dee5-4363-9900-9dd1b44bc8a5-kube-api-access-6fskm\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:44:09.558691 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:09.558653    2584 generic.go:356] "Generic (PLEG): container finished" podID="d9bc486e-dee5-4363-9900-9dd1b44bc8a5" containerID="3dc6a2ec221c4862df431410881c7d52d960c05504625a339fa5e6c6983658d3" exitCode=0
Sep 10 13:44:09.558883 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:09.558703    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"
Sep 10 13:44:09.558883 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:09.558718    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc" event={"ID":"d9bc486e-dee5-4363-9900-9dd1b44bc8a5","Type":"ContainerDied","Data":"3dc6a2ec221c4862df431410881c7d52d960c05504625a339fa5e6c6983658d3"}
Sep 10 13:44:09.558883 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:09.558776    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc" event={"ID":"d9bc486e-dee5-4363-9900-9dd1b44bc8a5","Type":"ContainerDied","Data":"f6ab2e8066a7316f36e46998a60ff87f535b713309ec8073c6e8fa2de92fbcdf"}
Sep 10 13:44:09.558883 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:09.558807    2584 scope.go:117] "RemoveContainer" containerID="3dc6a2ec221c4862df431410881c7d52d960c05504625a339fa5e6c6983658d3"
Sep 10 13:44:09.576445 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:09.576417    2584 scope.go:117] "RemoveContainer" containerID="3dc6a2ec221c4862df431410881c7d52d960c05504625a339fa5e6c6983658d3"
Sep 10 13:44:09.576787 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:44:09.576766    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dc6a2ec221c4862df431410881c7d52d960c05504625a339fa5e6c6983658d3\": container with ID starting with 3dc6a2ec221c4862df431410881c7d52d960c05504625a339fa5e6c6983658d3 not found: ID does not exist" containerID="3dc6a2ec221c4862df431410881c7d52d960c05504625a339fa5e6c6983658d3"
Sep 10 13:44:09.576859 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:09.576795    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc6a2ec221c4862df431410881c7d52d960c05504625a339fa5e6c6983658d3"} err="failed to get container status \"3dc6a2ec221c4862df431410881c7d52d960c05504625a339fa5e6c6983658d3\": rpc error: code = NotFound desc = could not find container \"3dc6a2ec221c4862df431410881c7d52d960c05504625a339fa5e6c6983658d3\": container with ID starting with 3dc6a2ec221c4862df431410881c7d52d960c05504625a339fa5e6c6983658d3 not found: ID does not exist"
Sep 10 13:44:09.592508 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:09.592443    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"]
Sep 10 13:44:09.594583 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:09.594541    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-37280b-868746949d-qhdtc"]
Sep 10 13:44:09.614322 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:09.614296    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9bc486e-dee5-4363-9900-9dd1b44bc8a5" path="/var/lib/kubelet/pods/d9bc486e-dee5-4363-9900-9dd1b44bc8a5/volumes"
Sep 10 13:44:36.096728 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.096692    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"]
Sep 10 13:44:36.097199 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.096903    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k" podUID="49c36ded-14ee-49fd-b25d-c5a64debbc46" containerName="maas-api" containerID="cri-o://8abe4569048de526b7844dd6b0245c0714f60f0b2723ad06c76ed6e56ba8f137" gracePeriod=30
Sep 10 13:44:36.360232 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.360166    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:44:36.487335 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.487308    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c36ded-14ee-49fd-b25d-c5a64debbc46-metrics-certs\") pod \"49c36ded-14ee-49fd-b25d-c5a64debbc46\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") "
Sep 10 13:44:36.487512 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.487381    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49c36ded-14ee-49fd-b25d-c5a64debbc46-maas-api-tls\") pod \"49c36ded-14ee-49fd-b25d-c5a64debbc46\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") "
Sep 10 13:44:36.487512 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.487431    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9vws\" (UniqueName: \"kubernetes.io/projected/49c36ded-14ee-49fd-b25d-c5a64debbc46-kube-api-access-z9vws\") pod \"49c36ded-14ee-49fd-b25d-c5a64debbc46\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") "
Sep 10 13:44:36.487512 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.487449    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c36ded-14ee-49fd-b25d-c5a64debbc46-openshift-service-ca\") pod \"49c36ded-14ee-49fd-b25d-c5a64debbc46\" (UID: \"49c36ded-14ee-49fd-b25d-c5a64debbc46\") "
Sep 10 13:44:36.487947 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.487915    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c36ded-14ee-49fd-b25d-c5a64debbc46-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "49c36ded-14ee-49fd-b25d-c5a64debbc46" (UID: "49c36ded-14ee-49fd-b25d-c5a64debbc46"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:44:36.489639 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.489613    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c36ded-14ee-49fd-b25d-c5a64debbc46-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "49c36ded-14ee-49fd-b25d-c5a64debbc46" (UID: "49c36ded-14ee-49fd-b25d-c5a64debbc46"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:44:36.489732 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.489645    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c36ded-14ee-49fd-b25d-c5a64debbc46-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "49c36ded-14ee-49fd-b25d-c5a64debbc46" (UID: "49c36ded-14ee-49fd-b25d-c5a64debbc46"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:44:36.489732 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.489705    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49c36ded-14ee-49fd-b25d-c5a64debbc46-kube-api-access-z9vws" (OuterVolumeSpecName: "kube-api-access-z9vws") pod "49c36ded-14ee-49fd-b25d-c5a64debbc46" (UID: "49c36ded-14ee-49fd-b25d-c5a64debbc46"). InnerVolumeSpecName "kube-api-access-z9vws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:44:36.588480 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.588440    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c36ded-14ee-49fd-b25d-c5a64debbc46-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:44:36.588480 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.588473    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49c36ded-14ee-49fd-b25d-c5a64debbc46-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:44:36.588480 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.588486    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9vws\" (UniqueName: \"kubernetes.io/projected/49c36ded-14ee-49fd-b25d-c5a64debbc46-kube-api-access-z9vws\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:44:36.588767 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.588498    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c36ded-14ee-49fd-b25d-c5a64debbc46-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:44:36.709256 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.709159    2584 generic.go:356] "Generic (PLEG): container finished" podID="49c36ded-14ee-49fd-b25d-c5a64debbc46" containerID="8abe4569048de526b7844dd6b0245c0714f60f0b2723ad06c76ed6e56ba8f137" exitCode=0
Sep 10 13:44:36.709256 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.709212    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"
Sep 10 13:44:36.709495 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.709248    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k" event={"ID":"49c36ded-14ee-49fd-b25d-c5a64debbc46","Type":"ContainerDied","Data":"8abe4569048de526b7844dd6b0245c0714f60f0b2723ad06c76ed6e56ba8f137"}
Sep 10 13:44:36.709495 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.709320    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k" event={"ID":"49c36ded-14ee-49fd-b25d-c5a64debbc46","Type":"ContainerDied","Data":"16bef9da4c76babbed36b3b22ca1589324cb02924ffc835dd0ff811fcf8fa057"}
Sep 10 13:44:36.709495 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.709350    2584 scope.go:117] "RemoveContainer" containerID="8abe4569048de526b7844dd6b0245c0714f60f0b2723ad06c76ed6e56ba8f137"
Sep 10 13:44:36.722758 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.722741    2584 scope.go:117] "RemoveContainer" containerID="8abe4569048de526b7844dd6b0245c0714f60f0b2723ad06c76ed6e56ba8f137"
Sep 10 13:44:36.723056 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:44:36.723030    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8abe4569048de526b7844dd6b0245c0714f60f0b2723ad06c76ed6e56ba8f137\": container with ID starting with 8abe4569048de526b7844dd6b0245c0714f60f0b2723ad06c76ed6e56ba8f137 not found: ID does not exist" containerID="8abe4569048de526b7844dd6b0245c0714f60f0b2723ad06c76ed6e56ba8f137"
Sep 10 13:44:36.723151 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.723063    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8abe4569048de526b7844dd6b0245c0714f60f0b2723ad06c76ed6e56ba8f137"} err="failed to get container status \"8abe4569048de526b7844dd6b0245c0714f60f0b2723ad06c76ed6e56ba8f137\": rpc error: code = NotFound desc = could not find container \"8abe4569048de526b7844dd6b0245c0714f60f0b2723ad06c76ed6e56ba8f137\": container with ID starting with 8abe4569048de526b7844dd6b0245c0714f60f0b2723ad06c76ed6e56ba8f137 not found: ID does not exist"
Sep 10 13:44:36.735047 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.735005    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"]
Sep 10 13:44:36.738198 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:36.738173    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-56b405-764f985bd5-cjc9k"]
Sep 10 13:44:37.614106 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:44:37.614071    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49c36ded-14ee-49fd-b25d-c5a64debbc46" path="/var/lib/kubelet/pods/49c36ded-14ee-49fd-b25d-c5a64debbc46/volumes"
Sep 10 13:45:26.367780 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:26.367747    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"]
Sep 10 13:45:26.368276 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:26.367956    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7" podUID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" containerName="istio-proxy" containerID="cri-o://fc5f7c5593bce41970e3d336f4344a6b1d032f313614ab5310280c3ba0aab959" gracePeriod=30
Sep 10 13:45:31.621544 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.621516    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:45:31.721888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.721790    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istiod-ca-cert\") pod \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") "
Sep 10 13:45:31.721888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.721832    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-workload-socket\") pod \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") "
Sep 10 13:45:31.721888 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.721865    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-data\") pod \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") "
Sep 10 13:45:31.722164 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.721926    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-token\") pod \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") "
Sep 10 13:45:31.722164 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.721951    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-credential-socket\") pod \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") "
Sep 10 13:45:31.722164 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.722013    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjh86\" (UniqueName: \"kubernetes.io/projected/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-kube-api-access-xjh86\") pod \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") "
Sep 10 13:45:31.722164 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.722033    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-workload-certs\") pod \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") "
Sep 10 13:45:31.722164 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.722068    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-podinfo\") pod \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") "
Sep 10 13:45:31.722164 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.722095    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-envoy\") pod \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\" (UID: \"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d\") "
Sep 10 13:45:31.722462 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.722163    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" (UID: "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:45:31.722462 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.722269    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" (UID: "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:45:31.722462 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.722326    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" (UID: "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:45:31.722663 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.722644    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istiod-ca-cert\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:31.722726 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.722666    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-workload-socket\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:31.722726 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.722680    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-workload-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:31.722952 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.722733    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" (UID: "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:45:31.722952 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.722941    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" (UID: "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:45:31.724596 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.724536    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" (UID: "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 13:45:31.724727 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.724617    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-kube-api-access-xjh86" (OuterVolumeSpecName: "kube-api-access-xjh86") pod "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" (UID: "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d"). InnerVolumeSpecName "kube-api-access-xjh86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:45:31.724785 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.724721    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" (UID: "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:45:31.724829 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.724803    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" (UID: "d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:45:31.823371 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.823337    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-token\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:31.823371 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.823372    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-credential-socket\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:31.823593 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.823384    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjh86\" (UniqueName: \"kubernetes.io/projected/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-kube-api-access-xjh86\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:31.823593 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.823392    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-podinfo\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:31.823593 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.823403    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-envoy\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:31.823593 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:31.823411    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d-istio-data\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:32.006821 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:32.006736    2584 generic.go:356] "Generic (PLEG): container finished" podID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" containerID="fc5f7c5593bce41970e3d336f4344a6b1d032f313614ab5310280c3ba0aab959" exitCode=0
Sep 10 13:45:32.006821 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:32.006787    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"
Sep 10 13:45:32.006999 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:32.006816    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7" event={"ID":"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d","Type":"ContainerDied","Data":"fc5f7c5593bce41970e3d336f4344a6b1d032f313614ab5310280c3ba0aab959"}
Sep 10 13:45:32.006999 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:32.006867    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7" event={"ID":"d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d","Type":"ContainerDied","Data":"1f4cfece3d4bed5960733dcd3c72b8897a63f797af477582e1e6913adf0fb0e4"}
Sep 10 13:45:32.006999 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:32.006890    2584 scope.go:117] "RemoveContainer" containerID="fc5f7c5593bce41970e3d336f4344a6b1d032f313614ab5310280c3ba0aab959"
Sep 10 13:45:32.017117 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:32.017101    2584 scope.go:117] "RemoveContainer" containerID="f00292dcecb345611dcde91a12f7a9813edad90c7e7df61ab91d28ff70ba41df"
Sep 10 13:45:32.025589 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:32.025547    2584 scope.go:117] "RemoveContainer" containerID="fc5f7c5593bce41970e3d336f4344a6b1d032f313614ab5310280c3ba0aab959"
Sep 10 13:45:32.025856 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:45:32.025835    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc5f7c5593bce41970e3d336f4344a6b1d032f313614ab5310280c3ba0aab959\": container with ID starting with fc5f7c5593bce41970e3d336f4344a6b1d032f313614ab5310280c3ba0aab959 not found: ID does not exist" containerID="fc5f7c5593bce41970e3d336f4344a6b1d032f313614ab5310280c3ba0aab959"
Sep 10 13:45:32.025924 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:32.025863    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc5f7c5593bce41970e3d336f4344a6b1d032f313614ab5310280c3ba0aab959"} err="failed to get container status \"fc5f7c5593bce41970e3d336f4344a6b1d032f313614ab5310280c3ba0aab959\": rpc error: code = NotFound desc = could not find container \"fc5f7c5593bce41970e3d336f4344a6b1d032f313614ab5310280c3ba0aab959\": container with ID starting with fc5f7c5593bce41970e3d336f4344a6b1d032f313614ab5310280c3ba0aab959 not found: ID does not exist"
Sep 10 13:45:32.025924 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:32.025878    2584 scope.go:117] "RemoveContainer" containerID="f00292dcecb345611dcde91a12f7a9813edad90c7e7df61ab91d28ff70ba41df"
Sep 10 13:45:32.026149 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:45:32.026134    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f00292dcecb345611dcde91a12f7a9813edad90c7e7df61ab91d28ff70ba41df\": container with ID starting with f00292dcecb345611dcde91a12f7a9813edad90c7e7df61ab91d28ff70ba41df not found: ID does not exist" containerID="f00292dcecb345611dcde91a12f7a9813edad90c7e7df61ab91d28ff70ba41df"
Sep 10 13:45:32.026190 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:32.026154    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f00292dcecb345611dcde91a12f7a9813edad90c7e7df61ab91d28ff70ba41df"} err="failed to get container status \"f00292dcecb345611dcde91a12f7a9813edad90c7e7df61ab91d28ff70ba41df\": rpc error: code = NotFound desc = could not find container \"f00292dcecb345611dcde91a12f7a9813edad90c7e7df61ab91d28ff70ba41df\": container with ID starting with f00292dcecb345611dcde91a12f7a9813edad90c7e7df61ab91d28ff70ba41df not found: ID does not exist"
Sep 10 13:45:32.031808 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:32.031789    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"]
Sep 10 13:45:32.035414 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:32.035395    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-56b405-openshift-default-7d47bcf458-fxtt7"]
Sep 10 13:45:33.614269 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:33.614229    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" path="/var/lib/kubelet/pods/d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d/volumes"
Sep 10 13:45:37.474602 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.474545    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"]
Sep 10 13:45:37.475158 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.474782    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv" podUID="97ec4151-4122-47d9-977d-c5ae2f89f801" containerName="maas-api" containerID="cri-o://abc39792fe1b634d75277e2ff1ec8c312efefae977024ea4c29f6d41756e9205" gracePeriod=30
Sep 10 13:45:37.740505 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.740440    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:45:37.780603 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.780550    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ec4151-4122-47d9-977d-c5ae2f89f801-metrics-certs\") pod \"97ec4151-4122-47d9-977d-c5ae2f89f801\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") "
Sep 10 13:45:37.780776 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.780624    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ec4151-4122-47d9-977d-c5ae2f89f801-openshift-service-ca\") pod \"97ec4151-4122-47d9-977d-c5ae2f89f801\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") "
Sep 10 13:45:37.780776 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.780680    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97ec4151-4122-47d9-977d-c5ae2f89f801-maas-api-tls\") pod \"97ec4151-4122-47d9-977d-c5ae2f89f801\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") "
Sep 10 13:45:37.780776 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.780760    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pwwg\" (UniqueName: \"kubernetes.io/projected/97ec4151-4122-47d9-977d-c5ae2f89f801-kube-api-access-5pwwg\") pod \"97ec4151-4122-47d9-977d-c5ae2f89f801\" (UID: \"97ec4151-4122-47d9-977d-c5ae2f89f801\") "
Sep 10 13:45:37.781048 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.781019    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97ec4151-4122-47d9-977d-c5ae2f89f801-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "97ec4151-4122-47d9-977d-c5ae2f89f801" (UID: "97ec4151-4122-47d9-977d-c5ae2f89f801"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:45:37.781141 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.781123    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ec4151-4122-47d9-977d-c5ae2f89f801-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:37.783089 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.783054    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97ec4151-4122-47d9-977d-c5ae2f89f801-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "97ec4151-4122-47d9-977d-c5ae2f89f801" (UID: "97ec4151-4122-47d9-977d-c5ae2f89f801"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:45:37.783198 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.783119    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97ec4151-4122-47d9-977d-c5ae2f89f801-kube-api-access-5pwwg" (OuterVolumeSpecName: "kube-api-access-5pwwg") pod "97ec4151-4122-47d9-977d-c5ae2f89f801" (UID: "97ec4151-4122-47d9-977d-c5ae2f89f801"). InnerVolumeSpecName "kube-api-access-5pwwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:45:37.783198 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.783180    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97ec4151-4122-47d9-977d-c5ae2f89f801-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "97ec4151-4122-47d9-977d-c5ae2f89f801" (UID: "97ec4151-4122-47d9-977d-c5ae2f89f801"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:45:37.882189 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.882157    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ec4151-4122-47d9-977d-c5ae2f89f801-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:37.882189 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.882182    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97ec4151-4122-47d9-977d-c5ae2f89f801-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:37.882189 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:37.882192    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pwwg\" (UniqueName: \"kubernetes.io/projected/97ec4151-4122-47d9-977d-c5ae2f89f801-kube-api-access-5pwwg\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:38.047317 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:38.047215    2584 generic.go:356] "Generic (PLEG): container finished" podID="97ec4151-4122-47d9-977d-c5ae2f89f801" containerID="abc39792fe1b634d75277e2ff1ec8c312efefae977024ea4c29f6d41756e9205" exitCode=0
Sep 10 13:45:38.047317 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:38.047267    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"
Sep 10 13:45:38.047317 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:38.047301    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv" event={"ID":"97ec4151-4122-47d9-977d-c5ae2f89f801","Type":"ContainerDied","Data":"abc39792fe1b634d75277e2ff1ec8c312efefae977024ea4c29f6d41756e9205"}
Sep 10 13:45:38.047632 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:38.047356    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv" event={"ID":"97ec4151-4122-47d9-977d-c5ae2f89f801","Type":"ContainerDied","Data":"ebca294414ff2d8eaeca3f72354130eb1129c994f494c86d75c2f3b80ffde360"}
Sep 10 13:45:38.047632 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:38.047379    2584 scope.go:117] "RemoveContainer" containerID="abc39792fe1b634d75277e2ff1ec8c312efefae977024ea4c29f6d41756e9205"
Sep 10 13:45:38.057746 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:38.057724    2584 scope.go:117] "RemoveContainer" containerID="abc39792fe1b634d75277e2ff1ec8c312efefae977024ea4c29f6d41756e9205"
Sep 10 13:45:38.058023 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:45:38.057992    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abc39792fe1b634d75277e2ff1ec8c312efefae977024ea4c29f6d41756e9205\": container with ID starting with abc39792fe1b634d75277e2ff1ec8c312efefae977024ea4c29f6d41756e9205 not found: ID does not exist" containerID="abc39792fe1b634d75277e2ff1ec8c312efefae977024ea4c29f6d41756e9205"
Sep 10 13:45:38.058140 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:38.058020    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abc39792fe1b634d75277e2ff1ec8c312efefae977024ea4c29f6d41756e9205"} err="failed to get container status \"abc39792fe1b634d75277e2ff1ec8c312efefae977024ea4c29f6d41756e9205\": rpc error: code = NotFound desc = could not find container \"abc39792fe1b634d75277e2ff1ec8c312efefae977024ea4c29f6d41756e9205\": container with ID starting with abc39792fe1b634d75277e2ff1ec8c312efefae977024ea4c29f6d41756e9205 not found: ID does not exist"
Sep 10 13:45:38.075701 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:38.075679    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"]
Sep 10 13:45:38.078343 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:38.078321    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-08b85c-97544fb48-nkmrv"]
Sep 10 13:45:39.614226 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:39.614188    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97ec4151-4122-47d9-977d-c5ae2f89f801" path="/var/lib/kubelet/pods/97ec4151-4122-47d9-977d-c5ae2f89f801/volumes"
Sep 10 13:45:56.462673 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.462639    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"]
Sep 10 13:45:56.463241 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.462873    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9" podUID="709124a3-81d7-415e-9523-e1dc874eb3ed" containerName="maas-api" containerID="cri-o://eb653724af236d4975f02561a126c00c7738803ccfdf6a1eed63c6522b9b2012" gracePeriod=30
Sep 10 13:45:56.725868 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.725795    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:45:56.865200 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.865169    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bpbg\" (UniqueName: \"kubernetes.io/projected/709124a3-81d7-415e-9523-e1dc874eb3ed-kube-api-access-8bpbg\") pod \"709124a3-81d7-415e-9523-e1dc874eb3ed\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") "
Sep 10 13:45:56.865405 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.865222    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/709124a3-81d7-415e-9523-e1dc874eb3ed-maas-api-tls\") pod \"709124a3-81d7-415e-9523-e1dc874eb3ed\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") "
Sep 10 13:45:56.865405 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.865270    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/709124a3-81d7-415e-9523-e1dc874eb3ed-metrics-certs\") pod \"709124a3-81d7-415e-9523-e1dc874eb3ed\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") "
Sep 10 13:45:56.865405 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.865289    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/709124a3-81d7-415e-9523-e1dc874eb3ed-openshift-service-ca\") pod \"709124a3-81d7-415e-9523-e1dc874eb3ed\" (UID: \"709124a3-81d7-415e-9523-e1dc874eb3ed\") "
Sep 10 13:45:56.865727 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.865696    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/709124a3-81d7-415e-9523-e1dc874eb3ed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "709124a3-81d7-415e-9523-e1dc874eb3ed" (UID: "709124a3-81d7-415e-9523-e1dc874eb3ed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:45:56.867600 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.867529    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/709124a3-81d7-415e-9523-e1dc874eb3ed-kube-api-access-8bpbg" (OuterVolumeSpecName: "kube-api-access-8bpbg") pod "709124a3-81d7-415e-9523-e1dc874eb3ed" (UID: "709124a3-81d7-415e-9523-e1dc874eb3ed"). InnerVolumeSpecName "kube-api-access-8bpbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:45:56.867600 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.867548    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/709124a3-81d7-415e-9523-e1dc874eb3ed-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "709124a3-81d7-415e-9523-e1dc874eb3ed" (UID: "709124a3-81d7-415e-9523-e1dc874eb3ed"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:45:56.867748 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.867618    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/709124a3-81d7-415e-9523-e1dc874eb3ed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "709124a3-81d7-415e-9523-e1dc874eb3ed" (UID: "709124a3-81d7-415e-9523-e1dc874eb3ed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:45:56.966257 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.966221    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/709124a3-81d7-415e-9523-e1dc874eb3ed-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:56.966257 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.966253    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/709124a3-81d7-415e-9523-e1dc874eb3ed-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:56.966257 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.966263    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bpbg\" (UniqueName: \"kubernetes.io/projected/709124a3-81d7-415e-9523-e1dc874eb3ed-kube-api-access-8bpbg\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:56.966499 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:56.966272    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/709124a3-81d7-415e-9523-e1dc874eb3ed-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:45:57.151238 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:57.151194    2584 generic.go:356] "Generic (PLEG): container finished" podID="709124a3-81d7-415e-9523-e1dc874eb3ed" containerID="eb653724af236d4975f02561a126c00c7738803ccfdf6a1eed63c6522b9b2012" exitCode=0
Sep 10 13:45:57.151238 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:57.151232    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"
Sep 10 13:45:57.151490 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:57.151287    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9" event={"ID":"709124a3-81d7-415e-9523-e1dc874eb3ed","Type":"ContainerDied","Data":"eb653724af236d4975f02561a126c00c7738803ccfdf6a1eed63c6522b9b2012"}
Sep 10 13:45:57.151490 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:57.151344    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9" event={"ID":"709124a3-81d7-415e-9523-e1dc874eb3ed","Type":"ContainerDied","Data":"c7a96f01f14bc22f22d14e549822ac9f617c4f1b0d31b6555e32dfec5324558f"}
Sep 10 13:45:57.151490 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:57.151376    2584 scope.go:117] "RemoveContainer" containerID="eb653724af236d4975f02561a126c00c7738803ccfdf6a1eed63c6522b9b2012"
Sep 10 13:45:57.165162 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:57.165141    2584 scope.go:117] "RemoveContainer" containerID="eb653724af236d4975f02561a126c00c7738803ccfdf6a1eed63c6522b9b2012"
Sep 10 13:45:57.165490 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:45:57.165467    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb653724af236d4975f02561a126c00c7738803ccfdf6a1eed63c6522b9b2012\": container with ID starting with eb653724af236d4975f02561a126c00c7738803ccfdf6a1eed63c6522b9b2012 not found: ID does not exist" containerID="eb653724af236d4975f02561a126c00c7738803ccfdf6a1eed63c6522b9b2012"
Sep 10 13:45:57.165539 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:57.165499    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb653724af236d4975f02561a126c00c7738803ccfdf6a1eed63c6522b9b2012"} err="failed to get container status \"eb653724af236d4975f02561a126c00c7738803ccfdf6a1eed63c6522b9b2012\": rpc error: code = NotFound desc = could not find container \"eb653724af236d4975f02561a126c00c7738803ccfdf6a1eed63c6522b9b2012\": container with ID starting with eb653724af236d4975f02561a126c00c7738803ccfdf6a1eed63c6522b9b2012 not found: ID does not exist"
Sep 10 13:45:57.179770 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:57.179734    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"]
Sep 10 13:45:57.187989 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:57.187967    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7657ef-7fc44d466d-kjmf9"]
Sep 10 13:45:57.614088 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:45:57.614057    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="709124a3-81d7-415e-9523-e1dc874eb3ed" path="/var/lib/kubelet/pods/709124a3-81d7-415e-9523-e1dc874eb3ed/volumes"
Sep 10 13:46:17.201286 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.201250    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"]
Sep 10 13:46:17.201711 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.201507    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69" podUID="eaa1261b-2790-4b7e-8595-b1f302a00ace" containerName="maas-api" containerID="cri-o://2bf621c164a8e7e7146761e654e46fae81ae6762da0dfb0deb702b8210edeaf7" gracePeriod=30
Sep 10 13:46:17.475045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.475020    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:46:17.562512 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.562471    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-metrics-certs\") pod \"eaa1261b-2790-4b7e-8595-b1f302a00ace\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") "
Sep 10 13:46:17.562512 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.562514    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfvw9\" (UniqueName: \"kubernetes.io/projected/eaa1261b-2790-4b7e-8595-b1f302a00ace-kube-api-access-tfvw9\") pod \"eaa1261b-2790-4b7e-8595-b1f302a00ace\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") "
Sep 10 13:46:17.562817 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.562628    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa1261b-2790-4b7e-8595-b1f302a00ace-openshift-service-ca\") pod \"eaa1261b-2790-4b7e-8595-b1f302a00ace\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") "
Sep 10 13:46:17.562817 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.562711    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-maas-api-tls\") pod \"eaa1261b-2790-4b7e-8595-b1f302a00ace\" (UID: \"eaa1261b-2790-4b7e-8595-b1f302a00ace\") "
Sep 10 13:46:17.563031 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.563003    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaa1261b-2790-4b7e-8595-b1f302a00ace-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eaa1261b-2790-4b7e-8595-b1f302a00ace" (UID: "eaa1261b-2790-4b7e-8595-b1f302a00ace"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:46:17.564876 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.564845    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "eaa1261b-2790-4b7e-8595-b1f302a00ace" (UID: "eaa1261b-2790-4b7e-8595-b1f302a00ace"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:46:17.565041 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.565015    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eaa1261b-2790-4b7e-8595-b1f302a00ace" (UID: "eaa1261b-2790-4b7e-8595-b1f302a00ace"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:46:17.565107 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.565071    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaa1261b-2790-4b7e-8595-b1f302a00ace-kube-api-access-tfvw9" (OuterVolumeSpecName: "kube-api-access-tfvw9") pod "eaa1261b-2790-4b7e-8595-b1f302a00ace" (UID: "eaa1261b-2790-4b7e-8595-b1f302a00ace"). InnerVolumeSpecName "kube-api-access-tfvw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:46:17.663847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.663810    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:46:17.663847 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.663846    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaa1261b-2790-4b7e-8595-b1f302a00ace-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:46:17.664123 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.663860    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfvw9\" (UniqueName: \"kubernetes.io/projected/eaa1261b-2790-4b7e-8595-b1f302a00ace-kube-api-access-tfvw9\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:46:17.664123 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:17.663876    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa1261b-2790-4b7e-8595-b1f302a00ace-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:46:18.262409 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:18.262377    2584 generic.go:356] "Generic (PLEG): container finished" podID="eaa1261b-2790-4b7e-8595-b1f302a00ace" containerID="2bf621c164a8e7e7146761e654e46fae81ae6762da0dfb0deb702b8210edeaf7" exitCode=0
Sep 10 13:46:18.262877 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:18.262425    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"
Sep 10 13:46:18.262877 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:18.262468    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69" event={"ID":"eaa1261b-2790-4b7e-8595-b1f302a00ace","Type":"ContainerDied","Data":"2bf621c164a8e7e7146761e654e46fae81ae6762da0dfb0deb702b8210edeaf7"}
Sep 10 13:46:18.262877 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:18.262524    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69" event={"ID":"eaa1261b-2790-4b7e-8595-b1f302a00ace","Type":"ContainerDied","Data":"a45ec6fe59cf6426d5b1713aac1ea69e0740fdbb0ff71c9646a1281a5cd98750"}
Sep 10 13:46:18.262877 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:18.262546    2584 scope.go:117] "RemoveContainer" containerID="2bf621c164a8e7e7146761e654e46fae81ae6762da0dfb0deb702b8210edeaf7"
Sep 10 13:46:18.272146 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:18.272122    2584 scope.go:117] "RemoveContainer" containerID="2bf621c164a8e7e7146761e654e46fae81ae6762da0dfb0deb702b8210edeaf7"
Sep 10 13:46:18.272488 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:46:18.272464    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bf621c164a8e7e7146761e654e46fae81ae6762da0dfb0deb702b8210edeaf7\": container with ID starting with 2bf621c164a8e7e7146761e654e46fae81ae6762da0dfb0deb702b8210edeaf7 not found: ID does not exist" containerID="2bf621c164a8e7e7146761e654e46fae81ae6762da0dfb0deb702b8210edeaf7"
Sep 10 13:46:18.272578 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:18.272497    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bf621c164a8e7e7146761e654e46fae81ae6762da0dfb0deb702b8210edeaf7"} err="failed to get container status \"2bf621c164a8e7e7146761e654e46fae81ae6762da0dfb0deb702b8210edeaf7\": rpc error: code = NotFound desc = could not find container \"2bf621c164a8e7e7146761e654e46fae81ae6762da0dfb0deb702b8210edeaf7\": container with ID starting with 2bf621c164a8e7e7146761e654e46fae81ae6762da0dfb0deb702b8210edeaf7 not found: ID does not exist"
Sep 10 13:46:18.320163 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:18.320122    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"]
Sep 10 13:46:18.337932 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:18.337895    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7739cb-fc5477fd4-tdx69"]
Sep 10 13:46:19.613991 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:19.613950    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaa1261b-2790-4b7e-8595-b1f302a00ace" path="/var/lib/kubelet/pods/eaa1261b-2790-4b7e-8595-b1f302a00ace/volumes"
Sep 10 13:46:45.729603 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:45.729569    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:46:45.731897 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:45.731871    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:46:45.735501 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:45.735482    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:46:45.737693 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:46:45.737675    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:49:14.199390 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:14.199348    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"]
Sep 10 13:49:14.200065 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:14.199626    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc" podUID="c2ef9454-8fb6-4787-8f11-c88f445ca901" containerName="manager" containerID="cri-o://e9e7a2dac83f4c55a515a3012ef4a0bce5efd861c0e848881fc63ad17e853e26" gracePeriod=10
Sep 10 13:49:14.466999 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:14.466926    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"
Sep 10 13:49:14.564261 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:14.564229    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2ef9454-8fb6-4787-8f11-c88f445ca901-extensions-socket-volume\") pod \"c2ef9454-8fb6-4787-8f11-c88f445ca901\" (UID: \"c2ef9454-8fb6-4787-8f11-c88f445ca901\") "
Sep 10 13:49:14.564409 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:14.564382    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpgn6\" (UniqueName: \"kubernetes.io/projected/c2ef9454-8fb6-4787-8f11-c88f445ca901-kube-api-access-gpgn6\") pod \"c2ef9454-8fb6-4787-8f11-c88f445ca901\" (UID: \"c2ef9454-8fb6-4787-8f11-c88f445ca901\") "
Sep 10 13:49:14.564603 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:14.564583    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2ef9454-8fb6-4787-8f11-c88f445ca901-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c2ef9454-8fb6-4787-8f11-c88f445ca901" (UID: "c2ef9454-8fb6-4787-8f11-c88f445ca901"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:49:14.564695 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:14.564683    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2ef9454-8fb6-4787-8f11-c88f445ca901-extensions-socket-volume\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:49:14.566470 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:14.566449    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2ef9454-8fb6-4787-8f11-c88f445ca901-kube-api-access-gpgn6" (OuterVolumeSpecName: "kube-api-access-gpgn6") pod "c2ef9454-8fb6-4787-8f11-c88f445ca901" (UID: "c2ef9454-8fb6-4787-8f11-c88f445ca901"). InnerVolumeSpecName "kube-api-access-gpgn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:49:14.665512 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:14.665474    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpgn6\" (UniqueName: \"kubernetes.io/projected/c2ef9454-8fb6-4787-8f11-c88f445ca901-kube-api-access-gpgn6\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:49:15.171623 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:15.171589    2584 generic.go:356] "Generic (PLEG): container finished" podID="c2ef9454-8fb6-4787-8f11-c88f445ca901" containerID="e9e7a2dac83f4c55a515a3012ef4a0bce5efd861c0e848881fc63ad17e853e26" exitCode=0
Sep 10 13:49:15.171801 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:15.171642    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"
Sep 10 13:49:15.171801 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:15.171675    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc" event={"ID":"c2ef9454-8fb6-4787-8f11-c88f445ca901","Type":"ContainerDied","Data":"e9e7a2dac83f4c55a515a3012ef4a0bce5efd861c0e848881fc63ad17e853e26"}
Sep 10 13:49:15.171801 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:15.171727    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc" event={"ID":"c2ef9454-8fb6-4787-8f11-c88f445ca901","Type":"ContainerDied","Data":"a66accbecd8ca1a283219498f2d5851b78161ac81955f8d20dcdc213a50b625f"}
Sep 10 13:49:15.171801 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:15.171759    2584 scope.go:117] "RemoveContainer" containerID="e9e7a2dac83f4c55a515a3012ef4a0bce5efd861c0e848881fc63ad17e853e26"
Sep 10 13:49:15.182186 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:15.182168    2584 scope.go:117] "RemoveContainer" containerID="e9e7a2dac83f4c55a515a3012ef4a0bce5efd861c0e848881fc63ad17e853e26"
Sep 10 13:49:15.182468 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:49:15.182447    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9e7a2dac83f4c55a515a3012ef4a0bce5efd861c0e848881fc63ad17e853e26\": container with ID starting with e9e7a2dac83f4c55a515a3012ef4a0bce5efd861c0e848881fc63ad17e853e26 not found: ID does not exist" containerID="e9e7a2dac83f4c55a515a3012ef4a0bce5efd861c0e848881fc63ad17e853e26"
Sep 10 13:49:15.182532 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:15.182483    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9e7a2dac83f4c55a515a3012ef4a0bce5efd861c0e848881fc63ad17e853e26"} err="failed to get container status \"e9e7a2dac83f4c55a515a3012ef4a0bce5efd861c0e848881fc63ad17e853e26\": rpc error: code = NotFound desc = could not find container \"e9e7a2dac83f4c55a515a3012ef4a0bce5efd861c0e848881fc63ad17e853e26\": container with ID starting with e9e7a2dac83f4c55a515a3012ef4a0bce5efd861c0e848881fc63ad17e853e26 not found: ID does not exist"
Sep 10 13:49:15.197174 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:15.197141    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"]
Sep 10 13:49:15.203608 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:15.203580    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cr2dc"]
Sep 10 13:49:15.614014 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:49:15.613979    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2ef9454-8fb6-4787-8f11-c88f445ca901" path="/var/lib/kubelet/pods/c2ef9454-8fb6-4787-8f11-c88f445ca901/volumes"
Sep 10 13:50:15.002262 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002227    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl"]
Sep 10 13:50:15.002736 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002675    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2ef9454-8fb6-4787-8f11-c88f445ca901" containerName="manager"
Sep 10 13:50:15.002736 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002687    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2ef9454-8fb6-4787-8f11-c88f445ca901" containerName="manager"
Sep 10 13:50:15.002736 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002697    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaa1261b-2790-4b7e-8595-b1f302a00ace" containerName="maas-api"
Sep 10 13:50:15.002736 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002702    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaa1261b-2790-4b7e-8595-b1f302a00ace" containerName="maas-api"
Sep 10 13:50:15.002736 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002710    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ec4151-4122-47d9-977d-c5ae2f89f801" containerName="maas-api"
Sep 10 13:50:15.002736 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002716    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ec4151-4122-47d9-977d-c5ae2f89f801" containerName="maas-api"
Sep 10 13:50:15.002736 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002723    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" containerName="istio-proxy"
Sep 10 13:50:15.002736 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002727    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" containerName="istio-proxy"
Sep 10 13:50:15.002736 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002734    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" containerName="istio-proxy"
Sep 10 13:50:15.002736 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002739    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" containerName="istio-proxy"
Sep 10 13:50:15.003045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002746    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9bc486e-dee5-4363-9900-9dd1b44bc8a5" containerName="maas-api"
Sep 10 13:50:15.003045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002751    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9bc486e-dee5-4363-9900-9dd1b44bc8a5" containerName="maas-api"
Sep 10 13:50:15.003045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002762    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="709124a3-81d7-415e-9523-e1dc874eb3ed" containerName="maas-api"
Sep 10 13:50:15.003045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002766    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="709124a3-81d7-415e-9523-e1dc874eb3ed" containerName="maas-api"
Sep 10 13:50:15.003045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002773    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c36ded-14ee-49fd-b25d-c5a64debbc46" containerName="maas-api"
Sep 10 13:50:15.003045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002777    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c36ded-14ee-49fd-b25d-c5a64debbc46" containerName="maas-api"
Sep 10 13:50:15.003045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002838    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" containerName="istio-proxy"
Sep 10 13:50:15.003045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002850    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="97ec4151-4122-47d9-977d-c5ae2f89f801" containerName="maas-api"
Sep 10 13:50:15.003045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002860    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaa1261b-2790-4b7e-8595-b1f302a00ace" containerName="maas-api"
Sep 10 13:50:15.003045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002869    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7ddefe2-7ba3-4a47-a8e4-e65bfdb9fc2d" containerName="istio-proxy"
Sep 10 13:50:15.003045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002874    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="49c36ded-14ee-49fd-b25d-c5a64debbc46" containerName="maas-api"
Sep 10 13:50:15.003045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002879    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9bc486e-dee5-4363-9900-9dd1b44bc8a5" containerName="maas-api"
Sep 10 13:50:15.003045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002884    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="709124a3-81d7-415e-9523-e1dc874eb3ed" containerName="maas-api"
Sep 10 13:50:15.003045 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.002890    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2ef9454-8fb6-4787-8f11-c88f445ca901" containerName="manager"
Sep 10 13:50:15.006093 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.006077    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl"
Sep 10 13:50:15.009281 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.009262    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gbttt\""
Sep 10 13:50:15.024048 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.024021    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl"]
Sep 10 13:50:15.114221 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.114179    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddlkj\" (UniqueName: \"kubernetes.io/projected/a05335d1-ff8c-499e-bf86-a76d7a4fb4c5-kube-api-access-ddlkj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ghgpl\" (UID: \"a05335d1-ff8c-499e-bf86-a76d7a4fb4c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl"
Sep 10 13:50:15.114221 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.114227    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a05335d1-ff8c-499e-bf86-a76d7a4fb4c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ghgpl\" (UID: \"a05335d1-ff8c-499e-bf86-a76d7a4fb4c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl"
Sep 10 13:50:15.215411 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.215366    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddlkj\" (UniqueName: \"kubernetes.io/projected/a05335d1-ff8c-499e-bf86-a76d7a4fb4c5-kube-api-access-ddlkj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ghgpl\" (UID: \"a05335d1-ff8c-499e-bf86-a76d7a4fb4c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl"
Sep 10 13:50:15.215624 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.215422    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a05335d1-ff8c-499e-bf86-a76d7a4fb4c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ghgpl\" (UID: \"a05335d1-ff8c-499e-bf86-a76d7a4fb4c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl"
Sep 10 13:50:15.215895 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.215873    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a05335d1-ff8c-499e-bf86-a76d7a4fb4c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ghgpl\" (UID: \"a05335d1-ff8c-499e-bf86-a76d7a4fb4c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl"
Sep 10 13:50:15.225771 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.225750    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddlkj\" (UniqueName: \"kubernetes.io/projected/a05335d1-ff8c-499e-bf86-a76d7a4fb4c5-kube-api-access-ddlkj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ghgpl\" (UID: \"a05335d1-ff8c-499e-bf86-a76d7a4fb4c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl"
Sep 10 13:50:15.316511 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.316422    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl"
Sep 10 13:50:15.620014 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:15.619978    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl"]
Sep 10 13:50:15.620287 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:50:15.620262    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05335d1_ff8c_499e_bf86_a76d7a4fb4c5.slice/crio-a7c75533a9226af620769769355e824da9a8e47496dcbb073ffb55c5b2c8b292 WatchSource:0}: Error finding container a7c75533a9226af620769769355e824da9a8e47496dcbb073ffb55c5b2c8b292: Status 404 returned error can't find the container with id a7c75533a9226af620769769355e824da9a8e47496dcbb073ffb55c5b2c8b292
Sep 10 13:50:16.483755 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:16.483719    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl" event={"ID":"a05335d1-ff8c-499e-bf86-a76d7a4fb4c5","Type":"ContainerStarted","Data":"ef55710b861d626deee474181b3814ac59d4b91ba92290b1c301413d1f80878f"}
Sep 10 13:50:16.484256 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:16.483772    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl" event={"ID":"a05335d1-ff8c-499e-bf86-a76d7a4fb4c5","Type":"ContainerStarted","Data":"a7c75533a9226af620769769355e824da9a8e47496dcbb073ffb55c5b2c8b292"}
Sep 10 13:50:16.484256 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:16.483873    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl"
Sep 10 13:50:16.526703 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:16.526651    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl" podStartSLOduration=2.526634147 podStartE2EDuration="2.526634147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:50:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:50:16.522587173 +0000 UTC m=+2011.408214198" watchObservedRunningTime="2026-09-10 13:50:16.526634147 +0000 UTC m=+2011.412261174"
Sep 10 13:50:27.494772 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:50:27.494735    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ghgpl"
Sep 10 13:51:45.761433 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:51:45.761406    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:51:45.767281 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:51:45.767259    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:51:45.768008 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:51:45.767982    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:51:45.773279 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:51:45.773257    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qngjl_8b7d18c8-587e-48db-b362-f3282dcb53f2/ovn-acl-logging/0.log"
Sep 10 13:52:11.156353 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.156316    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"]
Sep 10 13:52:11.160696 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.160673    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:11.173212 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.173182    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"]
Sep 10 13:52:11.183169 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.183138    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e408953-cb70-49a9-a27d-20334043694f-metrics-certs\") pod \"maas-api-584764ddc7-bhqsk\" (UID: \"5e408953-cb70-49a9-a27d-20334043694f\") " pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:11.183298 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.183208    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e408953-cb70-49a9-a27d-20334043694f-openshift-service-ca\") pod \"maas-api-584764ddc7-bhqsk\" (UID: \"5e408953-cb70-49a9-a27d-20334043694f\") " pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:11.183298 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.183227    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npkrs\" (UniqueName: \"kubernetes.io/projected/5e408953-cb70-49a9-a27d-20334043694f-kube-api-access-npkrs\") pod \"maas-api-584764ddc7-bhqsk\" (UID: \"5e408953-cb70-49a9-a27d-20334043694f\") " pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:11.183298 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.183252    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e408953-cb70-49a9-a27d-20334043694f-maas-api-tls\") pod \"maas-api-584764ddc7-bhqsk\" (UID: \"5e408953-cb70-49a9-a27d-20334043694f\") " pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:11.284000 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.283956    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e408953-cb70-49a9-a27d-20334043694f-metrics-certs\") pod \"maas-api-584764ddc7-bhqsk\" (UID: \"5e408953-cb70-49a9-a27d-20334043694f\") " pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:11.284203 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.284009    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e408953-cb70-49a9-a27d-20334043694f-openshift-service-ca\") pod \"maas-api-584764ddc7-bhqsk\" (UID: \"5e408953-cb70-49a9-a27d-20334043694f\") " pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:11.284203 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.284171    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npkrs\" (UniqueName: \"kubernetes.io/projected/5e408953-cb70-49a9-a27d-20334043694f-kube-api-access-npkrs\") pod \"maas-api-584764ddc7-bhqsk\" (UID: \"5e408953-cb70-49a9-a27d-20334043694f\") " pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:11.284312 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.284213    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e408953-cb70-49a9-a27d-20334043694f-maas-api-tls\") pod \"maas-api-584764ddc7-bhqsk\" (UID: \"5e408953-cb70-49a9-a27d-20334043694f\") " pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:11.284738 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.284718    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e408953-cb70-49a9-a27d-20334043694f-openshift-service-ca\") pod \"maas-api-584764ddc7-bhqsk\" (UID: \"5e408953-cb70-49a9-a27d-20334043694f\") " pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:11.286718 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.286695    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e408953-cb70-49a9-a27d-20334043694f-metrics-certs\") pod \"maas-api-584764ddc7-bhqsk\" (UID: \"5e408953-cb70-49a9-a27d-20334043694f\") " pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:11.286831 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.286814    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e408953-cb70-49a9-a27d-20334043694f-maas-api-tls\") pod \"maas-api-584764ddc7-bhqsk\" (UID: \"5e408953-cb70-49a9-a27d-20334043694f\") " pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:11.293276 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.293255    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npkrs\" (UniqueName: \"kubernetes.io/projected/5e408953-cb70-49a9-a27d-20334043694f-kube-api-access-npkrs\") pod \"maas-api-584764ddc7-bhqsk\" (UID: \"5e408953-cb70-49a9-a27d-20334043694f\") " pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:11.473359 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.473275    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:11.747904 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.747875    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"]
Sep 10 13:52:11.750055 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:52:11.750030    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e408953_cb70_49a9_a27d_20334043694f.slice/crio-2c6fc9d2f2b054b67f319d556834b175604819593bc7cd0ee42265829546fc42 WatchSource:0}: Error finding container 2c6fc9d2f2b054b67f319d556834b175604819593bc7cd0ee42265829546fc42: Status 404 returned error can't find the container with id 2c6fc9d2f2b054b67f319d556834b175604819593bc7cd0ee42265829546fc42
Sep 10 13:52:11.751515 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:11.751493    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 13:52:12.085400 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:12.085313    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk" event={"ID":"5e408953-cb70-49a9-a27d-20334043694f","Type":"ContainerStarted","Data":"2c6fc9d2f2b054b67f319d556834b175604819593bc7cd0ee42265829546fc42"}
Sep 10 13:52:13.091326 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:13.091283    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk" event={"ID":"5e408953-cb70-49a9-a27d-20334043694f","Type":"ContainerStarted","Data":"a8c3ba67e0fce79a77c774f1af4b8fe6d5d16425a8f9732c3728ffce9025d9b7"}
Sep 10 13:52:13.091786 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:13.091423    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:13.131893 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:13.131840    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk" podStartSLOduration=1.5283376039999998 podStartE2EDuration="2.131826003s" totalImagesPullingTime="603.488399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:52:13.131285821 +0000 UTC m=+2128.016912849" watchObservedRunningTime="2026-09-10 13:52:13.131826003 +0000 UTC m=+2128.017453030"
Sep 10 13:52:19.101890 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:19.101862    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-584764ddc7-bhqsk"
Sep 10 13:52:29.117516 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:29.117476    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"]
Sep 10 13:52:29.117964 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:29.117733    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv" podUID="240ead02-2167-4c1a-93e8-79d28cf962d4" containerName="maas-api" containerID="cri-o://075f41134e598a4e262d72ee0a5491d8791861ca0e639beca28c389195f43b53" gracePeriod=30
Sep 10 13:52:30.374001 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:30.373975    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:52:30.470801 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:30.470716    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tj4th\" (UniqueName: \"kubernetes.io/projected/240ead02-2167-4c1a-93e8-79d28cf962d4-kube-api-access-tj4th\") pod \"240ead02-2167-4c1a-93e8-79d28cf962d4\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") "
Sep 10 13:52:30.470966 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:30.470813    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/240ead02-2167-4c1a-93e8-79d28cf962d4-metrics-certs\") pod \"240ead02-2167-4c1a-93e8-79d28cf962d4\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") "
Sep 10 13:52:30.470966 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:30.470858    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240ead02-2167-4c1a-93e8-79d28cf962d4-openshift-service-ca\") pod \"240ead02-2167-4c1a-93e8-79d28cf962d4\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") "
Sep 10 13:52:30.471084 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:30.470999    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240ead02-2167-4c1a-93e8-79d28cf962d4-maas-api-tls\") pod \"240ead02-2167-4c1a-93e8-79d28cf962d4\" (UID: \"240ead02-2167-4c1a-93e8-79d28cf962d4\") "
Sep 10 13:52:30.471248 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:30.471216    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/240ead02-2167-4c1a-93e8-79d28cf962d4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "240ead02-2167-4c1a-93e8-79d28cf962d4" (UID: "240ead02-2167-4c1a-93e8-79d28cf962d4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:52:30.471389 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:30.471368    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240ead02-2167-4c1a-93e8-79d28cf962d4-openshift-service-ca\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:52:30.473395 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:30.473363    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240ead02-2167-4c1a-93e8-79d28cf962d4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "240ead02-2167-4c1a-93e8-79d28cf962d4" (UID: "240ead02-2167-4c1a-93e8-79d28cf962d4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:52:30.473781 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:30.473760    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/240ead02-2167-4c1a-93e8-79d28cf962d4-kube-api-access-tj4th" (OuterVolumeSpecName: "kube-api-access-tj4th") pod "240ead02-2167-4c1a-93e8-79d28cf962d4" (UID: "240ead02-2167-4c1a-93e8-79d28cf962d4"). InnerVolumeSpecName "kube-api-access-tj4th". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:52:30.473934 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:30.473918    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240ead02-2167-4c1a-93e8-79d28cf962d4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "240ead02-2167-4c1a-93e8-79d28cf962d4" (UID: "240ead02-2167-4c1a-93e8-79d28cf962d4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:52:30.571970 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:30.571935    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/240ead02-2167-4c1a-93e8-79d28cf962d4-metrics-certs\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:52:30.571970 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:30.571963    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240ead02-2167-4c1a-93e8-79d28cf962d4-maas-api-tls\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:52:30.571970 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:30.571975    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tj4th\" (UniqueName: \"kubernetes.io/projected/240ead02-2167-4c1a-93e8-79d28cf962d4-kube-api-access-tj4th\") on node \"ip-10-0-143-211.ec2.internal\" DevicePath \"\""
Sep 10 13:52:31.189375 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:31.189340    2584 generic.go:356] "Generic (PLEG): container finished" podID="240ead02-2167-4c1a-93e8-79d28cf962d4" containerID="075f41134e598a4e262d72ee0a5491d8791861ca0e639beca28c389195f43b53" exitCode=0
Sep 10 13:52:31.189534 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:31.189396    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"
Sep 10 13:52:31.189534 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:31.189434    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv" event={"ID":"240ead02-2167-4c1a-93e8-79d28cf962d4","Type":"ContainerDied","Data":"075f41134e598a4e262d72ee0a5491d8791861ca0e639beca28c389195f43b53"}
Sep 10 13:52:31.189534 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:31.189496    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv" event={"ID":"240ead02-2167-4c1a-93e8-79d28cf962d4","Type":"ContainerDied","Data":"a1f2494454af877310247aa86fc263548cbca7caf3981b9c7247565e5feb2f8a"}
Sep 10 13:52:31.189534 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:31.189520    2584 scope.go:117] "RemoveContainer" containerID="075f41134e598a4e262d72ee0a5491d8791861ca0e639beca28c389195f43b53"
Sep 10 13:52:31.198861 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:31.198843    2584 scope.go:117] "RemoveContainer" containerID="075f41134e598a4e262d72ee0a5491d8791861ca0e639beca28c389195f43b53"
Sep 10 13:52:31.199132 ip-10-0-143-211 kubenswrapper[2584]: E0910 13:52:31.199116    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"075f41134e598a4e262d72ee0a5491d8791861ca0e639beca28c389195f43b53\": container with ID starting with 075f41134e598a4e262d72ee0a5491d8791861ca0e639beca28c389195f43b53 not found: ID does not exist" containerID="075f41134e598a4e262d72ee0a5491d8791861ca0e639beca28c389195f43b53"
Sep 10 13:52:31.199182 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:31.199141    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"075f41134e598a4e262d72ee0a5491d8791861ca0e639beca28c389195f43b53"} err="failed to get container status \"075f41134e598a4e262d72ee0a5491d8791861ca0e639beca28c389195f43b53\": rpc error: code = NotFound desc = could not find container \"075f41134e598a4e262d72ee0a5491d8791861ca0e639beca28c389195f43b53\": container with ID starting with 075f41134e598a4e262d72ee0a5491d8791861ca0e639beca28c389195f43b53 not found: ID does not exist"
Sep 10 13:52:31.213004 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:31.212971    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"]
Sep 10 13:52:31.217685 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:31.217663    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-85b6f7bf49-2wnlv"]
Sep 10 13:52:31.613648 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:31.613613    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="240ead02-2167-4c1a-93e8-79d28cf962d4" path="/var/lib/kubelet/pods/240ead02-2167-4c1a-93e8-79d28cf962d4/volumes"
Sep 10 13:52:48.547388 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:48.547350    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5rtbz_ce742769-0b91-4d0b-802e-1b801d1a32bc/manager/0.log"
Sep 10 13:52:49.333449 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:49.333418    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699db476d-hj8ts_2a9a03e6-84f1-47b8-9434-d8b39a89b814/copy-manifests/0.log"
Sep 10 13:52:49.348231 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:49.348207    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699db476d-hj8ts_2a9a03e6-84f1-47b8-9434-d8b39a89b814/manager/0.log"
Sep 10 13:52:49.868293 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:49.868261    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-584764ddc7-bhqsk_5e408953-cb70-49a9-a27d-20334043694f/maas-api/0.log"
Sep 10 13:52:50.360019 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:50.359984    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-qvp5b_a53dab01-d766-44d5-961a-e4d85b40f372/postgres/0.log"
Sep 10 13:52:51.347604 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:51.347570    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-fdhsn_ec980810-3bcb-46cd-8d11-1aff27c76bdf/manager/0.log"
Sep 10 13:52:51.466830 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:51.466797    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-wjmsd_71d9f156-f062-4769-8721-c2be23369712/manager/0.log"
Sep 10 13:52:51.719221 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:51.719148    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-ghgpl_a05335d1-ff8c-499e-bf86-a76d7a4fb4c5/manager/0.log"
Sep 10 13:52:51.977113 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:51.977039    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-tctlh_db150a17-6b6e-4855-bd95-f76e58d86cd6/manager/0.log"
Sep 10 13:52:52.614745 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:52.614688    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69d5c84f88-kq52j_dae98928-5004-42e9-ba6f-56a1701f564b/kube-auth-proxy/0.log"
Sep 10 13:52:53.002139 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:53.002061    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nlccn_c413a9f4-c38f-40b7-a33c-84dfa1ad985e/payload-pre-processing/0.log"
Sep 10 13:52:53.273081 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:53.272996    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cc659cd8-kmvzg_6f148377-3da6-4888-8b3d-70dd02ea46a6/router/0.log"
Sep 10 13:52:53.756029 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:53.756005    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-d6g82_8339b55c-4107-45ff-98da-2b3918de6250/main/0.log"
Sep 10 13:52:53.880745 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:53.880717    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-ls5zg_18dabf45-e370-489f-a903-d597ead2ad86/main/0.log"
Sep 10 13:52:54.127176 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:52:54.127148    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8s8nr_c159b14a-163b-4dcc-86ab-e66043f810c3/main/0.log"
Sep 10 13:53:00.648143 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.648104    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9tqt4/must-gather-5h57z"]
Sep 10 13:53:00.648586 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.648570    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240ead02-2167-4c1a-93e8-79d28cf962d4" containerName="maas-api"
Sep 10 13:53:00.648638 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.648590    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="240ead02-2167-4c1a-93e8-79d28cf962d4" containerName="maas-api"
Sep 10 13:53:00.648684 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.648668    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="240ead02-2167-4c1a-93e8-79d28cf962d4" containerName="maas-api"
Sep 10 13:53:00.652100 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.652082    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9tqt4/must-gather-5h57z"
Sep 10 13:53:00.656014 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.655982    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9tqt4\"/\"kube-root-ca.crt\""
Sep 10 13:53:00.656914 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.656896    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9tqt4\"/\"default-dockercfg-hkk72\""
Sep 10 13:53:00.657037 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.656933    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9tqt4\"/\"openshift-service-ca.crt\""
Sep 10 13:53:00.662989 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.662966    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9tqt4/must-gather-5h57z"]
Sep 10 13:53:00.763462 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.763428    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz9sn\" (UniqueName: \"kubernetes.io/projected/b00eb646-056a-4f69-a1ce-3e1f75f2c6e4-kube-api-access-fz9sn\") pod \"must-gather-5h57z\" (UID: \"b00eb646-056a-4f69-a1ce-3e1f75f2c6e4\") " pod="openshift-must-gather-9tqt4/must-gather-5h57z"
Sep 10 13:53:00.763638 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.763472    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b00eb646-056a-4f69-a1ce-3e1f75f2c6e4-must-gather-output\") pod \"must-gather-5h57z\" (UID: \"b00eb646-056a-4f69-a1ce-3e1f75f2c6e4\") " pod="openshift-must-gather-9tqt4/must-gather-5h57z"
Sep 10 13:53:00.864767 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.864732    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz9sn\" (UniqueName: \"kubernetes.io/projected/b00eb646-056a-4f69-a1ce-3e1f75f2c6e4-kube-api-access-fz9sn\") pod \"must-gather-5h57z\" (UID: \"b00eb646-056a-4f69-a1ce-3e1f75f2c6e4\") " pod="openshift-must-gather-9tqt4/must-gather-5h57z"
Sep 10 13:53:00.864973 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.864783    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b00eb646-056a-4f69-a1ce-3e1f75f2c6e4-must-gather-output\") pod \"must-gather-5h57z\" (UID: \"b00eb646-056a-4f69-a1ce-3e1f75f2c6e4\") " pod="openshift-must-gather-9tqt4/must-gather-5h57z"
Sep 10 13:53:00.865171 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.865149    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b00eb646-056a-4f69-a1ce-3e1f75f2c6e4-must-gather-output\") pod \"must-gather-5h57z\" (UID: \"b00eb646-056a-4f69-a1ce-3e1f75f2c6e4\") " pod="openshift-must-gather-9tqt4/must-gather-5h57z"
Sep 10 13:53:00.876103 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.876068    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz9sn\" (UniqueName: \"kubernetes.io/projected/b00eb646-056a-4f69-a1ce-3e1f75f2c6e4-kube-api-access-fz9sn\") pod \"must-gather-5h57z\" (UID: \"b00eb646-056a-4f69-a1ce-3e1f75f2c6e4\") " pod="openshift-must-gather-9tqt4/must-gather-5h57z"
Sep 10 13:53:00.962785 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:00.962690    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9tqt4/must-gather-5h57z"
Sep 10 13:53:01.252417 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:01.252387    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9tqt4/must-gather-5h57z"]
Sep 10 13:53:01.254647 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:53:01.254619    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb00eb646_056a_4f69_a1ce_3e1f75f2c6e4.slice/crio-bd72759c8afbd7ad5e885a103536f1f6e5d0ba39d418bfe7bb130e320e493b75 WatchSource:0}: Error finding container bd72759c8afbd7ad5e885a103536f1f6e5d0ba39d418bfe7bb130e320e493b75: Status 404 returned error can't find the container with id bd72759c8afbd7ad5e885a103536f1f6e5d0ba39d418bfe7bb130e320e493b75
Sep 10 13:53:01.346521 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:01.346485    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9tqt4/must-gather-5h57z" event={"ID":"b00eb646-056a-4f69-a1ce-3e1f75f2c6e4","Type":"ContainerStarted","Data":"bd72759c8afbd7ad5e885a103536f1f6e5d0ba39d418bfe7bb130e320e493b75"}
Sep 10 13:53:02.356753 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:02.356643    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9tqt4/must-gather-5h57z" event={"ID":"b00eb646-056a-4f69-a1ce-3e1f75f2c6e4","Type":"ContainerStarted","Data":"a9c5a4eea75640d14b762ce0e364cc07d54a3cf2f5fe6892dee74a0aedfe2ac4"}
Sep 10 13:53:02.356753 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:02.356723    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9tqt4/must-gather-5h57z" event={"ID":"b00eb646-056a-4f69-a1ce-3e1f75f2c6e4","Type":"ContainerStarted","Data":"5ff221b80852d24604e1b1012f7fd7351ef78c6abab31069d8abf6b88a9ea953"}
Sep 10 13:53:02.384466 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:02.383506    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9tqt4/must-gather-5h57z" podStartSLOduration=1.509681738 podStartE2EDuration="2.383483814s" totalImagesPullingTime="873.802076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:53:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:53:02.379581797 +0000 UTC m=+2177.265208827" watchObservedRunningTime="2026-09-10 13:53:02.383483814 +0000 UTC m=+2177.269110844"
Sep 10 13:53:04.104344 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:04.104315    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rtk5d_2ecc73e8-ab67-439d-a624-8950a0b2fabb/global-pull-secret-syncer/0.log"
Sep 10 13:53:04.229940 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:04.229855    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kkcx2_68deb1d1-ced7-4eec-90c7-1090a1a404ca/konnectivity-agent/0.log"
Sep 10 13:53:04.309901 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:04.309867    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-211.ec2.internal_c9dd63382dd4a5b6596522a0ad956aab/haproxy/0.log"
Sep 10 13:53:08.617303 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:08.617259    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-fdhsn_ec980810-3bcb-46cd-8d11-1aff27c76bdf/manager/0.log"
Sep 10 13:53:08.653988 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:08.653954    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-wjmsd_71d9f156-f062-4769-8721-c2be23369712/manager/0.log"
Sep 10 13:53:08.742324 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:08.742287    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-ghgpl_a05335d1-ff8c-499e-bf86-a76d7a4fb4c5/manager/0.log"
Sep 10 13:53:08.841645 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:08.841269    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-tctlh_db150a17-6b6e-4855-bd95-f76e58d86cd6/manager/0.log"
Sep 10 13:53:10.759405 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:10.759367    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-9f564_34d5e373-33e5-4c3a-b4f7-ceceea4767de/cluster-monitoring-operator/0.log"
Sep 10 13:53:11.134441 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:11.134401    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwpns_0565d65d-cfb1-47e2-a13a-9c37f939e84e/node-exporter/0.log"
Sep 10 13:53:11.161445 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:11.161382    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwpns_0565d65d-cfb1-47e2-a13a-9c37f939e84e/kube-rbac-proxy/0.log"
Sep 10 13:53:11.194617 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:11.194589    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwpns_0565d65d-cfb1-47e2-a13a-9c37f939e84e/init-textfile/0.log"
Sep 10 13:53:11.792884 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:11.792845    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-76d2s_0144f46b-341f-4305-88df-e33099b26f5e/prometheus-operator/0.log"
Sep 10 13:53:11.834126 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:11.834097    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-76d2s_0144f46b-341f-4305-88df-e33099b26f5e/kube-rbac-proxy/0.log"
Sep 10 13:53:11.914388 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:11.914358    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-6drlm_62194097-c08c-44b8-9ec9-16a723a6115a/prometheus-operator-admission-webhook/0.log"
Sep 10 13:53:13.807626 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:13.807576    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-4cd8z_032020fa-2542-42fc-a6ff-6750421c5665/networking-console-plugin/0.log"
Sep 10 13:53:14.198868 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.198827    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"]
Sep 10 13:53:14.203611 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.203585    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.225218 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.225171    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"]
Sep 10 13:53:14.321793 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.321753    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67f91fdb-a932-4661-bd17-20dec957f6a9-proc\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.322087 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.322068    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67f91fdb-a932-4661-bd17-20dec957f6a9-podres\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.322250 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.322230    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbddh\" (UniqueName: \"kubernetes.io/projected/67f91fdb-a932-4661-bd17-20dec957f6a9-kube-api-access-wbddh\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.322441 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.322424    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67f91fdb-a932-4661-bd17-20dec957f6a9-lib-modules\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.322632 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.322617    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67f91fdb-a932-4661-bd17-20dec957f6a9-sys\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.424540 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.424498    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67f91fdb-a932-4661-bd17-20dec957f6a9-sys\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.424744 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.424641    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67f91fdb-a932-4661-bd17-20dec957f6a9-proc\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.424744 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.424661    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67f91fdb-a932-4661-bd17-20dec957f6a9-sys\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.424744 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.424666    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67f91fdb-a932-4661-bd17-20dec957f6a9-podres\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.424929 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.424742    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbddh\" (UniqueName: \"kubernetes.io/projected/67f91fdb-a932-4661-bd17-20dec957f6a9-kube-api-access-wbddh\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.424929 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.424804    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67f91fdb-a932-4661-bd17-20dec957f6a9-lib-modules\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.424929 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.424848    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67f91fdb-a932-4661-bd17-20dec957f6a9-proc\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.425082 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.424805    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67f91fdb-a932-4661-bd17-20dec957f6a9-podres\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.425082 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.425010    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67f91fdb-a932-4661-bd17-20dec957f6a9-lib-modules\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.436235 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.436200    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbddh\" (UniqueName: \"kubernetes.io/projected/67f91fdb-a932-4661-bd17-20dec957f6a9-kube-api-access-wbddh\") pod \"perf-node-gather-daemonset-5lxxf\" (UID: \"67f91fdb-a932-4661-bd17-20dec957f6a9\") " pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.518034 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.517938    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:14.828714 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.828624    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"]
Sep 10 13:53:14.834800 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.834767    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/1.log"
Sep 10 13:53:14.841397 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:14.841371    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-6qc7l_22ec15f1-c11d-4159-8edd-a8d3934bc4ca/console-operator/2.log"
Sep 10 13:53:14.843618 ip-10-0-143-211 kubenswrapper[2584]: W0910 13:53:14.843588    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod67f91fdb_a932_4661_bd17_20dec957f6a9.slice/crio-af090dc45ce055e0be7394eadb66a6918d320af0b11cbc75d1d661a82d663c8a WatchSource:0}: Error finding container af090dc45ce055e0be7394eadb66a6918d320af0b11cbc75d1d661a82d663c8a: Status 404 returned error can't find the container with id af090dc45ce055e0be7394eadb66a6918d320af0b11cbc75d1d661a82d663c8a
Sep 10 13:53:15.483682 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:15.483637    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf" event={"ID":"67f91fdb-a932-4661-bd17-20dec957f6a9","Type":"ContainerStarted","Data":"707aef34902357cd9402097e676be9e81d76892d57eec3543a4e709595c8d79c"}
Sep 10 13:53:15.483891 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:15.483714    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf" event={"ID":"67f91fdb-a932-4661-bd17-20dec957f6a9","Type":"ContainerStarted","Data":"af090dc45ce055e0be7394eadb66a6918d320af0b11cbc75d1d661a82d663c8a"}
Sep 10 13:53:15.483971 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:15.483901    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:15.735190 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:15.735088    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-r7cdm_b7f79949-c76d-4e86-b217-91e20c453acd/download-server/0.log"
Sep 10 13:53:16.446926 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:16.446898    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-clnsk_2d3008ed-6458-4c13-8e00-07c20b56a772/volume-data-source-validator/0.log"
Sep 10 13:53:18.000258 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:18.000231    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fqzp6_79818a02-d821-4a83-865c-240c44e4c5ec/dns/0.log"
Sep 10 13:53:18.079440 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:18.079406    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fqzp6_79818a02-d821-4a83-865c-240c44e4c5ec/kube-rbac-proxy/0.log"
Sep 10 13:53:18.314429 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:18.314351    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ccf52_f9ce9b89-8697-4720-9e7e-bf40f89f9ceb/dns-node-resolver/0.log"
Sep 10 13:53:19.017711 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:19.017685    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hvhhv_704bb6a6-751c-47b7-9fd3-c2cc8fcbc82c/node-ca/0.log"
Sep 10 13:53:20.704209 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:20.704169    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69d5c84f88-kq52j_dae98928-5004-42e9-ba6f-56a1701f564b/kube-auth-proxy/0.log"
Sep 10 13:53:20.852872 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:20.852841    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nlccn_c413a9f4-c38f-40b7-a33c-84dfa1ad985e/payload-pre-processing/0.log"
Sep 10 13:53:20.928616 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:20.928546    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cc659cd8-kmvzg_6f148377-3da6-4888-8b3d-70dd02ea46a6/router/0.log"
Sep 10 13:53:21.503639 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:21.503600    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf"
Sep 10 13:53:21.528006 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:21.527941    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9tqt4/perf-node-gather-daemonset-5lxxf" podStartSLOduration=7.527920559 podStartE2EDuration="7.527920559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:53:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:53:15.522625632 +0000 UTC m=+2190.408252661" watchObservedRunningTime="2026-09-10 13:53:21.527920559 +0000 UTC m=+2196.413547588"
Sep 10 13:53:22.083251 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:22.083220    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pvgkz_1806c922-6bc4-4db8-83e8-15fdb1684b16/serve-healthcheck-canary/0.log"
Sep 10 13:53:22.909481 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:22.909451    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-pmk8q_eb360902-5133-4fb6-ab33-a7e16a4d2b16/insights-operator/0.log"
Sep 10 13:53:22.910706 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:22.910671    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-pmk8q_eb360902-5133-4fb6-ab33-a7e16a4d2b16/insights-operator/1.log"
Sep 10 13:53:23.113887 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:23.113861    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vjggg_1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf/kube-rbac-proxy/0.log"
Sep 10 13:53:23.142150 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:23.142115    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vjggg_1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf/exporter/0.log"
Sep 10 13:53:23.171441 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:23.171413    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vjggg_1b764ab5-f3b5-44b1-883c-ab3dc5c03cdf/extractor/0.log"
Sep 10 13:53:25.468403 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:25.468373    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69d5c84f88-kq52j_dae98928-5004-42e9-ba6f-56a1701f564b/kube-auth-proxy/0.log"
Sep 10 13:53:25.558512 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:25.558471    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nlccn_c413a9f4-c38f-40b7-a33c-84dfa1ad985e/payload-pre-processing/0.log"
Sep 10 13:53:25.604412 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:25.604379    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cc659cd8-kmvzg_6f148377-3da6-4888-8b3d-70dd02ea46a6/router/0.log"
Sep 10 13:53:25.891577 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:25.891519    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5rtbz_ce742769-0b91-4d0b-802e-1b801d1a32bc/manager/0.log"
Sep 10 13:53:26.473674 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:26.473640    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699db476d-hj8ts_2a9a03e6-84f1-47b8-9434-d8b39a89b814/manager/0.log"
Sep 10 13:53:26.538283 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:26.538252    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699db476d-hj8ts_2a9a03e6-84f1-47b8-9434-d8b39a89b814/copy-manifests/0.log"
Sep 10 13:53:27.402321 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:27.402292    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69d5c84f88-kq52j_dae98928-5004-42e9-ba6f-56a1701f564b/kube-auth-proxy/0.log"
Sep 10 13:53:27.482921 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:27.482892    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nlccn_c413a9f4-c38f-40b7-a33c-84dfa1ad985e/payload-pre-processing/0.log"
Sep 10 13:53:27.523872 ip-10-0-143-211 kubenswrapper[2584]: I0910 13:53:27.523802    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cc659cd8-kmvzg_6f148377-3da6-4888-8b3d-70dd02ea46a6/router/0.log"