Sep 11 14:12:59.929175 ip-10-0-142-0 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 14:12:59.929191 ip-10-0-142-0 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 14:12:59.929200 ip-10-0-142-0 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 14:12:59.929409 ip-10-0-142-0 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 14:13:10.066124 ip-10-0-142-0 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 14:13:10.066146 ip-10-0-142-0 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d0a977068a6c47abbdb785452a36d122 --
Sep 11 14:15:02.854367 ip-10-0-142-0 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 14:15:03.287761 ip-10-0-142-0 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 14:15:03.287761 ip-10-0-142-0 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 14:15:03.287761 ip-10-0-142-0 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 14:15:03.287761 ip-10-0-142-0 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 14:15:03.287761 ip-10-0-142-0 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 14:15:03.288861 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.288770    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 14:15:03.293066 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293031    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:03.293066 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293065    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:03.293066 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293068    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293073    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293076    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293079    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293081    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293084    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293087    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293089    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293092    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293094    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293097    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293099    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293103    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293106    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293108    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293110    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293114    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293118    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293121    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:03.293162 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293124    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293127    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293130    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293132    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293134    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293137    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293140    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293142    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293145    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293147    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293150    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293153    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293157    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293163    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293165    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293169    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293171    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293174    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293177    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293180    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:03.293617 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293182    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293185    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293187    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293190    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293192    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293195    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293198    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293201    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293204    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293206    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293209    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293211    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293214    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293216    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293219    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293221    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293224    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293226    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293228    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293231    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:03.294120 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293233    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293236    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293238    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293241    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293243    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293247    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293250    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293252    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293255    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293257    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293260    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293262    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293265    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293267    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293269    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293272    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293274    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293277    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293280    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:03.294609 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293284    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293287    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293290    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293292    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293295    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293298    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293301    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293303    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293306    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293308    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293310    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293313    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293315    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293318    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293320    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293322    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293325    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293327    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:03.295374 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.293330    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:03.296327 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296307    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:03.296327 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296326    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:03.296327 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296332    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296337    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296342    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296346    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296351    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296355    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296359    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296366    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296372    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296376    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296381    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296385    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296389    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296393    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296397    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296401    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296405    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296409    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296414    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:03.296494 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296417    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296422    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296426    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296430    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296435    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296441    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296446    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296450    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296454    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296459    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296463    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296467    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296471    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296478    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296485    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296491    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296497    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296502    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296506    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:03.297356 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296511    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296515    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296519    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296523    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296527    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296531    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296536    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296540    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296544    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296549    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296553    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296557    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296561    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296565    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296569    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296573    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296577    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296583    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296587    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296591    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:03.298224 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296595    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296601    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296605    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296609    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296613    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296618    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296622    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296626    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296631    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296635    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296640    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296644    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296648    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296652    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296656    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296661    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296666    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296670    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296675    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:03.299122 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296679    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296685    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296691    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296696    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296711    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296717    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296723    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296727    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296731    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296735    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296739    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296743    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296748    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296753    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296758    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296762    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296767    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296771    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296776    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:03.299858 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.296780    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297503    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297515    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297521    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297526    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297530    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297536    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297541    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297545    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297549    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297553    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297558    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297562    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297567    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297571    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297576    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297580    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297595    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297600    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:03.300376 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297604    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297611    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297617    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297621    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297626    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297630    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297635    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297640    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297644    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297649    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297653    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297657    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297663    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297670    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297675    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297681    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297685    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297689    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297694    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:03.300933 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297698    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297702    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297707    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297711    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297716    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297720    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297724    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297728    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297733    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297736    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297741    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297744    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297757    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297762    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297766    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297770    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297774    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297778    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297783    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297787    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:03.301460 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297793    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297797    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297801    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297806    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297810    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297815    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297819    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297823    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297828    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297832    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297836    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297840    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297844    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297849    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297853    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297857    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297861    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297865    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297872    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297877    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:03.301950 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297882    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297886    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297890    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297894    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297899    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297913    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297920    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297925    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297929    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297934    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297938    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297943    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297947    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297951    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297955    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297960    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297963    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297968    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297972    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:03.302727 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297977    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297981    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.297985    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298134    2582 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298190    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298204    2582 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298211    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298218    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298223    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298229    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298236    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298241    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298246    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298251    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298257    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298262    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298267    2582 flags.go:64] FLAG: --cgroup-root=""
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298272    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298277    2582 flags.go:64] FLAG: --client-ca-file=""
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298283    2582 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298289    2582 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298295    2582 flags.go:64] FLAG: --cluster-domain=""
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298300    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 14:15:03.303240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298305    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298310    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298316    2582 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298323    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298328    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298333    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298338    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298343    2582 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298348    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298353    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298358    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298363    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298370    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298375    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298380    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298385    2582 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298390    2582 flags.go:64] FLAG: --enable-server="true"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298395    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298403    2582 flags.go:64] FLAG: --event-burst="100"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298408    2582 flags.go:64] FLAG: --event-qps="50"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298414    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298419    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298424    2582 flags.go:64] FLAG: --eviction-hard=""
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298430    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 14:15:03.303802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298435    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298440    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298445    2582 flags.go:64] FLAG: --eviction-soft=""
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298450    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298455    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298461    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298467    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298472    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298477    2582 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298482    2582 flags.go:64] FLAG: --feature-gates=""
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298489    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298494    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298499    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298504    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298509    2582 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298515    2582 flags.go:64] FLAG: --help="false"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298519    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298525    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298530    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298534    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298540    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298545    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298550    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 14:15:03.304511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298555    2582 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298560    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298565    2582 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298570    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298576    2582 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298581    2582 flags.go:64] FLAG: --kube-reserved=""
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298586    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298590    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298595    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298601    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298605    2582 flags.go:64] FLAG: --lock-file=""
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298610    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298615    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298620    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298633    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298639    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298644    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298649    2582 flags.go:64] FLAG: --logging-format="text"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298654    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298659    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298665    2582 flags.go:64] FLAG: --manifest-url=""
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298669    2582 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298676    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298682    2582 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298688    2582 flags.go:64] FLAG: --max-pods="110"
Sep 11 14:15:03.305132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298694    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298699    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298703    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298708    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298713    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298718    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298723    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298735    2582 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298740    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298745    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298753    2582 flags.go:64] FLAG: --pod-cidr=""
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298757    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298766    2582 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298772    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298777    2582 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298782    2582 flags.go:64] FLAG: --port="10250"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298787    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298792    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-054d01b6cee5d1c51"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298797    2582 flags.go:64] FLAG: --qos-reserved=""
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298802    2582 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298807    2582 flags.go:64] FLAG: --register-node="true"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298811    2582 flags.go:64] FLAG: --register-with-taints=""
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298817    2582 flags.go:64] FLAG: --registry-burst="10"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298823    2582 flags.go:64] FLAG: --registry-qps="5"
Sep 11 14:15:03.305755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298828    2582 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298835    2582 flags.go:64] FLAG: --reserved-memory=""
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298841    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298846    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298851    2582 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298856    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298861    2582 flags.go:64] FLAG: --runonce="false"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298866    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298871    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298876    2582 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298881    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298885    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298890    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298895    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298900    2582 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298905    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298910    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298915    2582 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298922    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298926    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298931    2582 flags.go:64] FLAG: --system-cgroups=""
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298936    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298945    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298950    2582 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298955    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 14:15:03.306394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298961    2582 flags.go:64] FLAG: --tls-min-version=""
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298965    2582 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298970    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298974    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298979    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298984    2582 flags.go:64] FLAG: --v="2"
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298991    2582 flags.go:64] FLAG: --version="false"
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.298998    2582 flags.go:64] FLAG: --vmodule=""
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.299008    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.299013    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299223    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299232    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299237    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299242    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299248    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299253    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299258    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299263    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299268    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299273    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299277    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:03.307012 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299282    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299287    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299292    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299297    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299304    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299309    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299313    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299317    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299322    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299326    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299331    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299335    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299339    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299344    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299349    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299353    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299357    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299361    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299366    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299375    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:03.307626 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299380    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299384    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299388    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299392    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299396    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299401    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299405    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299409    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299414    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299418    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299422    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299429    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299435    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299439    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299444    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299448    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299454    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299459    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299463    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299468    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:03.308156 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299472    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299476    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299481    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299485    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299489    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299494    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299498    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299503    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299507    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299514    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299520    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299526    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299532    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299537    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299542    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299548    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299552    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299556    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299561    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299566    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:03.308652 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299570    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299574    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299578    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299583    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299587    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299591    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299595    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299600    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299605    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299609    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299613    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299618    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299622    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299626    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299630    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299635    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299639    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299643    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299649    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299655    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:03.309185 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299662    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:03.309682 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299667    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:03.309682 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299671    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:03.309682 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299677    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:03.309682 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299682    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:03.309682 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299688    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:03.309682 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299692    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:03.309682 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.299696    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:03.309682 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.300556    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 14:15:03.309682 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.308860    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 14:15:03.309682 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.308876    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.309783    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.309790    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309851    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309857    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309860    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309864    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309867    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309870    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309873    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309876    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309879    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309881    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309884    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309886    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309889    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309892    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309894    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309897    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309900    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:03.309976 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309902    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309905    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309907    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309909    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309912    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309914    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309917    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309925    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309929    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309932    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309935    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309938    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309940    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309943    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309946    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309949    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309952    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309954    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309957    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:03.310493 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309959    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309962    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309965    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309967    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309970    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309973    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309976    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309978    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309981    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309984    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309987    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309989    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309992    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309995    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.309997    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310000    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310002    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310005    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310008    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310011    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:03.310947 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310013    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310017    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310020    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310022    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310025    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310028    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310030    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310046    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310049    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310052    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310055    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310057    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310060    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310062    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310065    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310068    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310070    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310073    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310077    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310080    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:03.311461 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310083    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310086    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310089    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310092    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310094    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310097    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310100    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310103    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310107    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310110    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310113    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310116    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310119    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310121    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310125    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310127    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310130    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310132    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310135    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:03.311946 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310138    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310140    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310143    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310145    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.310151    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310272    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310277    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310279    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310282    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310285    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310288    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310290    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310293    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310295    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310298    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:03.312487 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310301    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310303    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310306    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310309    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310311    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310314    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310317    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310319    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310322    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310325    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310327    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310330    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310333    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310336    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310339    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310341    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310343    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310346    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310349    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310351    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:03.312868 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310354    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310356    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310359    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310361    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310364    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310366    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310369    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310371    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310373    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310376    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310378    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310381    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310383    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310386    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310388    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310391    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310393    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310396    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310398    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310401    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:03.313394 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310403    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310406    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310409    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310412    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310416    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310419    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310422    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310425    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310428    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310431    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310433    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310436    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310438    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310441    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310443    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310446    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310448    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310451    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310453    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:03.313901 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310455    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310458    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310461    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310464    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310468    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310470    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310474    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310478    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310481    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310484    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310487    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310490    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310492    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310495    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310498    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310501    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310503    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310506    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310508    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:03.314441 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310511    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:03.314960 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310514    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:03.314960 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310517    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:03.314960 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310519    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:03.314960 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310521    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:03.314960 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310524    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:03.314960 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310527    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:03.314960 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310529    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:03.314960 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310531    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:03.314960 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310534    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:03.314960 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:03.310536    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:03.314960 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.310541    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 14:15:03.314960 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.310670    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 14:15:03.314960 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.313166    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 14:15:03.314960 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.314274    2582 server.go:1019] "Starting client certificate rotation"
Sep 11 14:15:03.315336 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.314389    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 14:15:03.315336 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.314431    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 14:15:03.317110 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.317093    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 14:15:03.318198 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.318180    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 14:15:03.330467 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.330449    2582 log.go:25] "Validated CRI v1 runtime API"
Sep 11 14:15:03.333811 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.333796    2582 log.go:25] "Validated CRI v1 image API"
Sep 11 14:15:03.334732 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.334716    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 14:15:03.337370 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.337348    2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7e30afea-1adb-4eb2-ad09-d64b18be5e23:/dev/nvme0n1p4 84583f54-f540-4082-b015-c380322c34bc:/dev/nvme0n1p3]
Sep 11 14:15:03.337429 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.337370    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 14:15:03.343641 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.343529    2582 manager.go:216] Machine: {Timestamp:2026-09-11 14:15:03.34214891 +0000 UTC m=+0.374583762 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102113 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2967d054e924b8c8287288d91d7fce SystemUUID:ec2967d0-54e9-24b8-c828-7288d91d7fce BootID:d0a97706-8a6c-47ab-bdb7-85452a36d122 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dd:cd:ff:21:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dd:cd:ff:21:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:d2:63:ac:82:5e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 14:15:03.343641 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.343638    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 14:15:03.343758 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.343712    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 14:15:03.347161 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.347137    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 14:15:03.347296 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.347165    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-0.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 14:15:03.347999 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.347990    2582 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 14:15:03.348032 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.348001    2582 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 14:15:03.348032 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.348008    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 14:15:03.348873 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.348861    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 14:15:03.350134 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.350124    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 14:15:03.352531 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.352516    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 14:15:03.354802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.354790    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 14:15:03.354916 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.354906    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 14:15:03.354947 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.354934    2582 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 14:15:03.354947 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.354943    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 14:15:03.355000 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.354955    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 14:15:03.355000 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.354964    2582 kubelet.go:398] "Adding apiserver pod source"
Sep 11 14:15:03.355000 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.354972    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 14:15:03.355318 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.355302    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 14:15:03.355407 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.355324    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 14:15:03.358360 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.358330    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 14:15:03.360642 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.360628    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 14:15:03.360707 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.360659    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 14:15:03.362647 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.362634    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 14:15:03.362707 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.362652    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 14:15:03.362707 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.362658    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 14:15:03.362707 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.362664    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 14:15:03.362707 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.362672    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 14:15:03.362707 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.362678    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 14:15:03.362850 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.362711    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 14:15:03.362850 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.362718    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 14:15:03.362850 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.362724    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 14:15:03.362850 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.362729    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 14:15:03.362850 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.362738    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 14:15:03.362850 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.362743    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 14:15:03.363688 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.363674    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 14:15:03.363688 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.363684    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 14:15:03.366873 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.366857    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-0.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 14:15:03.366944 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.366894    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 14:15:03.366944 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.366910    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 14:15:03.369046 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.369021    2582 server.go:1268] "Started kubelet"
Sep 11 14:15:03.369128 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.369093    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 14:15:03.369182 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.369113    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 14:15:03.369233 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.369221    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 14:15:03.369838 ip-10-0-142-0 systemd[1]: Started Kubernetes Kubelet.
Sep 11 14:15:03.374002 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.373858    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 14:15:03.375194 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.375150    2582 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 14:15:03.375652 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.375625    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 14:15:03.376497 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.376471    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dp7vj"
Sep 11 14:15:03.379495 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.378452    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-0.ec2.internal.18d449ce8822b3da  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-0.ec2.internal,UID:ip-10-0-142-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-0.ec2.internal,},FirstTimestamp:2026-09-11 14:15:03.368995802 +0000 UTC m=+0.401430653,LastTimestamp:2026-09-11 14:15:03.368995802 +0000 UTC m=+0.401430653,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-0.ec2.internal,}"
Sep 11 14:15:03.379847 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.379830    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 14:15:03.380583 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.380561    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 14:15:03.380825 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.380810    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-0.ec2.internal\" not found"
Sep 11 14:15:03.381443 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.381424    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 14:15:03.381550 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.381467    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 14:15:03.381550 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.381482    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 14:15:03.381650 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.381594    2582 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 14:15:03.381650 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.381601    2582 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 14:15:03.381868 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.381851    2582 factory.go:55] Registering systemd factory
Sep 11 14:15:03.381914 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.381874    2582 factory.go:223] Registration of the systemd container factory successfully
Sep 11 14:15:03.382114 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.382099    2582 factory.go:153] Registering CRI-O factory
Sep 11 14:15:03.382202 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.382116    2582 factory.go:223] Registration of the crio container factory successfully
Sep 11 14:15:03.382202 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.382166    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 14:15:03.382202 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.382184    2582 factory.go:103] Registering Raw factory
Sep 11 14:15:03.382202 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.382203    2582 manager.go:1196] Started watching for new ooms in manager
Sep 11 14:15:03.383591 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.383577    2582 manager.go:349] Starting recovery of all containers
Sep 11 14:15:03.385113 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.385092    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dp7vj"
Sep 11 14:15:03.389329 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.389301    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 14:15:03.391663 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.391641    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 14:15:03.391765 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.391747    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 14:15:03.393734 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.393719    2582 manager.go:354] Recovery completed
Sep 11 14:15:03.398052 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.398022    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:03.399733 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.399718    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:03.399802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.399748    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:03.399802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.399761    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:03.400342 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.400325    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 14:15:03.400342 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.400341    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 14:15:03.400433 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.400326    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:03.400433 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.400358    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 14:15:03.401069 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.401053    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:03.401157 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.401083    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:03.401157 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.401097    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:03.402448 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.402432    2582 policy_none.go:49] "None policy: Start"
Sep 11 14:15:03.402448 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.402448    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 14:15:03.402730 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.402457    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 14:15:03.404491 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.404475    2582 policy_none.go:47] "Start"
Sep 11 14:15:03.448632 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.448615    2582 manager.go:337] "Starting Device Plugin manager"
Sep 11 14:15:03.465401 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.448650    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 14:15:03.465401 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.448661    2582 server.go:87] "Starting device plugin registration server"
Sep 11 14:15:03.465401 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.449057    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 14:15:03.465401 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.449070    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 14:15:03.465401 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.449152    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 14:15:03.465401 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.449240    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 14:15:03.465401 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.449250    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 14:15:03.465401 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.449758    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 14:15:03.465401 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.449803    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-0.ec2.internal\" not found"
Sep 11 14:15:03.487989 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.487965    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 14:15:03.488081 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.488013    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 14:15:03.488081 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.488031    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 14:15:03.488156 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.488088    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 14:15:03.490764 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.490746    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:03.550190 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.550132    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:03.551326 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.551310    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:03.551396 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.551342    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:03.551396 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.551354    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:03.551396 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.551374    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.558496 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.558481    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.558550 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.558502    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-0.ec2.internal\": node \"ip-10-0-142-0.ec2.internal\" not found"
Sep 11 14:15:03.579239 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.579221    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-0.ec2.internal\" not found"
Sep 11 14:15:03.588665 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.588649    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-0.ec2.internal"]
Sep 11 14:15:03.588713 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.588706    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:03.590029 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.590014    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:03.590104 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.590062    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:03.590104 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.590075    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:03.592389 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.592378    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:03.592576 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.592563    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.592609 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.592591    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:03.593105 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.593088    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:03.593170 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.593122    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:03.593170 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.593088    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:03.593170 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.593134    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:03.593170 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.593152    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:03.593170 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.593165    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:03.595460 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.595445    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.595536 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.595469    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:03.596132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.596107    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:03.596220 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.596142    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:03.596220 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.596155    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:03.614653 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.614634    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-0.ec2.internal\" not found" node="ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.618855 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.618841    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-0.ec2.internal\" not found" node="ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.680233 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.680210    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-0.ec2.internal\" not found"
Sep 11 14:15:03.682819 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.682795    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1347d1c5046484b2bcfd6ea5ef7ddac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal\" (UID: \"b1347d1c5046484b2bcfd6ea5ef7ddac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.682910 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.682825    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1347d1c5046484b2bcfd6ea5ef7ddac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal\" (UID: \"b1347d1c5046484b2bcfd6ea5ef7ddac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.682910 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.682848    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3051aa755ff5f3c1f618d35112a873c7-config\") pod \"kube-apiserver-proxy-ip-10-0-142-0.ec2.internal\" (UID: \"3051aa755ff5f3c1f618d35112a873c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.780399 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.780377    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-0.ec2.internal\" not found"
Sep 11 14:15:03.783657 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.783638    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1347d1c5046484b2bcfd6ea5ef7ddac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal\" (UID: \"b1347d1c5046484b2bcfd6ea5ef7ddac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.783753 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.783672    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1347d1c5046484b2bcfd6ea5ef7ddac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal\" (UID: \"b1347d1c5046484b2bcfd6ea5ef7ddac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.783753 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.783698    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3051aa755ff5f3c1f618d35112a873c7-config\") pod \"kube-apiserver-proxy-ip-10-0-142-0.ec2.internal\" (UID: \"3051aa755ff5f3c1f618d35112a873c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.783842 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.783754    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3051aa755ff5f3c1f618d35112a873c7-config\") pod \"kube-apiserver-proxy-ip-10-0-142-0.ec2.internal\" (UID: \"3051aa755ff5f3c1f618d35112a873c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.783842 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.783762    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1347d1c5046484b2bcfd6ea5ef7ddac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal\" (UID: \"b1347d1c5046484b2bcfd6ea5ef7ddac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.783842 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.783754    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1347d1c5046484b2bcfd6ea5ef7ddac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal\" (UID: \"b1347d1c5046484b2bcfd6ea5ef7ddac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.880938 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.880862    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-0.ec2.internal\" not found"
Sep 11 14:15:03.917255 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.917222    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.921222 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:03.921198    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:03.981105 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:03.981077    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-0.ec2.internal\" not found"
Sep 11 14:15:04.081531 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.081502    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-0.ec2.internal\" not found"
Sep 11 14:15:04.181851 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.181829    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-0.ec2.internal\" not found"
Sep 11 14:15:04.231348 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.231326    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:04.281698 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.281666    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:04.301260 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.301239    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 14:15:04.302763 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.302750    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:04.314399 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.314380    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 14:15:04.314512 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.314494    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 14:15:04.314566 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.314524    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 14:15:04.314613 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.314565    2582 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a0af01956503e4cd69205ac2070be4bf-ca74b8b8485c5bf2.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": read tcp 10.0.142.0:55836->3.211.21.202:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-0.ec2.internal"
Sep 11 14:15:04.333689 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.333667    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:04.355721 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.355701    2582 apiserver.go:52] "Watching apiserver"
Sep 11 14:15:04.360619 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.360603    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 14:15:04.362135 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.362114    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal","openshift-multus/multus-8q4n4","openshift-multus/multus-additional-cni-plugins-2z8jt","openshift-dns/node-resolver-l67jz","openshift-image-registry/node-ca-pbmvf","openshift-multus/network-metrics-daemon-n28zt","openshift-network-diagnostics/network-check-target-4ljct","openshift-network-operator/iptables-alerter-jdfld","openshift-ovn-kubernetes/ovnkube-node-mtf2x","kube-system/global-pull-secret-syncer-htlrd","kube-system/konnectivity-agent-m6d8t","kube-system/kube-apiserver-proxy-ip-10-0-142-0.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28","openshift-cluster-node-tuning-operator/tuned-ckwn8"]
Sep 11 14:15:04.364678 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.364660    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:04.364763 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.364721    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:04.366865 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.366846    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.369308 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.369285    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.371705 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.371681    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l67jz"
Sep 11 14:15:04.372695 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.372442    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 14:15:04.372695 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.372574    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vhfbv\""
Sep 11 14:15:04.372695 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.372618    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 14:15:04.373882 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.373774    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vwmwk\""
Sep 11 14:15:04.373882 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.373798    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fnjk8\""
Sep 11 14:15:04.374064 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.374005    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 14:15:04.374119 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.374080    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 14:15:04.374119 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.374103    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 14:15:04.374370 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.374353    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 14:15:04.374664 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.374622    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 14:15:04.374717 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.374665    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 14:15:04.374717 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.374673    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 14:15:04.374955 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.374936    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pbmvf"
Sep 11 14:15:04.375111 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.375094    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 14:15:04.377400 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.377382    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:04.377487 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.377435    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:04.379666 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.379647    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.379918 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.379899    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 14:15:04.380529 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.380510    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 14:15:04.380793 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.380776    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 14:15:04.380869 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.380844    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kfss7\""
Sep 11 14:15:04.380938 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.380924    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 14:15:04.382458 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.382442    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.385382 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.384832    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 14:15:04.385382 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.384880    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 14:15:04.385382 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.384906    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rcqb6\""
Sep 11 14:15:04.385382 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.385015    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 14:15:04.385382 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.385075    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 14:15:04.385382 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.385075    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 14:15:04.385382 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.385345    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.385711 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.385436    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 14:15:04.385711 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.385642    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sxttc\""
Sep 11 14:15:04.385711 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.385629    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:15:04.385831 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.385745    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 14:15:04.385984 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.385965    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c46f2e8d-a84b-4163-b0e1-998e17076ba3-cni-binary-copy\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.386024 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386000    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-kubernetes\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.386071 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386028    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-run-ovn-kubernetes\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.386110 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-registration-dir\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.386110 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386103    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.386203 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386141    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-systemd\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.386203 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386190    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-244th\" (UniqueName: \"kubernetes.io/projected/e7dffbdd-5a77-4f63-913e-6bdcb72064de-kube-api-access-244th\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.386264 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386211    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-log-socket\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.386264 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386231    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-tuned\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.386264 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-cni-netd\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.386264 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386259    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfgnn\" (UniqueName: \"kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn\") pod \"network-check-target-4ljct\" (UID: \"dc3ec023-a44e-4352-807e-54c84c900153\") " pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:04.386380 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-slash\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.386380 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386323    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-host\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.386380 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386338    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-var-lib-openvswitch\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.386380 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mnnd\" (UniqueName: \"kubernetes.io/projected/7c5116d8-d864-4919-8f30-da195179e39b-kube-api-access-8mnnd\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.386494 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcq7t\" (UniqueName: \"kubernetes.io/projected/97841560-b854-400b-8866-6df5111b9230-kube-api-access-mcq7t\") pod \"network-metrics-daemon-n28zt\" (UID: \"97841560-b854-400b-8866-6df5111b9230\") " pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:04.386494 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-lib-modules\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.386494 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386421    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-var-lib-kubelet\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.386494 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386439    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs\") pod \"network-metrics-daemon-n28zt\" (UID: \"97841560-b854-400b-8866-6df5111b9230\") " pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:04.386494 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-sysctl-conf\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.386682 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386508    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkmw5\" (UniqueName: \"kubernetes.io/projected/c46f2e8d-a84b-4163-b0e1-998e17076ba3-kube-api-access-qkmw5\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.386682 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386535    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2459af77-ccb7-4ff6-819c-d1ac79618d37-hosts-file\") pod \"node-resolver-l67jz\" (UID: \"2459af77-ccb7-4ff6-819c-d1ac79618d37\") " pod="openshift-dns/node-resolver-l67jz"
Sep 11 14:15:04.386682 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-cni-bin\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.386682 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386577    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-etc-openvswitch\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.386682 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386597    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-node-log\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.386682 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386636    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-device-dir\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.386682 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386659    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-kubelet\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.386873 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.386873 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386736    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-sys-fs\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.386873 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386757    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-sysctl-d\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.386873 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386788    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c46f2e8d-a84b-4163-b0e1-998e17076ba3-system-cni-dir\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.386873 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c46f2e8d-a84b-4163-b0e1-998e17076ba3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.386873 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5989f214-195a-4b8c-ac07-6b7f461ebfd7-env-overrides\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.387107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386874    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-socket-dir\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.387107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c46f2e8d-a84b-4163-b0e1-998e17076ba3-cnibin\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.387107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386915    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5989f214-195a-4b8c-ac07-6b7f461ebfd7-ovn-node-metrics-cert\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.387107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386944    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8k4z\" (UniqueName: \"kubernetes.io/projected/5989f214-195a-4b8c-ac07-6b7f461ebfd7-kube-api-access-w8k4z\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.387107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt8wb\" (UniqueName: \"kubernetes.io/projected/2459af77-ccb7-4ff6-819c-d1ac79618d37-kube-api-access-tt8wb\") pod \"node-resolver-l67jz\" (UID: \"2459af77-ccb7-4ff6-819c-d1ac79618d37\") " pod="openshift-dns/node-resolver-l67jz"
Sep 11 14:15:04.387107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.386991    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-sysconfig\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.387107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387007    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-sys\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.387107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387023    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c46f2e8d-a84b-4163-b0e1-998e17076ba3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.387107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387062    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbkwg\" (UniqueName: \"kubernetes.io/projected/8302613f-a418-483e-8ce5-59b148aef907-kube-api-access-kbkwg\") pod \"node-ca-pbmvf\" (UID: \"8302613f-a418-483e-8ce5-59b148aef907\") " pod="openshift-image-registry/node-ca-pbmvf"
Sep 11 14:15:04.387107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387080    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5989f214-195a-4b8c-ac07-6b7f461ebfd7-ovnkube-config\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.387107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387095    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8302613f-a418-483e-8ce5-59b148aef907-host\") pod \"node-ca-pbmvf\" (UID: \"8302613f-a418-483e-8ce5-59b148aef907\") " pod="openshift-image-registry/node-ca-pbmvf"
Sep 11 14:15:04.387107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-systemd-units\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.387518 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387136    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-run-openvswitch\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.387518 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387167    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5989f214-195a-4b8c-ac07-6b7f461ebfd7-ovnkube-script-lib\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.387518 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387192    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-modprobe-d\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.387518 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387210    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c46f2e8d-a84b-4163-b0e1-998e17076ba3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.387518 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-run-ovn\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.387518 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387259    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2459af77-ccb7-4ff6-819c-d1ac79618d37-tmp-dir\") pod \"node-resolver-l67jz\" (UID: \"2459af77-ccb7-4ff6-819c-d1ac79618d37\") " pod="openshift-dns/node-resolver-l67jz"
Sep 11 14:15:04.387518 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-run\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.387518 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387346    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7dffbdd-5a77-4f63-913e-6bdcb72064de-tmp\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.387518 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387370    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8302613f-a418-483e-8ce5-59b148aef907-serviceca\") pod \"node-ca-pbmvf\" (UID: \"8302613f-a418-483e-8ce5-59b148aef907\") " pod="openshift-image-registry/node-ca-pbmvf"
Sep 11 14:15:04.387518 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-run-netns\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.387518 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387417    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-run-systemd\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.387518 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.388004 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387716    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jdfld"
Sep 11 14:15:04.388004 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.387926    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 14:15:04.388581 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.388567    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k455g\""
Sep 11 14:15:04.389600 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.389584    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lnk52\""
Sep 11 14:15:04.389685 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.389673    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 14:15:04.390147 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.390131    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:15:04.390231 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.390216    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m6d8t"
Sep 11 14:15:04.390442 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.390412    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 14:15:04.392498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.392483    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:04.392555 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.392534    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:04.392742 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.392725    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 14:15:04.392849 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.392834    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j6l7d\""
Sep 11 14:15:04.393018 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.393005    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 14:15:04.394074 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.394021    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 14:10:03 +0000 UTC" deadline="2028-02-25 09:41:23.5955377 +0000 UTC"
Sep 11 14:15:04.394128 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.394076    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12763h26m19.201465879s"
Sep 11 14:15:04.399520 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.399495    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 14:15:04.399649 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.399633    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:04.414855 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.414837    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-55cks"
Sep 11 14:15:04.428064 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.428030    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-55cks"
Sep 11 14:15:04.482136 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.482114    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 14:15:04.488380 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c46f2e8d-a84b-4163-b0e1-998e17076ba3-system-cni-dir\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.488512 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488390    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c46f2e8d-a84b-4163-b0e1-998e17076ba3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.488512 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5989f214-195a-4b8c-ac07-6b7f461ebfd7-env-overrides\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.488512 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488432    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-socket-dir\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.488512 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488474    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c46f2e8d-a84b-4163-b0e1-998e17076ba3-system-cni-dir\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.488512 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488458    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-multus-daemon-config\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.488770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488555    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c46f2e8d-a84b-4163-b0e1-998e17076ba3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.488770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c46f2e8d-a84b-4163-b0e1-998e17076ba3-cnibin\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.488770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5989f214-195a-4b8c-ac07-6b7f461ebfd7-ovn-node-metrics-cert\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.488770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488597    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c46f2e8d-a84b-4163-b0e1-998e17076ba3-cnibin\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.488770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8k4z\" (UniqueName: \"kubernetes.io/projected/5989f214-195a-4b8c-ac07-6b7f461ebfd7-kube-api-access-w8k4z\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.488770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488602    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-socket-dir\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.488770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt8wb\" (UniqueName: \"kubernetes.io/projected/2459af77-ccb7-4ff6-819c-d1ac79618d37-kube-api-access-tt8wb\") pod \"node-resolver-l67jz\" (UID: \"2459af77-ccb7-4ff6-819c-d1ac79618d37\") " pod="openshift-dns/node-resolver-l67jz"
Sep 11 14:15:04.488770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-sysconfig\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.488770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-sys\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.488770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-run-multus-certs\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.488770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c46f2e8d-a84b-4163-b0e1-998e17076ba3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.488770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488737    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-sysconfig\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.488770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488752    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-sys\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.488770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbkwg\" (UniqueName: \"kubernetes.io/projected/8302613f-a418-483e-8ce5-59b148aef907-kube-api-access-kbkwg\") pod \"node-ca-pbmvf\" (UID: \"8302613f-a418-483e-8ce5-59b148aef907\") " pod="openshift-image-registry/node-ca-pbmvf"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5989f214-195a-4b8c-ac07-6b7f461ebfd7-ovnkube-config\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488878    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-cnibin\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488903    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-var-lib-cni-multus\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488935    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5989f214-195a-4b8c-ac07-6b7f461ebfd7-env-overrides\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.488990    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95a60cea-19ed-4140-8257-87cd771a68cc-agent-certs\") pod \"konnectivity-agent-m6d8t\" (UID: \"95a60cea-19ed-4140-8257-87cd771a68cc\") " pod="kube-system/konnectivity-agent-m6d8t"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8302613f-a418-483e-8ce5-59b148aef907-host\") pod \"node-ca-pbmvf\" (UID: \"8302613f-a418-483e-8ce5-59b148aef907\") " pod="openshift-image-registry/node-ca-pbmvf"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489070    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-systemd-units\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489095    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-run-openvswitch\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489106    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8302613f-a418-483e-8ce5-59b148aef907-host\") pod \"node-ca-pbmvf\" (UID: \"8302613f-a418-483e-8ce5-59b148aef907\") " pod="openshift-image-registry/node-ca-pbmvf"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489120    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5989f214-195a-4b8c-ac07-6b7f461ebfd7-ovnkube-script-lib\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489144    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-modprobe-d\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489163    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-systemd-units\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489167    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-var-lib-cni-bin\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489193    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-hostroot\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489219    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c46f2e8d-a84b-4163-b0e1-998e17076ba3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489247    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-run-ovn\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.489484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489269    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2459af77-ccb7-4ff6-819c-d1ac79618d37-tmp-dir\") pod \"node-resolver-l67jz\" (UID: \"2459af77-ccb7-4ff6-819c-d1ac79618d37\") " pod="openshift-dns/node-resolver-l67jz"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489273    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-modprobe-d\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489290    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-run\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489310    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c46f2e8d-a84b-4163-b0e1-998e17076ba3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489320    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-run-openvswitch\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489323    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489350    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5989f214-195a-4b8c-ac07-6b7f461ebfd7-ovnkube-config\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7dffbdd-5a77-4f63-913e-6bdcb72064de-tmp\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489698    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2459af77-ccb7-4ff6-819c-d1ac79618d37-tmp-dir\") pod \"node-resolver-l67jz\" (UID: \"2459af77-ccb7-4ff6-819c-d1ac79618d37\") " pod="openshift-dns/node-resolver-l67jz"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489713    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5989f214-195a-4b8c-ac07-6b7f461ebfd7-ovnkube-script-lib\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489747    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-run-ovn\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489774    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-run\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489808    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-etc-kubernetes\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8302613f-a418-483e-8ce5-59b148aef907-serviceca\") pod \"node-ca-pbmvf\" (UID: \"8302613f-a418-483e-8ce5-59b148aef907\") " pod="openshift-image-registry/node-ca-pbmvf"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489870    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c46f2e8d-a84b-4163-b0e1-998e17076ba3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-run-netns\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-run-systemd\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.490324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-var-lib-kubelet\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489991    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-run-systemd\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-run-netns\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.489993    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c46f2e8d-a84b-4163-b0e1-998e17076ba3-cni-binary-copy\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-kubernetes\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490054    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490074    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z88f4\" (UniqueName: \"kubernetes.io/projected/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-kube-api-access-z88f4\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-run-ovn-kubernetes\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490121    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-registration-dir\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490144    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-cni-binary-copy\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490164    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-kubernetes\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490213    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-run-ovn-kubernetes\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490218    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8302613f-a418-483e-8ce5-59b148aef907-serviceca\") pod \"node-ca-pbmvf\" (UID: \"8302613f-a418-483e-8ce5-59b148aef907\") " pod="openshift-image-registry/node-ca-pbmvf"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490259    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-registration-dir\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490268    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-systemd\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490279    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.491235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-244th\" (UniqueName: \"kubernetes.io/projected/e7dffbdd-5a77-4f63-913e-6bdcb72064de-kube-api-access-244th\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490312    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-systemd\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490339    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-run-k8s-cni-cncf-io\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490368    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c257df5-da6d-4b3c-ae58-113a8eea811f-iptables-alerter-script\") pod \"iptables-alerter-jdfld\" (UID: \"2c257df5-da6d-4b3c-ae58-113a8eea811f\") " pod="openshift-network-operator/iptables-alerter-jdfld"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-log-socket\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490439    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c46f2e8d-a84b-4163-b0e1-998e17076ba3-cni-binary-copy\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490482    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-tuned\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490490    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-log-socket\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490548    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-multus-socket-dir-parent\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490590    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-cni-netd\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490615    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfgnn\" (UniqueName: \"kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn\") pod \"network-check-target-4ljct\" (UID: \"dc3ec023-a44e-4352-807e-54c84c900153\") " pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490634    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-slash\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-host\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490677    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-cni-netd\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490678    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wtpk\" (UniqueName: \"kubernetes.io/projected/2c257df5-da6d-4b3c-ae58-113a8eea811f-kube-api-access-7wtpk\") pod \"iptables-alerter-jdfld\" (UID: \"2c257df5-da6d-4b3c-ae58-113a8eea811f\") " pod="openshift-network-operator/iptables-alerter-jdfld"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490721    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-slash\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-var-lib-openvswitch\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.492125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490760    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mnnd\" (UniqueName: \"kubernetes.io/projected/7c5116d8-d864-4919-8f30-da195179e39b-kube-api-access-8mnnd\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490768    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-host\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcq7t\" (UniqueName: \"kubernetes.io/projected/97841560-b854-400b-8866-6df5111b9230-kube-api-access-mcq7t\") pod \"network-metrics-daemon-n28zt\" (UID: \"97841560-b854-400b-8866-6df5111b9230\") " pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490798    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-var-lib-openvswitch\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-lib-modules\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490822    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-var-lib-kubelet\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs\") pod \"network-metrics-daemon-n28zt\" (UID: \"97841560-b854-400b-8866-6df5111b9230\") " pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490878    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-sysctl-conf\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490899    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-multus-conf-dir\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkmw5\" (UniqueName: \"kubernetes.io/projected/c46f2e8d-a84b-4163-b0e1-998e17076ba3-kube-api-access-qkmw5\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2459af77-ccb7-4ff6-819c-d1ac79618d37-hosts-file\") pod \"node-resolver-l67jz\" (UID: \"2459af77-ccb7-4ff6-819c-d1ac79618d37\") " pod="openshift-dns/node-resolver-l67jz"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490942    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-var-lib-kubelet\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490963    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-system-cni-dir\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.490990    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95a60cea-19ed-4140-8257-87cd771a68cc-konnectivity-ca\") pod \"konnectivity-agent-m6d8t\" (UID: \"95a60cea-19ed-4140-8257-87cd771a68cc\") " pod="kube-system/konnectivity-agent-m6d8t"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-cni-bin\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-etc-openvswitch\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-node-log\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.491091    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:04.492596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491107    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-device-dir\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491131    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-run-netns\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491196    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c257df5-da6d-4b3c-ae58-113a8eea811f-host-slash\") pod \"iptables-alerter-jdfld\" (UID: \"2c257df5-da6d-4b3c-ae58-113a8eea811f\") " pod="openshift-network-operator/iptables-alerter-jdfld"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491240    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-lib-modules\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.491343    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs podName:97841560-b854-400b-8866-6df5111b9230 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:04.991299089 +0000 UTC m=+2.023733942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs") pod "network-metrics-daemon-n28zt" (UID: "97841560-b854-400b-8866-6df5111b9230") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a61a2aa3-3169-4b47-8bd8-3567df82ac12-kubelet-config\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491382    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a61a2aa3-3169-4b47-8bd8-3567df82ac12-dbus\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491430    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-sysctl-conf\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-kubelet\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491528    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-sys-fs\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-sysctl-d\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-multus-cni-dir\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491574    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-etc-openvswitch\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491621    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2459af77-ccb7-4ff6-819c-d1ac79618d37-hosts-file\") pod \"node-resolver-l67jz\" (UID: \"2459af77-ccb7-4ff6-819c-d1ac79618d37\") " pod="openshift-dns/node-resolver-l67jz"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491684    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-device-dir\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.493176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491706    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:04.493817 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491717    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-cni-bin\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.493817 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491760    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.493817 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491770    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c5116d8-d864-4919-8f30-da195179e39b-sys-fs\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.493817 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491797    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-host-kubelet\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.493817 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491812    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5989f214-195a-4b8c-ac07-6b7f461ebfd7-node-log\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.493817 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.491837    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-sysctl-d\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.493817 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.493324    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7dffbdd-5a77-4f63-913e-6bdcb72064de-etc-tuned\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.493817 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.493523    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5989f214-195a-4b8c-ac07-6b7f461ebfd7-ovn-node-metrics-cert\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.494083 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.493834    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7dffbdd-5a77-4f63-913e-6bdcb72064de-tmp\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.510431 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.510402    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8k4z\" (UniqueName: \"kubernetes.io/projected/5989f214-195a-4b8c-ac07-6b7f461ebfd7-kube-api-access-w8k4z\") pod \"ovnkube-node-mtf2x\" (UID: \"5989f214-195a-4b8c-ac07-6b7f461ebfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.510558 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.510425    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbkwg\" (UniqueName: \"kubernetes.io/projected/8302613f-a418-483e-8ce5-59b148aef907-kube-api-access-kbkwg\") pod \"node-ca-pbmvf\" (UID: \"8302613f-a418-483e-8ce5-59b148aef907\") " pod="openshift-image-registry/node-ca-pbmvf"
Sep 11 14:15:04.510888 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.510855    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcq7t\" (UniqueName: \"kubernetes.io/projected/97841560-b854-400b-8866-6df5111b9230-kube-api-access-mcq7t\") pod \"network-metrics-daemon-n28zt\" (UID: \"97841560-b854-400b-8866-6df5111b9230\") " pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:04.511686 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.511661    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-244th\" (UniqueName: \"kubernetes.io/projected/e7dffbdd-5a77-4f63-913e-6bdcb72064de-kube-api-access-244th\") pod \"tuned-ckwn8\" (UID: \"e7dffbdd-5a77-4f63-913e-6bdcb72064de\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.511843 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.511823    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:04.511843 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.511849    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:04.511971 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.511863    2582 projected.go:196] Error preparing data for projected volume kube-api-access-dfgnn for pod openshift-network-diagnostics/network-check-target-4ljct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:04.511971 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.511933    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt8wb\" (UniqueName: \"kubernetes.io/projected/2459af77-ccb7-4ff6-819c-d1ac79618d37-kube-api-access-tt8wb\") pod \"node-resolver-l67jz\" (UID: \"2459af77-ccb7-4ff6-819c-d1ac79618d37\") " pod="openshift-dns/node-resolver-l67jz"
Sep 11 14:15:04.511971 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.511942    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn podName:dc3ec023-a44e-4352-807e-54c84c900153 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:05.011923419 +0000 UTC m=+2.044358279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dfgnn" (UniqueName: "kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn") pod "network-check-target-4ljct" (UID: "dc3ec023-a44e-4352-807e-54c84c900153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:04.512289 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.512269    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mnnd\" (UniqueName: \"kubernetes.io/projected/7c5116d8-d864-4919-8f30-da195179e39b-kube-api-access-8mnnd\") pod \"aws-ebs-csi-driver-node-hrd28\" (UID: \"7c5116d8-d864-4919-8f30-da195179e39b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.512772 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.512755    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkmw5\" (UniqueName: \"kubernetes.io/projected/c46f2e8d-a84b-4163-b0e1-998e17076ba3-kube-api-access-qkmw5\") pod \"multus-additional-cni-plugins-2z8jt\" (UID: \"c46f2e8d-a84b-4163-b0e1-998e17076ba3\") " pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.593002 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.592971    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-etc-kubernetes\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.593206 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-var-lib-kubelet\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.593318 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593078    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-etc-kubernetes\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.593318 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593220    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z88f4\" (UniqueName: \"kubernetes.io/projected/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-kube-api-access-z88f4\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.593318 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593271    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-var-lib-kubelet\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.593318 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-cni-binary-copy\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.593318 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593300    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-run-k8s-cni-cncf-io\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.593565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c257df5-da6d-4b3c-ae58-113a8eea811f-iptables-alerter-script\") pod \"iptables-alerter-jdfld\" (UID: \"2c257df5-da6d-4b3c-ae58-113a8eea811f\") " pod="openshift-network-operator/iptables-alerter-jdfld"
Sep 11 14:15:04.593565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-multus-socket-dir-parent\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.593565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wtpk\" (UniqueName: \"kubernetes.io/projected/2c257df5-da6d-4b3c-ae58-113a8eea811f-kube-api-access-7wtpk\") pod \"iptables-alerter-jdfld\" (UID: \"2c257df5-da6d-4b3c-ae58-113a8eea811f\") " pod="openshift-network-operator/iptables-alerter-jdfld"
Sep 11 14:15:04.593565 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:04.593384    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3051aa755ff5f3c1f618d35112a873c7.slice/crio-481596c0d4be7c1f5b10a3b05c5858076d2064e39dac65479bcb6f1c59ca675e WatchSource:0}: Error finding container 481596c0d4be7c1f5b10a3b05c5858076d2064e39dac65479bcb6f1c59ca675e: Status 404 returned error can't find the container with id 481596c0d4be7c1f5b10a3b05c5858076d2064e39dac65479bcb6f1c59ca675e
Sep 11 14:15:04.593565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593424    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-multus-conf-dir\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.593565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-system-cni-dir\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.593565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593473    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95a60cea-19ed-4140-8257-87cd771a68cc-konnectivity-ca\") pod \"konnectivity-agent-m6d8t\" (UID: \"95a60cea-19ed-4140-8257-87cd771a68cc\") " pod="kube-system/konnectivity-agent-m6d8t"
Sep 11 14:15:04.593565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593498    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-run-netns\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.593565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593520    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c257df5-da6d-4b3c-ae58-113a8eea811f-host-slash\") pod \"iptables-alerter-jdfld\" (UID: \"2c257df5-da6d-4b3c-ae58-113a8eea811f\") " pod="openshift-network-operator/iptables-alerter-jdfld"
Sep 11 14:15:04.593565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a61a2aa3-3169-4b47-8bd8-3567df82ac12-kubelet-config\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:04.593565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593541    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-run-k8s-cni-cncf-io\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.593565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a61a2aa3-3169-4b47-8bd8-3567df82ac12-dbus\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-multus-cni-dir\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593627    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a61a2aa3-3169-4b47-8bd8-3567df82ac12-dbus\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-multus-daemon-config\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-run-multus-certs\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593667    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-multus-socket-dir-parent\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-cnibin\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593716    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-multus-conf-dir\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593732    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-var-lib-cni-multus\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593744    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-system-cni-dir\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95a60cea-19ed-4140-8257-87cd771a68cc-agent-certs\") pod \"konnectivity-agent-m6d8t\" (UID: \"95a60cea-19ed-4140-8257-87cd771a68cc\") " pod="kube-system/konnectivity-agent-m6d8t"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593783    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-var-lib-cni-bin\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593805    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-hostroot\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593870    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-hostroot\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593899    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c257df5-da6d-4b3c-ae58-113a8eea811f-iptables-alerter-script\") pod \"iptables-alerter-jdfld\" (UID: \"2c257df5-da6d-4b3c-ae58-113a8eea811f\") " pod="openshift-network-operator/iptables-alerter-jdfld"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593926    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-multus-cni-dir\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.593973    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c257df5-da6d-4b3c-ae58-113a8eea811f-host-slash\") pod \"iptables-alerter-jdfld\" (UID: \"2c257df5-da6d-4b3c-ae58-113a8eea811f\") " pod="openshift-network-operator/iptables-alerter-jdfld"
Sep 11 14:15:04.594165 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.594073    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:04.594935 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.594125    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret podName:a61a2aa3-3169-4b47-8bd8-3567df82ac12 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:05.094107575 +0000 UTC m=+2.126542429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret") pod "global-pull-secret-syncer-htlrd" (UID: "a61a2aa3-3169-4b47-8bd8-3567df82ac12") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:04.594935 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.594142    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-var-lib-cni-multus\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594935 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.594224    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95a60cea-19ed-4140-8257-87cd771a68cc-konnectivity-ca\") pod \"konnectivity-agent-m6d8t\" (UID: \"95a60cea-19ed-4140-8257-87cd771a68cc\") " pod="kube-system/konnectivity-agent-m6d8t"
Sep 11 14:15:04.594935 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.594237    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-cnibin\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594935 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.594223    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-run-netns\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594935 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.594257    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-run-multus-certs\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594935 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.594304    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a61a2aa3-3169-4b47-8bd8-3567df82ac12-kubelet-config\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:04.594935 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.594316    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-host-var-lib-cni-bin\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594935 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.594515    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-cni-binary-copy\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.594935 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.594874    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-multus-daemon-config\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.595275 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:04.594963    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1347d1c5046484b2bcfd6ea5ef7ddac.slice/crio-1780a0d0224b47407c0c4b7a94e96e98f349e57ce214559a02fee07a9423284a WatchSource:0}: Error finding container 1780a0d0224b47407c0c4b7a94e96e98f349e57ce214559a02fee07a9423284a: Status 404 returned error can't find the container with id 1780a0d0224b47407c0c4b7a94e96e98f349e57ce214559a02fee07a9423284a
Sep 11 14:15:04.596900 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.596881    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95a60cea-19ed-4140-8257-87cd771a68cc-agent-certs\") pod \"konnectivity-agent-m6d8t\" (UID: \"95a60cea-19ed-4140-8257-87cd771a68cc\") " pod="kube-system/konnectivity-agent-m6d8t"
Sep 11 14:15:04.598488 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.598472    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:15:04.609850 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.609832    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z88f4\" (UniqueName: \"kubernetes.io/projected/d75d6fa4-7101-4f9b-8877-bf3f41e7b752-kube-api-access-z88f4\") pod \"multus-8q4n4\" (UID: \"d75d6fa4-7101-4f9b-8877-bf3f41e7b752\") " pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.611404 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.611385    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wtpk\" (UniqueName: \"kubernetes.io/projected/2c257df5-da6d-4b3c-ae58-113a8eea811f-kube-api-access-7wtpk\") pod \"iptables-alerter-jdfld\" (UID: \"2c257df5-da6d-4b3c-ae58-113a8eea811f\") " pod="openshift-network-operator/iptables-alerter-jdfld"
Sep 11 14:15:04.700621 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.700544    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28"
Sep 11 14:15:04.711223 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.711201    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2z8jt"
Sep 11 14:15:04.711611 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:04.711588    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5116d8_d864_4919_8f30_da195179e39b.slice/crio-615136e6ad77fe06f212316773736aee4e8cb7b01937e9c2ad685fbb1670b2db WatchSource:0}: Error finding container 615136e6ad77fe06f212316773736aee4e8cb7b01937e9c2ad685fbb1670b2db: Status 404 returned error can't find the container with id 615136e6ad77fe06f212316773736aee4e8cb7b01937e9c2ad685fbb1670b2db
Sep 11 14:15:04.720088 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:04.720065    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46f2e8d_a84b_4163_b0e1_998e17076ba3.slice/crio-8fa18c562bc2df66c197c88539ea4fbcbac656710b972b43182e34fe863cabe2 WatchSource:0}: Error finding container 8fa18c562bc2df66c197c88539ea4fbcbac656710b972b43182e34fe863cabe2: Status 404 returned error can't find the container with id 8fa18c562bc2df66c197c88539ea4fbcbac656710b972b43182e34fe863cabe2
Sep 11 14:15:04.729438 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.729419    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l67jz"
Sep 11 14:15:04.737691 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:04.737670    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2459af77_ccb7_4ff6_819c_d1ac79618d37.slice/crio-d11cf8d73bade9134e1719db20c8cf49869416a0c50908beb62c0a1311ed00eb WatchSource:0}: Error finding container d11cf8d73bade9134e1719db20c8cf49869416a0c50908beb62c0a1311ed00eb: Status 404 returned error can't find the container with id d11cf8d73bade9134e1719db20c8cf49869416a0c50908beb62c0a1311ed00eb
Sep 11 14:15:04.742722 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.742704    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pbmvf"
Sep 11 14:15:04.748743 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.748722    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:04.753331 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:04.753300    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8302613f_a418_483e_8ce5_59b148aef907.slice/crio-085c1cb1ce6aea96fb9f6eef0b4ed77e6f3efd2fd173598b5f6526e63bd47cd9 WatchSource:0}: Error finding container 085c1cb1ce6aea96fb9f6eef0b4ed77e6f3efd2fd173598b5f6526e63bd47cd9: Status 404 returned error can't find the container with id 085c1cb1ce6aea96fb9f6eef0b4ed77e6f3efd2fd173598b5f6526e63bd47cd9
Sep 11 14:15:04.759239 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:04.759218    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5989f214_195a_4b8c_ac07_6b7f461ebfd7.slice/crio-bc06c6b5e945ad5e5a39dcf0bc3300f1f0f34c5d296a031d0b830589ee491db8 WatchSource:0}: Error finding container bc06c6b5e945ad5e5a39dcf0bc3300f1f0f34c5d296a031d0b830589ee491db8: Status 404 returned error can't find the container with id bc06c6b5e945ad5e5a39dcf0bc3300f1f0f34c5d296a031d0b830589ee491db8
Sep 11 14:15:04.776304 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.776276    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ckwn8"
Sep 11 14:15:04.782291 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.782273    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8q4n4"
Sep 11 14:15:04.785533 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:04.785515    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7dffbdd_5a77_4f63_913e_6bdcb72064de.slice/crio-c4024f0bf2fd09b8cd5634a807a4eeab0bc06bb50391ac965738e0f678444677 WatchSource:0}: Error finding container c4024f0bf2fd09b8cd5634a807a4eeab0bc06bb50391ac965738e0f678444677: Status 404 returned error can't find the container with id c4024f0bf2fd09b8cd5634a807a4eeab0bc06bb50391ac965738e0f678444677
Sep 11 14:15:04.790968 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:04.790941    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75d6fa4_7101_4f9b_8877_bf3f41e7b752.slice/crio-8406528f41d6c75c994f1a707e87ecde757a1cc90b2d49da015ebb77ad3ad3a2 WatchSource:0}: Error finding container 8406528f41d6c75c994f1a707e87ecde757a1cc90b2d49da015ebb77ad3ad3a2: Status 404 returned error can't find the container with id 8406528f41d6c75c994f1a707e87ecde757a1cc90b2d49da015ebb77ad3ad3a2
Sep 11 14:15:04.800324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.800305    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jdfld"
Sep 11 14:15:04.805347 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.805332    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m6d8t"
Sep 11 14:15:04.810128 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:04.810091    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c257df5_da6d_4b3c_ae58_113a8eea811f.slice/crio-af8bf9337f50d911723d70491756cbbf50a30c08a062f487d15bf870324c703c WatchSource:0}: Error finding container af8bf9337f50d911723d70491756cbbf50a30c08a062f487d15bf870324c703c: Status 404 returned error can't find the container with id af8bf9337f50d911723d70491756cbbf50a30c08a062f487d15bf870324c703c
Sep 11 14:15:04.815435 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:04.815411    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a60cea_19ed_4140_8257_87cd771a68cc.slice/crio-dccbaf8633ddabbd795d85ece6d8377d63457633a294600360be7eaac7668110 WatchSource:0}: Error finding container dccbaf8633ddabbd795d85ece6d8377d63457633a294600360be7eaac7668110: Status 404 returned error can't find the container with id dccbaf8633ddabbd795d85ece6d8377d63457633a294600360be7eaac7668110
Sep 11 14:15:04.997167 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:04.997063    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs\") pod \"network-metrics-daemon-n28zt\" (UID: \"97841560-b854-400b-8866-6df5111b9230\") " pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:04.997327 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.997167    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:04.997327 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:04.997227    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs podName:97841560-b854-400b-8866-6df5111b9230 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:05.997209397 +0000 UTC m=+3.029644262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs") pod "network-metrics-daemon-n28zt" (UID: "97841560-b854-400b-8866-6df5111b9230") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:05.098237 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.098196    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfgnn\" (UniqueName: \"kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn\") pod \"network-check-target-4ljct\" (UID: \"dc3ec023-a44e-4352-807e-54c84c900153\") " pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:05.098429 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.098284    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:05.098429 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:05.098382    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:05.098429 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:05.098415    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:05.098429 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:05.098429    2582 projected.go:196] Error preparing data for projected volume kube-api-access-dfgnn for pod openshift-network-diagnostics/network-check-target-4ljct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:05.098650 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:05.098480    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn podName:dc3ec023-a44e-4352-807e-54c84c900153 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:06.098464018 +0000 UTC m=+3.130898862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfgnn" (UniqueName: "kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn") pod "network-check-target-4ljct" (UID: "dc3ec023-a44e-4352-807e-54c84c900153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:05.098650 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:05.098384    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:05.098650 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:05.098535    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret podName:a61a2aa3-3169-4b47-8bd8-3567df82ac12 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:06.098523566 +0000 UTC m=+3.130958405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret") pod "global-pull-secret-syncer-htlrd" (UID: "a61a2aa3-3169-4b47-8bd8-3567df82ac12") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:05.431028 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.430965    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 14:10:04 +0000 UTC" deadline="2028-04-17 13:33:42.717180544 +0000 UTC"
Sep 11 14:15:05.431028 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.431029    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14015h18m37.286156028s"
Sep 11 14:15:05.494759 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.494724    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:05.495397 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:05.495345    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:05.495613 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.495595    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:05.495771 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:05.495724    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:05.495867 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.495800    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:05.495976 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:05.495925    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:05.524584 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.522651    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-0.ec2.internal" event={"ID":"3051aa755ff5f3c1f618d35112a873c7","Type":"ContainerStarted","Data":"481596c0d4be7c1f5b10a3b05c5858076d2064e39dac65479bcb6f1c59ca675e"}
Sep 11 14:15:05.527477 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.524965    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ckwn8" event={"ID":"e7dffbdd-5a77-4f63-913e-6bdcb72064de","Type":"ContainerStarted","Data":"c4024f0bf2fd09b8cd5634a807a4eeab0bc06bb50391ac965738e0f678444677"}
Sep 11 14:15:05.533678 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.533505    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x" event={"ID":"5989f214-195a-4b8c-ac07-6b7f461ebfd7","Type":"ContainerStarted","Data":"bc06c6b5e945ad5e5a39dcf0bc3300f1f0f34c5d296a031d0b830589ee491db8"}
Sep 11 14:15:05.542241 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.542190    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2z8jt" event={"ID":"c46f2e8d-a84b-4163-b0e1-998e17076ba3","Type":"ContainerStarted","Data":"8fa18c562bc2df66c197c88539ea4fbcbac656710b972b43182e34fe863cabe2"}
Sep 11 14:15:05.545455 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.545385    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal" event={"ID":"b1347d1c5046484b2bcfd6ea5ef7ddac","Type":"ContainerStarted","Data":"1780a0d0224b47407c0c4b7a94e96e98f349e57ce214559a02fee07a9423284a"}
Sep 11 14:15:05.548987 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.548951    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m6d8t" event={"ID":"95a60cea-19ed-4140-8257-87cd771a68cc","Type":"ContainerStarted","Data":"dccbaf8633ddabbd795d85ece6d8377d63457633a294600360be7eaac7668110"}
Sep 11 14:15:05.555252 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.555226    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jdfld" event={"ID":"2c257df5-da6d-4b3c-ae58-113a8eea811f","Type":"ContainerStarted","Data":"af8bf9337f50d911723d70491756cbbf50a30c08a062f487d15bf870324c703c"}
Sep 11 14:15:05.560638 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.560609    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8q4n4" event={"ID":"d75d6fa4-7101-4f9b-8877-bf3f41e7b752","Type":"ContainerStarted","Data":"8406528f41d6c75c994f1a707e87ecde757a1cc90b2d49da015ebb77ad3ad3a2"}
Sep 11 14:15:05.564090 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.564059    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pbmvf" event={"ID":"8302613f-a418-483e-8ce5-59b148aef907","Type":"ContainerStarted","Data":"085c1cb1ce6aea96fb9f6eef0b4ed77e6f3efd2fd173598b5f6526e63bd47cd9"}
Sep 11 14:15:05.567583 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.567556    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l67jz" event={"ID":"2459af77-ccb7-4ff6-819c-d1ac79618d37","Type":"ContainerStarted","Data":"d11cf8d73bade9134e1719db20c8cf49869416a0c50908beb62c0a1311ed00eb"}
Sep 11 14:15:05.582449 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.582389    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28" event={"ID":"7c5116d8-d864-4919-8f30-da195179e39b","Type":"ContainerStarted","Data":"615136e6ad77fe06f212316773736aee4e8cb7b01937e9c2ad685fbb1670b2db"}
Sep 11 14:15:05.744225 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:05.744141    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:06.010296 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:06.010197    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs\") pod \"network-metrics-daemon-n28zt\" (UID: \"97841560-b854-400b-8866-6df5111b9230\") " pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:06.010435 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:06.010385    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:06.010473 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:06.010454    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs podName:97841560-b854-400b-8866-6df5111b9230 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:08.01043482 +0000 UTC m=+5.042869668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs") pod "network-metrics-daemon-n28zt" (UID: "97841560-b854-400b-8866-6df5111b9230") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:06.111539 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:06.111469    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:06.111738 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:06.111571    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfgnn\" (UniqueName: \"kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn\") pod \"network-check-target-4ljct\" (UID: \"dc3ec023-a44e-4352-807e-54c84c900153\") " pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:06.111738 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:06.111628    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:06.111738 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:06.111704    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret podName:a61a2aa3-3169-4b47-8bd8-3567df82ac12 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:08.111683648 +0000 UTC m=+5.144118499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret") pod "global-pull-secret-syncer-htlrd" (UID: "a61a2aa3-3169-4b47-8bd8-3567df82ac12") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:06.111738 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:06.111731    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:06.111952 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:06.111752    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:06.111952 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:06.111765    2582 projected.go:196] Error preparing data for projected volume kube-api-access-dfgnn for pod openshift-network-diagnostics/network-check-target-4ljct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:06.111952 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:06.111815    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn podName:dc3ec023-a44e-4352-807e-54c84c900153 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:08.11179941 +0000 UTC m=+5.144234256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfgnn" (UniqueName: "kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn") pod "network-check-target-4ljct" (UID: "dc3ec023-a44e-4352-807e-54c84c900153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:06.212916 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:06.212880    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:06.431801 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:06.431740    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 14:10:04 +0000 UTC" deadline="2028-03-09 07:33:17.98016599 +0000 UTC"
Sep 11 14:15:06.431801 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:06.431802    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13073h18m11.548368472s"
Sep 11 14:15:07.491184 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:07.491148    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:07.491749 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:07.491294    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:07.491749 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:07.491307    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:07.491749 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:07.491421    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:07.491749 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:07.491470    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:07.491749 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:07.491541    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:08.036172 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:08.036135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs\") pod \"network-metrics-daemon-n28zt\" (UID: \"97841560-b854-400b-8866-6df5111b9230\") " pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:08.036362 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:08.036319    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:08.036425 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:08.036384    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs podName:97841560-b854-400b-8866-6df5111b9230 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:12.036366618 +0000 UTC m=+9.068801471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs") pod "network-metrics-daemon-n28zt" (UID: "97841560-b854-400b-8866-6df5111b9230") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:08.137269 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:08.137224    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfgnn\" (UniqueName: \"kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn\") pod \"network-check-target-4ljct\" (UID: \"dc3ec023-a44e-4352-807e-54c84c900153\") " pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:08.137414 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:08.137307    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:08.137495 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:08.137460    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:08.137539 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:08.137528    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret podName:a61a2aa3-3169-4b47-8bd8-3567df82ac12 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:12.137510458 +0000 UTC m=+9.169945313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret") pod "global-pull-secret-syncer-htlrd" (UID: "a61a2aa3-3169-4b47-8bd8-3567df82ac12") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:08.137982 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:08.137964    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:08.138057 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:08.137991    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:08.138057 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:08.138004    2582 projected.go:196] Error preparing data for projected volume kube-api-access-dfgnn for pod openshift-network-diagnostics/network-check-target-4ljct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:08.138154 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:08.138070    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn podName:dc3ec023-a44e-4352-807e-54c84c900153 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:12.138053251 +0000 UTC m=+9.170488103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfgnn" (UniqueName: "kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn") pod "network-check-target-4ljct" (UID: "dc3ec023-a44e-4352-807e-54c84c900153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:09.491929 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:09.491130    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:09.491929 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:09.491307    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:09.491929 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:09.491672    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:09.491929 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:09.491770    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:09.491929 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:09.491814    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:09.491929 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:09.491875    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:11.488490 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:11.488452    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:11.488490 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:11.488480    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:11.488981 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:11.488582    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:11.488981 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:11.488607    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:11.488981 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:11.488762    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:11.488981 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:11.488892    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:12.069292 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:12.069188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs\") pod \"network-metrics-daemon-n28zt\" (UID: \"97841560-b854-400b-8866-6df5111b9230\") " pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:12.069472 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:12.069361    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:12.069472 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:12.069443    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs podName:97841560-b854-400b-8866-6df5111b9230 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:20.069421767 +0000 UTC m=+17.101856624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs") pod "network-metrics-daemon-n28zt" (UID: "97841560-b854-400b-8866-6df5111b9230") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:12.170543 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:12.169937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:12.170543 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:12.170011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfgnn\" (UniqueName: \"kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn\") pod \"network-check-target-4ljct\" (UID: \"dc3ec023-a44e-4352-807e-54c84c900153\") " pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:12.170543 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:12.170162    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:12.170543 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:12.170168    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:12.170543 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:12.170188    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:12.170543 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:12.170202    2582 projected.go:196] Error preparing data for projected volume kube-api-access-dfgnn for pod openshift-network-diagnostics/network-check-target-4ljct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:12.170543 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:12.170229    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret podName:a61a2aa3-3169-4b47-8bd8-3567df82ac12 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:20.170212377 +0000 UTC m=+17.202647218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret") pod "global-pull-secret-syncer-htlrd" (UID: "a61a2aa3-3169-4b47-8bd8-3567df82ac12") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:12.170543 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:12.170247    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn podName:dc3ec023-a44e-4352-807e-54c84c900153 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:20.170238884 +0000 UTC m=+17.202673725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfgnn" (UniqueName: "kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn") pod "network-check-target-4ljct" (UID: "dc3ec023-a44e-4352-807e-54c84c900153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:13.490781 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:13.490116    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:13.490781 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:13.490242    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:13.490781 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:13.490603    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:13.490781 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:13.490690    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:13.496072 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:13.490728    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:13.496072 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:13.491831    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:15.489057 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:15.489013    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:15.489645 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:15.489013    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:15.489645 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:15.489185    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:15.489645 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:15.489237    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:15.489645 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:15.489351    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:15.489645 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:15.489464    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:17.488395 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:17.488364    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:17.488751 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:17.488467    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:17.488805 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:17.488758    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:17.488839 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:17.488827    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:17.488871 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:17.488857    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:17.488906 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:17.488899    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:19.488922 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:19.488877    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:19.488922 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:19.488879    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:19.488922 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:19.488904    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:19.489475 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:19.489024    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:19.489475 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:19.489140    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:19.489475 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:19.489209    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:20.129976 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:20.129955    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs\") pod \"network-metrics-daemon-n28zt\" (UID: \"97841560-b854-400b-8866-6df5111b9230\") " pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:20.130116 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:20.130094    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:20.130172 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:20.130162    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs podName:97841560-b854-400b-8866-6df5111b9230 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:36.13014429 +0000 UTC m=+33.162579146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs") pod "network-metrics-daemon-n28zt" (UID: "97841560-b854-400b-8866-6df5111b9230") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:20.231268 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:20.231239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfgnn\" (UniqueName: \"kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn\") pod \"network-check-target-4ljct\" (UID: \"dc3ec023-a44e-4352-807e-54c84c900153\") " pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:20.231427 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:20.231284    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:20.231427 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:20.231385    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:20.231427 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:20.231414    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:20.231643 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:20.231439    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:20.231643 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:20.231443    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret podName:a61a2aa3-3169-4b47-8bd8-3567df82ac12 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:36.231424069 +0000 UTC m=+33.263858923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret") pod "global-pull-secret-syncer-htlrd" (UID: "a61a2aa3-3169-4b47-8bd8-3567df82ac12") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:20.231643 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:20.231451    2582 projected.go:196] Error preparing data for projected volume kube-api-access-dfgnn for pod openshift-network-diagnostics/network-check-target-4ljct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:20.231643 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:20.231503    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn podName:dc3ec023-a44e-4352-807e-54c84c900153 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:36.231487197 +0000 UTC m=+33.263922052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfgnn" (UniqueName: "kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn") pod "network-check-target-4ljct" (UID: "dc3ec023-a44e-4352-807e-54c84c900153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:21.488640 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:21.488604    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:21.489170 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:21.488604    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:21.489170 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:21.488734    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:21.489170 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:21.488604    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:21.489170 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:21.488815    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:21.489170 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:21.488884    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:23.489329 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:23.489292    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:23.489815 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:23.489395    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:23.489815 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:23.489406    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:23.489815 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:23.489492    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:23.489815 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:23.489552    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:23.489815 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:23.489635    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:24.639706 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:24.639420    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8q4n4" event={"ID":"d75d6fa4-7101-4f9b-8877-bf3f41e7b752","Type":"ContainerStarted","Data":"0bcfd6906a13e23dfa8c66e57ae5ef9883289976be6810a09eb6e8f630e5d056"}
Sep 11 14:15:24.642777 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:24.642702    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-0.ec2.internal" event={"ID":"3051aa755ff5f3c1f618d35112a873c7","Type":"ContainerStarted","Data":"a542c28dedaa374b61ffbc696c15eecc453b70d178bde9a7fa030b12f3e0d25d"}
Sep 11 14:15:24.647236 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:24.645413    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ckwn8" event={"ID":"e7dffbdd-5a77-4f63-913e-6bdcb72064de","Type":"ContainerStarted","Data":"5b55e25d21fa3eab06b575cb6d90e2fb7d1bad3eeb9b163b87e316e81423915e"}
Sep 11 14:15:24.648775 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:24.648741    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x" event={"ID":"5989f214-195a-4b8c-ac07-6b7f461ebfd7","Type":"ContainerStarted","Data":"fdcf852545b53ee405b0743a9ecad555de900c1be8e07a65a650c1f69b9e6c2d"}
Sep 11 14:15:24.703131 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:24.702977    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-0.ec2.internal" podStartSLOduration=20.702949067 podStartE2EDuration="20.702949067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:24.702668046 +0000 UTC m=+21.735102907" watchObservedRunningTime="2026-09-11 14:15:24.702949067 +0000 UTC m=+21.735383928"
Sep 11 14:15:24.703339 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:24.703301    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8q4n4" podStartSLOduration=2.437766454 podStartE2EDuration="21.703290807s" totalImagesPullingTime="19.265524353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:24.675464983 +0000 UTC m=+21.707899843" watchObservedRunningTime="2026-09-11 14:15:24.703290807 +0000 UTC m=+21.735725669"
Sep 11 14:15:24.730198 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:24.730089    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ckwn8" podStartSLOduration=2.708359363 podStartE2EDuration="21.730066719s" totalImagesPullingTime="19.021707356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:24.729352144 +0000 UTC m=+21.761787006" watchObservedRunningTime="2026-09-11 14:15:24.730066719 +0000 UTC m=+21.762501581"
Sep 11 14:15:25.488625 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.488574    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:25.488792 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.488714    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:25.488792 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:25.488725    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:25.488792 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.488752    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:25.488939 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:25.488905    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:25.489023 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:25.488994    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:25.652824 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.652792    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m6d8t" event={"ID":"95a60cea-19ed-4140-8257-87cd771a68cc","Type":"ContainerStarted","Data":"75b838cf8b757243cf9875a1b68c37bdbb7205fe4da47d992e071e09f4c66169"}
Sep 11 14:15:25.654239 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.654217    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jdfld" event={"ID":"2c257df5-da6d-4b3c-ae58-113a8eea811f","Type":"ContainerStarted","Data":"da86cd2763fba5fd6a61ef485b69893b9b28bec1d7a0c02880176737f024dfad"}
Sep 11 14:15:25.655493 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.655472    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pbmvf" event={"ID":"8302613f-a418-483e-8ce5-59b148aef907","Type":"ContainerStarted","Data":"44422071e610430eccac34fd157c727a7589d24b11ddf29bd7ec32f6c8b7881a"}
Sep 11 14:15:25.656773 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.656756    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l67jz" event={"ID":"2459af77-ccb7-4ff6-819c-d1ac79618d37","Type":"ContainerStarted","Data":"e391c9ec320282cc017802199a7d536b54a255da45b220db7e6878f9effb3a2e"}
Sep 11 14:15:25.658182 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.658162    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28" event={"ID":"7c5116d8-d864-4919-8f30-da195179e39b","Type":"ContainerStarted","Data":"2909c0c7364b28985046e0e06a60be9b5a09853c8e5d74587a45214e62609a0b"}
Sep 11 14:15:25.661152 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.661133    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x" event={"ID":"5989f214-195a-4b8c-ac07-6b7f461ebfd7","Type":"ContainerStarted","Data":"5a0bd0b9a13ae486828db398ad7f17e125f85abe54adaf1e673e22f0b8cc1f1a"}
Sep 11 14:15:25.661260 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.661188    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x" event={"ID":"5989f214-195a-4b8c-ac07-6b7f461ebfd7","Type":"ContainerStarted","Data":"48994ace1894d62b109a5549baefb4738556037cb6fe45fd8ced2d61542abaa8"}
Sep 11 14:15:25.661260 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.661226    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x" event={"ID":"5989f214-195a-4b8c-ac07-6b7f461ebfd7","Type":"ContainerStarted","Data":"43ee16f8616e5220157007f566076431947d23bc48070a69a9a5be25bfcc77a8"}
Sep 11 14:15:25.661260 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.661255    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x" event={"ID":"5989f214-195a-4b8c-ac07-6b7f461ebfd7","Type":"ContainerStarted","Data":"3ce938a6a7f3f3d1490ddbe29079a8f553930b8df075bbc39a08aff125e82b2a"}
Sep 11 14:15:25.661392 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.661284    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x" event={"ID":"5989f214-195a-4b8c-ac07-6b7f461ebfd7","Type":"ContainerStarted","Data":"7ce3d9c3ef4182fc88422357704849524811de874f56bbbe643260d402204d34"}
Sep 11 14:15:25.662508 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.662487    2582 generic.go:356] "Generic (PLEG): container finished" podID="c46f2e8d-a84b-4163-b0e1-998e17076ba3" containerID="7a0a1a1c41c94aa5b7b83d94cfebcd30b5cccdbc2f9548e7d579bb331e920e3a" exitCode=0
Sep 11 14:15:25.662600 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.662552    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2z8jt" event={"ID":"c46f2e8d-a84b-4163-b0e1-998e17076ba3","Type":"ContainerDied","Data":"7a0a1a1c41c94aa5b7b83d94cfebcd30b5cccdbc2f9548e7d579bb331e920e3a"}
Sep 11 14:15:25.664158 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.664137    2582 generic.go:356] "Generic (PLEG): container finished" podID="b1347d1c5046484b2bcfd6ea5ef7ddac" containerID="1378c48b4f35b732b7570c84526eb110c240b7e1cdc90f4c5471926b9c2d5cbf" exitCode=0
Sep 11 14:15:25.664247 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.664229    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal" event={"ID":"b1347d1c5046484b2bcfd6ea5ef7ddac","Type":"ContainerDied","Data":"1378c48b4f35b732b7570c84526eb110c240b7e1cdc90f4c5471926b9c2d5cbf"}
Sep 11 14:15:25.681479 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.681439    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m6d8t" podStartSLOduration=3.720928149 podStartE2EDuration="22.681425416s" totalImagesPullingTime="18.960497267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:25.681094985 +0000 UTC m=+22.713529842" watchObservedRunningTime="2026-09-11 14:15:25.681425416 +0000 UTC m=+22.713860272"
Sep 11 14:15:25.728206 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.728155    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jdfld" podStartSLOduration=3.731897663 podStartE2EDuration="22.728137958s" totalImagesPullingTime="18.996240295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:25.705953268 +0000 UTC m=+22.738388131" watchObservedRunningTime="2026-09-11 14:15:25.728137958 +0000 UTC m=+22.760572817"
Sep 11 14:15:25.818806 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.818761    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l67jz" podStartSLOduration=3.744461441 podStartE2EDuration="22.818743177s" totalImagesPullingTime="19.074281736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:25.788610665 +0000 UTC m=+22.821045525" watchObservedRunningTime="2026-09-11 14:15:25.818743177 +0000 UTC m=+22.851178037"
Sep 11 14:15:25.818912 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:25.818833    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pbmvf" podStartSLOduration=3.766241269 podStartE2EDuration="22.818827804s" totalImagesPullingTime="19.052586535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:25.818519145 +0000 UTC m=+22.850954005" watchObservedRunningTime="2026-09-11 14:15:25.818827804 +0000 UTC m=+22.851262663"
Sep 11 14:15:26.030294 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:26.030264    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 14:15:26.462116 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:26.461996    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T14:15:26.030282723Z","UUID":"c613a796-bd83-4b51-a7fe-8a85827ac627","Handler":null,"Name":"","Endpoint":""}
Sep 11 14:15:26.463778 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:26.463757    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 14:15:26.463905 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:26.463787    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 14:15:26.669687 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:26.669649    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal" event={"ID":"b1347d1c5046484b2bcfd6ea5ef7ddac","Type":"ContainerStarted","Data":"a09003694d3177dd52d32defb44b7b744f4ff2402d039eb08beb8ff4911b9ad5"}
Sep 11 14:15:26.672455 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:26.672237    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28" event={"ID":"7c5116d8-d864-4919-8f30-da195179e39b","Type":"ContainerStarted","Data":"f459f77c1fd8ebee87a1af8894619cdb97e90366194e9d380f7c99cfe6e121b6"}
Sep 11 14:15:26.705517 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:26.705468    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-0.ec2.internal" podStartSLOduration=22.705453454 podStartE2EDuration="22.705453454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:26.705230413 +0000 UTC m=+23.737665274" watchObservedRunningTime="2026-09-11 14:15:26.705453454 +0000 UTC m=+23.737888314"
Sep 11 14:15:27.489187 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:27.489157    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:27.489187 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:27.489174    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:27.489517 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:27.489283    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:27.489517 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:27.489381    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:27.489517 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:27.489435    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:27.489517 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:27.489504    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:27.678968 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:27.678877    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x" event={"ID":"5989f214-195a-4b8c-ac07-6b7f461ebfd7","Type":"ContainerStarted","Data":"56820ced3e80a967c0a041e39e9d83689047c43cb6c85172bb2ad915535d2072"}
Sep 11 14:15:27.681456 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:27.681416    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28" event={"ID":"7c5116d8-d864-4919-8f30-da195179e39b","Type":"ContainerStarted","Data":"8bfb7ef711efaf33902a372cd4e891ec1fdd395014042e935ab10f8986cf77a0"}
Sep 11 14:15:29.488373 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:29.488343    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:29.488836 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:29.488353    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:29.488836 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:29.488483    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:29.488836 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:29.488544    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:29.488836 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:29.488608    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:29.488836 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:29.488737    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:30.154760 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:30.154732    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m6d8t"
Sep 11 14:15:30.155319 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:30.155295    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m6d8t"
Sep 11 14:15:30.175940 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:30.175899    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrd28" podStartSLOduration=5.586074705 podStartE2EDuration="27.175885423s" totalImagesPullingTime="21.589810718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:27.704981791 +0000 UTC m=+24.737416651" watchObservedRunningTime="2026-09-11 14:15:30.175885423 +0000 UTC m=+27.208320280"
Sep 11 14:15:30.691615 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:30.691582    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x" event={"ID":"5989f214-195a-4b8c-ac07-6b7f461ebfd7","Type":"ContainerStarted","Data":"026ac50058dbb95785787c5e12ccca6ce58e3f20e832979ab8493b73405d7f49"}
Sep 11 14:15:30.692086 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:30.691833    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:30.697173 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:30.697145    2582 generic.go:356] "Generic (PLEG): container finished" podID="c46f2e8d-a84b-4163-b0e1-998e17076ba3" containerID="8354dc8818701eedf867a744166e2eb9823968c47ef617f0300b62184fdf3a34" exitCode=0
Sep 11 14:15:30.697344 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:30.697228    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2z8jt" event={"ID":"c46f2e8d-a84b-4163-b0e1-998e17076ba3","Type":"ContainerDied","Data":"8354dc8818701eedf867a744166e2eb9823968c47ef617f0300b62184fdf3a34"}
Sep 11 14:15:30.697450 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:30.697430    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m6d8t"
Sep 11 14:15:30.698450 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:30.697856    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m6d8t"
Sep 11 14:15:30.708651 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:30.708633    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:30.731097 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:30.731060    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x" podStartSLOduration=8.10968352 podStartE2EDuration="27.731028447s" totalImagesPullingTime="19.621344927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:30.730922553 +0000 UTC m=+27.763357437" watchObservedRunningTime="2026-09-11 14:15:30.731028447 +0000 UTC m=+27.763463306"
Sep 11 14:15:31.488702 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:31.488663    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:31.488702 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:31.488703    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:31.489053 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:31.488663    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:31.489053 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:31.488799    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:31.489053 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:31.488877    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:31.489053 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:31.488961    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:31.702260 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:31.702214    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2z8jt" event={"ID":"c46f2e8d-a84b-4163-b0e1-998e17076ba3","Type":"ContainerStarted","Data":"2d49e75d2da8f8506721d9c049e2fb598b4616ec1b945fc8ac18458f2ce80dca"}
Sep 11 14:15:31.702863 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:31.702230    2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 14:15:31.702973 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:31.702931    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:31.717571 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:31.717553    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:32.122381 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:32.122216    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4ljct"]
Sep 11 14:15:32.122381 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:32.122363    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:32.122558 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:32.122442    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:32.126518 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:32.126493    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n28zt"]
Sep 11 14:15:32.126617 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:32.126586    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:32.126693 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:32.126662    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:32.141816 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:32.141788    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-htlrd"]
Sep 11 14:15:32.141936 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:32.141881    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:32.141977 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:32.141959    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:32.708388 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:32.708356    2582 generic.go:356] "Generic (PLEG): container finished" podID="c46f2e8d-a84b-4163-b0e1-998e17076ba3" containerID="2d49e75d2da8f8506721d9c049e2fb598b4616ec1b945fc8ac18458f2ce80dca" exitCode=0
Sep 11 14:15:32.708963 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:32.708444    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2z8jt" event={"ID":"c46f2e8d-a84b-4163-b0e1-998e17076ba3","Type":"ContainerDied","Data":"2d49e75d2da8f8506721d9c049e2fb598b4616ec1b945fc8ac18458f2ce80dca"}
Sep 11 14:15:32.708963 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:32.708506    2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 14:15:33.489125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:33.488938    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:33.489287 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:33.489005    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:33.489287 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:33.489182    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:33.489287 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:33.489025    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:33.489287 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:33.489258    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:33.489469 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:33.489367    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:33.710742 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:33.710720    2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 14:15:33.744338 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:33.744235    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:15:34.715084 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:34.715032    2582 generic.go:356] "Generic (PLEG): container finished" podID="c46f2e8d-a84b-4163-b0e1-998e17076ba3" containerID="208314574d54071e2e5cb712bce0aad2a27e75267259840393b16a66d843ff2f" exitCode=0
Sep 11 14:15:34.715486 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:34.715144    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2z8jt" event={"ID":"c46f2e8d-a84b-4163-b0e1-998e17076ba3","Type":"ContainerDied","Data":"208314574d54071e2e5cb712bce0aad2a27e75267259840393b16a66d843ff2f"}
Sep 11 14:15:34.726296 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:34.726265    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x" podUID="5989f214-195a-4b8c-ac07-6b7f461ebfd7" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 11 14:15:35.488936 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:35.488905    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:35.489124 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:35.489018    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n28zt" podUID="97841560-b854-400b-8866-6df5111b9230"
Sep 11 14:15:35.489278 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:35.489258    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:35.489389 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:35.489363    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htlrd" podUID="a61a2aa3-3169-4b47-8bd8-3567df82ac12"
Sep 11 14:15:35.489456 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:35.489425    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:35.489530 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:35.489504    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ljct" podUID="dc3ec023-a44e-4352-807e-54c84c900153"
Sep 11 14:15:36.147982 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:36.147942    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs\") pod \"network-metrics-daemon-n28zt\" (UID: \"97841560-b854-400b-8866-6df5111b9230\") " pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:36.148477 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:36.148082    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:36.148477 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:36.148157    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs podName:97841560-b854-400b-8866-6df5111b9230 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:08.148134664 +0000 UTC m=+65.180569516 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs") pod "network-metrics-daemon-n28zt" (UID: "97841560-b854-400b-8866-6df5111b9230") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:36.248975 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:36.248939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfgnn\" (UniqueName: \"kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn\") pod \"network-check-target-4ljct\" (UID: \"dc3ec023-a44e-4352-807e-54c84c900153\") " pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:36.249190 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:36.249014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:36.249190 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:36.249145    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:36.249304 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:36.249203    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret podName:a61a2aa3-3169-4b47-8bd8-3567df82ac12 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:08.249188261 +0000 UTC m=+65.281623104 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret") pod "global-pull-secret-syncer-htlrd" (UID: "a61a2aa3-3169-4b47-8bd8-3567df82ac12") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:36.249541 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:36.249513    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:36.249541 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:36.249541    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:36.249717 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:36.249561    2582 projected.go:196] Error preparing data for projected volume kube-api-access-dfgnn for pod openshift-network-diagnostics/network-check-target-4ljct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:36.249717 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:36.249622    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn podName:dc3ec023-a44e-4352-807e-54c84c900153 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:08.249605932 +0000 UTC m=+65.282040776 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfgnn" (UniqueName: "kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn") pod "network-check-target-4ljct" (UID: "dc3ec023-a44e-4352-807e-54c84c900153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:37.306398 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.306371    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-0.ec2.internal" event="NodeReady"
Sep 11 14:15:37.306852 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.306528    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 14:15:37.387705 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.387670    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n8q7k"]
Sep 11 14:15:37.392597 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.392568    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n8q7k"
Sep 11 14:15:37.398380 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.398319    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 14:15:37.398511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.398448    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 14:15:37.399229 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.398966    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 14:15:37.399229 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.399005    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nv8ln\""
Sep 11 14:15:37.399819 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.399802    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ck8m8"]
Sep 11 14:15:37.403492 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.403469    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n8q7k"]
Sep 11 14:15:37.403603 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.403556    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:37.408270 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.408123    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xhc84\""
Sep 11 14:15:37.408270 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.408230    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 14:15:37.409012 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.408994    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 14:15:37.423785 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.423762    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ck8m8"]
Sep 11 14:15:37.489148 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.489120    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:15:37.489148 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.489133    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:15:37.489372 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.489122    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:15:37.494130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.494110    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lrm6v\""
Sep 11 14:15:37.494563 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.494543    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 14:15:37.494752 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.494711    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 14:15:37.494966 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.494945    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cqjkr\""
Sep 11 14:15:37.494966 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.494959    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 14:15:37.495152 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.494962    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 14:15:37.560309 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.560232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4pck\" (UniqueName: \"kubernetes.io/projected/71972c3b-22f5-4cd1-8e47-bbfb9c0e0308-kube-api-access-f4pck\") pod \"ingress-canary-n8q7k\" (UID: \"71972c3b-22f5-4cd1-8e47-bbfb9c0e0308\") " pod="openshift-ingress-canary/ingress-canary-n8q7k"
Sep 11 14:15:37.560309 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.560295    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/389be6eb-2f59-42ef-82cb-d0f800ae1748-config-volume\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:37.560478 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.560340    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjqhf\" (UniqueName: \"kubernetes.io/projected/389be6eb-2f59-42ef-82cb-d0f800ae1748-kube-api-access-gjqhf\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:37.560478 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.560396    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389be6eb-2f59-42ef-82cb-d0f800ae1748-tmp-dir\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:37.560478 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.560421    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:37.560478 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.560437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71972c3b-22f5-4cd1-8e47-bbfb9c0e0308-cert\") pod \"ingress-canary-n8q7k\" (UID: \"71972c3b-22f5-4cd1-8e47-bbfb9c0e0308\") " pod="openshift-ingress-canary/ingress-canary-n8q7k"
Sep 11 14:15:37.661655 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.661614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4pck\" (UniqueName: \"kubernetes.io/projected/71972c3b-22f5-4cd1-8e47-bbfb9c0e0308-kube-api-access-f4pck\") pod \"ingress-canary-n8q7k\" (UID: \"71972c3b-22f5-4cd1-8e47-bbfb9c0e0308\") " pod="openshift-ingress-canary/ingress-canary-n8q7k"
Sep 11 14:15:37.661816 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.661678    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/389be6eb-2f59-42ef-82cb-d0f800ae1748-config-volume\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:37.661816 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.661706    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjqhf\" (UniqueName: \"kubernetes.io/projected/389be6eb-2f59-42ef-82cb-d0f800ae1748-kube-api-access-gjqhf\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:37.661816 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.661739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389be6eb-2f59-42ef-82cb-d0f800ae1748-tmp-dir\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:37.661816 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.661759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:37.661816 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.661778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71972c3b-22f5-4cd1-8e47-bbfb9c0e0308-cert\") pod \"ingress-canary-n8q7k\" (UID: \"71972c3b-22f5-4cd1-8e47-bbfb9c0e0308\") " pod="openshift-ingress-canary/ingress-canary-n8q7k"
Sep 11 14:15:37.662304 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:37.662279    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:37.662429 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:37.662369    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls podName:389be6eb-2f59-42ef-82cb-d0f800ae1748 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:38.162330968 +0000 UTC m=+35.194765818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls") pod "dns-default-ck8m8" (UID: "389be6eb-2f59-42ef-82cb-d0f800ae1748") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:37.662429 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.662389    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389be6eb-2f59-42ef-82cb-d0f800ae1748-tmp-dir\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:37.662727 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.662709    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/389be6eb-2f59-42ef-82cb-d0f800ae1748-config-volume\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:37.667151 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.667132    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71972c3b-22f5-4cd1-8e47-bbfb9c0e0308-cert\") pod \"ingress-canary-n8q7k\" (UID: \"71972c3b-22f5-4cd1-8e47-bbfb9c0e0308\") " pod="openshift-ingress-canary/ingress-canary-n8q7k"
Sep 11 14:15:37.677713 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.677686    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjqhf\" (UniqueName: \"kubernetes.io/projected/389be6eb-2f59-42ef-82cb-d0f800ae1748-kube-api-access-gjqhf\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:37.677964 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.677941    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4pck\" (UniqueName: \"kubernetes.io/projected/71972c3b-22f5-4cd1-8e47-bbfb9c0e0308-kube-api-access-f4pck\") pod \"ingress-canary-n8q7k\" (UID: \"71972c3b-22f5-4cd1-8e47-bbfb9c0e0308\") " pod="openshift-ingress-canary/ingress-canary-n8q7k"
Sep 11 14:15:37.703764 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:37.703739    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n8q7k"
Sep 11 14:15:38.165140 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:38.165101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:38.165337 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:38.165290    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:38.165394 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:38.165374    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls podName:389be6eb-2f59-42ef-82cb-d0f800ae1748 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:39.165350141 +0000 UTC m=+36.197784997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls") pod "dns-default-ck8m8" (UID: "389be6eb-2f59-42ef-82cb-d0f800ae1748") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:38.904755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:38.904522    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n8q7k"]
Sep 11 14:15:38.909075 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:15:38.909022    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71972c3b_22f5_4cd1_8e47_bbfb9c0e0308.slice/crio-e92e30401fa4fe98503d1a2d612c6ce5a5483290fa4eafea29791749b4554d3b WatchSource:0}: Error finding container e92e30401fa4fe98503d1a2d612c6ce5a5483290fa4eafea29791749b4554d3b: Status 404 returned error can't find the container with id e92e30401fa4fe98503d1a2d612c6ce5a5483290fa4eafea29791749b4554d3b
Sep 11 14:15:39.173379 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:39.173293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:39.173522 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:39.173451    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:39.173522 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:39.173517    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls podName:389be6eb-2f59-42ef-82cb-d0f800ae1748 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:41.173502974 +0000 UTC m=+38.205937812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls") pod "dns-default-ck8m8" (UID: "389be6eb-2f59-42ef-82cb-d0f800ae1748") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:39.728446 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:39.728402    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n8q7k" event={"ID":"71972c3b-22f5-4cd1-8e47-bbfb9c0e0308","Type":"ContainerStarted","Data":"e92e30401fa4fe98503d1a2d612c6ce5a5483290fa4eafea29791749b4554d3b"}
Sep 11 14:15:39.734696 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:39.734662    2582 generic.go:356] "Generic (PLEG): container finished" podID="c46f2e8d-a84b-4163-b0e1-998e17076ba3" containerID="029de0ff199944d223df63dbe0417a743b54135c6b1b5c3c05dd481543fbd0e8" exitCode=0
Sep 11 14:15:39.734854 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:39.734708    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2z8jt" event={"ID":"c46f2e8d-a84b-4163-b0e1-998e17076ba3","Type":"ContainerDied","Data":"029de0ff199944d223df63dbe0417a743b54135c6b1b5c3c05dd481543fbd0e8"}
Sep 11 14:15:40.741400 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:40.741366    2582 generic.go:356] "Generic (PLEG): container finished" podID="c46f2e8d-a84b-4163-b0e1-998e17076ba3" containerID="854424d5f849a22a5339771a25335391005679edd6a481fdf873d30e84799a7f" exitCode=0
Sep 11 14:15:40.742066 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:40.741412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2z8jt" event={"ID":"c46f2e8d-a84b-4163-b0e1-998e17076ba3","Type":"ContainerDied","Data":"854424d5f849a22a5339771a25335391005679edd6a481fdf873d30e84799a7f"}
Sep 11 14:15:41.189233 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:41.189190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:41.189421 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:41.189329    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:41.189421 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:41.189402    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls podName:389be6eb-2f59-42ef-82cb-d0f800ae1748 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:45.189381705 +0000 UTC m=+42.221816564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls") pod "dns-default-ck8m8" (UID: "389be6eb-2f59-42ef-82cb-d0f800ae1748") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:41.748677 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:41.748591    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2z8jt" event={"ID":"c46f2e8d-a84b-4163-b0e1-998e17076ba3","Type":"ContainerStarted","Data":"83a57e19e012ca357ef651d2b2e8f0389711199c4cf1eb1585520f11056cd971"}
Sep 11 14:15:41.750231 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:41.750201    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n8q7k" event={"ID":"71972c3b-22f5-4cd1-8e47-bbfb9c0e0308","Type":"ContainerStarted","Data":"d77e27f7fdb7fc4b13120159d7c8dc0fad5b91cf34e337af2848f71b61c35f4d"}
Sep 11 14:15:41.791764 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:41.791718    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2z8jt" podStartSLOduration=9.451324459 podStartE2EDuration="38.791702077s" totalImagesPullingTime="29.340377618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:41.788557582 +0000 UTC m=+38.820992462" watchObservedRunningTime="2026-09-11 14:15:41.791702077 +0000 UTC m=+38.824136970"
Sep 11 14:15:41.873757 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:41.873693    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n8q7k" podStartSLOduration=2.18428315 podStartE2EDuration="4.873669165s" totalImagesPullingTime="2.689386015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:41.872939476 +0000 UTC m=+38.905374350" watchObservedRunningTime="2026-09-11 14:15:41.873669165 +0000 UTC m=+38.906104025"
Sep 11 14:15:45.217528 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:45.217483    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:45.217907 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:45.217595    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:45.217907 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:45.217647    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls podName:389be6eb-2f59-42ef-82cb-d0f800ae1748 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:53.217633484 +0000 UTC m=+50.250068334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls") pod "dns-default-ck8m8" (UID: "389be6eb-2f59-42ef-82cb-d0f800ae1748") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:53.273762 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:15:53.273720    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:15:53.274216 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:53.273833    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:53.274216 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:15:53.273889    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls podName:389be6eb-2f59-42ef-82cb-d0f800ae1748 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:09.273876341 +0000 UTC m=+66.306311180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls") pod "dns-default-ck8m8" (UID: "389be6eb-2f59-42ef-82cb-d0f800ae1748") : secret "dns-default-metrics-tls" not found
Sep 11 14:16:04.725224 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:04.725192    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtf2x"
Sep 11 14:16:05.224924 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.224887    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-pjw5x"]
Sep 11 14:16:05.227369 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.227354    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.233770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.233737    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 14:16:05.233892 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.233824    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 14:16:05.233892 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.233824    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xhmsx\""
Sep 11 14:16:05.234211 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.234192    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 14:16:05.234296 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.234244    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 14:16:05.250275 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.250245    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 14:16:05.250755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.250736    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6d2c7403-c974-4e6d-b59c-3f59341c8b77-snapshots\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.250822 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.250762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d2c7403-c974-4e6d-b59c-3f59341c8b77-tmp\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.250822 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.250797    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2c7403-c974-4e6d-b59c-3f59341c8b77-trusted-ca-bundle\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.250907 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.250820    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98p2r\" (UniqueName: \"kubernetes.io/projected/6d2c7403-c974-4e6d-b59c-3f59341c8b77-kube-api-access-98p2r\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.250907 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.250852    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2c7403-c974-4e6d-b59c-3f59341c8b77-service-ca-bundle\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.250907 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.250866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d2c7403-c974-4e6d-b59c-3f59341c8b77-serving-cert\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.268811 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.268790    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-pjw5x"]
Sep 11 14:16:05.351392 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.351359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6d2c7403-c974-4e6d-b59c-3f59341c8b77-snapshots\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.351392 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.351392    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d2c7403-c974-4e6d-b59c-3f59341c8b77-tmp\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.351610 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.351431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2c7403-c974-4e6d-b59c-3f59341c8b77-trusted-ca-bundle\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.351610 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.351447    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98p2r\" (UniqueName: \"kubernetes.io/projected/6d2c7403-c974-4e6d-b59c-3f59341c8b77-kube-api-access-98p2r\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.351610 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.351469    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2c7403-c974-4e6d-b59c-3f59341c8b77-service-ca-bundle\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.351610 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.351485    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d2c7403-c974-4e6d-b59c-3f59341c8b77-serving-cert\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.352148 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.352122    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6d2c7403-c974-4e6d-b59c-3f59341c8b77-snapshots\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.352402 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.352377    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d2c7403-c974-4e6d-b59c-3f59341c8b77-tmp\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.352562 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.352543    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2c7403-c974-4e6d-b59c-3f59341c8b77-service-ca-bundle\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.352938 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.352917    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2c7403-c974-4e6d-b59c-3f59341c8b77-trusted-ca-bundle\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.355148 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.355129    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d2c7403-c974-4e6d-b59c-3f59341c8b77-serving-cert\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.356673 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.356657    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"]
Sep 11 14:16:05.358614 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.358596    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"
Sep 11 14:16:05.373921 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.373902    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:16:05.374023 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.373973    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 14:16:05.380194 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.380177    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 14:16:05.386247 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.386232    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-959vc\""
Sep 11 14:16:05.388969 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.388950    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"]
Sep 11 14:16:05.402196 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.402179    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98p2r\" (UniqueName: \"kubernetes.io/projected/6d2c7403-c974-4e6d-b59c-3f59341c8b77-kube-api-access-98p2r\") pod \"insights-operator-5844b856db-pjw5x\" (UID: \"6d2c7403-c974-4e6d-b59c-3f59341c8b77\") " pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.452104 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.452075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8slv\" (UniqueName: \"kubernetes.io/projected/3c06e0b7-618d-430f-bd22-a606c43640ff-kube-api-access-h8slv\") pod \"cluster-samples-operator-86499c89c4-xxw2c\" (UID: \"3c06e0b7-618d-430f-bd22-a606c43640ff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"
Sep 11 14:16:05.452104 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.452107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xxw2c\" (UID: \"3c06e0b7-618d-430f-bd22-a606c43640ff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"
Sep 11 14:16:05.481565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.481502    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"]
Sep 11 14:16:05.483296 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.483276    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79849455f8-6sjnq"]
Sep 11 14:16:05.483408 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.483391    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"
Sep 11 14:16:05.484962 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.484945    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:05.493530 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.493506    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret"
Sep 11 14:16:05.493614 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.493590    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-stats-default\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" type="*v1.Secret"
Sep 11 14:16:05.493669 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.493647    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-metrics-certs-default\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" type="*v1.Secret"
Sep 11 14:16:05.493669 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.493649    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 11 14:16:05.493963 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.493947    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 11 14:16:05.494004 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.493964    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-dockercfg-s5kgm\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-dockercfg-s5kgm\"" type="*v1.Secret"
Sep 11 14:16:05.494094 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.494077    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-bundle\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" type="*v1.ConfigMap"
Sep 11 14:16:05.496702 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.496677    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-storage-version-migrator-operator-dockercfg-2v6df\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2v6df\"" type="*v1.Secret"
Sep 11 14:16:05.496822 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.496806    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 11 14:16:05.497208 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.497184    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-storage-version-migrator-operator-6c8f84f897-9sc4p\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" podUID="e74eccd2-29ac-4aca-b61d-9b023b24269f" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"
Sep 11 14:16:05.510716 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.510697    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-ingress-cert\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" type="*v1.Secret"
Sep 11 14:16:05.511589 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.511567    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 11 14:16:05.511656 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.511573    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"config\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap"
Sep 11 14:16:05.535878 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.535860    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-pjw5x"
Sep 11 14:16:05.547136 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.547116    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79849455f8-6sjnq"]
Sep 11 14:16:05.552646 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.552612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6hzt\" (UniqueName: \"kubernetes.io/projected/e74eccd2-29ac-4aca-b61d-9b023b24269f-kube-api-access-q6hzt\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9sc4p\" (UID: \"e74eccd2-29ac-4aca-b61d-9b023b24269f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"
Sep 11 14:16:05.552748 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.552729    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e74eccd2-29ac-4aca-b61d-9b023b24269f-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9sc4p\" (UID: \"e74eccd2-29ac-4aca-b61d-9b023b24269f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"
Sep 11 14:16:05.552825 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.552807    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8slv\" (UniqueName: \"kubernetes.io/projected/3c06e0b7-618d-430f-bd22-a606c43640ff-kube-api-access-h8slv\") pod \"cluster-samples-operator-86499c89c4-xxw2c\" (UID: \"3c06e0b7-618d-430f-bd22-a606c43640ff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"
Sep 11 14:16:05.552916 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.552844    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e74eccd2-29ac-4aca-b61d-9b023b24269f-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9sc4p\" (UID: \"e74eccd2-29ac-4aca-b61d-9b023b24269f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"
Sep 11 14:16:05.552916 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.552880    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xxw2c\" (UID: \"3c06e0b7-618d-430f-bd22-a606c43640ff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"
Sep 11 14:16:05.553066 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.553032    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 14:16:05.553126 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:05.553115    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls podName:3c06e0b7-618d-430f-bd22-a606c43640ff nodeName:}" failed. No retries permitted until 2026-09-11 14:16:06.053096238 +0000 UTC m=+63.085531090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xxw2c" (UID: "3c06e0b7-618d-430f-bd22-a606c43640ff") : secret "samples-operator-tls" not found
Sep 11 14:16:05.568615 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.568579    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"]
Sep 11 14:16:05.653287 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.653260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e74eccd2-29ac-4aca-b61d-9b023b24269f-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9sc4p\" (UID: \"e74eccd2-29ac-4aca-b61d-9b023b24269f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"
Sep 11 14:16:05.653427 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.653313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e74eccd2-29ac-4aca-b61d-9b023b24269f-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9sc4p\" (UID: \"e74eccd2-29ac-4aca-b61d-9b023b24269f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"
Sep 11 14:16:05.653427 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.653351    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-stats-auth\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:05.653427 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.653385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6hzt\" (UniqueName: \"kubernetes.io/projected/e74eccd2-29ac-4aca-b61d-9b023b24269f-kube-api-access-q6hzt\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9sc4p\" (UID: \"e74eccd2-29ac-4aca-b61d-9b023b24269f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"
Sep 11 14:16:05.653427 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.653414    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:05.653591 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.653453    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-default-certificate\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:05.653591 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.653475    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:05.653591 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.653491    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95kb8\" (UniqueName: \"kubernetes.io/projected/6b373715-10c6-4794-8be8-cf3ece87f800-kube-api-access-95kb8\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:05.704619 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.704583    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8slv\" (UniqueName: \"kubernetes.io/projected/3c06e0b7-618d-430f-bd22-a606c43640ff-kube-api-access-h8slv\") pod \"cluster-samples-operator-86499c89c4-xxw2c\" (UID: \"3c06e0b7-618d-430f-bd22-a606c43640ff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"
Sep 11 14:16:05.754650 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.754592    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-stats-auth\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:05.754650 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.754636    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:05.755005 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.754659    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-default-certificate\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:05.755005 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.754676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:05.755005 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.754692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95kb8\" (UniqueName: \"kubernetes.io/projected/6b373715-10c6-4794-8be8-cf3ece87f800-kube-api-access-95kb8\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:05.853832 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.853805    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54496484db-vk2tx"]
Sep 11 14:16:05.859395 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.859370    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:05.863517 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.863499    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 14:16:05.866810 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.866791    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 14:16:05.900175 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:16:05.900154    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d2c7403_c974_4e6d_b59c_3f59341c8b77.slice/crio-7f1daf2705074592bd33a887a728be8586dc3b3e51082de8f7f9a700c0e73825 WatchSource:0}: Error finding container 7f1daf2705074592bd33a887a728be8586dc3b3e51082de8f7f9a700c0e73825: Status 404 returned error can't find the container with id 7f1daf2705074592bd33a887a728be8586dc3b3e51082de8f7f9a700c0e73825
Sep 11 14:16:05.901097 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.901081    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 14:16:05.901457 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.901437    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w4lvw\""
Sep 11 14:16:05.902246 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.902227    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-pjw5x"]
Sep 11 14:16:05.917510 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.917491    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 14:16:05.939158 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.939134    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54496484db-vk2tx"]
Sep 11 14:16:05.958139 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.958112    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-image-registry-private-configuration\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:05.958242 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.958145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-certificates\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:05.958242 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.958165    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-bound-sa-token\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:05.958242 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.958208    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-ca-trust-extracted\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:05.958373 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.958255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-trusted-ca\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:05.958373 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.958274    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:05.958373 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.958290    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr597\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-kube-api-access-nr597\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:05.958373 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:05.958324    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-installation-pull-secrets\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.059702 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.059610    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xxw2c\" (UID: \"3c06e0b7-618d-430f-bd22-a606c43640ff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"
Sep 11 14:16:06.059702 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.059647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-ca-trust-extracted\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.059702 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.059673    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-trusted-ca\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.059702 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.059691    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.059702 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.059705    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr597\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-kube-api-access-nr597\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.060469 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.059740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-installation-pull-secrets\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.060469 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.059774    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 14:16:06.060469 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.059806    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 14:16:06.060469 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.059826    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54496484db-vk2tx: secret "image-registry-tls" not found
Sep 11 14:16:06.060469 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.059784    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-image-registry-private-configuration\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.060469 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.059865    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls podName:3c06e0b7-618d-430f-bd22-a606c43640ff nodeName:}" failed. No retries permitted until 2026-09-11 14:16:07.059840332 +0000 UTC m=+64.092275193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xxw2c" (UID: "3c06e0b7-618d-430f-bd22-a606c43640ff") : secret "samples-operator-tls" not found
Sep 11 14:16:06.060469 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.059901    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls podName:0d3fb1c6-1ef3-4e11-babf-62999ce21ae6 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:06.559889118 +0000 UTC m=+63.592323959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls") pod "image-registry-54496484db-vk2tx" (UID: "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6") : secret "image-registry-tls" not found
Sep 11 14:16:06.060469 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.059954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-certificates\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.060469 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.059990    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-bound-sa-token\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.060469 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.060181    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-ca-trust-extracted\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.060838 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.060562    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-certificates\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.060838 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.060771    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-trusted-ca\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.062980 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.062958    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-image-registry-private-configuration\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.063022 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.062958    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-installation-pull-secrets\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.147304 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.147279    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-bound-sa-token\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.153375 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.153358    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr597\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-kube-api-access-nr597\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.423250 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.423167    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 14:16:06.424539 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.424522    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e74eccd2-29ac-4aca-b61d-9b023b24269f-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9sc4p\" (UID: \"e74eccd2-29ac-4aca-b61d-9b023b24269f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"
Sep 11 14:16:06.427247 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.427228    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 14:16:06.537082 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.537053    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 14:16:06.544826 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.544807    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 14:16:06.544923 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.544886    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs podName:6b373715-10c6-4794-8be8-cf3ece87f800 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:07.044865435 +0000 UTC m=+64.077300287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs") pod "router-default-79849455f8-6sjnq" (UID: "6b373715-10c6-4794-8be8-cf3ece87f800") : secret "router-metrics-certs-default" not found
Sep 11 14:16:06.563845 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.563819    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:06.564002 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.563947    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 14:16:06.564002 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.563961    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54496484db-vk2tx: secret "image-registry-tls" not found
Sep 11 14:16:06.564107 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.564012    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls podName:0d3fb1c6-1ef3-4e11-babf-62999ce21ae6 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:07.563999583 +0000 UTC m=+64.596434421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls") pod "image-registry-54496484db-vk2tx" (UID: "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6") : secret "image-registry-tls" not found
Sep 11 14:16:06.590822 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.590802    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 14:16:06.599527 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.599506    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95kb8\" (UniqueName: \"kubernetes.io/projected/6b373715-10c6-4794-8be8-cf3ece87f800-kube-api-access-95kb8\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:06.624973 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.624950    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2v6df\""
Sep 11 14:16:06.642501 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.642482    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 14:16:06.653737 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.653723    2582 secret.go:189] Couldn't get secret openshift-kube-storage-version-migrator-operator/serving-cert: failed to sync secret cache: timed out waiting for the condition
Sep 11 14:16:06.653813 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.653795    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e74eccd2-29ac-4aca-b61d-9b023b24269f-serving-cert podName:e74eccd2-29ac-4aca-b61d-9b023b24269f nodeName:}" failed. No retries permitted until 2026-09-11 14:16:07.153762533 +0000 UTC m=+64.186197372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/e74eccd2-29ac-4aca-b61d-9b023b24269f-serving-cert") pod "kube-storage-version-migrator-operator-6c8f84f897-9sc4p" (UID: "e74eccd2-29ac-4aca-b61d-9b023b24269f") : failed to sync secret cache: timed out waiting for the condition
Sep 11 14:16:06.686827 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.686811    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 14:16:06.718134 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.718114    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-s5kgm\""
Sep 11 14:16:06.755626 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.755605    2582 configmap.go:193] Couldn't get configMap openshift-ingress/service-ca-bundle: failed to sync configmap cache: timed out waiting for the condition
Sep 11 14:16:06.755901 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.755626    2582 secret.go:189] Couldn't get secret openshift-ingress/default-ingress-cert: failed to sync secret cache: timed out waiting for the condition
Sep 11 14:16:06.755901 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.755615    2582 secret.go:189] Couldn't get secret openshift-ingress/router-stats-default: failed to sync secret cache: timed out waiting for the condition
Sep 11 14:16:06.755901 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.755678    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle podName:6b373715-10c6-4794-8be8-cf3ece87f800 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:07.255664676 +0000 UTC m=+64.288099532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle") pod "router-default-79849455f8-6sjnq" (UID: "6b373715-10c6-4794-8be8-cf3ece87f800") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 14:16:06.755901 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.755691    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-stats-auth podName:6b373715-10c6-4794-8be8-cf3ece87f800 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:07.25568557 +0000 UTC m=+64.288120408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "stats-auth" (UniqueName: "kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-stats-auth") pod "router-default-79849455f8-6sjnq" (UID: "6b373715-10c6-4794-8be8-cf3ece87f800") : failed to sync secret cache: timed out waiting for the condition
Sep 11 14:16:06.755901 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:06.755747    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-default-certificate podName:6b373715-10c6-4794-8be8-cf3ece87f800 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:07.255725529 +0000 UTC m=+64.288160388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "default-certificate" (UniqueName: "kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-default-certificate") pod "router-default-79849455f8-6sjnq" (UID: "6b373715-10c6-4794-8be8-cf3ece87f800") : failed to sync secret cache: timed out waiting for the condition
Sep 11 14:16:06.801342 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.801320    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:16:06.806996 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.806975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6hzt\" (UniqueName: \"kubernetes.io/projected/e74eccd2-29ac-4aca-b61d-9b023b24269f-kube-api-access-q6hzt\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9sc4p\" (UID: \"e74eccd2-29ac-4aca-b61d-9b023b24269f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"
Sep 11 14:16:06.812999 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:06.812978    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-pjw5x" event={"ID":"6d2c7403-c974-4e6d-b59c-3f59341c8b77","Type":"ContainerStarted","Data":"7f1daf2705074592bd33a887a728be8586dc3b3e51082de8f7f9a700c0e73825"}
Sep 11 14:16:07.007109 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.007033    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 14:16:07.065970 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.065944    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 14:16:07.067272 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.067253    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xxw2c\" (UID: \"3c06e0b7-618d-430f-bd22-a606c43640ff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"
Sep 11 14:16:07.067321 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.067300    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:07.067404 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:07.067391    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 14:16:07.067453 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:07.067444    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs podName:6b373715-10c6-4794-8be8-cf3ece87f800 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:08.067431471 +0000 UTC m=+65.099866308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs") pod "router-default-79849455f8-6sjnq" (UID: "6b373715-10c6-4794-8be8-cf3ece87f800") : secret "router-metrics-certs-default" not found
Sep 11 14:16:07.067498 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:07.067392    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 14:16:07.067530 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:07.067523    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls podName:3c06e0b7-618d-430f-bd22-a606c43640ff nodeName:}" failed. No retries permitted until 2026-09-11 14:16:09.06751029 +0000 UTC m=+66.099945132 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xxw2c" (UID: "3c06e0b7-618d-430f-bd22-a606c43640ff") : secret "samples-operator-tls" not found
Sep 11 14:16:07.086181 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.086157    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 14:16:07.168232 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.168192    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e74eccd2-29ac-4aca-b61d-9b023b24269f-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9sc4p\" (UID: \"e74eccd2-29ac-4aca-b61d-9b023b24269f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"
Sep 11 14:16:07.170533 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.170505    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e74eccd2-29ac-4aca-b61d-9b023b24269f-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9sc4p\" (UID: \"e74eccd2-29ac-4aca-b61d-9b023b24269f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"
Sep 11 14:16:07.269372 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.269291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-stats-auth\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:07.269372 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.269338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-default-certificate\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:07.269372 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.269361    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:07.269549 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:07.269512    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle podName:6b373715-10c6-4794-8be8-cf3ece87f800 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:08.269496876 +0000 UTC m=+65.301931715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle") pod "router-default-79849455f8-6sjnq" (UID: "6b373715-10c6-4794-8be8-cf3ece87f800") : configmap references non-existent config key: service-ca.crt
Sep 11 14:16:07.272210 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.272187    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-stats-auth\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:07.272302 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.272216    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-default-certificate\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:07.293329 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.293304    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"
Sep 11 14:16:07.572450 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.572359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:07.572595 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:07.572519    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 14:16:07.572595 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:07.572538    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54496484db-vk2tx: secret "image-registry-tls" not found
Sep 11 14:16:07.572595 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:07.572593    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls podName:0d3fb1c6-1ef3-4e11-babf-62999ce21ae6 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:09.572576538 +0000 UTC m=+66.605011387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls") pod "image-registry-54496484db-vk2tx" (UID: "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6") : secret "image-registry-tls" not found
Sep 11 14:16:07.582130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.582104    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p"]
Sep 11 14:16:07.588011 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:16:07.587990    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode74eccd2_29ac_4aca_b61d_9b023b24269f.slice/crio-e5557ffea77fa144e6292da08d31226ee6f58cc4680a2c8146712a931586274a WatchSource:0}: Error finding container e5557ffea77fa144e6292da08d31226ee6f58cc4680a2c8146712a931586274a: Status 404 returned error can't find the container with id e5557ffea77fa144e6292da08d31226ee6f58cc4680a2c8146712a931586274a
Sep 11 14:16:07.817294 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:07.817250    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p" event={"ID":"e74eccd2-29ac-4aca-b61d-9b023b24269f","Type":"ContainerStarted","Data":"e5557ffea77fa144e6292da08d31226ee6f58cc4680a2c8146712a931586274a"}
Sep 11 14:16:08.078099 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:08.078059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:08.078282 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:08.078231    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 14:16:08.078336 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:08.078310    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs podName:6b373715-10c6-4794-8be8-cf3ece87f800 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:10.078291115 +0000 UTC m=+67.110725968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs") pod "router-default-79849455f8-6sjnq" (UID: "6b373715-10c6-4794-8be8-cf3ece87f800") : secret "router-metrics-certs-default" not found
Sep 11 14:16:08.179393 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:08.179356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs\") pod \"network-metrics-daemon-n28zt\" (UID: \"97841560-b854-400b-8866-6df5111b9230\") " pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:16:08.182333 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:08.182309    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 14:16:08.190613 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:08.190580    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 14:16:08.190702 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:08.190661    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs podName:97841560-b854-400b-8866-6df5111b9230 nodeName:}" failed. No retries permitted until 2026-09-11 14:17:12.190638613 +0000 UTC m=+129.223073467 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs") pod "network-metrics-daemon-n28zt" (UID: "97841560-b854-400b-8866-6df5111b9230") : secret "metrics-daemon-secret" not found
Sep 11 14:16:08.280226 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:08.280190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfgnn\" (UniqueName: \"kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn\") pod \"network-check-target-4ljct\" (UID: \"dc3ec023-a44e-4352-807e-54c84c900153\") " pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:16:08.280388 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:08.280251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:16:08.280388 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:08.280345    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:08.280537 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:08.280514    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle podName:6b373715-10c6-4794-8be8-cf3ece87f800 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:10.280494432 +0000 UTC m=+67.312929276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle") pod "router-default-79849455f8-6sjnq" (UID: "6b373715-10c6-4794-8be8-cf3ece87f800") : configmap references non-existent config key: service-ca.crt
Sep 11 14:16:08.286743 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:08.286721    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 14:16:08.286851 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:08.286742    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 14:16:08.294065 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:08.294028    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 14:16:08.294332 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:08.294313    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61a2aa3-3169-4b47-8bd8-3567df82ac12-original-pull-secret\") pod \"global-pull-secret-syncer-htlrd\" (UID: \"a61a2aa3-3169-4b47-8bd8-3567df82ac12\") " pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:16:08.304582 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:08.304561    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfgnn\" (UniqueName: \"kubernetes.io/projected/dc3ec023-a44e-4352-807e-54c84c900153-kube-api-access-dfgnn\") pod \"network-check-target-4ljct\" (UID: \"dc3ec023-a44e-4352-807e-54c84c900153\") " pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:16:08.410805 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:08.410725    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cqjkr\""
Sep 11 14:16:08.414922 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:08.414884    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htlrd"
Sep 11 14:16:08.418888 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:08.418726    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:16:09.089442 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:09.089398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xxw2c\" (UID: \"3c06e0b7-618d-430f-bd22-a606c43640ff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"
Sep 11 14:16:09.089868 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:09.089597    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 14:16:09.089868 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:09.089681    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls podName:3c06e0b7-618d-430f-bd22-a606c43640ff nodeName:}" failed. No retries permitted until 2026-09-11 14:16:13.08965828 +0000 UTC m=+70.122093138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xxw2c" (UID: "3c06e0b7-618d-430f-bd22-a606c43640ff") : secret "samples-operator-tls" not found
Sep 11 14:16:09.290998 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:09.290955    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:16:09.291218 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:09.291147    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:16:09.291292 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:09.291226    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls podName:389be6eb-2f59-42ef-82cb-d0f800ae1748 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:41.291205881 +0000 UTC m=+98.323640730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls") pod "dns-default-ck8m8" (UID: "389be6eb-2f59-42ef-82cb-d0f800ae1748") : secret "dns-default-metrics-tls" not found
Sep 11 14:16:09.593454 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:09.593409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:09.593627 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:09.593580    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 14:16:09.593627 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:09.593599    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54496484db-vk2tx: secret "image-registry-tls" not found
Sep 11 14:16:09.593695 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:09.593657    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls podName:0d3fb1c6-1ef3-4e11-babf-62999ce21ae6 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:13.59364093 +0000 UTC m=+70.626075772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls") pod "image-registry-54496484db-vk2tx" (UID: "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6") : secret "image-registry-tls" not found
Sep 11 14:16:10.097944 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:10.097902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:10.098398 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:10.098080    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 14:16:10.098398 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:10.098147    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs podName:6b373715-10c6-4794-8be8-cf3ece87f800 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:14.098131784 +0000 UTC m=+71.130566640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs") pod "router-default-79849455f8-6sjnq" (UID: "6b373715-10c6-4794-8be8-cf3ece87f800") : secret "router-metrics-certs-default" not found
Sep 11 14:16:10.107712 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:10.107683    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4ljct"]
Sep 11 14:16:10.110543 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:16:10.110516    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3ec023_a44e_4352_807e_54c84c900153.slice/crio-98d940ab48cbf2db063abc7a7a61f133231702b8c5e8f6f7e80205bb4ecf4e1f WatchSource:0}: Error finding container 98d940ab48cbf2db063abc7a7a61f133231702b8c5e8f6f7e80205bb4ecf4e1f: Status 404 returned error can't find the container with id 98d940ab48cbf2db063abc7a7a61f133231702b8c5e8f6f7e80205bb4ecf4e1f
Sep 11 14:16:10.114704 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:10.114668    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-htlrd"]
Sep 11 14:16:10.119240 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:16:10.119212    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61a2aa3_3169_4b47_8bd8_3567df82ac12.slice/crio-509900887d892f2a2c85ffe6843fbdae2cb00ab53f04ab8406cc1587201f6119 WatchSource:0}: Error finding container 509900887d892f2a2c85ffe6843fbdae2cb00ab53f04ab8406cc1587201f6119: Status 404 returned error can't find the container with id 509900887d892f2a2c85ffe6843fbdae2cb00ab53f04ab8406cc1587201f6119
Sep 11 14:16:10.300187 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:10.300146    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:10.300348 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:10.300296    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle podName:6b373715-10c6-4794-8be8-cf3ece87f800 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:14.300279624 +0000 UTC m=+71.332714463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle") pod "router-default-79849455f8-6sjnq" (UID: "6b373715-10c6-4794-8be8-cf3ece87f800") : configmap references non-existent config key: service-ca.crt
Sep 11 14:16:10.831722 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:10.831412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-pjw5x" event={"ID":"6d2c7403-c974-4e6d-b59c-3f59341c8b77","Type":"ContainerStarted","Data":"1a53a2a54480a277ab9e57b9cd2040f3f4224aa7548ae530133e87772ba7e99a"}
Sep 11 14:16:10.834557 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:10.834526    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p" event={"ID":"e74eccd2-29ac-4aca-b61d-9b023b24269f","Type":"ContainerStarted","Data":"014294f37a47233593cb4b585f4597330690676c591f98b276ad9ebe6e3436b2"}
Sep 11 14:16:10.836728 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:10.836694    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4ljct" event={"ID":"dc3ec023-a44e-4352-807e-54c84c900153","Type":"ContainerStarted","Data":"98d940ab48cbf2db063abc7a7a61f133231702b8c5e8f6f7e80205bb4ecf4e1f"}
Sep 11 14:16:10.839103 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:10.839053    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-htlrd" event={"ID":"a61a2aa3-3169-4b47-8bd8-3567df82ac12","Type":"ContainerStarted","Data":"509900887d892f2a2c85ffe6843fbdae2cb00ab53f04ab8406cc1587201f6119"}
Sep 11 14:16:10.855666 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:10.855117    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-pjw5x" podStartSLOduration=1.920825913 podStartE2EDuration="5.855099312s" totalImagesPullingTime="3.934273399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:10.852254691 +0000 UTC m=+67.884689551" watchObservedRunningTime="2026-09-11 14:16:10.855099312 +0000 UTC m=+67.887534174"
Sep 11 14:16:10.877963 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:10.871265    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p" podStartSLOduration=3.624037393 podStartE2EDuration="5.871247026s" totalImagesPullingTime="2.247209633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:10.868925783 +0000 UTC m=+67.901360644" watchObservedRunningTime="2026-09-11 14:16:10.871247026 +0000 UTC m=+67.903681889"
Sep 11 14:16:11.407444 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.407412    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p2dsk"]
Sep 11 14:16:11.442585 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.442553    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p2dsk"]
Sep 11 14:16:11.442737 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.442694    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:11.448720 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.448147    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 14:16:11.448720 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.448359    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 14:16:11.448720 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.448556    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lzjkv\""
Sep 11 14:16:11.510894 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.510862    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-crio-socket\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:11.511095 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.511065    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf9nm\" (UniqueName: \"kubernetes.io/projected/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-api-access-kf9nm\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:11.511177 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.511111    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-data-volume\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:11.511177 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.511128    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:11.511177 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.511163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:11.612917 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.612583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf9nm\" (UniqueName: \"kubernetes.io/projected/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-api-access-kf9nm\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:11.612917 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.612679    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-data-volume\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:11.612917 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.612697    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:11.612917 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.612800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:11.612917 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.612863    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-crio-socket\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:11.612917 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:11.612882    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:11.613361 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:11.612947    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm podName:5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd nodeName:}" failed. No retries permitted until 2026-09-11 14:16:12.112927297 +0000 UTC m=+69.145362140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p2dsk" (UID: "5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:11.613361 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.612966    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-crio-socket\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:11.613361 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:11.612998    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:11.613361 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:11.613070    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls podName:5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd nodeName:}" failed. No retries permitted until 2026-09-11 14:16:12.113055542 +0000 UTC m=+69.145490379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p2dsk" (UID: "5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:11.613361 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.613087    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-data-volume\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:11.627070 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:11.626962    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf9nm\" (UniqueName: \"kubernetes.io/projected/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-api-access-kf9nm\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:12.119505 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:12.119461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:12.119697 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:12.119512    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:12.119697 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:12.119687    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:12.119825 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:12.119739    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls podName:5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd nodeName:}" failed. No retries permitted until 2026-09-11 14:16:13.119726205 +0000 UTC m=+70.152161056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p2dsk" (UID: "5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:12.119825 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:12.119800    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:12.119825 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:12.119824    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm podName:5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd nodeName:}" failed. No retries permitted until 2026-09-11 14:16:13.119816848 +0000 UTC m=+70.152251686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p2dsk" (UID: "5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:13.127451 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:13.127406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:13.127451 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:13.127469    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:13.127973 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:13.127539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xxw2c\" (UID: \"3c06e0b7-618d-430f-bd22-a606c43640ff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"
Sep 11 14:16:13.127973 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:13.127544    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:13.127973 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:13.127628    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm podName:5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd nodeName:}" failed. No retries permitted until 2026-09-11 14:16:15.127605039 +0000 UTC m=+72.160039878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p2dsk" (UID: "5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:13.127973 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:13.127663    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:13.127973 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:13.127707    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 14:16:13.127973 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:13.127736    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls podName:5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd nodeName:}" failed. No retries permitted until 2026-09-11 14:16:15.127717252 +0000 UTC m=+72.160152112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p2dsk" (UID: "5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:13.127973 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:13.127759    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls podName:3c06e0b7-618d-430f-bd22-a606c43640ff nodeName:}" failed. No retries permitted until 2026-09-11 14:16:21.127744208 +0000 UTC m=+78.160179066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xxw2c" (UID: "3c06e0b7-618d-430f-bd22-a606c43640ff") : secret "samples-operator-tls" not found
Sep 11 14:16:13.279787 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:13.279755    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l67jz_2459af77-ccb7-4ff6-819c-d1ac79618d37/dns-node-resolver/0.log"
Sep 11 14:16:13.635020 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:13.634985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:13.635212 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:13.635150    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 14:16:13.635212 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:13.635170    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54496484db-vk2tx: secret "image-registry-tls" not found
Sep 11 14:16:13.635306 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:13.635230    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls podName:0d3fb1c6-1ef3-4e11-babf-62999ce21ae6 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:21.635212352 +0000 UTC m=+78.667647211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls") pod "image-registry-54496484db-vk2tx" (UID: "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6") : secret "image-registry-tls" not found
Sep 11 14:16:14.139409 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:14.139374    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:14.139832 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:14.139518    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 14:16:14.139832 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:14.139578    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs podName:6b373715-10c6-4794-8be8-cf3ece87f800 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:22.139562947 +0000 UTC m=+79.171997789 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs") pod "router-default-79849455f8-6sjnq" (UID: "6b373715-10c6-4794-8be8-cf3ece87f800") : secret "router-metrics-certs-default" not found
Sep 11 14:16:14.341709 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:14.341666    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:14.341884 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:14.341820    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle podName:6b373715-10c6-4794-8be8-cf3ece87f800 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:22.341803251 +0000 UTC m=+79.374238093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle") pod "router-default-79849455f8-6sjnq" (UID: "6b373715-10c6-4794-8be8-cf3ece87f800") : configmap references non-existent config key: service-ca.crt
Sep 11 14:16:14.477148 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:14.477112    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pbmvf_8302613f-a418-483e-8ce5-59b148aef907/node-ca/0.log"
Sep 11 14:16:14.851802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:14.851766    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4ljct" event={"ID":"dc3ec023-a44e-4352-807e-54c84c900153","Type":"ContainerStarted","Data":"5cab5f1feb136510e4763643864e0ebfdae74eeb90cfb0b239c8e5639e93c94b"}
Sep 11 14:16:14.851995 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:14.851883    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:16:14.853435 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:14.853403    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-htlrd" event={"ID":"a61a2aa3-3169-4b47-8bd8-3567df82ac12","Type":"ContainerStarted","Data":"098e6113dc168c5d61a576a5909c62de2f89f84c15fe62fcda0d7ca49ccefda8"}
Sep 11 14:16:14.875493 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:14.875435    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4ljct" podStartSLOduration=67.288208533 podStartE2EDuration="1m11.875417015s" totalImagesPullingTime="4.587208482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:14.874112272 +0000 UTC m=+71.906547131" watchObservedRunningTime="2026-09-11 14:16:14.875417015 +0000 UTC m=+71.907851876"
Sep 11 14:16:14.906221 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:14.906177    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-htlrd" podStartSLOduration=66.323344822 podStartE2EDuration="1m10.906161913s" totalImagesPullingTime="4.582817091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:14.905131042 +0000 UTC m=+71.937565903" watchObservedRunningTime="2026-09-11 14:16:14.906161913 +0000 UTC m=+71.938596766"
Sep 11 14:16:15.148875 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:15.148798    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:15.148875 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:15.148831    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:15.149298 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:15.148929    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:15.149298 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:15.148935    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:15.149298 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:15.148977    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls podName:5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd nodeName:}" failed. No retries permitted until 2026-09-11 14:16:19.148964928 +0000 UTC m=+76.181399767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p2dsk" (UID: "5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:15.149298 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:15.148990    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm podName:5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd nodeName:}" failed. No retries permitted until 2026-09-11 14:16:19.148984133 +0000 UTC m=+76.181418971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p2dsk" (UID: "5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:15.281871 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:15.281835    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n8q7k_71972c3b-22f5-4cd1-8e47-bbfb9c0e0308/serve-healthcheck-canary/0.log"
Sep 11 14:16:19.181631 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:19.181590    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:19.181631 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:19.181635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:19.182132 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:19.181752    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:19.182132 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:19.181774    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:19.182132 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:19.181831    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm podName:5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd nodeName:}" failed. No retries permitted until 2026-09-11 14:16:27.181811367 +0000 UTC m=+84.214246224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p2dsk" (UID: "5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:19.182132 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:19.181855    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls podName:5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd nodeName:}" failed. No retries permitted until 2026-09-11 14:16:27.181838732 +0000 UTC m=+84.214273577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p2dsk" (UID: "5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:21.198667 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:21.198621    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xxw2c\" (UID: \"3c06e0b7-618d-430f-bd22-a606c43640ff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"
Sep 11 14:16:21.201160 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:21.201140    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c06e0b7-618d-430f-bd22-a606c43640ff-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xxw2c\" (UID: \"3c06e0b7-618d-430f-bd22-a606c43640ff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"
Sep 11 14:16:21.267320 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:21.267285    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"
Sep 11 14:16:21.539092 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:21.538801    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c"]
Sep 11 14:16:21.703182 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:21.703151    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls\") pod \"image-registry-54496484db-vk2tx\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") " pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:21.703388 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:21.703268    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 14:16:21.703388 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:21.703284    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54496484db-vk2tx: secret "image-registry-tls" not found
Sep 11 14:16:21.703388 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:21.703345    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls podName:0d3fb1c6-1ef3-4e11-babf-62999ce21ae6 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:37.703327494 +0000 UTC m=+94.735762337 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls") pod "image-registry-54496484db-vk2tx" (UID: "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6") : secret "image-registry-tls" not found
Sep 11 14:16:21.876157 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:21.876076    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c" event={"ID":"3c06e0b7-618d-430f-bd22-a606c43640ff","Type":"ContainerStarted","Data":"d784ba00040d8b69f972c84568dc2a1b40f1e9edd982adaaab0da87faaaccf36"}
Sep 11 14:16:22.207063 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:22.207011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:22.207417 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:22.207128    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 14:16:22.207417 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:22.207180    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs podName:6b373715-10c6-4794-8be8-cf3ece87f800 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:38.207168468 +0000 UTC m=+95.239603310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs") pod "router-default-79849455f8-6sjnq" (UID: "6b373715-10c6-4794-8be8-cf3ece87f800") : secret "router-metrics-certs-default" not found
Sep 11 14:16:22.408168 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:22.408134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:22.408324 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:22.408307    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle podName:6b373715-10c6-4794-8be8-cf3ece87f800 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:38.408289767 +0000 UTC m=+95.440724609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle") pod "router-default-79849455f8-6sjnq" (UID: "6b373715-10c6-4794-8be8-cf3ece87f800") : configmap references non-existent config key: service-ca.crt
Sep 11 14:16:24.886469 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:24.886427    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c" event={"ID":"3c06e0b7-618d-430f-bd22-a606c43640ff","Type":"ContainerStarted","Data":"e2710832d860ceb8f2d9cf7c4605ae1e6c250916b67d586962e59af9e4fbab2a"}
Sep 11 14:16:24.886921 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:24.886493    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c" event={"ID":"3c06e0b7-618d-430f-bd22-a606c43640ff","Type":"ContainerStarted","Data":"ce68c95a743e4b82c439d1fe7345182e358821af0b6f3a148d9e63314c0d850b"}
Sep 11 14:16:27.250073 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:27.248946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:27.250073 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:27.249012    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:27.250073 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:27.249222    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:27.250073 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:27.249339    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls podName:5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd nodeName:}" failed. No retries permitted until 2026-09-11 14:16:43.249316452 +0000 UTC m=+100.281751363 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p2dsk" (UID: "5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:27.250073 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:27.249813    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:34.576513 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.576461    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xxw2c" podStartSLOduration=26.852894672 podStartE2EDuration="29.576444142s" totalImagesPullingTime="2.72354947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:24.943380666 +0000 UTC m=+81.975815526" watchObservedRunningTime="2026-09-11 14:16:34.576444142 +0000 UTC m=+91.608878996"
Sep 11 14:16:34.577692 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.577670    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-xxptg"]
Sep 11 14:16:34.581710 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.581694    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-xxptg"
Sep 11 14:16:34.587142 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.587111    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 14:16:34.587280 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.587261    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hstjx\""
Sep 11 14:16:34.587487 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.587469    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 14:16:34.603822 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.603793    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-xxptg"]
Sep 11 14:16:34.630952 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.630919    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54496484db-vk2tx"]
Sep 11 14:16:34.631234 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:34.631209    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-54496484db-vk2tx" podUID="0d3fb1c6-1ef3-4e11-babf-62999ce21ae6"
Sep 11 14:16:34.706146 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.706105    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z5h8\" (UniqueName: \"kubernetes.io/projected/d14622a5-67e8-41a3-97a8-c933173005a0-kube-api-access-4z5h8\") pod \"downloads-76f99584f4-xxptg\" (UID: \"d14622a5-67e8-41a3-97a8-c933173005a0\") " pod="openshift-console/downloads-76f99584f4-xxptg"
Sep 11 14:16:34.712513 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.712483    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-666878b48d-l969n"]
Sep 11 14:16:34.715452 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.715433    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.748884 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.748855    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-666878b48d-l969n"]
Sep 11 14:16:34.806764 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.806735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z5h8\" (UniqueName: \"kubernetes.io/projected/d14622a5-67e8-41a3-97a8-c933173005a0-kube-api-access-4z5h8\") pod \"downloads-76f99584f4-xxptg\" (UID: \"d14622a5-67e8-41a3-97a8-c933173005a0\") " pod="openshift-console/downloads-76f99584f4-xxptg"
Sep 11 14:16:34.806914 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.806773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a0679e92-a5a4-498e-8f8d-f77e13739e4b-ca-trust-extracted\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.806914 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.806816    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0679e92-a5a4-498e-8f8d-f77e13739e4b-bound-sa-token\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.806914 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.806845    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a0679e92-a5a4-498e-8f8d-f77e13739e4b-registry-certificates\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.806914 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.806879    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0679e92-a5a4-498e-8f8d-f77e13739e4b-registry-tls\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.807117 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.806956    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82w9v\" (UniqueName: \"kubernetes.io/projected/a0679e92-a5a4-498e-8f8d-f77e13739e4b-kube-api-access-82w9v\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.807117 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.806983    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a0679e92-a5a4-498e-8f8d-f77e13739e4b-installation-pull-secrets\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.807117 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.807016    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a0679e92-a5a4-498e-8f8d-f77e13739e4b-image-registry-private-configuration\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.807117 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.807056    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0679e92-a5a4-498e-8f8d-f77e13739e4b-trusted-ca\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.820605 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.820575    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z5h8\" (UniqueName: \"kubernetes.io/projected/d14622a5-67e8-41a3-97a8-c933173005a0-kube-api-access-4z5h8\") pod \"downloads-76f99584f4-xxptg\" (UID: \"d14622a5-67e8-41a3-97a8-c933173005a0\") " pod="openshift-console/downloads-76f99584f4-xxptg"
Sep 11 14:16:34.890173 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.890085    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-xxptg"
Sep 11 14:16:34.908340 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.908311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a0679e92-a5a4-498e-8f8d-f77e13739e4b-installation-pull-secrets\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.908486 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.908388    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a0679e92-a5a4-498e-8f8d-f77e13739e4b-image-registry-private-configuration\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.908486 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.908419    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0679e92-a5a4-498e-8f8d-f77e13739e4b-trusted-ca\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.909367 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.908780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a0679e92-a5a4-498e-8f8d-f77e13739e4b-ca-trust-extracted\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.909586 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.909022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0679e92-a5a4-498e-8f8d-f77e13739e4b-bound-sa-token\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.909668 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.909646    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a0679e92-a5a4-498e-8f8d-f77e13739e4b-registry-certificates\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.909726 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.909201    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a0679e92-a5a4-498e-8f8d-f77e13739e4b-ca-trust-extracted\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.909726 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.909543    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0679e92-a5a4-498e-8f8d-f77e13739e4b-trusted-ca\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.909726 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.909705    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0679e92-a5a4-498e-8f8d-f77e13739e4b-registry-tls\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.909856 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.909756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82w9v\" (UniqueName: \"kubernetes.io/projected/a0679e92-a5a4-498e-8f8d-f77e13739e4b-kube-api-access-82w9v\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.910547 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.910479    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a0679e92-a5a4-498e-8f8d-f77e13739e4b-registry-certificates\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.911308 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.911288    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a0679e92-a5a4-498e-8f8d-f77e13739e4b-image-registry-private-configuration\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.911409 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.911327    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a0679e92-a5a4-498e-8f8d-f77e13739e4b-installation-pull-secrets\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.912114 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.912098    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0679e92-a5a4-498e-8f8d-f77e13739e4b-registry-tls\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.919248 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.919228    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:34.928854 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.928813    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82w9v\" (UniqueName: \"kubernetes.io/projected/a0679e92-a5a4-498e-8f8d-f77e13739e4b-kube-api-access-82w9v\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:34.929080 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.929060    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:34.931028 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:34.930999    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0679e92-a5a4-498e-8f8d-f77e13739e4b-bound-sa-token\") pod \"image-registry-666878b48d-l969n\" (UID: \"a0679e92-a5a4-498e-8f8d-f77e13739e4b\") " pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:35.010894 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.010857    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-image-registry-private-configuration\") pod \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") "
Sep 11 14:16:35.010894 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.010896    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-trusted-ca\") pod \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") "
Sep 11 14:16:35.011166 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.010921    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-bound-sa-token\") pod \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") "
Sep 11 14:16:35.011166 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.010945    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-certificates\") pod \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") "
Sep 11 14:16:35.011166 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.010965    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-ca-trust-extracted\") pod \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") "
Sep 11 14:16:35.011166 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.011017    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-installation-pull-secrets\") pod \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") "
Sep 11 14:16:35.011166 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.011078    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr597\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-kube-api-access-nr597\") pod \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\" (UID: \"0d3fb1c6-1ef3-4e11-babf-62999ce21ae6\") "
Sep 11 14:16:35.011453 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.011397    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6" (UID: "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:16:35.011547 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.011500    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6" (UID: "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:16:35.011725 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.011691    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6" (UID: "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:16:35.013548 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.013525    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6" (UID: "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:16:35.013636 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.013567    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6" (UID: "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:16:35.013835 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.013810    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-kube-api-access-nr597" (OuterVolumeSpecName: "kube-api-access-nr597") pod "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6" (UID: "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6"). InnerVolumeSpecName "kube-api-access-nr597". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:16:35.013920 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.013811    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6" (UID: "0d3fb1c6-1ef3-4e11-babf-62999ce21ae6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:16:35.023948 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.023926    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:35.112380 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.112355    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-installation-pull-secrets\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:16:35.112380 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.112377    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr597\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-kube-api-access-nr597\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:16:35.112546 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.112389    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-image-registry-private-configuration\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:16:35.112546 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.112398    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-trusted-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:16:35.112546 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.112406    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-bound-sa-token\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:16:35.112546 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.112414    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-certificates\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:16:35.112546 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.112422    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-ca-trust-extracted\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:16:35.185398 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.185372    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-xxptg"]
Sep 11 14:16:35.189142 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:16:35.189113    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14622a5_67e8_41a3_97a8_c933173005a0.slice/crio-feff7412345ae586866abd9b2d2201ceced0d5434d2b57856ed253d82f528527 WatchSource:0}: Error finding container feff7412345ae586866abd9b2d2201ceced0d5434d2b57856ed253d82f528527: Status 404 returned error can't find the container with id feff7412345ae586866abd9b2d2201ceced0d5434d2b57856ed253d82f528527
Sep 11 14:16:35.304564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.304531    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-666878b48d-l969n"]
Sep 11 14:16:35.308585 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:16:35.308560    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0679e92_a5a4_498e_8f8d_f77e13739e4b.slice/crio-6639ed2f227c4b5d67232d185734512e678298e4438579a649ea33501978c1e0 WatchSource:0}: Error finding container 6639ed2f227c4b5d67232d185734512e678298e4438579a649ea33501978c1e0: Status 404 returned error can't find the container with id 6639ed2f227c4b5d67232d185734512e678298e4438579a649ea33501978c1e0
Sep 11 14:16:35.925121 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.925076    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-666878b48d-l969n" event={"ID":"a0679e92-a5a4-498e-8f8d-f77e13739e4b","Type":"ContainerStarted","Data":"dbd79f86825ae2d4873440dc32df0df0b488866df047d430c5b07d954f5998f4"}
Sep 11 14:16:35.925703 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.925178    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-666878b48d-l969n" event={"ID":"a0679e92-a5a4-498e-8f8d-f77e13739e4b","Type":"ContainerStarted","Data":"6639ed2f227c4b5d67232d185734512e678298e4438579a649ea33501978c1e0"}
Sep 11 14:16:35.925703 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.925337    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:35.926361 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.926343    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54496484db-vk2tx"
Sep 11 14:16:35.926473 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.926370    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-xxptg" event={"ID":"d14622a5-67e8-41a3-97a8-c933173005a0","Type":"ContainerStarted","Data":"feff7412345ae586866abd9b2d2201ceced0d5434d2b57856ed253d82f528527"}
Sep 11 14:16:35.953113 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:35.953065    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-666878b48d-l969n" podStartSLOduration=1.9530517 podStartE2EDuration="1.9530517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:35.952873128 +0000 UTC m=+92.985307989" watchObservedRunningTime="2026-09-11 14:16:35.9530517 +0000 UTC m=+92.985486551"
Sep 11 14:16:36.000848 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:36.000815    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54496484db-vk2tx"]
Sep 11 14:16:36.006012 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:36.005984    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54496484db-vk2tx"]
Sep 11 14:16:36.122530 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:36.122453    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6-registry-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:16:37.493111 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:37.493077    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d3fb1c6-1ef3-4e11-babf-62999ce21ae6" path="/var/lib/kubelet/pods/0d3fb1c6-1ef3-4e11-babf-62999ce21ae6/volumes"
Sep 11 14:16:38.240974 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:38.240932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:38.244080 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:38.244026    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b373715-10c6-4794-8be8-cf3ece87f800-metrics-certs\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:38.443118 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:38.443084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:38.443839 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:38.443811    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b373715-10c6-4794-8be8-cf3ece87f800-service-ca-bundle\") pod \"router-default-79849455f8-6sjnq\" (UID: \"6b373715-10c6-4794-8be8-cf3ece87f800\") " pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:38.498295 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:38.498215    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:38.787939 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:38.787865    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79849455f8-6sjnq"]
Sep 11 14:16:38.791840 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:16:38.791811    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b373715_10c6_4794_8be8_cf3ece87f800.slice/crio-53eb32e3e112861125f5bd722d8088fda2859301513062c7be06e258195e8384 WatchSource:0}: Error finding container 53eb32e3e112861125f5bd722d8088fda2859301513062c7be06e258195e8384: Status 404 returned error can't find the container with id 53eb32e3e112861125f5bd722d8088fda2859301513062c7be06e258195e8384
Sep 11 14:16:38.940137 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:38.940093    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79849455f8-6sjnq" event={"ID":"6b373715-10c6-4794-8be8-cf3ece87f800","Type":"ContainerStarted","Data":"99f6921c64baab15378de4d7c566631dcb45aea1512a904a9e44675966a0bde5"}
Sep 11 14:16:38.940322 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:38.940152    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79849455f8-6sjnq" event={"ID":"6b373715-10c6-4794-8be8-cf3ece87f800","Type":"ContainerStarted","Data":"53eb32e3e112861125f5bd722d8088fda2859301513062c7be06e258195e8384"}
Sep 11 14:16:39.038601 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:39.038489    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-79849455f8-6sjnq" podStartSLOduration=34.038466427 podStartE2EDuration="34.038466427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:39.036607065 +0000 UTC m=+96.069041926" watchObservedRunningTime="2026-09-11 14:16:39.038466427 +0000 UTC m=+96.070901290"
Sep 11 14:16:39.499119 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:39.499082    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:39.501991 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:39.501969    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:39.943729 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:39.943694    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:39.945139 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:39.945115    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79849455f8-6sjnq"
Sep 11 14:16:40.077242 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.077208    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b86cdb77-5xbl4"]
Sep 11 14:16:40.080153 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.080130    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.084201 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.084027    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 14:16:40.084321 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.084299    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 14:16:40.084383 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.084360    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 14:16:40.084438 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.084424    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 14:16:40.084487 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.084462    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jlnkm\""
Sep 11 14:16:40.084804 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.084779    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 14:16:40.142534 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.142498    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b86cdb77-5xbl4"]
Sep 11 14:16:40.258199 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.258099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-config\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.258199 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.258178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stnch\" (UniqueName: \"kubernetes.io/projected/7127b4a1-6a6f-4997-bc00-edd9458639ef-kube-api-access-stnch\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.258416 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.258248    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-serving-cert\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.258416 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.258288    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-oauth-config\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.258416 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.258324    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-oauth-serving-cert\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.258416 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.258361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-service-ca\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.359307 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.359271    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-oauth-serving-cert\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.359491 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.359322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-service-ca\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.359491 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.359386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-config\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.359491 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.359453    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stnch\" (UniqueName: \"kubernetes.io/projected/7127b4a1-6a6f-4997-bc00-edd9458639ef-kube-api-access-stnch\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.359491 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.359481    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-serving-cert\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.359713 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.359504    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-oauth-config\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.360263 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.360232    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-oauth-serving-cert\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.360392 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.360309    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-service-ca\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.360620 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.360603    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-config\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.362664 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.362641    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-oauth-config\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.362750 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.362691    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-serving-cert\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.368874 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.368849    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stnch\" (UniqueName: \"kubernetes.io/projected/7127b4a1-6a6f-4997-bc00-edd9458639ef-kube-api-access-stnch\") pod \"console-b86cdb77-5xbl4\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") " pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.391686 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.391660    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:16:40.702409 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.702328    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b86cdb77-5xbl4"]
Sep 11 14:16:40.707443 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:16:40.707410    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7127b4a1_6a6f_4997_bc00_edd9458639ef.slice/crio-061022e3b4c06a96b0c92a5e71eb7288552ba9f79fdeafd03830b6d03f33c8ae WatchSource:0}: Error finding container 061022e3b4c06a96b0c92a5e71eb7288552ba9f79fdeafd03830b6d03f33c8ae: Status 404 returned error can't find the container with id 061022e3b4c06a96b0c92a5e71eb7288552ba9f79fdeafd03830b6d03f33c8ae
Sep 11 14:16:40.948441 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:40.948390    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b86cdb77-5xbl4" event={"ID":"7127b4a1-6a6f-4997-bc00-edd9458639ef","Type":"ContainerStarted","Data":"061022e3b4c06a96b0c92a5e71eb7288552ba9f79fdeafd03830b6d03f33c8ae"}
Sep 11 14:16:41.367732 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:41.367692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:16:41.370818 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:41.370792    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/389be6eb-2f59-42ef-82cb-d0f800ae1748-metrics-tls\") pod \"dns-default-ck8m8\" (UID: \"389be6eb-2f59-42ef-82cb-d0f800ae1748\") " pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:16:41.616750 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:41.616716    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xhc84\""
Sep 11 14:16:41.624480 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:41.624198    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:16:41.909179 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:41.909057    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ck8m8"]
Sep 11 14:16:41.913988 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:16:41.913952    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389be6eb_2f59_42ef_82cb_d0f800ae1748.slice/crio-d28b5cab527970dcecef0459774a41e7ad00417dfe6a3103e1ac7a8527255e11 WatchSource:0}: Error finding container d28b5cab527970dcecef0459774a41e7ad00417dfe6a3103e1ac7a8527255e11: Status 404 returned error can't find the container with id d28b5cab527970dcecef0459774a41e7ad00417dfe6a3103e1ac7a8527255e11
Sep 11 14:16:41.956167 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:41.956114    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ck8m8" event={"ID":"389be6eb-2f59-42ef-82cb-d0f800ae1748","Type":"ContainerStarted","Data":"d28b5cab527970dcecef0459774a41e7ad00417dfe6a3103e1ac7a8527255e11"}
Sep 11 14:16:43.285896 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:43.285844    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:43.288872 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:43.288839    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2dsk\" (UID: \"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd\") " pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:43.554548 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:43.554461    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p2dsk"
Sep 11 14:16:44.559462 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.559430    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"]
Sep 11 14:16:44.586669 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.586636    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"
Sep 11 14:16:44.615091 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.615054    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 14:16:44.615091 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.615079    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 14:16:44.615383 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.615366    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 11 14:16:44.615635 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.615616    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ddnjc\""
Sep 11 14:16:44.615784 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.615773    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 11 14:16:44.616607 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.616580    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"]
Sep 11 14:16:44.620548 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.620526    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 14:16:44.700800 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.700771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99e2a7be-a4db-4116-a2ba-8528b54a0a4b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-7c9km\" (UID: \"99e2a7be-a4db-4116-a2ba-8528b54a0a4b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"
Sep 11 14:16:44.700975 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.700807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99e2a7be-a4db-4116-a2ba-8528b54a0a4b-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-7c9km\" (UID: \"99e2a7be-a4db-4116-a2ba-8528b54a0a4b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"
Sep 11 14:16:44.700975 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.700835    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/99e2a7be-a4db-4116-a2ba-8528b54a0a4b-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-7c9km\" (UID: \"99e2a7be-a4db-4116-a2ba-8528b54a0a4b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"
Sep 11 14:16:44.700975 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.700937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt6xc\" (UniqueName: \"kubernetes.io/projected/99e2a7be-a4db-4116-a2ba-8528b54a0a4b-kube-api-access-dt6xc\") pod \"prometheus-operator-68bcd7f987-7c9km\" (UID: \"99e2a7be-a4db-4116-a2ba-8528b54a0a4b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"
Sep 11 14:16:44.801737 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.801696    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt6xc\" (UniqueName: \"kubernetes.io/projected/99e2a7be-a4db-4116-a2ba-8528b54a0a4b-kube-api-access-dt6xc\") pod \"prometheus-operator-68bcd7f987-7c9km\" (UID: \"99e2a7be-a4db-4116-a2ba-8528b54a0a4b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"
Sep 11 14:16:44.801930 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.801793    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99e2a7be-a4db-4116-a2ba-8528b54a0a4b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-7c9km\" (UID: \"99e2a7be-a4db-4116-a2ba-8528b54a0a4b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"
Sep 11 14:16:44.801930 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.801833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99e2a7be-a4db-4116-a2ba-8528b54a0a4b-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-7c9km\" (UID: \"99e2a7be-a4db-4116-a2ba-8528b54a0a4b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"
Sep 11 14:16:44.802082 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.801920    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/99e2a7be-a4db-4116-a2ba-8528b54a0a4b-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-7c9km\" (UID: \"99e2a7be-a4db-4116-a2ba-8528b54a0a4b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"
Sep 11 14:16:44.802626 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.802588    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99e2a7be-a4db-4116-a2ba-8528b54a0a4b-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-7c9km\" (UID: \"99e2a7be-a4db-4116-a2ba-8528b54a0a4b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"
Sep 11 14:16:44.804541 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.804513    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99e2a7be-a4db-4116-a2ba-8528b54a0a4b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-7c9km\" (UID: \"99e2a7be-a4db-4116-a2ba-8528b54a0a4b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"
Sep 11 14:16:44.804675 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.804579    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/99e2a7be-a4db-4116-a2ba-8528b54a0a4b-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-7c9km\" (UID: \"99e2a7be-a4db-4116-a2ba-8528b54a0a4b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"
Sep 11 14:16:44.814330 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.814260    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt6xc\" (UniqueName: \"kubernetes.io/projected/99e2a7be-a4db-4116-a2ba-8528b54a0a4b-kube-api-access-dt6xc\") pod \"prometheus-operator-68bcd7f987-7c9km\" (UID: \"99e2a7be-a4db-4116-a2ba-8528b54a0a4b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"
Sep 11 14:16:44.899055 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:44.899009    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"
Sep 11 14:16:45.858599 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:45.858557    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4ljct"
Sep 11 14:16:46.465988 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.465955    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b7499df47-dqdgk"]
Sep 11 14:16:46.485691 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.485662    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.494207 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.494187    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 14:16:46.505643 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.505593    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b7499df47-dqdgk"]
Sep 11 14:16:46.617905 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.617870    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p26w\" (UniqueName: \"kubernetes.io/projected/460375f8-a101-40f6-93fe-f072f433d368-kube-api-access-9p26w\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.618121 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.617918    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/460375f8-a101-40f6-93fe-f072f433d368-console-serving-cert\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.618121 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.618060    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-oauth-serving-cert\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.618121 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.618099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-trusted-ca-bundle\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.618303 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.618162    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-console-config\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.618303 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.618214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/460375f8-a101-40f6-93fe-f072f433d368-console-oauth-config\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.618303 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.618236    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-service-ca\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.719269 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.719177    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-oauth-serving-cert\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.719269 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.719234    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-trusted-ca-bundle\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.719269 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.719266    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-console-config\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.719541 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.719310    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/460375f8-a101-40f6-93fe-f072f433d368-console-oauth-config\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.719541 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.719333    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-service-ca\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.719541 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.719370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p26w\" (UniqueName: \"kubernetes.io/projected/460375f8-a101-40f6-93fe-f072f433d368-kube-api-access-9p26w\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.719541 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.719393    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/460375f8-a101-40f6-93fe-f072f433d368-console-serving-cert\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.720141 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.720114    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-console-config\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.720288 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.720125    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-oauth-serving-cert\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.720288 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.720239    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-service-ca\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.720401 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.720297    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-trusted-ca-bundle\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.722265 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.722243    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/460375f8-a101-40f6-93fe-f072f433d368-console-oauth-config\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.722370 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.722337    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/460375f8-a101-40f6-93fe-f072f433d368-console-serving-cert\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.731111 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.731094    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p26w\" (UniqueName: \"kubernetes.io/projected/460375f8-a101-40f6-93fe-f072f433d368-kube-api-access-9p26w\") pod \"console-b7499df47-dqdgk\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") " pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:46.797459 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:46.797418    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:51.996059 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:51.996006    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b86cdb77-5xbl4" event={"ID":"7127b4a1-6a6f-4997-bc00-edd9458639ef","Type":"ContainerStarted","Data":"def1b3886b6b4d937dee37709a4d0e6f9a72a5c850111e81be57a49789735603"}
Sep 11 14:16:52.203029 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:16:52.202994    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c54c5f7_c93a_4b2d_abfd_8abbfd8163fd.slice/crio-77271bbcc202e31bd283138ab79fe35c2c3af3327b07ea7bc15a4cf2533c6dab WatchSource:0}: Error finding container 77271bbcc202e31bd283138ab79fe35c2c3af3327b07ea7bc15a4cf2533c6dab: Status 404 returned error can't find the container with id 77271bbcc202e31bd283138ab79fe35c2c3af3327b07ea7bc15a4cf2533c6dab
Sep 11 14:16:52.238548 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:52.238508    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p2dsk"]
Sep 11 14:16:52.285996 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:52.285930    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-7c9km"]
Sep 11 14:16:52.292311 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:52.292276    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b7499df47-dqdgk"]
Sep 11 14:16:52.315323 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:16:52.315284    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460375f8_a101_40f6_93fe_f072f433d368.slice/crio-61e5bbbd2354fc7603d4e35a8df800bec030900172b358d6b2968219d3778cd5 WatchSource:0}: Error finding container 61e5bbbd2354fc7603d4e35a8df800bec030900172b358d6b2968219d3778cd5: Status 404 returned error can't find the container with id 61e5bbbd2354fc7603d4e35a8df800bec030900172b358d6b2968219d3778cd5
Sep 11 14:16:52.316123 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:16:52.316088    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99e2a7be_a4db_4116_a2ba_8528b54a0a4b.slice/crio-250daa96afa6fd11b95ccb93a3fd6fbbefcf9a59d3712c5e88fd72608a24e593 WatchSource:0}: Error finding container 250daa96afa6fd11b95ccb93a3fd6fbbefcf9a59d3712c5e88fd72608a24e593: Status 404 returned error can't find the container with id 250daa96afa6fd11b95ccb93a3fd6fbbefcf9a59d3712c5e88fd72608a24e593
Sep 11 14:16:53.005335 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.004690    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7499df47-dqdgk" event={"ID":"460375f8-a101-40f6-93fe-f072f433d368","Type":"ContainerStarted","Data":"a036ab71161a9252b78f50c9c8337656cb6d871260d547cfb00a939e7c636576"}
Sep 11 14:16:53.005335 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.004764    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7499df47-dqdgk" event={"ID":"460375f8-a101-40f6-93fe-f072f433d368","Type":"ContainerStarted","Data":"61e5bbbd2354fc7603d4e35a8df800bec030900172b358d6b2968219d3778cd5"}
Sep 11 14:16:53.006866 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.006832    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km" event={"ID":"99e2a7be-a4db-4116-a2ba-8528b54a0a4b","Type":"ContainerStarted","Data":"250daa96afa6fd11b95ccb93a3fd6fbbefcf9a59d3712c5e88fd72608a24e593"}
Sep 11 14:16:53.009163 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.009103    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-xxptg" event={"ID":"d14622a5-67e8-41a3-97a8-c933173005a0","Type":"ContainerStarted","Data":"a10bdf89f8e3c6efcc8080d7441ead40cd127252310a9e78b6ea602635a31af5"}
Sep 11 14:16:53.009878 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.009675    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-xxptg"
Sep 11 14:16:53.013414 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.013377    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ck8m8" event={"ID":"389be6eb-2f59-42ef-82cb-d0f800ae1748","Type":"ContainerStarted","Data":"124e4cbd94419f429f84195ff24f45ea5530159d3609daf6d2dcc07de201dcf2"}
Sep 11 14:16:53.013543 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.013422    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ck8m8" event={"ID":"389be6eb-2f59-42ef-82cb-d0f800ae1748","Type":"ContainerStarted","Data":"fe1c53cb2bb8766702e8270c3431f2591e30bf4a14ca6b92f7b020348e46068a"}
Sep 11 14:16:53.013609 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.013592    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:16:53.015994 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.015957    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p2dsk" event={"ID":"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd","Type":"ContainerStarted","Data":"edfbe1eac4f96a0284132bc7f57607110abc38688de6d99d4b49ae2ad72f8cfe"}
Sep 11 14:16:53.016125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.016019    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p2dsk" event={"ID":"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd","Type":"ContainerStarted","Data":"77271bbcc202e31bd283138ab79fe35c2c3af3327b07ea7bc15a4cf2533c6dab"}
Sep 11 14:16:53.024434 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.024405    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-xxptg"
Sep 11 14:16:53.035488 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.035430    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b7499df47-dqdgk" podStartSLOduration=7.035410486 podStartE2EDuration="7.035410486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:53.033280779 +0000 UTC m=+110.065715640" watchObservedRunningTime="2026-09-11 14:16:53.035410486 +0000 UTC m=+110.067845343"
Sep 11 14:16:53.060753 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.060690    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ck8m8" podStartSLOduration=66.105981516 podStartE2EDuration="1m16.060668188s" totalImagesPullingTime="9.954686672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:53.058505186 +0000 UTC m=+110.090940085" watchObservedRunningTime="2026-09-11 14:16:53.060668188 +0000 UTC m=+110.093103049"
Sep 11 14:16:53.088415 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.088266    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b86cdb77-5xbl4" podStartSLOduration=1.929349454 podStartE2EDuration="13.088245499s" totalImagesPullingTime="11.158896045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:53.08553498 +0000 UTC m=+110.117969842" watchObservedRunningTime="2026-09-11 14:16:53.088245499 +0000 UTC m=+110.120680360"
Sep 11 14:16:53.118738 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:53.117058    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-xxptg" podStartSLOduration=2.378734302 podStartE2EDuration="19.117014082s" totalImagesPullingTime="16.73827978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:53.116802026 +0000 UTC m=+110.149236893" watchObservedRunningTime="2026-09-11 14:16:53.117014082 +0000 UTC m=+110.149448942"
Sep 11 14:16:54.023128 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:54.023083    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p2dsk" event={"ID":"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd","Type":"ContainerStarted","Data":"b8e6a95fec940cd06e6c9006f5bad40d35db4a20ce15df08b13fcabfc99234a0"}
Sep 11 14:16:55.030964 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:55.030924    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km" event={"ID":"99e2a7be-a4db-4116-a2ba-8528b54a0a4b","Type":"ContainerStarted","Data":"498a3a7e6077cae652a7f34e44658be53986a8e746ba6baef021c9cc8dbd1239"}
Sep 11 14:16:55.031475 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:55.030996    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km" event={"ID":"99e2a7be-a4db-4116-a2ba-8528b54a0a4b","Type":"ContainerStarted","Data":"7db79462f7858042ff41ff2dfc9a838e23931ea39a58de6db7769718a3ee2cfe"}
Sep 11 14:16:55.055727 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:55.055670    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-7c9km" podStartSLOduration=9.175691296 podStartE2EDuration="11.055646413s" totalImagesPullingTime="1.879955117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:55.054964441 +0000 UTC m=+112.087399292" watchObservedRunningTime="2026-09-11 14:16:55.055646413 +0000 UTC m=+112.088081273"
Sep 11 14:16:56.037822 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:56.037728    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p2dsk" event={"ID":"5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd","Type":"ContainerStarted","Data":"a2ca412fe1b93844fd3cfce03618630e33fca27fa251094a094c3f9f648d4679"}
Sep 11 14:16:56.089918 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:56.086718    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p2dsk" podStartSLOduration=41.681270571 podStartE2EDuration="45.086689872s" totalImagesPullingTime="3.405419301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:16:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:56.085335602 +0000 UTC m=+113.117770464" watchObservedRunningTime="2026-09-11 14:16:56.086689872 +0000 UTC m=+113.119124732"
Sep 11 14:16:56.798307 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:56.798269    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:56.798497 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:56.798336    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:56.803882 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:56.803861    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:56.934746 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:56.934712    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-666878b48d-l969n"
Sep 11 14:16:57.051300 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.051225    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:16:57.262234 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.262201    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b86cdb77-5xbl4"]
Sep 11 14:16:57.631873 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.631838    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"]
Sep 11 14:16:57.657095 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.657066    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.664353 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:57.664325    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-state-metrics-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" type="*v1.Secret"
Sep 11 14:16:57.665228 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:57.664621    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-state-metrics-dockercfg-nfvkt\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nfvkt\"" type="*v1.Secret"
Sep 11 14:16:57.665228 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:57.664691    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-state-metrics-59fbdd77d-mtdt4\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" podUID="c60380da-d7cf-4c61-8955-ec4bd09a82ff" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.665228 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:57.664758    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-state-metrics-custom-resource-state-configmap\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" type="*v1.ConfigMap"
Sep 11 14:16:57.665228 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:57.664867    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-state-metrics-tls\" is forbidden: User \"system:node:ip-10-0-142-0.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-142-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" type="*v1.Secret"
Sep 11 14:16:57.675206 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.675176    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"]
Sep 11 14:16:57.717690 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.717662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.717869 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.717806    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.717869 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.717848    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hwpk\" (UniqueName: \"kubernetes.io/projected/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-api-access-4hwpk\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.717966 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.717890    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c60380da-d7cf-4c61-8955-ec4bd09a82ff-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.717966 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.717925    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c60380da-d7cf-4c61-8955-ec4bd09a82ff-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.717966 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.717951    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.719426 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.719406    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7w292"]
Sep 11 14:16:57.737162 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.737138    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.747507 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.747484    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 14:16:57.747604 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.747486    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 14:16:57.747668 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.747613    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 14:16:57.767309 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.767280    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tsp77\""
Sep 11 14:16:57.819185 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c60380da-d7cf-4c61-8955-ec4bd09a82ff-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.819328 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c60380da-d7cf-4c61-8955-ec4bd09a82ff-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.819328 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.819328 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819248    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5fg6\" (UniqueName: \"kubernetes.io/projected/39354256-f81b-4c10-8854-f3fdb2f75e9f-kube-api-access-b5fg6\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.819328 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819291    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.819538 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819336    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.819538 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819396    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-wtmp\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.819538 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819439    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.819538 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39354256-f81b-4c10-8854-f3fdb2f75e9f-sys\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.819538 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819494    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39354256-f81b-4c10-8854-f3fdb2f75e9f-metrics-client-ca\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.819783 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-textfile\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.819783 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-tls\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.819783 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.819783 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819630    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hwpk\" (UniqueName: \"kubernetes.io/projected/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-api-access-4hwpk\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.819783 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819637    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c60380da-d7cf-4c61-8955-ec4bd09a82ff-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.819783 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39354256-f81b-4c10-8854-f3fdb2f75e9f-root\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.820028 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.819986    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c60380da-d7cf-4c61-8955-ec4bd09a82ff-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.878900 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.878866    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hwpk\" (UniqueName: \"kubernetes.io/projected/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-api-access-4hwpk\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:57.920412 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.920343    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-wtmp\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.920412 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.920394    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.920610 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.920419    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39354256-f81b-4c10-8854-f3fdb2f75e9f-sys\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.920610 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.920441    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39354256-f81b-4c10-8854-f3fdb2f75e9f-metrics-client-ca\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.920610 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.920468    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-textfile\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.920610 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.920490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-tls\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.920610 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.920527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39354256-f81b-4c10-8854-f3fdb2f75e9f-root\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.920610 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.920542    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-wtmp\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.920610 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.920575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5fg6\" (UniqueName: \"kubernetes.io/projected/39354256-f81b-4c10-8854-f3fdb2f75e9f-kube-api-access-b5fg6\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.920957 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.920614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.920957 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.920669    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39354256-f81b-4c10-8854-f3fdb2f75e9f-sys\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.920957 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.920869    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-textfile\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.921229 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.921201    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39354256-f81b-4c10-8854-f3fdb2f75e9f-root\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.921489 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.921288    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39354256-f81b-4c10-8854-f3fdb2f75e9f-metrics-client-ca\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.921489 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.921357    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.923234 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.923213    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-tls\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.923351 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.923339    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39354256-f81b-4c10-8854-f3fdb2f75e9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:57.959194 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:57.959163    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5fg6\" (UniqueName: \"kubernetes.io/projected/39354256-f81b-4c10-8854-f3fdb2f75e9f-kube-api-access-b5fg6\") pod \"node-exporter-7w292\" (UID: \"39354256-f81b-4c10-8854-f3fdb2f75e9f\") " pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:58.047697 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:58.047666    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7w292"
Sep 11 14:16:58.083924 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:16:58.083893    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39354256_f81b_4c10_8854_f3fdb2f75e9f.slice/crio-f82923b6a6e36a6ae1c07f5593e23743b02a7a8d9567394eaaae1e94a4601f94 WatchSource:0}: Error finding container f82923b6a6e36a6ae1c07f5593e23743b02a7a8d9567394eaaae1e94a4601f94: Status 404 returned error can't find the container with id f82923b6a6e36a6ae1c07f5593e23743b02a7a8d9567394eaaae1e94a4601f94
Sep 11 14:16:58.820116 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:58.820077    2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition
Sep 11 14:16:58.820116 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:58.820100    2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: failed to sync secret cache: timed out waiting for the condition
Sep 11 14:16:58.820427 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:58.820080    2582 configmap.go:193] Couldn't get configMap openshift-monitoring/kube-state-metrics-custom-resource-state-configmap: failed to sync configmap cache: timed out waiting for the condition
Sep 11 14:16:58.820427 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:58.820183    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-kube-rbac-proxy-config podName:c60380da-d7cf-4c61-8955-ec4bd09a82ff nodeName:}" failed. No retries permitted until 2026-09-11 14:16:59.320161124 +0000 UTC m=+116.352595965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-kube-rbac-proxy-config") pod "kube-state-metrics-59fbdd77d-mtdt4" (UID: "c60380da-d7cf-4c61-8955-ec4bd09a82ff") : failed to sync secret cache: timed out waiting for the condition
Sep 11 14:16:58.820427 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:58.820225    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-tls podName:c60380da-d7cf-4c61-8955-ec4bd09a82ff nodeName:}" failed. No retries permitted until 2026-09-11 14:16:59.320207096 +0000 UTC m=+116.352641935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-mtdt4" (UID: "c60380da-d7cf-4c61-8955-ec4bd09a82ff") : failed to sync secret cache: timed out waiting for the condition
Sep 11 14:16:58.820427 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:16:58.820245    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-custom-resource-state-configmap podName:c60380da-d7cf-4c61-8955-ec4bd09a82ff nodeName:}" failed. No retries permitted until 2026-09-11 14:16:59.32023568 +0000 UTC m=+116.352670521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-custom-resource-state-configmap" (UniqueName: "kubernetes.io/configmap/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-custom-resource-state-configmap") pod "kube-state-metrics-59fbdd77d-mtdt4" (UID: "c60380da-d7cf-4c61-8955-ec4bd09a82ff") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 14:16:58.835274 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:58.835242    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nfvkt\""
Sep 11 14:16:58.862350 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:58.862323    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 14:16:59.001239 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:59.001204    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 14:16:59.056744 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:59.056697    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7w292" event={"ID":"39354256-f81b-4c10-8854-f3fdb2f75e9f","Type":"ContainerStarted","Data":"f82923b6a6e36a6ae1c07f5593e23743b02a7a8d9567394eaaae1e94a4601f94"}
Sep 11 14:16:59.265233 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:59.265196    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 14:16:59.337230 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:59.337188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:59.337403 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:59.337266    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:59.337403 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:59.337354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:59.338057 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:59.338014    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:59.340114 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:59.340083    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:59.340350 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:59.340323    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c60380da-d7cf-4c61-8955-ec4bd09a82ff-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-mtdt4\" (UID: \"c60380da-d7cf-4c61-8955-ec4bd09a82ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:59.467333 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:59.467297    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"
Sep 11 14:16:59.884468 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:16:59.884376    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4"]
Sep 11 14:16:59.898211 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:16:59.898177    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60380da_d7cf_4c61_8955_ec4bd09a82ff.slice/crio-1310076bbd913dbae4bca6a8dffe30f0379c5144dac4b416efa32dd30b44a623 WatchSource:0}: Error finding container 1310076bbd913dbae4bca6a8dffe30f0379c5144dac4b416efa32dd30b44a623: Status 404 returned error can't find the container with id 1310076bbd913dbae4bca6a8dffe30f0379c5144dac4b416efa32dd30b44a623
Sep 11 14:17:00.062765 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.062727    2582 generic.go:356] "Generic (PLEG): container finished" podID="39354256-f81b-4c10-8854-f3fdb2f75e9f" containerID="524e5071817ba60c705caa169b94a385180032ad5a974cc39ba3fc5d196eeecd" exitCode=0
Sep 11 14:17:00.062952 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.062815    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7w292" event={"ID":"39354256-f81b-4c10-8854-f3fdb2f75e9f","Type":"ContainerDied","Data":"524e5071817ba60c705caa169b94a385180032ad5a974cc39ba3fc5d196eeecd"}
Sep 11 14:17:00.064511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.064481    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4" event={"ID":"c60380da-d7cf-4c61-8955-ec4bd09a82ff","Type":"ContainerStarted","Data":"1310076bbd913dbae4bca6a8dffe30f0379c5144dac4b416efa32dd30b44a623"}
Sep 11 14:17:00.392580 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.392454    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:17:00.667947 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.665999    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"]
Sep 11 14:17:00.684556 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.684521    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.691397 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.691366    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4gnnc\""
Sep 11 14:17:00.691724 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.691703    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 11 14:17:00.694217 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.692116    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 11 14:17:00.694217 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.693796    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 11 14:17:00.694217 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.693932    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 11 14:17:00.694667 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.694544    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-homiscpigt3l\""
Sep 11 14:17:00.707021 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.706994    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"]
Sep 11 14:17:00.708501 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.708300    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 11 14:17:00.750438 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.750402    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.750695 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.750538    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-tls\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.750695 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.750615    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-metrics-client-ca\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.750695 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.750650    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.750695 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.750680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.750908 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.750708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv2vt\" (UniqueName: \"kubernetes.io/projected/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-kube-api-access-gv2vt\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.750908 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.750813    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-grpc-tls\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.750908 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.750861    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.851522 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.851471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-metrics-client-ca\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.851736 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.851547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.851736 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.851584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.851736 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.851614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv2vt\" (UniqueName: \"kubernetes.io/projected/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-kube-api-access-gv2vt\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.851736 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.851687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-grpc-tls\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.852013 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.851749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.852013 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.851783    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.852013 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.851887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-tls\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.852456 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.852333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-metrics-client-ca\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.854910 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.854860    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.855563 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.855539    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-grpc-tls\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.855972 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.855951    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.858582 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.858532    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.859062 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.859021    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.859514 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.859495    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-secret-thanos-querier-tls\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.874396 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.874370    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv2vt\" (UniqueName: \"kubernetes.io/projected/2a8b5c05-2111-49ce-9abb-a5cbb70e604c-kube-api-access-gv2vt\") pod \"thanos-querier-6d49ddb4b7-p7nqk\" (UID: \"2a8b5c05-2111-49ce-9abb-a5cbb70e604c\") " pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:00.998315 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:00.998064    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:01.072989 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:01.072938    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7w292" event={"ID":"39354256-f81b-4c10-8854-f3fdb2f75e9f","Type":"ContainerStarted","Data":"678a9111db3c6b24acdf97d99146683a28cd906a49abe127bea2cb0d7c18c73c"}
Sep 11 14:17:01.073232 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:01.073004    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7w292" event={"ID":"39354256-f81b-4c10-8854-f3fdb2f75e9f","Type":"ContainerStarted","Data":"603acd907886892e8df213a25710c614601e848d794ba9ef5faf3b548d75c531"}
Sep 11 14:17:01.107657 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:01.107598    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7w292" podStartSLOduration=2.524410783 podStartE2EDuration="4.107578847s" totalImagesPullingTime="1.483614581s" totalInitContainerRuntime="99.553483ms" isStatefulPod=true podCreationTimestamp="2026-09-11 14:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:17:01.106932639 +0000 UTC m=+118.139367525" watchObservedRunningTime="2026-09-11 14:17:01.107578847 +0000 UTC m=+118.140013708"
Sep 11 14:17:01.599529 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:01.599490    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"]
Sep 11 14:17:01.643533 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:17:01.643500    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a8b5c05_2111_49ce_9abb_a5cbb70e604c.slice/crio-fb64c3a83b0e10499ba9c3e66f40241a51bd7ec8861431a529b8ec78365221bb WatchSource:0}: Error finding container fb64c3a83b0e10499ba9c3e66f40241a51bd7ec8861431a529b8ec78365221bb: Status 404 returned error can't find the container with id fb64c3a83b0e10499ba9c3e66f40241a51bd7ec8861431a529b8ec78365221bb
Sep 11 14:17:01.956107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:01.956009    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-r975q"]
Sep 11 14:17:01.983385 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:01.983361    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-r975q"
Sep 11 14:17:02.016060 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.015855    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6qjsd\""
Sep 11 14:17:02.016060 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.015922    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 14:17:02.016608 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.016586    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-r975q"]
Sep 11 14:17:02.064976 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.064941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0326bcf1-cd37-438a-ba32-45d073adbeca-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-r975q\" (UID: \"0326bcf1-cd37-438a-ba32-45d073adbeca\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-r975q"
Sep 11 14:17:02.065181 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.065122    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc8v2\" (UniqueName: \"kubernetes.io/projected/0326bcf1-cd37-438a-ba32-45d073adbeca-kube-api-access-cc8v2\") pod \"monitoring-plugin-5d85778b9d-r975q\" (UID: \"0326bcf1-cd37-438a-ba32-45d073adbeca\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-r975q"
Sep 11 14:17:02.080139 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.080099    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk" event={"ID":"2a8b5c05-2111-49ce-9abb-a5cbb70e604c","Type":"ContainerStarted","Data":"fb64c3a83b0e10499ba9c3e66f40241a51bd7ec8861431a529b8ec78365221bb"}
Sep 11 14:17:02.087011 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.086881    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4" event={"ID":"c60380da-d7cf-4c61-8955-ec4bd09a82ff","Type":"ContainerStarted","Data":"d29b8112138d0e3e3f8a7992223cc0d5df9ac7d3398eb4469fc07a783aa2e7dc"}
Sep 11 14:17:02.087011 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.086937    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4" event={"ID":"c60380da-d7cf-4c61-8955-ec4bd09a82ff","Type":"ContainerStarted","Data":"9e838fb94cf83a03ace804d3142887988fdf1425f1aeaade177d7a17a4de384e"}
Sep 11 14:17:02.087011 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.086965    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4" event={"ID":"c60380da-d7cf-4c61-8955-ec4bd09a82ff","Type":"ContainerStarted","Data":"e6835c1226e57d041e1fa69dd1176444979ccee377c383bfffdb02029720cc97"}
Sep 11 14:17:02.144122 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.143992    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mtdt4" podStartSLOduration=3.367725844 podStartE2EDuration="5.143967832s" totalImagesPullingTime="1.776241988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:17:02.143744729 +0000 UTC m=+119.176179594" watchObservedRunningTime="2026-09-11 14:17:02.143967832 +0000 UTC m=+119.176402692"
Sep 11 14:17:02.166207 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.166171    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0326bcf1-cd37-438a-ba32-45d073adbeca-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-r975q\" (UID: \"0326bcf1-cd37-438a-ba32-45d073adbeca\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-r975q"
Sep 11 14:17:02.166444 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.166413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc8v2\" (UniqueName: \"kubernetes.io/projected/0326bcf1-cd37-438a-ba32-45d073adbeca-kube-api-access-cc8v2\") pod \"monitoring-plugin-5d85778b9d-r975q\" (UID: \"0326bcf1-cd37-438a-ba32-45d073adbeca\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-r975q"
Sep 11 14:17:02.170595 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.170498    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0326bcf1-cd37-438a-ba32-45d073adbeca-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-r975q\" (UID: \"0326bcf1-cd37-438a-ba32-45d073adbeca\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-r975q"
Sep 11 14:17:02.187709 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.187629    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc8v2\" (UniqueName: \"kubernetes.io/projected/0326bcf1-cd37-438a-ba32-45d073adbeca-kube-api-access-cc8v2\") pod \"monitoring-plugin-5d85778b9d-r975q\" (UID: \"0326bcf1-cd37-438a-ba32-45d073adbeca\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-r975q"
Sep 11 14:17:02.293431 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.293396    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-r975q"
Sep 11 14:17:02.642443 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:17:02.642406    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0326bcf1_cd37_438a_ba32_45d073adbeca.slice/crio-142d8f04f95203dbb8faa7e1cc8c54af0f45a84edd2c4f5f1952b98fa76e7389 WatchSource:0}: Error finding container 142d8f04f95203dbb8faa7e1cc8c54af0f45a84edd2c4f5f1952b98fa76e7389: Status 404 returned error can't find the container with id 142d8f04f95203dbb8faa7e1cc8c54af0f45a84edd2c4f5f1952b98fa76e7389
Sep 11 14:17:02.643923 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:02.643895    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-r975q"]
Sep 11 14:17:03.026322 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:03.026290    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ck8m8"
Sep 11 14:17:03.092890 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:03.092857    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-r975q" event={"ID":"0326bcf1-cd37-438a-ba32-45d073adbeca","Type":"ContainerStarted","Data":"142d8f04f95203dbb8faa7e1cc8c54af0f45a84edd2c4f5f1952b98fa76e7389"}
Sep 11 14:17:04.098181 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:04.098144    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk" event={"ID":"2a8b5c05-2111-49ce-9abb-a5cbb70e604c","Type":"ContainerStarted","Data":"339e73280586d3b20d0f5265aa43c9310c200d55d58aa446c1659ff8662318e9"}
Sep 11 14:17:04.098535 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:04.098212    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk" event={"ID":"2a8b5c05-2111-49ce-9abb-a5cbb70e604c","Type":"ContainerStarted","Data":"b37bc527669c779cac7e00f4799db55bd5f7684059f20de84ccead3dd9d085b3"}
Sep 11 14:17:05.104608 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:05.104574    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk" event={"ID":"2a8b5c05-2111-49ce-9abb-a5cbb70e604c","Type":"ContainerStarted","Data":"531facba90e9b263498ae70458fdd8852136b1db428f1bbaa3e21adc70cb8952"}
Sep 11 14:17:05.106158 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:05.106127    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-r975q" event={"ID":"0326bcf1-cd37-438a-ba32-45d073adbeca","Type":"ContainerStarted","Data":"0e2507fce734aae46f357e362c79fcf676f1440ede3c74b35c2cefb545e5325b"}
Sep 11 14:17:05.106279 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:05.106265    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-r975q"
Sep 11 14:17:05.110968 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:05.110948    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-r975q"
Sep 11 14:17:05.132280 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:05.132189    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-r975q" podStartSLOduration=1.9017662789999998 podStartE2EDuration="4.132168449s" totalImagesPullingTime="2.23040217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:17:05.130740794 +0000 UTC m=+122.163175655" watchObservedRunningTime="2026-09-11 14:17:05.132168449 +0000 UTC m=+122.164603308"
Sep 11 14:17:06.117787 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:06.117710    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk" event={"ID":"2a8b5c05-2111-49ce-9abb-a5cbb70e604c","Type":"ContainerStarted","Data":"a6535150a014bab3668bc62241bb04ce3166391ca62a457f2e1bbbfd8609accb"}
Sep 11 14:17:06.118247 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:06.117823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk" event={"ID":"2a8b5c05-2111-49ce-9abb-a5cbb70e604c","Type":"ContainerStarted","Data":"9ebddf2bb25e4b1bce87ae2e7ed2b550601bba23e14d4bdd3069a1971c7b8cfd"}
Sep 11 14:17:07.124900 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:07.124861    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk" event={"ID":"2a8b5c05-2111-49ce-9abb-a5cbb70e604c","Type":"ContainerStarted","Data":"651e2f0a5587a05d5fbdbda6855dd9198ebad93b6a52fc51611865c3407ce530"}
Sep 11 14:17:08.128967 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:08.128932    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:09.139403 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:09.139375    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk"
Sep 11 14:17:09.201358 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:09.201309    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d49ddb4b7-p7nqk" podStartSLOduration=5.825825616 podStartE2EDuration="9.201292742s" totalImagesPullingTime="3.375467126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:17:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:17:07.168274091 +0000 UTC m=+124.200708951" watchObservedRunningTime="2026-09-11 14:17:09.201292742 +0000 UTC m=+126.233727603"
Sep 11 14:17:12.258530 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:12.258477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs\") pod \"network-metrics-daemon-n28zt\" (UID: \"97841560-b854-400b-8866-6df5111b9230\") " pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:17:12.261072 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:12.261029    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97841560-b854-400b-8866-6df5111b9230-metrics-certs\") pod \"network-metrics-daemon-n28zt\" (UID: \"97841560-b854-400b-8866-6df5111b9230\") " pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:17:12.303271 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:12.303247    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lrm6v\""
Sep 11 14:17:12.310413 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:12.310393    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n28zt"
Sep 11 14:17:12.625449 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:12.625375    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n28zt"]
Sep 11 14:17:12.628349 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:17:12.628306    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97841560_b854_400b_8866_6df5111b9230.slice/crio-4de0972011edce63779c00166f93303e70ac9cfd46d16db90e62b16a556df903 WatchSource:0}: Error finding container 4de0972011edce63779c00166f93303e70ac9cfd46d16db90e62b16a556df903: Status 404 returned error can't find the container with id 4de0972011edce63779c00166f93303e70ac9cfd46d16db90e62b16a556df903
Sep 11 14:17:13.149081 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:13.149023    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n28zt" event={"ID":"97841560-b854-400b-8866-6df5111b9230","Type":"ContainerStarted","Data":"4de0972011edce63779c00166f93303e70ac9cfd46d16db90e62b16a556df903"}
Sep 11 14:17:13.891474 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:13.891426    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b7499df47-dqdgk"]
Sep 11 14:17:14.156010 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:14.155979    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n28zt" event={"ID":"97841560-b854-400b-8866-6df5111b9230","Type":"ContainerStarted","Data":"fe8d2f351cb465a5d62106c483a333534025a43315e7e04aafa58b95434aeca8"}
Sep 11 14:17:15.161859 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:15.161818    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n28zt" event={"ID":"97841560-b854-400b-8866-6df5111b9230","Type":"ContainerStarted","Data":"4d4b6974f37a2b515064922069b6e467415470f060e4a7b61cbab35a36ff235e"}
Sep 11 14:17:15.198572 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:15.194768    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n28zt" podStartSLOduration=130.881783796 podStartE2EDuration="2m12.194738282s" totalImagesPullingTime="1.312954486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:17:15.19264525 +0000 UTC m=+132.225080109" watchObservedRunningTime="2026-09-11 14:17:15.194738282 +0000 UTC m=+132.227173142"
Sep 11 14:17:16.167432 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:16.167395    2582 generic.go:356] "Generic (PLEG): container finished" podID="e74eccd2-29ac-4aca-b61d-9b023b24269f" containerID="014294f37a47233593cb4b585f4597330690676c591f98b276ad9ebe6e3436b2" exitCode=0
Sep 11 14:17:16.167810 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:16.167472    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p" event={"ID":"e74eccd2-29ac-4aca-b61d-9b023b24269f","Type":"ContainerDied","Data":"014294f37a47233593cb4b585f4597330690676c591f98b276ad9ebe6e3436b2"}
Sep 11 14:17:16.167856 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:16.167825    2582 scope.go:117] "RemoveContainer" containerID="014294f37a47233593cb4b585f4597330690676c591f98b276ad9ebe6e3436b2"
Sep 11 14:17:17.172837 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:17.172800    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9sc4p" event={"ID":"e74eccd2-29ac-4aca-b61d-9b023b24269f","Type":"ContainerStarted","Data":"e33234db2c9068be79357dc67c929255ada9b48a5e166aa81caec688a32b948d"}
Sep 11 14:17:22.284350 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.284306    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b86cdb77-5xbl4" podUID="7127b4a1-6a6f-4997-bc00-edd9458639ef" containerName="console" containerID="cri-o://def1b3886b6b4d937dee37709a4d0e6f9a72a5c850111e81be57a49789735603" gracePeriod=15
Sep 11 14:17:22.562882 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.562810    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:17:22.652946 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.652913    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-config\") pod \"7127b4a1-6a6f-4997-bc00-edd9458639ef\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") "
Sep 11 14:17:22.652946 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.652953    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-serving-cert\") pod \"7127b4a1-6a6f-4997-bc00-edd9458639ef\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") "
Sep 11 14:17:22.653197 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.652994    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-service-ca\") pod \"7127b4a1-6a6f-4997-bc00-edd9458639ef\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") "
Sep 11 14:17:22.653197 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.653023    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-oauth-serving-cert\") pod \"7127b4a1-6a6f-4997-bc00-edd9458639ef\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") "
Sep 11 14:17:22.653197 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.653176    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-oauth-config\") pod \"7127b4a1-6a6f-4997-bc00-edd9458639ef\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") "
Sep 11 14:17:22.653347 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.653231    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stnch\" (UniqueName: \"kubernetes.io/projected/7127b4a1-6a6f-4997-bc00-edd9458639ef-kube-api-access-stnch\") pod \"7127b4a1-6a6f-4997-bc00-edd9458639ef\" (UID: \"7127b4a1-6a6f-4997-bc00-edd9458639ef\") "
Sep 11 14:17:22.653398 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.653369    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-config" (OuterVolumeSpecName: "console-config") pod "7127b4a1-6a6f-4997-bc00-edd9458639ef" (UID: "7127b4a1-6a6f-4997-bc00-edd9458639ef"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:17:22.653501 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.653477    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7127b4a1-6a6f-4997-bc00-edd9458639ef" (UID: "7127b4a1-6a6f-4997-bc00-edd9458639ef"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:17:22.653565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.653515    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-config\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:17:22.653675 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.653652    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-service-ca" (OuterVolumeSpecName: "service-ca") pod "7127b4a1-6a6f-4997-bc00-edd9458639ef" (UID: "7127b4a1-6a6f-4997-bc00-edd9458639ef"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:17:22.655448 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.655417    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7127b4a1-6a6f-4997-bc00-edd9458639ef-kube-api-access-stnch" (OuterVolumeSpecName: "kube-api-access-stnch") pod "7127b4a1-6a6f-4997-bc00-edd9458639ef" (UID: "7127b4a1-6a6f-4997-bc00-edd9458639ef"). InnerVolumeSpecName "kube-api-access-stnch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:17:22.655448 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.655434    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7127b4a1-6a6f-4997-bc00-edd9458639ef" (UID: "7127b4a1-6a6f-4997-bc00-edd9458639ef"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:17:22.655614 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.655452    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7127b4a1-6a6f-4997-bc00-edd9458639ef" (UID: "7127b4a1-6a6f-4997-bc00-edd9458639ef"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:17:22.754086 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.754030    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-serving-cert\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:17:22.754086 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.754080    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:17:22.754086 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.754089    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7127b4a1-6a6f-4997-bc00-edd9458639ef-oauth-serving-cert\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:17:22.754301 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.754099    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7127b4a1-6a6f-4997-bc00-edd9458639ef-console-oauth-config\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:17:22.754301 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:22.754109    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stnch\" (UniqueName: \"kubernetes.io/projected/7127b4a1-6a6f-4997-bc00-edd9458639ef-kube-api-access-stnch\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:17:23.199188 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:23.199146    2582 generic.go:356] "Generic (PLEG): container finished" podID="7127b4a1-6a6f-4997-bc00-edd9458639ef" containerID="def1b3886b6b4d937dee37709a4d0e6f9a72a5c850111e81be57a49789735603" exitCode=0
Sep 11 14:17:23.199188 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:23.199190    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b86cdb77-5xbl4"
Sep 11 14:17:23.199379 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:23.199188    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b86cdb77-5xbl4" event={"ID":"7127b4a1-6a6f-4997-bc00-edd9458639ef","Type":"ContainerDied","Data":"def1b3886b6b4d937dee37709a4d0e6f9a72a5c850111e81be57a49789735603"}
Sep 11 14:17:23.199379 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:23.199328    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b86cdb77-5xbl4" event={"ID":"7127b4a1-6a6f-4997-bc00-edd9458639ef","Type":"ContainerDied","Data":"061022e3b4c06a96b0c92a5e71eb7288552ba9f79fdeafd03830b6d03f33c8ae"}
Sep 11 14:17:23.199379 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:23.199358    2582 scope.go:117] "RemoveContainer" containerID="def1b3886b6b4d937dee37709a4d0e6f9a72a5c850111e81be57a49789735603"
Sep 11 14:17:23.208559 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:23.208541    2582 scope.go:117] "RemoveContainer" containerID="def1b3886b6b4d937dee37709a4d0e6f9a72a5c850111e81be57a49789735603"
Sep 11 14:17:23.208881 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:17:23.208860    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"def1b3886b6b4d937dee37709a4d0e6f9a72a5c850111e81be57a49789735603\": container with ID starting with def1b3886b6b4d937dee37709a4d0e6f9a72a5c850111e81be57a49789735603 not found: ID does not exist" containerID="def1b3886b6b4d937dee37709a4d0e6f9a72a5c850111e81be57a49789735603"
Sep 11 14:17:23.208942 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:23.208891    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"def1b3886b6b4d937dee37709a4d0e6f9a72a5c850111e81be57a49789735603"} err="failed to get container status \"def1b3886b6b4d937dee37709a4d0e6f9a72a5c850111e81be57a49789735603\": rpc error: code = NotFound desc = could not find container \"def1b3886b6b4d937dee37709a4d0e6f9a72a5c850111e81be57a49789735603\": container with ID starting with def1b3886b6b4d937dee37709a4d0e6f9a72a5c850111e81be57a49789735603 not found: ID does not exist"
Sep 11 14:17:23.224596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:23.224562    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b86cdb77-5xbl4"]
Sep 11 14:17:23.227077 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:23.227058    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b86cdb77-5xbl4"]
Sep 11 14:17:23.495088 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:23.494985    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7127b4a1-6a6f-4997-bc00-edd9458639ef" path="/var/lib/kubelet/pods/7127b4a1-6a6f-4997-bc00-edd9458639ef/volumes"
Sep 11 14:17:26.213049 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:26.212999    2582 generic.go:356] "Generic (PLEG): container finished" podID="6d2c7403-c974-4e6d-b59c-3f59341c8b77" containerID="1a53a2a54480a277ab9e57b9cd2040f3f4224aa7548ae530133e87772ba7e99a" exitCode=0
Sep 11 14:17:26.213509 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:26.213066    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-pjw5x" event={"ID":"6d2c7403-c974-4e6d-b59c-3f59341c8b77","Type":"ContainerDied","Data":"1a53a2a54480a277ab9e57b9cd2040f3f4224aa7548ae530133e87772ba7e99a"}
Sep 11 14:17:26.213509 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:26.213405    2582 scope.go:117] "RemoveContainer" containerID="1a53a2a54480a277ab9e57b9cd2040f3f4224aa7548ae530133e87772ba7e99a"
Sep 11 14:17:27.219012 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:27.218977    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-pjw5x" event={"ID":"6d2c7403-c974-4e6d-b59c-3f59341c8b77","Type":"ContainerStarted","Data":"c727ba5e0ac789681716e44e544b5960f60c26dbcbaa8150f1c15b6fa0cf1f20"}
Sep 11 14:17:38.911142 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:38.911075    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b7499df47-dqdgk" podUID="460375f8-a101-40f6-93fe-f072f433d368" containerName="console" containerID="cri-o://a036ab71161a9252b78f50c9c8337656cb6d871260d547cfb00a939e7c636576" gracePeriod=15
Sep 11 14:17:39.239565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.239528    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:17:39.277298 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.277252    2582 generic.go:356] "Generic (PLEG): container finished" podID="460375f8-a101-40f6-93fe-f072f433d368" containerID="a036ab71161a9252b78f50c9c8337656cb6d871260d547cfb00a939e7c636576" exitCode=0
Sep 11 14:17:39.277446 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.277339    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7499df47-dqdgk" event={"ID":"460375f8-a101-40f6-93fe-f072f433d368","Type":"ContainerDied","Data":"a036ab71161a9252b78f50c9c8337656cb6d871260d547cfb00a939e7c636576"}
Sep 11 14:17:39.277446 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.277356    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7499df47-dqdgk"
Sep 11 14:17:39.277446 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.277395    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7499df47-dqdgk" event={"ID":"460375f8-a101-40f6-93fe-f072f433d368","Type":"ContainerDied","Data":"61e5bbbd2354fc7603d4e35a8df800bec030900172b358d6b2968219d3778cd5"}
Sep 11 14:17:39.277446 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.277431    2582 scope.go:117] "RemoveContainer" containerID="a036ab71161a9252b78f50c9c8337656cb6d871260d547cfb00a939e7c636576"
Sep 11 14:17:39.286083 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.286061    2582 scope.go:117] "RemoveContainer" containerID="a036ab71161a9252b78f50c9c8337656cb6d871260d547cfb00a939e7c636576"
Sep 11 14:17:39.286406 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:17:39.286387    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a036ab71161a9252b78f50c9c8337656cb6d871260d547cfb00a939e7c636576\": container with ID starting with a036ab71161a9252b78f50c9c8337656cb6d871260d547cfb00a939e7c636576 not found: ID does not exist" containerID="a036ab71161a9252b78f50c9c8337656cb6d871260d547cfb00a939e7c636576"
Sep 11 14:17:39.286456 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.286416    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a036ab71161a9252b78f50c9c8337656cb6d871260d547cfb00a939e7c636576"} err="failed to get container status \"a036ab71161a9252b78f50c9c8337656cb6d871260d547cfb00a939e7c636576\": rpc error: code = NotFound desc = could not find container \"a036ab71161a9252b78f50c9c8337656cb6d871260d547cfb00a939e7c636576\": container with ID starting with a036ab71161a9252b78f50c9c8337656cb6d871260d547cfb00a939e7c636576 not found: ID does not exist"
Sep 11 14:17:39.292670 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.292649    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/460375f8-a101-40f6-93fe-f072f433d368-console-oauth-config\") pod \"460375f8-a101-40f6-93fe-f072f433d368\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") "
Sep 11 14:17:39.292795 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.292690    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-console-config\") pod \"460375f8-a101-40f6-93fe-f072f433d368\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") "
Sep 11 14:17:39.292795 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.292723    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-trusted-ca-bundle\") pod \"460375f8-a101-40f6-93fe-f072f433d368\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") "
Sep 11 14:17:39.292795 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.292759    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-oauth-serving-cert\") pod \"460375f8-a101-40f6-93fe-f072f433d368\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") "
Sep 11 14:17:39.292948 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.292797    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p26w\" (UniqueName: \"kubernetes.io/projected/460375f8-a101-40f6-93fe-f072f433d368-kube-api-access-9p26w\") pod \"460375f8-a101-40f6-93fe-f072f433d368\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") "
Sep 11 14:17:39.292948 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.292819    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/460375f8-a101-40f6-93fe-f072f433d368-console-serving-cert\") pod \"460375f8-a101-40f6-93fe-f072f433d368\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") "
Sep 11 14:17:39.292948 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.292844    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-service-ca\") pod \"460375f8-a101-40f6-93fe-f072f433d368\" (UID: \"460375f8-a101-40f6-93fe-f072f433d368\") "
Sep 11 14:17:39.293141 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.293118    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-console-config" (OuterVolumeSpecName: "console-config") pod "460375f8-a101-40f6-93fe-f072f433d368" (UID: "460375f8-a101-40f6-93fe-f072f433d368"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:17:39.293232 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.293203    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "460375f8-a101-40f6-93fe-f072f433d368" (UID: "460375f8-a101-40f6-93fe-f072f433d368"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:17:39.293469 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.293425    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-service-ca" (OuterVolumeSpecName: "service-ca") pod "460375f8-a101-40f6-93fe-f072f433d368" (UID: "460375f8-a101-40f6-93fe-f072f433d368"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:17:39.293620 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.293474    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "460375f8-a101-40f6-93fe-f072f433d368" (UID: "460375f8-a101-40f6-93fe-f072f433d368"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:17:39.295225 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.295194    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/460375f8-a101-40f6-93fe-f072f433d368-kube-api-access-9p26w" (OuterVolumeSpecName: "kube-api-access-9p26w") pod "460375f8-a101-40f6-93fe-f072f433d368" (UID: "460375f8-a101-40f6-93fe-f072f433d368"). InnerVolumeSpecName "kube-api-access-9p26w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:17:39.295321 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.295253    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/460375f8-a101-40f6-93fe-f072f433d368-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "460375f8-a101-40f6-93fe-f072f433d368" (UID: "460375f8-a101-40f6-93fe-f072f433d368"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:17:39.295321 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.295282    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/460375f8-a101-40f6-93fe-f072f433d368-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "460375f8-a101-40f6-93fe-f072f433d368" (UID: "460375f8-a101-40f6-93fe-f072f433d368"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:17:39.394356 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.394319    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/460375f8-a101-40f6-93fe-f072f433d368-console-oauth-config\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:17:39.394356 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.394358    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-console-config\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:17:39.394544 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.394371    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-trusted-ca-bundle\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:17:39.394544 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.394382    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-oauth-serving-cert\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:17:39.394544 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.394391    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p26w\" (UniqueName: \"kubernetes.io/projected/460375f8-a101-40f6-93fe-f072f433d368-kube-api-access-9p26w\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:17:39.394544 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.394400    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/460375f8-a101-40f6-93fe-f072f433d368-console-serving-cert\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:17:39.394544 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.394411    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/460375f8-a101-40f6-93fe-f072f433d368-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:17:39.593270 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.593235    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b7499df47-dqdgk"]
Sep 11 14:17:39.595799 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:39.595772    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b7499df47-dqdgk"]
Sep 11 14:17:41.493675 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:17:41.493641    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="460375f8-a101-40f6-93fe-f072f433d368" path="/var/lib/kubelet/pods/460375f8-a101-40f6-93fe-f072f433d368/volumes"
Sep 11 14:20:03.401466 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:20:03.401439    2582 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 14:22:10.822816 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.822781    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-867d4645b5-vtkd2"]
Sep 11 14:22:10.823437 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.823231    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7127b4a1-6a6f-4997-bc00-edd9458639ef" containerName="console"
Sep 11 14:22:10.823437 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.823250    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7127b4a1-6a6f-4997-bc00-edd9458639ef" containerName="console"
Sep 11 14:22:10.823437 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.823268    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460375f8-a101-40f6-93fe-f072f433d368" containerName="console"
Sep 11 14:22:10.823437 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.823276    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="460375f8-a101-40f6-93fe-f072f433d368" containerName="console"
Sep 11 14:22:10.823437 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.823366    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7127b4a1-6a6f-4997-bc00-edd9458639ef" containerName="console"
Sep 11 14:22:10.823437 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.823377    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="460375f8-a101-40f6-93fe-f072f433d368" containerName="console"
Sep 11 14:22:10.828608 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.828568    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:10.831673 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.831652    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 14:22:10.831673 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.831662    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 14:22:10.831860 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.831730    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 14:22:10.832235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.832221    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jlnkm\""
Sep 11 14:22:10.832438 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.832422    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 14:22:10.832841 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.832827    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 14:22:10.837845 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.837828    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 14:22:10.840292 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:10.840269    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867d4645b5-vtkd2"]
Sep 11 14:22:11.006877 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.006833    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx76v\" (UniqueName: \"kubernetes.io/projected/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-kube-api-access-tx76v\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.007074 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.006888    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-oauth-serving-cert\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.007074 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.006961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-config\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.007074 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.007009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-trusted-ca-bundle\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.007180 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.007094    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-serving-cert\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.007180 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.007121    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-oauth-config\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.007245 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.007194    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-service-ca\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.107801 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.107699    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-serving-cert\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.107801 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.107742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-oauth-config\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.107801 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.107768    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-service-ca\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.108130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.107827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx76v\" (UniqueName: \"kubernetes.io/projected/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-kube-api-access-tx76v\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.108130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.107857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-oauth-serving-cert\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.108130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.107892    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-config\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.108130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.107930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-trusted-ca-bundle\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.108639 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.108611    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-service-ca\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.108774 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.108611    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-oauth-serving-cert\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.109072 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.109025    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-config\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.109169 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.109147    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-trusted-ca-bundle\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.110939 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.110893    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-serving-cert\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.112677 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.112654    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-oauth-config\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.119223 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.119197    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx76v\" (UniqueName: \"kubernetes.io/projected/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-kube-api-access-tx76v\") pod \"console-867d4645b5-vtkd2\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") " pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.139161 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.139136    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:11.438070 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:11.438015    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867d4645b5-vtkd2"]
Sep 11 14:22:11.441210 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:22:11.441174    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267a4af1_dd8d_4aa5_9e76_a8cb04c06c27.slice/crio-7dfad38c87079227ceec3ce584e47060e8bc0c1c68ba00eece1f0cf96a50ee54 WatchSource:0}: Error finding container 7dfad38c87079227ceec3ce584e47060e8bc0c1c68ba00eece1f0cf96a50ee54: Status 404 returned error can't find the container with id 7dfad38c87079227ceec3ce584e47060e8bc0c1c68ba00eece1f0cf96a50ee54
Sep 11 14:22:12.282194 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:12.282159    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d4645b5-vtkd2" event={"ID":"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27","Type":"ContainerStarted","Data":"3bd26f714878171dd8e19d8194e571a23f65cb489b611ddf1337422e5432d823"}
Sep 11 14:22:12.282579 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:12.282204    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d4645b5-vtkd2" event={"ID":"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27","Type":"ContainerStarted","Data":"7dfad38c87079227ceec3ce584e47060e8bc0c1c68ba00eece1f0cf96a50ee54"}
Sep 11 14:22:21.139606 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:21.139551    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:21.140022 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:21.139627    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:21.144679 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:21.144655    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:22:21.173684 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:21.173625    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-867d4645b5-vtkd2" podStartSLOduration=11.173602831 podStartE2EDuration="11.173602831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:22:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:22:12.31481528 +0000 UTC m=+429.347250138" watchObservedRunningTime="2026-09-11 14:22:21.173602831 +0000 UTC m=+438.206037751"
Sep 11 14:22:21.324535 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:22:21.324503    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:23:31.545015 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.544982    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fcfb4f5f6-vmqx6"]
Sep 11 14:23:31.548238 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.548212    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.586766 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.586741    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fcfb4f5f6-vmqx6"]
Sep 11 14:23:31.651506 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.651476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-oauth-config\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.651683 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.651536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-service-ca\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.651683 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.651586    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-oauth-serving-cert\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.651683 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.651649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-config\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.651849 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.651684    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj84p\" (UniqueName: \"kubernetes.io/projected/91675628-8d74-491b-8b9e-1bf6abdb4dbd-kube-api-access-sj84p\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.651849 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.651712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-serving-cert\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.651849 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.651738    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-trusted-ca-bundle\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.753015 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.752985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj84p\" (UniqueName: \"kubernetes.io/projected/91675628-8d74-491b-8b9e-1bf6abdb4dbd-kube-api-access-sj84p\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.753015 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.753019    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-serving-cert\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.753275 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.753051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-trusted-ca-bundle\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.753275 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.753102    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-oauth-config\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.753275 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.753134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-service-ca\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.753275 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.753154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-oauth-serving-cert\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.753275 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.753192    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-config\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.753928 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.753901    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-oauth-serving-cert\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.754059 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.753957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-config\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.754059 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.753978    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-service-ca\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.754569 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.754546    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-trusted-ca-bundle\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.755503 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.755480    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-oauth-config\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.755757 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.755741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-serving-cert\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.765888 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.765867    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj84p\" (UniqueName: \"kubernetes.io/projected/91675628-8d74-491b-8b9e-1bf6abdb4dbd-kube-api-access-sj84p\") pod \"console-7fcfb4f5f6-vmqx6\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") " pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:31.857307 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:31.857212    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:32.209102 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:32.209069    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fcfb4f5f6-vmqx6"]
Sep 11 14:23:32.212024 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:23:32.211998    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91675628_8d74_491b_8b9e_1bf6abdb4dbd.slice/crio-bc6bd445c33fac4b31eb5ddc90909c89f9ddd88f72114e31ac769bbcb707eb97 WatchSource:0}: Error finding container bc6bd445c33fac4b31eb5ddc90909c89f9ddd88f72114e31ac769bbcb707eb97: Status 404 returned error can't find the container with id bc6bd445c33fac4b31eb5ddc90909c89f9ddd88f72114e31ac769bbcb707eb97
Sep 11 14:23:32.593595 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:32.593511    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fcfb4f5f6-vmqx6" event={"ID":"91675628-8d74-491b-8b9e-1bf6abdb4dbd","Type":"ContainerStarted","Data":"abedbd68fe779ab65865cd5d76ad2cf06a7da5a2fae34567e3431bc4d608ac4e"}
Sep 11 14:23:32.593595 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:32.593560    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fcfb4f5f6-vmqx6" event={"ID":"91675628-8d74-491b-8b9e-1bf6abdb4dbd","Type":"ContainerStarted","Data":"bc6bd445c33fac4b31eb5ddc90909c89f9ddd88f72114e31ac769bbcb707eb97"}
Sep 11 14:23:41.858318 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:41.858277    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:41.858709 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:41.858329    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:41.863830 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:41.863806    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:41.897747 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:41.897703    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fcfb4f5f6-vmqx6" podStartSLOduration=10.897689367 podStartE2EDuration="10.897689367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:23:33.604160282 +0000 UTC m=+510.636595141" watchObservedRunningTime="2026-09-11 14:23:41.897689367 +0000 UTC m=+518.930124227"
Sep 11 14:23:42.632787 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:42.632756    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:23:42.755892 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:23:42.755862    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-867d4645b5-vtkd2"]
Sep 11 14:24:07.774601 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:07.774488    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-867d4645b5-vtkd2" podUID="267a4af1-dd8d-4aa5-9e76-a8cb04c06c27" containerName="console" containerID="cri-o://3bd26f714878171dd8e19d8194e571a23f65cb489b611ddf1337422e5432d823" gracePeriod=15
Sep 11 14:24:08.015564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.015540    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:24:08.163339 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.163258    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-service-ca\") pod \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") "
Sep 11 14:24:08.163339 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.163320    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-serving-cert\") pod \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") "
Sep 11 14:24:08.163539 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.163344    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-trusted-ca-bundle\") pod \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") "
Sep 11 14:24:08.163539 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.163380    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-oauth-config\") pod \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") "
Sep 11 14:24:08.163539 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.163422    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx76v\" (UniqueName: \"kubernetes.io/projected/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-kube-api-access-tx76v\") pod \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") "
Sep 11 14:24:08.163539 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.163455    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-oauth-serving-cert\") pod \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") "
Sep 11 14:24:08.163539 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.163483    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-config\") pod \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\" (UID: \"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27\") "
Sep 11 14:24:08.163780 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.163711    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-service-ca" (OuterVolumeSpecName: "service-ca") pod "267a4af1-dd8d-4aa5-9e76-a8cb04c06c27" (UID: "267a4af1-dd8d-4aa5-9e76-a8cb04c06c27"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:24:08.163951 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.163913    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "267a4af1-dd8d-4aa5-9e76-a8cb04c06c27" (UID: "267a4af1-dd8d-4aa5-9e76-a8cb04c06c27"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:24:08.163951 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.163927    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "267a4af1-dd8d-4aa5-9e76-a8cb04c06c27" (UID: "267a4af1-dd8d-4aa5-9e76-a8cb04c06c27"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:24:08.164078 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.163969    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-config" (OuterVolumeSpecName: "console-config") pod "267a4af1-dd8d-4aa5-9e76-a8cb04c06c27" (UID: "267a4af1-dd8d-4aa5-9e76-a8cb04c06c27"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:24:08.165761 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.165735    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-kube-api-access-tx76v" (OuterVolumeSpecName: "kube-api-access-tx76v") pod "267a4af1-dd8d-4aa5-9e76-a8cb04c06c27" (UID: "267a4af1-dd8d-4aa5-9e76-a8cb04c06c27"). InnerVolumeSpecName "kube-api-access-tx76v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:24:08.166163 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.166143    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "267a4af1-dd8d-4aa5-9e76-a8cb04c06c27" (UID: "267a4af1-dd8d-4aa5-9e76-a8cb04c06c27"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:24:08.166163 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.166153    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "267a4af1-dd8d-4aa5-9e76-a8cb04c06c27" (UID: "267a4af1-dd8d-4aa5-9e76-a8cb04c06c27"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:24:08.264771 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.264717    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-serving-cert\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:24:08.264771 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.264761    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-trusted-ca-bundle\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:24:08.264771 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.264771    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-oauth-config\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:24:08.264771 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.264780    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx76v\" (UniqueName: \"kubernetes.io/projected/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-kube-api-access-tx76v\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:24:08.264771 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.264788    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-oauth-serving-cert\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:24:08.265099 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.264797    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-console-config\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:24:08.265099 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.264806    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:24:08.727163 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.727128    2582 generic.go:356] "Generic (PLEG): container finished" podID="267a4af1-dd8d-4aa5-9e76-a8cb04c06c27" containerID="3bd26f714878171dd8e19d8194e571a23f65cb489b611ddf1337422e5432d823" exitCode=0
Sep 11 14:24:08.727353 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.727171    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d4645b5-vtkd2"
Sep 11 14:24:08.727353 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.727195    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d4645b5-vtkd2" event={"ID":"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27","Type":"ContainerDied","Data":"3bd26f714878171dd8e19d8194e571a23f65cb489b611ddf1337422e5432d823"}
Sep 11 14:24:08.727353 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.727245    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d4645b5-vtkd2" event={"ID":"267a4af1-dd8d-4aa5-9e76-a8cb04c06c27","Type":"ContainerDied","Data":"7dfad38c87079227ceec3ce584e47060e8bc0c1c68ba00eece1f0cf96a50ee54"}
Sep 11 14:24:08.727353 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.727270    2582 scope.go:117] "RemoveContainer" containerID="3bd26f714878171dd8e19d8194e571a23f65cb489b611ddf1337422e5432d823"
Sep 11 14:24:08.736288 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.736272    2582 scope.go:117] "RemoveContainer" containerID="3bd26f714878171dd8e19d8194e571a23f65cb489b611ddf1337422e5432d823"
Sep 11 14:24:08.736574 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:24:08.736551    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd26f714878171dd8e19d8194e571a23f65cb489b611ddf1337422e5432d823\": container with ID starting with 3bd26f714878171dd8e19d8194e571a23f65cb489b611ddf1337422e5432d823 not found: ID does not exist" containerID="3bd26f714878171dd8e19d8194e571a23f65cb489b611ddf1337422e5432d823"
Sep 11 14:24:08.736665 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.736579    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd26f714878171dd8e19d8194e571a23f65cb489b611ddf1337422e5432d823"} err="failed to get container status \"3bd26f714878171dd8e19d8194e571a23f65cb489b611ddf1337422e5432d823\": rpc error: code = NotFound desc = could not find container \"3bd26f714878171dd8e19d8194e571a23f65cb489b611ddf1337422e5432d823\": container with ID starting with 3bd26f714878171dd8e19d8194e571a23f65cb489b611ddf1337422e5432d823 not found: ID does not exist"
Sep 11 14:24:08.755609 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.755587    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-867d4645b5-vtkd2"]
Sep 11 14:24:08.771218 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:08.771193    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-867d4645b5-vtkd2"]
Sep 11 14:24:09.493550 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:09.493509    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="267a4af1-dd8d-4aa5-9e76-a8cb04c06c27" path="/var/lib/kubelet/pods/267a4af1-dd8d-4aa5-9e76-a8cb04c06c27/volumes"
Sep 11 14:24:41.977607 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:41.977579    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"]
Sep 11 14:24:41.978100 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:41.977871    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="267a4af1-dd8d-4aa5-9e76-a8cb04c06c27" containerName="console"
Sep 11 14:24:41.978100 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:41.977881    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="267a4af1-dd8d-4aa5-9e76-a8cb04c06c27" containerName="console"
Sep 11 14:24:41.978100 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:41.977940    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="267a4af1-dd8d-4aa5-9e76-a8cb04c06c27" containerName="console"
Sep 11 14:24:41.980925 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:41.980910    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"
Sep 11 14:24:41.986317 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:41.986287    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 14:24:41.986733 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:41.986714    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 14:24:41.986845 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:41.986720    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rjv7x\""
Sep 11 14:24:42.010227 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:42.010200    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"]
Sep 11 14:24:42.025453 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:42.025423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a89b1115-9993-4118-a9c2-60093b9e95c0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr\" (UID: \"a89b1115-9993-4118-a9c2-60093b9e95c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"
Sep 11 14:24:42.025564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:42.025458    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88jgx\" (UniqueName: \"kubernetes.io/projected/a89b1115-9993-4118-a9c2-60093b9e95c0-kube-api-access-88jgx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr\" (UID: \"a89b1115-9993-4118-a9c2-60093b9e95c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"
Sep 11 14:24:42.025564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:42.025530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a89b1115-9993-4118-a9c2-60093b9e95c0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr\" (UID: \"a89b1115-9993-4118-a9c2-60093b9e95c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"
Sep 11 14:24:42.126257 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:42.126224    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a89b1115-9993-4118-a9c2-60093b9e95c0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr\" (UID: \"a89b1115-9993-4118-a9c2-60093b9e95c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"
Sep 11 14:24:42.126257 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:42.126267    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88jgx\" (UniqueName: \"kubernetes.io/projected/a89b1115-9993-4118-a9c2-60093b9e95c0-kube-api-access-88jgx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr\" (UID: \"a89b1115-9993-4118-a9c2-60093b9e95c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"
Sep 11 14:24:42.126505 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:42.126333    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a89b1115-9993-4118-a9c2-60093b9e95c0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr\" (UID: \"a89b1115-9993-4118-a9c2-60093b9e95c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"
Sep 11 14:24:42.126631 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:42.126607    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a89b1115-9993-4118-a9c2-60093b9e95c0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr\" (UID: \"a89b1115-9993-4118-a9c2-60093b9e95c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"
Sep 11 14:24:42.126703 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:42.126661    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a89b1115-9993-4118-a9c2-60093b9e95c0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr\" (UID: \"a89b1115-9993-4118-a9c2-60093b9e95c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"
Sep 11 14:24:42.139745 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:42.139706    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88jgx\" (UniqueName: \"kubernetes.io/projected/a89b1115-9993-4118-a9c2-60093b9e95c0-kube-api-access-88jgx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr\" (UID: \"a89b1115-9993-4118-a9c2-60093b9e95c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"
Sep 11 14:24:42.289464 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:42.289383    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"
Sep 11 14:24:42.586526 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:42.586447    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"]
Sep 11 14:24:42.589856 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:24:42.589827    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda89b1115_9993_4118_a9c2_60093b9e95c0.slice/crio-b1251cba7302969d831fe742f12119019a82d060b026804fc98d98f1a81272b3 WatchSource:0}: Error finding container b1251cba7302969d831fe742f12119019a82d060b026804fc98d98f1a81272b3: Status 404 returned error can't find the container with id b1251cba7302969d831fe742f12119019a82d060b026804fc98d98f1a81272b3
Sep 11 14:24:42.591784 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:42.591768    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:24:42.853228 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:42.853146    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr" event={"ID":"a89b1115-9993-4118-a9c2-60093b9e95c0","Type":"ContainerStarted","Data":"b1251cba7302969d831fe742f12119019a82d060b026804fc98d98f1a81272b3"}
Sep 11 14:24:49.888726 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:49.888688    2582 generic.go:356] "Generic (PLEG): container finished" podID="a89b1115-9993-4118-a9c2-60093b9e95c0" containerID="4e9d49b3add3d40feeb7a4d5ede52a3fd34a0d2d841e3a2799eb88791276ada3" exitCode=0
Sep 11 14:24:49.889214 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:49.888742    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr" event={"ID":"a89b1115-9993-4118-a9c2-60093b9e95c0","Type":"ContainerDied","Data":"4e9d49b3add3d40feeb7a4d5ede52a3fd34a0d2d841e3a2799eb88791276ada3"}
Sep 11 14:24:51.899024 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:51.898991    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr" event={"ID":"a89b1115-9993-4118-a9c2-60093b9e95c0","Type":"ContainerStarted","Data":"181b4949ff3e743dbd354bb93a35855b4a9025df4f70128b1d496382e3a85c6c"}
Sep 11 14:24:52.904297 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:52.904259    2582 generic.go:356] "Generic (PLEG): container finished" podID="a89b1115-9993-4118-a9c2-60093b9e95c0" containerID="181b4949ff3e743dbd354bb93a35855b4a9025df4f70128b1d496382e3a85c6c" exitCode=0
Sep 11 14:24:52.904650 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:52.904318    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr" event={"ID":"a89b1115-9993-4118-a9c2-60093b9e95c0","Type":"ContainerDied","Data":"181b4949ff3e743dbd354bb93a35855b4a9025df4f70128b1d496382e3a85c6c"}
Sep 11 14:24:59.939446 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:59.939411    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr" event={"ID":"a89b1115-9993-4118-a9c2-60093b9e95c0","Type":"ContainerStarted","Data":"353a7f78fa1ce7101e874b36ad44db13a1e456fad817a8093b22f8c5c1945f16"}
Sep 11 14:24:59.984075 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:24:59.984008    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr" podStartSLOduration=3.4594253139999998 podStartE2EDuration="18.983992101s" totalImagesPullingTime="15.524566787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:24:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:24:59.983316689 +0000 UTC m=+597.015751564" watchObservedRunningTime="2026-09-11 14:24:59.983992101 +0000 UTC m=+597.016427002"
Sep 11 14:25:00.945147 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:00.945110    2582 generic.go:356] "Generic (PLEG): container finished" podID="a89b1115-9993-4118-a9c2-60093b9e95c0" containerID="353a7f78fa1ce7101e874b36ad44db13a1e456fad817a8093b22f8c5c1945f16" exitCode=0
Sep 11 14:25:00.945544 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:00.945152    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr" event={"ID":"a89b1115-9993-4118-a9c2-60093b9e95c0","Type":"ContainerDied","Data":"353a7f78fa1ce7101e874b36ad44db13a1e456fad817a8093b22f8c5c1945f16"}
Sep 11 14:25:02.078274 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:02.078242    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"
Sep 11 14:25:02.206699 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:02.206615    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88jgx\" (UniqueName: \"kubernetes.io/projected/a89b1115-9993-4118-a9c2-60093b9e95c0-kube-api-access-88jgx\") pod \"a89b1115-9993-4118-a9c2-60093b9e95c0\" (UID: \"a89b1115-9993-4118-a9c2-60093b9e95c0\") "
Sep 11 14:25:02.206850 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:02.206709    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a89b1115-9993-4118-a9c2-60093b9e95c0-util\") pod \"a89b1115-9993-4118-a9c2-60093b9e95c0\" (UID: \"a89b1115-9993-4118-a9c2-60093b9e95c0\") "
Sep 11 14:25:02.206850 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:02.206820    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a89b1115-9993-4118-a9c2-60093b9e95c0-bundle\") pod \"a89b1115-9993-4118-a9c2-60093b9e95c0\" (UID: \"a89b1115-9993-4118-a9c2-60093b9e95c0\") "
Sep 11 14:25:02.207465 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:02.207443    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a89b1115-9993-4118-a9c2-60093b9e95c0-bundle" (OuterVolumeSpecName: "bundle") pod "a89b1115-9993-4118-a9c2-60093b9e95c0" (UID: "a89b1115-9993-4118-a9c2-60093b9e95c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:25:02.208976 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:02.208954    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a89b1115-9993-4118-a9c2-60093b9e95c0-kube-api-access-88jgx" (OuterVolumeSpecName: "kube-api-access-88jgx") pod "a89b1115-9993-4118-a9c2-60093b9e95c0" (UID: "a89b1115-9993-4118-a9c2-60093b9e95c0"). InnerVolumeSpecName "kube-api-access-88jgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:25:02.210651 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:02.210630    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a89b1115-9993-4118-a9c2-60093b9e95c0-util" (OuterVolumeSpecName: "util") pod "a89b1115-9993-4118-a9c2-60093b9e95c0" (UID: "a89b1115-9993-4118-a9c2-60093b9e95c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:25:02.307930 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:02.307899    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88jgx\" (UniqueName: \"kubernetes.io/projected/a89b1115-9993-4118-a9c2-60093b9e95c0-kube-api-access-88jgx\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:25:02.307930 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:02.307925    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a89b1115-9993-4118-a9c2-60093b9e95c0-util\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:25:02.308117 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:02.307938    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a89b1115-9993-4118-a9c2-60093b9e95c0-bundle\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:25:02.953821 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:02.953790    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr"
Sep 11 14:25:02.953821 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:02.953800    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xnzr" event={"ID":"a89b1115-9993-4118-a9c2-60093b9e95c0","Type":"ContainerDied","Data":"b1251cba7302969d831fe742f12119019a82d060b026804fc98d98f1a81272b3"}
Sep 11 14:25:02.954020 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:02.953842    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1251cba7302969d831fe742f12119019a82d060b026804fc98d98f1a81272b3"
Sep 11 14:25:12.694619 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.694585    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dg625"]
Sep 11 14:25:12.694996 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.694907    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a89b1115-9993-4118-a9c2-60093b9e95c0" containerName="util"
Sep 11 14:25:12.694996 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.694919    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a89b1115-9993-4118-a9c2-60093b9e95c0" containerName="util"
Sep 11 14:25:12.694996 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.694935    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a89b1115-9993-4118-a9c2-60093b9e95c0" containerName="pull"
Sep 11 14:25:12.694996 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.694941    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a89b1115-9993-4118-a9c2-60093b9e95c0" containerName="pull"
Sep 11 14:25:12.694996 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.694952    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a89b1115-9993-4118-a9c2-60093b9e95c0" containerName="extract"
Sep 11 14:25:12.694996 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.694959    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a89b1115-9993-4118-a9c2-60093b9e95c0" containerName="extract"
Sep 11 14:25:12.695250 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.695017    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a89b1115-9993-4118-a9c2-60093b9e95c0" containerName="extract"
Sep 11 14:25:12.699955 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.699930    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dg625"
Sep 11 14:25:12.726618 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.726590    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 14:25:12.726746 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.726681    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:25:12.726942 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.726928    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fgk9j\""
Sep 11 14:25:12.772958 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.772930    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dg625"]
Sep 11 14:25:12.792814 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.792784    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8qlp\" (UniqueName: \"kubernetes.io/projected/12cc859f-da9d-41d5-98a2-ea55787f1809-kube-api-access-g8qlp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dg625\" (UID: \"12cc859f-da9d-41d5-98a2-ea55787f1809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dg625"
Sep 11 14:25:12.792933 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.792858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12cc859f-da9d-41d5-98a2-ea55787f1809-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dg625\" (UID: \"12cc859f-da9d-41d5-98a2-ea55787f1809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dg625"
Sep 11 14:25:12.893302 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.893269    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12cc859f-da9d-41d5-98a2-ea55787f1809-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dg625\" (UID: \"12cc859f-da9d-41d5-98a2-ea55787f1809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dg625"
Sep 11 14:25:12.893446 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.893341    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8qlp\" (UniqueName: \"kubernetes.io/projected/12cc859f-da9d-41d5-98a2-ea55787f1809-kube-api-access-g8qlp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dg625\" (UID: \"12cc859f-da9d-41d5-98a2-ea55787f1809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dg625"
Sep 11 14:25:12.893617 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.893596    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12cc859f-da9d-41d5-98a2-ea55787f1809-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dg625\" (UID: \"12cc859f-da9d-41d5-98a2-ea55787f1809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dg625"
Sep 11 14:25:12.908859 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:12.908832    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8qlp\" (UniqueName: \"kubernetes.io/projected/12cc859f-da9d-41d5-98a2-ea55787f1809-kube-api-access-g8qlp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dg625\" (UID: \"12cc859f-da9d-41d5-98a2-ea55787f1809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dg625"
Sep 11 14:25:13.009513 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:13.009443    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dg625"
Sep 11 14:25:13.321440 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:13.321367    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dg625"]
Sep 11 14:25:13.324689 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:25:13.324617    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12cc859f_da9d_41d5_98a2_ea55787f1809.slice/crio-96e107eddeb3444ecd033223ed1a3e759c73bec21952cf99bbdb31fa7a80d4b3 WatchSource:0}: Error finding container 96e107eddeb3444ecd033223ed1a3e759c73bec21952cf99bbdb31fa7a80d4b3: Status 404 returned error can't find the container with id 96e107eddeb3444ecd033223ed1a3e759c73bec21952cf99bbdb31fa7a80d4b3
Sep 11 14:25:13.998720 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:13.998679    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dg625" event={"ID":"12cc859f-da9d-41d5-98a2-ea55787f1809","Type":"ContainerStarted","Data":"96e107eddeb3444ecd033223ed1a3e759c73bec21952cf99bbdb31fa7a80d4b3"}
Sep 11 14:25:16.009557 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:16.009522    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dg625" event={"ID":"12cc859f-da9d-41d5-98a2-ea55787f1809","Type":"ContainerStarted","Data":"3adfdfa696029bc03fe58eafdb677c82b24ef49a566b23536fcbdd101cbbb377"}
Sep 11 14:25:16.060562 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:16.060457    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dg625" podStartSLOduration=2.384161744 podStartE2EDuration="4.060437217s" totalImagesPullingTime="1.676275473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:25:16.059624829 +0000 UTC m=+613.092059688" watchObservedRunningTime="2026-09-11 14:25:16.060437217 +0000 UTC m=+613.092872077"
Sep 11 14:25:17.950220 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:17.950183    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"]
Sep 11 14:25:17.953884 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:17.953863    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"
Sep 11 14:25:17.973063 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:17.973026    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 14:25:17.973186 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:17.973093    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 14:25:17.991643 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:17.991617    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rjv7x\""
Sep 11 14:25:18.031055 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.031004    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"]
Sep 11 14:25:18.036750 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.036718    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da30576d-9315-4a7e-be80-ef7e266055f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7\" (UID: \"da30576d-9315-4a7e-be80-ef7e266055f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"
Sep 11 14:25:18.036902 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.036774    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcv4k\" (UniqueName: \"kubernetes.io/projected/da30576d-9315-4a7e-be80-ef7e266055f2-kube-api-access-dcv4k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7\" (UID: \"da30576d-9315-4a7e-be80-ef7e266055f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"
Sep 11 14:25:18.036902 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.036837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da30576d-9315-4a7e-be80-ef7e266055f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7\" (UID: \"da30576d-9315-4a7e-be80-ef7e266055f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"
Sep 11 14:25:18.137414 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.137376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcv4k\" (UniqueName: \"kubernetes.io/projected/da30576d-9315-4a7e-be80-ef7e266055f2-kube-api-access-dcv4k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7\" (UID: \"da30576d-9315-4a7e-be80-ef7e266055f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"
Sep 11 14:25:18.137589 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.137430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da30576d-9315-4a7e-be80-ef7e266055f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7\" (UID: \"da30576d-9315-4a7e-be80-ef7e266055f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"
Sep 11 14:25:18.137589 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.137473    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da30576d-9315-4a7e-be80-ef7e266055f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7\" (UID: \"da30576d-9315-4a7e-be80-ef7e266055f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"
Sep 11 14:25:18.137894 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.137873    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da30576d-9315-4a7e-be80-ef7e266055f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7\" (UID: \"da30576d-9315-4a7e-be80-ef7e266055f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"
Sep 11 14:25:18.137933 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.137888    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da30576d-9315-4a7e-be80-ef7e266055f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7\" (UID: \"da30576d-9315-4a7e-be80-ef7e266055f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"
Sep 11 14:25:18.247781 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.247701    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcv4k\" (UniqueName: \"kubernetes.io/projected/da30576d-9315-4a7e-be80-ef7e266055f2-kube-api-access-dcv4k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7\" (UID: \"da30576d-9315-4a7e-be80-ef7e266055f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"
Sep 11 14:25:18.262581 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.262548    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"
Sep 11 14:25:18.390396 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.390364    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lt4m4"]
Sep 11 14:25:18.393859 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.393843    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lt4m4"
Sep 11 14:25:18.406783 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.406763    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 14:25:18.407394 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.407380    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 14:25:18.440300 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.440271    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lcq5\" (UniqueName: \"kubernetes.io/projected/c9960817-6fb1-4bb5-bfd9-1a17c0937c7b-kube-api-access-6lcq5\") pod \"cert-manager-webhook-6486ffd997-lt4m4\" (UID: \"c9960817-6fb1-4bb5-bfd9-1a17c0937c7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lt4m4"
Sep 11 14:25:18.440452 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.440315    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9960817-6fb1-4bb5-bfd9-1a17c0937c7b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lt4m4\" (UID: \"c9960817-6fb1-4bb5-bfd9-1a17c0937c7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lt4m4"
Sep 11 14:25:18.479241 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.479213    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lt4m4"]
Sep 11 14:25:18.540958 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.540884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lcq5\" (UniqueName: \"kubernetes.io/projected/c9960817-6fb1-4bb5-bfd9-1a17c0937c7b-kube-api-access-6lcq5\") pod \"cert-manager-webhook-6486ffd997-lt4m4\" (UID: \"c9960817-6fb1-4bb5-bfd9-1a17c0937c7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lt4m4"
Sep 11 14:25:18.540958 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.540937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9960817-6fb1-4bb5-bfd9-1a17c0937c7b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lt4m4\" (UID: \"c9960817-6fb1-4bb5-bfd9-1a17c0937c7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lt4m4"
Sep 11 14:25:18.588645 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.588613    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9960817-6fb1-4bb5-bfd9-1a17c0937c7b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lt4m4\" (UID: \"c9960817-6fb1-4bb5-bfd9-1a17c0937c7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lt4m4"
Sep 11 14:25:18.588804 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.588618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lcq5\" (UniqueName: \"kubernetes.io/projected/c9960817-6fb1-4bb5-bfd9-1a17c0937c7b-kube-api-access-6lcq5\") pod \"cert-manager-webhook-6486ffd997-lt4m4\" (UID: \"c9960817-6fb1-4bb5-bfd9-1a17c0937c7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lt4m4"
Sep 11 14:25:18.645025 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.644909    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"]
Sep 11 14:25:18.647613 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:25:18.647585    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda30576d_9315_4a7e_be80_ef7e266055f2.slice/crio-1d5ed44a607d277aa44e5ce7e0c5a6454b015b9a65888c8467c2145364a307a2 WatchSource:0}: Error finding container 1d5ed44a607d277aa44e5ce7e0c5a6454b015b9a65888c8467c2145364a307a2: Status 404 returned error can't find the container with id 1d5ed44a607d277aa44e5ce7e0c5a6454b015b9a65888c8467c2145364a307a2
Sep 11 14:25:18.712298 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:18.712273    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lt4m4"
Sep 11 14:25:19.009124 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:19.009089    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lt4m4"]
Sep 11 14:25:19.023847 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:19.023815    2582 generic.go:356] "Generic (PLEG): container finished" podID="da30576d-9315-4a7e-be80-ef7e266055f2" containerID="d14c637800aa105b737653058495343bc6ff763505d429230a559ff9041b6319" exitCode=0
Sep 11 14:25:19.024016 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:19.023910    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7" event={"ID":"da30576d-9315-4a7e-be80-ef7e266055f2","Type":"ContainerDied","Data":"d14c637800aa105b737653058495343bc6ff763505d429230a559ff9041b6319"}
Sep 11 14:25:19.024016 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:19.023970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7" event={"ID":"da30576d-9315-4a7e-be80-ef7e266055f2","Type":"ContainerStarted","Data":"1d5ed44a607d277aa44e5ce7e0c5a6454b015b9a65888c8467c2145364a307a2"}
Sep 11 14:25:19.050266 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:25:19.050235    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9960817_6fb1_4bb5_bfd9_1a17c0937c7b.slice/crio-9e7d35bf841327c190f2b53521204079a6cdb4fe339f29143c754a81bee0972c WatchSource:0}: Error finding container 9e7d35bf841327c190f2b53521204079a6cdb4fe339f29143c754a81bee0972c: Status 404 returned error can't find the container with id 9e7d35bf841327c190f2b53521204079a6cdb4fe339f29143c754a81bee0972c
Sep 11 14:25:20.030372 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:20.030330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lt4m4" event={"ID":"c9960817-6fb1-4bb5-bfd9-1a17c0937c7b","Type":"ContainerStarted","Data":"9e7d35bf841327c190f2b53521204079a6cdb4fe339f29143c754a81bee0972c"}
Sep 11 14:25:22.040887 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:22.040856    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lt4m4" event={"ID":"c9960817-6fb1-4bb5-bfd9-1a17c0937c7b","Type":"ContainerStarted","Data":"600bca63f22201e587acc18f86c7d52d54389bf7fc91cdd6f1079906efc8f6c4"}
Sep 11 14:25:22.041292 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:22.040989    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lt4m4"
Sep 11 14:25:22.103156 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:22.103101    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lt4m4" podStartSLOduration=1.5151750339999999 podStartE2EDuration="4.103080236s" totalImagesPullingTime="2.587905202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:25:22.102009223 +0000 UTC m=+619.134444107" watchObservedRunningTime="2026-09-11 14:25:22.103080236 +0000 UTC m=+619.135515095"
Sep 11 14:25:28.049754 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:28.049664    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lt4m4"
Sep 11 14:25:30.080657 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:30.080572    2582 generic.go:356] "Generic (PLEG): container finished" podID="da30576d-9315-4a7e-be80-ef7e266055f2" containerID="cdc812a1291a0d48a994e77d20ac793859d3193715206addbef21790e44df7ca" exitCode=0
Sep 11 14:25:30.081028 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:30.080665    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7" event={"ID":"da30576d-9315-4a7e-be80-ef7e266055f2","Type":"ContainerDied","Data":"cdc812a1291a0d48a994e77d20ac793859d3193715206addbef21790e44df7ca"}
Sep 11 14:25:31.086859 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:31.086813    2582 generic.go:356] "Generic (PLEG): container finished" podID="da30576d-9315-4a7e-be80-ef7e266055f2" containerID="a1b8076d9122af8aea8c39683fe679a92b19070d7169442ebfb620cfbeea82b7" exitCode=0
Sep 11 14:25:31.087291 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:31.086908    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7" event={"ID":"da30576d-9315-4a7e-be80-ef7e266055f2","Type":"ContainerDied","Data":"a1b8076d9122af8aea8c39683fe679a92b19070d7169442ebfb620cfbeea82b7"}
Sep 11 14:25:32.220996 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:32.220973    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"
Sep 11 14:25:32.360956 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:32.360870    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da30576d-9315-4a7e-be80-ef7e266055f2-util\") pod \"da30576d-9315-4a7e-be80-ef7e266055f2\" (UID: \"da30576d-9315-4a7e-be80-ef7e266055f2\") "
Sep 11 14:25:32.361404 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:32.361376    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da30576d-9315-4a7e-be80-ef7e266055f2-bundle\") pod \"da30576d-9315-4a7e-be80-ef7e266055f2\" (UID: \"da30576d-9315-4a7e-be80-ef7e266055f2\") "
Sep 11 14:25:32.361619 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:32.361602    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcv4k\" (UniqueName: \"kubernetes.io/projected/da30576d-9315-4a7e-be80-ef7e266055f2-kube-api-access-dcv4k\") pod \"da30576d-9315-4a7e-be80-ef7e266055f2\" (UID: \"da30576d-9315-4a7e-be80-ef7e266055f2\") "
Sep 11 14:25:32.361711 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:32.361663    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da30576d-9315-4a7e-be80-ef7e266055f2-bundle" (OuterVolumeSpecName: "bundle") pod "da30576d-9315-4a7e-be80-ef7e266055f2" (UID: "da30576d-9315-4a7e-be80-ef7e266055f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:25:32.362225 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:32.362207    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da30576d-9315-4a7e-be80-ef7e266055f2-bundle\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:25:32.364471 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:32.364432    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da30576d-9315-4a7e-be80-ef7e266055f2-kube-api-access-dcv4k" (OuterVolumeSpecName: "kube-api-access-dcv4k") pod "da30576d-9315-4a7e-be80-ef7e266055f2" (UID: "da30576d-9315-4a7e-be80-ef7e266055f2"). InnerVolumeSpecName "kube-api-access-dcv4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:25:32.369609 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:32.369585    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da30576d-9315-4a7e-be80-ef7e266055f2-util" (OuterVolumeSpecName: "util") pod "da30576d-9315-4a7e-be80-ef7e266055f2" (UID: "da30576d-9315-4a7e-be80-ef7e266055f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:25:32.462902 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:32.462862    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcv4k\" (UniqueName: \"kubernetes.io/projected/da30576d-9315-4a7e-be80-ef7e266055f2-kube-api-access-dcv4k\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:25:32.462902 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:32.462896    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da30576d-9315-4a7e-be80-ef7e266055f2-util\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:25:33.097194 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:33.097157    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7" event={"ID":"da30576d-9315-4a7e-be80-ef7e266055f2","Type":"ContainerDied","Data":"1d5ed44a607d277aa44e5ce7e0c5a6454b015b9a65888c8467c2145364a307a2"}
Sep 11 14:25:33.097359 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:33.097209    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d5ed44a607d277aa44e5ce7e0c5a6454b015b9a65888c8467c2145364a307a2"
Sep 11 14:25:33.097359 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:33.097173    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9xz7"
Sep 11 14:25:35.233562 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.233531    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtsjv"]
Sep 11 14:25:35.233991 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.233850    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da30576d-9315-4a7e-be80-ef7e266055f2" containerName="util"
Sep 11 14:25:35.233991 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.233861    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da30576d-9315-4a7e-be80-ef7e266055f2" containerName="util"
Sep 11 14:25:35.233991 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.233869    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da30576d-9315-4a7e-be80-ef7e266055f2" containerName="pull"
Sep 11 14:25:35.233991 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.233875    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da30576d-9315-4a7e-be80-ef7e266055f2" containerName="pull"
Sep 11 14:25:35.233991 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.233902    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da30576d-9315-4a7e-be80-ef7e266055f2" containerName="extract"
Sep 11 14:25:35.233991 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.233908    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da30576d-9315-4a7e-be80-ef7e266055f2" containerName="extract"
Sep 11 14:25:35.233991 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.233951    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="da30576d-9315-4a7e-be80-ef7e266055f2" containerName="extract"
Sep 11 14:25:35.237211 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.237188    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtsjv"
Sep 11 14:25:35.240283 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.240264    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 14:25:35.240518 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.240500    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2dv67\""
Sep 11 14:25:35.240572 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.240506    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:25:35.250563 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.250540    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtsjv"]
Sep 11 14:25:35.390236 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.390201    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b30d512c-6ddc-4936-8eec-2a0f82f3b8e5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jtsjv\" (UID: \"b30d512c-6ddc-4936-8eec-2a0f82f3b8e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtsjv"
Sep 11 14:25:35.390402 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.390261    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwgwf\" (UniqueName: \"kubernetes.io/projected/b30d512c-6ddc-4936-8eec-2a0f82f3b8e5-kube-api-access-zwgwf\") pod \"openshift-lws-operator-fd8ccff4c-jtsjv\" (UID: \"b30d512c-6ddc-4936-8eec-2a0f82f3b8e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtsjv"
Sep 11 14:25:35.491099 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.491008    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b30d512c-6ddc-4936-8eec-2a0f82f3b8e5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jtsjv\" (UID: \"b30d512c-6ddc-4936-8eec-2a0f82f3b8e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtsjv"
Sep 11 14:25:35.491281 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.491135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwgwf\" (UniqueName: \"kubernetes.io/projected/b30d512c-6ddc-4936-8eec-2a0f82f3b8e5-kube-api-access-zwgwf\") pod \"openshift-lws-operator-fd8ccff4c-jtsjv\" (UID: \"b30d512c-6ddc-4936-8eec-2a0f82f3b8e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtsjv"
Sep 11 14:25:35.491372 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.491350    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b30d512c-6ddc-4936-8eec-2a0f82f3b8e5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jtsjv\" (UID: \"b30d512c-6ddc-4936-8eec-2a0f82f3b8e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtsjv"
Sep 11 14:25:35.502998 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.502975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwgwf\" (UniqueName: \"kubernetes.io/projected/b30d512c-6ddc-4936-8eec-2a0f82f3b8e5-kube-api-access-zwgwf\") pod \"openshift-lws-operator-fd8ccff4c-jtsjv\" (UID: \"b30d512c-6ddc-4936-8eec-2a0f82f3b8e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtsjv"
Sep 11 14:25:35.546966 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.546944    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtsjv"
Sep 11 14:25:35.845663 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:35.845511    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtsjv"]
Sep 11 14:25:35.848225 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:25:35.848197    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb30d512c_6ddc_4936_8eec_2a0f82f3b8e5.slice/crio-7c705d33898f9f1f2a41bbf4a1d6825632fabaed8ec396fba91ca14b76247e70 WatchSource:0}: Error finding container 7c705d33898f9f1f2a41bbf4a1d6825632fabaed8ec396fba91ca14b76247e70: Status 404 returned error can't find the container with id 7c705d33898f9f1f2a41bbf4a1d6825632fabaed8ec396fba91ca14b76247e70
Sep 11 14:25:36.111730 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:36.111646    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtsjv" event={"ID":"b30d512c-6ddc-4936-8eec-2a0f82f3b8e5","Type":"ContainerStarted","Data":"7c705d33898f9f1f2a41bbf4a1d6825632fabaed8ec396fba91ca14b76247e70"}
Sep 11 14:25:53.187191 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:53.187151    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtsjv" event={"ID":"b30d512c-6ddc-4936-8eec-2a0f82f3b8e5","Type":"ContainerStarted","Data":"a0f56268d9f9fd0cdcca0a807f6f23a447786c6e3d7ecee78291c4e2a05250d9"}
Sep 11 14:25:53.212356 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:53.212306    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtsjv" podStartSLOduration=1.691393284 podStartE2EDuration="18.212291106s" totalImagesPullingTime="16.520897822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:25:53.211307673 +0000 UTC m=+650.243742534" watchObservedRunningTime="2026-09-11 14:25:53.212291106 +0000 UTC m=+650.244726031"
Sep 11 14:25:56.290516 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.290481    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"]
Sep 11 14:25:56.294025 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.294004    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"
Sep 11 14:25:56.297100 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.297081    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 14:25:56.297544 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.297527    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rjv7x\""
Sep 11 14:25:56.297634 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.297535    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 14:25:56.304896 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.304872    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"]
Sep 11 14:25:56.371743 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.371707    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4f87ed-5440-4ab9-9c4c-e368a8388119-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8\" (UID: \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"
Sep 11 14:25:56.371911 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.371753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4f87ed-5440-4ab9-9c4c-e368a8388119-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8\" (UID: \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"
Sep 11 14:25:56.371911 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.371773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbxn5\" (UniqueName: \"kubernetes.io/projected/aa4f87ed-5440-4ab9-9c4c-e368a8388119-kube-api-access-pbxn5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8\" (UID: \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"
Sep 11 14:25:56.472473 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.472440    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4f87ed-5440-4ab9-9c4c-e368a8388119-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8\" (UID: \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"
Sep 11 14:25:56.472473 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.472474    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbxn5\" (UniqueName: \"kubernetes.io/projected/aa4f87ed-5440-4ab9-9c4c-e368a8388119-kube-api-access-pbxn5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8\" (UID: \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"
Sep 11 14:25:56.472684 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.472543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4f87ed-5440-4ab9-9c4c-e368a8388119-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8\" (UID: \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"
Sep 11 14:25:56.472828 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.472809    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4f87ed-5440-4ab9-9c4c-e368a8388119-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8\" (UID: \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"
Sep 11 14:25:56.472866 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.472839    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4f87ed-5440-4ab9-9c4c-e368a8388119-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8\" (UID: \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"
Sep 11 14:25:56.485880 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.485848    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbxn5\" (UniqueName: \"kubernetes.io/projected/aa4f87ed-5440-4ab9-9c4c-e368a8388119-kube-api-access-pbxn5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8\" (UID: \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"
Sep 11 14:25:56.603242 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.603157    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"
Sep 11 14:25:56.883372 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:56.883346    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"]
Sep 11 14:25:56.885398 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:25:56.885371    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4f87ed_5440_4ab9_9c4c_e368a8388119.slice/crio-c23837208ab7dd278d1f8407ccdc7bfd4e0dd6018c4a09db73d0c3e6d0e01866 WatchSource:0}: Error finding container c23837208ab7dd278d1f8407ccdc7bfd4e0dd6018c4a09db73d0c3e6d0e01866: Status 404 returned error can't find the container with id c23837208ab7dd278d1f8407ccdc7bfd4e0dd6018c4a09db73d0c3e6d0e01866
Sep 11 14:25:57.207413 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:57.207378    2582 generic.go:356] "Generic (PLEG): container finished" podID="aa4f87ed-5440-4ab9-9c4c-e368a8388119" containerID="7343160e2b1544d5b4215d29c81ec072a43eec2bf606b345c75afd0f4e11a290" exitCode=0
Sep 11 14:25:57.207577 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:57.207467    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8" event={"ID":"aa4f87ed-5440-4ab9-9c4c-e368a8388119","Type":"ContainerDied","Data":"7343160e2b1544d5b4215d29c81ec072a43eec2bf606b345c75afd0f4e11a290"}
Sep 11 14:25:57.207577 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:57.207515    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8" event={"ID":"aa4f87ed-5440-4ab9-9c4c-e368a8388119","Type":"ContainerStarted","Data":"c23837208ab7dd278d1f8407ccdc7bfd4e0dd6018c4a09db73d0c3e6d0e01866"}
Sep 11 14:25:58.213323 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:58.213290    2582 generic.go:356] "Generic (PLEG): container finished" podID="aa4f87ed-5440-4ab9-9c4c-e368a8388119" containerID="a1c206397d8dac962dd8b56cdde731a59264fa74d497c22823d7e39877b70704" exitCode=0
Sep 11 14:25:58.213671 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:58.213365    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8" event={"ID":"aa4f87ed-5440-4ab9-9c4c-e368a8388119","Type":"ContainerDied","Data":"a1c206397d8dac962dd8b56cdde731a59264fa74d497c22823d7e39877b70704"}
Sep 11 14:25:59.221212 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:59.221178    2582 generic.go:356] "Generic (PLEG): container finished" podID="aa4f87ed-5440-4ab9-9c4c-e368a8388119" containerID="60b1c2d024ddf51cd0520a9c4e8cdca60c43f8acd68b077778712ea70cb31fab" exitCode=0
Sep 11 14:25:59.221703 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:25:59.221419    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8" event={"ID":"aa4f87ed-5440-4ab9-9c4c-e368a8388119","Type":"ContainerDied","Data":"60b1c2d024ddf51cd0520a9c4e8cdca60c43f8acd68b077778712ea70cb31fab"}
Sep 11 14:26:00.353442 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:00.353419    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"
Sep 11 14:26:00.400927 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:00.400899    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbxn5\" (UniqueName: \"kubernetes.io/projected/aa4f87ed-5440-4ab9-9c4c-e368a8388119-kube-api-access-pbxn5\") pod \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\" (UID: \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\") "
Sep 11 14:26:00.401085 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:00.400943    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4f87ed-5440-4ab9-9c4c-e368a8388119-util\") pod \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\" (UID: \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\") "
Sep 11 14:26:00.401085 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:00.400994    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4f87ed-5440-4ab9-9c4c-e368a8388119-bundle\") pod \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\" (UID: \"aa4f87ed-5440-4ab9-9c4c-e368a8388119\") "
Sep 11 14:26:00.401786 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:00.401720    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4f87ed-5440-4ab9-9c4c-e368a8388119-bundle" (OuterVolumeSpecName: "bundle") pod "aa4f87ed-5440-4ab9-9c4c-e368a8388119" (UID: "aa4f87ed-5440-4ab9-9c4c-e368a8388119"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:26:00.403229 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:00.403208    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4f87ed-5440-4ab9-9c4c-e368a8388119-kube-api-access-pbxn5" (OuterVolumeSpecName: "kube-api-access-pbxn5") pod "aa4f87ed-5440-4ab9-9c4c-e368a8388119" (UID: "aa4f87ed-5440-4ab9-9c4c-e368a8388119"). InnerVolumeSpecName "kube-api-access-pbxn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:26:00.408418 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:00.408395    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4f87ed-5440-4ab9-9c4c-e368a8388119-util" (OuterVolumeSpecName: "util") pod "aa4f87ed-5440-4ab9-9c4c-e368a8388119" (UID: "aa4f87ed-5440-4ab9-9c4c-e368a8388119"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:26:00.501940 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:00.501871    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4f87ed-5440-4ab9-9c4c-e368a8388119-util\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:26:00.501940 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:00.501896    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4f87ed-5440-4ab9-9c4c-e368a8388119-bundle\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:26:00.501940 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:00.501906    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbxn5\" (UniqueName: \"kubernetes.io/projected/aa4f87ed-5440-4ab9-9c4c-e368a8388119-kube-api-access-pbxn5\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:26:01.232116 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:01.232088    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8"
Sep 11 14:26:01.232282 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:01.232120    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z6h8" event={"ID":"aa4f87ed-5440-4ab9-9c4c-e368a8388119","Type":"ContainerDied","Data":"c23837208ab7dd278d1f8407ccdc7bfd4e0dd6018c4a09db73d0c3e6d0e01866"}
Sep 11 14:26:01.232282 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:01.232187    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c23837208ab7dd278d1f8407ccdc7bfd4e0dd6018c4a09db73d0c3e6d0e01866"
Sep 11 14:26:11.016250 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.016214    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"]
Sep 11 14:26:11.016648 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.016577    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4f87ed-5440-4ab9-9c4c-e368a8388119" containerName="extract"
Sep 11 14:26:11.016648 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.016589    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4f87ed-5440-4ab9-9c4c-e368a8388119" containerName="extract"
Sep 11 14:26:11.016648 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.016599    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4f87ed-5440-4ab9-9c4c-e368a8388119" containerName="util"
Sep 11 14:26:11.016648 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.016604    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4f87ed-5440-4ab9-9c4c-e368a8388119" containerName="util"
Sep 11 14:26:11.016648 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.016615    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4f87ed-5440-4ab9-9c4c-e368a8388119" containerName="pull"
Sep 11 14:26:11.016648 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.016623    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4f87ed-5440-4ab9-9c4c-e368a8388119" containerName="pull"
Sep 11 14:26:11.016871 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.016683    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa4f87ed-5440-4ab9-9c4c-e368a8388119" containerName="extract"
Sep 11 14:26:11.023973 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.023952    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"
Sep 11 14:26:11.046592 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.046566    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 14:26:11.046700 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.046681    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rjv7x\""
Sep 11 14:26:11.058437 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.058416    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 14:26:11.068074 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.067992    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"]
Sep 11 14:26:11.075511 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.075482    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p52t2\" (UniqueName: \"kubernetes.io/projected/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-kube-api-access-p52t2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69\" (UID: \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"
Sep 11 14:26:11.075615 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.075544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69\" (UID: \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"
Sep 11 14:26:11.075679 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.075631    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69\" (UID: \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"
Sep 11 14:26:11.176729 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.176687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p52t2\" (UniqueName: \"kubernetes.io/projected/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-kube-api-access-p52t2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69\" (UID: \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"
Sep 11 14:26:11.176891 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.176743    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69\" (UID: \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"
Sep 11 14:26:11.176891 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.176778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69\" (UID: \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"
Sep 11 14:26:11.177132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.177116    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69\" (UID: \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"
Sep 11 14:26:11.177169 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.177154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69\" (UID: \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"
Sep 11 14:26:11.189632 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.189609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p52t2\" (UniqueName: \"kubernetes.io/projected/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-kube-api-access-p52t2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69\" (UID: \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"
Sep 11 14:26:11.333636 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.333555    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"
Sep 11 14:26:11.638019 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:11.637993    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"]
Sep 11 14:26:11.639965 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:26:11.639938    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863d6c38_1c72_49cc_8de6_5b07a8e9e75a.slice/crio-ff788b81866a675b1082e8108c8002187af7d62199f464cb9a4368efacd50dd7 WatchSource:0}: Error finding container ff788b81866a675b1082e8108c8002187af7d62199f464cb9a4368efacd50dd7: Status 404 returned error can't find the container with id ff788b81866a675b1082e8108c8002187af7d62199f464cb9a4368efacd50dd7
Sep 11 14:26:12.281256 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.281220    2582 generic.go:356] "Generic (PLEG): container finished" podID="863d6c38-1c72-49cc-8de6-5b07a8e9e75a" containerID="e2b39973ac32fa002d584b700e39df5133141920c1640b0763362e6b6fba9f98" exitCode=0
Sep 11 14:26:12.281622 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.281315    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69" event={"ID":"863d6c38-1c72-49cc-8de6-5b07a8e9e75a","Type":"ContainerDied","Data":"e2b39973ac32fa002d584b700e39df5133141920c1640b0763362e6b6fba9f98"}
Sep 11 14:26:12.281622 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.281371    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69" event={"ID":"863d6c38-1c72-49cc-8de6-5b07a8e9e75a","Type":"ContainerStarted","Data":"ff788b81866a675b1082e8108c8002187af7d62199f464cb9a4368efacd50dd7"}
Sep 11 14:26:12.892525 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.892501    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"]
Sep 11 14:26:12.895740 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.895725    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:12.899347 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.899325    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 14:26:12.899425 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.899393    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vsjmn\""
Sep 11 14:26:12.899425 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.899325    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 14:26:12.901584 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.901566    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 14:26:12.904688 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.904673    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 14:26:12.976824 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.976799    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"]
Sep 11 14:26:12.992867 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.992840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/365badc1-00dc-40fd-9a59-38907dfa6bb6-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:12.992980 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.992873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr76r\" (UniqueName: \"kubernetes.io/projected/365badc1-00dc-40fd-9a59-38907dfa6bb6-kube-api-access-mr76r\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:12.992980 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.992923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/365badc1-00dc-40fd-9a59-38907dfa6bb6-manifests\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:12.993079 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.993019    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/365badc1-00dc-40fd-9a59-38907dfa6bb6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:12.993113 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:12.993099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/365badc1-00dc-40fd-9a59-38907dfa6bb6-tmp\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:13.094348 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:13.094270    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/365badc1-00dc-40fd-9a59-38907dfa6bb6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:13.094348 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:13.094316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/365badc1-00dc-40fd-9a59-38907dfa6bb6-tmp\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:13.094348 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:13.094348    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/365badc1-00dc-40fd-9a59-38907dfa6bb6-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:13.094606 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:13.094365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr76r\" (UniqueName: \"kubernetes.io/projected/365badc1-00dc-40fd-9a59-38907dfa6bb6-kube-api-access-mr76r\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:13.094606 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:13.094397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/365badc1-00dc-40fd-9a59-38907dfa6bb6-manifests\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:13.094808 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:13.094778    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/365badc1-00dc-40fd-9a59-38907dfa6bb6-manifests\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:13.096815 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:13.096785    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/365badc1-00dc-40fd-9a59-38907dfa6bb6-tmp\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:13.096904 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:13.096869    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/365badc1-00dc-40fd-9a59-38907dfa6bb6-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:13.096941 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:13.096904    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/365badc1-00dc-40fd-9a59-38907dfa6bb6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:13.107801 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:13.107780    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr76r\" (UniqueName: \"kubernetes.io/projected/365badc1-00dc-40fd-9a59-38907dfa6bb6-kube-api-access-mr76r\") pod \"opendatahub-operator-controller-manager-86d7f488b8-mrt8n\" (UID: \"365badc1-00dc-40fd-9a59-38907dfa6bb6\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:13.230289 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:13.230255    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:13.289977 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:13.289831    2582 generic.go:356] "Generic (PLEG): container finished" podID="863d6c38-1c72-49cc-8de6-5b07a8e9e75a" containerID="f336ad9f668ab1613b3cce4c490618bafa720537cbbbc156b8dab7946510fac0" exitCode=0
Sep 11 14:26:13.289977 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:13.289883    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69" event={"ID":"863d6c38-1c72-49cc-8de6-5b07a8e9e75a","Type":"ContainerDied","Data":"f336ad9f668ab1613b3cce4c490618bafa720537cbbbc156b8dab7946510fac0"}
Sep 11 14:26:13.523120 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:13.523090    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"]
Sep 11 14:26:13.526895 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:26:13.526867    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod365badc1_00dc_40fd_9a59_38907dfa6bb6.slice/crio-80e164e2baadcc50d3614c81dd5c2a2f227f9ab22cdac6a46eeafc867e70bc66 WatchSource:0}: Error finding container 80e164e2baadcc50d3614c81dd5c2a2f227f9ab22cdac6a46eeafc867e70bc66: Status 404 returned error can't find the container with id 80e164e2baadcc50d3614c81dd5c2a2f227f9ab22cdac6a46eeafc867e70bc66
Sep 11 14:26:14.297745 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:14.297701    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n" event={"ID":"365badc1-00dc-40fd-9a59-38907dfa6bb6","Type":"ContainerStarted","Data":"80e164e2baadcc50d3614c81dd5c2a2f227f9ab22cdac6a46eeafc867e70bc66"}
Sep 11 14:26:14.300592 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:14.300493    2582 generic.go:356] "Generic (PLEG): container finished" podID="863d6c38-1c72-49cc-8de6-5b07a8e9e75a" containerID="3b926ba8a26d66be882d17f01841d57bf0a305e085af0325acc529ba4a3182e2" exitCode=0
Sep 11 14:26:14.300592 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:14.300544    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69" event={"ID":"863d6c38-1c72-49cc-8de6-5b07a8e9e75a","Type":"ContainerDied","Data":"3b926ba8a26d66be882d17f01841d57bf0a305e085af0325acc529ba4a3182e2"}
Sep 11 14:26:16.502724 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:16.502699    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"
Sep 11 14:26:16.522906 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:16.522885    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p52t2\" (UniqueName: \"kubernetes.io/projected/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-kube-api-access-p52t2\") pod \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\" (UID: \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\") "
Sep 11 14:26:16.523024 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:16.522954    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-bundle\") pod \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\" (UID: \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\") "
Sep 11 14:26:16.523024 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:16.523000    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-util\") pod \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\" (UID: \"863d6c38-1c72-49cc-8de6-5b07a8e9e75a\") "
Sep 11 14:26:16.523638 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:16.523574    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-bundle" (OuterVolumeSpecName: "bundle") pod "863d6c38-1c72-49cc-8de6-5b07a8e9e75a" (UID: "863d6c38-1c72-49cc-8de6-5b07a8e9e75a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:26:16.525287 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:16.525257    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-kube-api-access-p52t2" (OuterVolumeSpecName: "kube-api-access-p52t2") pod "863d6c38-1c72-49cc-8de6-5b07a8e9e75a" (UID: "863d6c38-1c72-49cc-8de6-5b07a8e9e75a"). InnerVolumeSpecName "kube-api-access-p52t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:26:16.528123 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:16.528098    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-util" (OuterVolumeSpecName: "util") pod "863d6c38-1c72-49cc-8de6-5b07a8e9e75a" (UID: "863d6c38-1c72-49cc-8de6-5b07a8e9e75a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:26:16.623682 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:16.623650    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p52t2\" (UniqueName: \"kubernetes.io/projected/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-kube-api-access-p52t2\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:26:16.623682 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:16.623678    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-bundle\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:26:16.623815 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:16.623691    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/863d6c38-1c72-49cc-8de6-5b07a8e9e75a-util\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:26:17.320160 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:17.320133    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69"
Sep 11 14:26:17.320160 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:17.320146    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b056m69" event={"ID":"863d6c38-1c72-49cc-8de6-5b07a8e9e75a","Type":"ContainerDied","Data":"ff788b81866a675b1082e8108c8002187af7d62199f464cb9a4368efacd50dd7"}
Sep 11 14:26:17.320456 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:17.320218    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff788b81866a675b1082e8108c8002187af7d62199f464cb9a4368efacd50dd7"
Sep 11 14:26:17.322015 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:17.321986    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n" event={"ID":"365badc1-00dc-40fd-9a59-38907dfa6bb6","Type":"ContainerStarted","Data":"9f79af10355a1250bded1f5f959a67193d2b643777e294c2a311d398f76f3fd0"}
Sep 11 14:26:18.328451 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:18.328413    2582 generic.go:356] "Generic (PLEG): container finished" podID="365badc1-00dc-40fd-9a59-38907dfa6bb6" containerID="9f79af10355a1250bded1f5f959a67193d2b643777e294c2a311d398f76f3fd0" exitCode=0
Sep 11 14:26:18.328843 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:18.328499    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n" event={"ID":"365badc1-00dc-40fd-9a59-38907dfa6bb6","Type":"ContainerDied","Data":"9f79af10355a1250bded1f5f959a67193d2b643777e294c2a311d398f76f3fd0"}
Sep 11 14:26:19.335512 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:19.335479    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n" event={"ID":"365badc1-00dc-40fd-9a59-38907dfa6bb6","Type":"ContainerStarted","Data":"00e04e8c0ddc90d298f9164c97bacc524b1341c06b8de9efa4ba1a9b03a26fd4"}
Sep 11 14:26:19.335915 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:19.335570    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:19.363628 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:19.363574    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n" podStartSLOduration=2.866887069 podStartE2EDuration="7.363554072s" totalImagesPullingTime="3.406418654s" totalInitContainerRuntime="1.090248349s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:26:19.362499392 +0000 UTC m=+676.394934254" watchObservedRunningTime="2026-09-11 14:26:19.363554072 +0000 UTC m=+676.395988934"
Sep 11 14:26:30.342235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:30.342200    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-mrt8n"
Sep 11 14:26:34.471753 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.471716    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf"]
Sep 11 14:26:34.472264 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.472245    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="863d6c38-1c72-49cc-8de6-5b07a8e9e75a" containerName="pull"
Sep 11 14:26:34.472339 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.472264    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="863d6c38-1c72-49cc-8de6-5b07a8e9e75a" containerName="pull"
Sep 11 14:26:34.472339 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.472275    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="863d6c38-1c72-49cc-8de6-5b07a8e9e75a" containerName="extract"
Sep 11 14:26:34.472339 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.472284    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="863d6c38-1c72-49cc-8de6-5b07a8e9e75a" containerName="extract"
Sep 11 14:26:34.472339 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.472301    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="863d6c38-1c72-49cc-8de6-5b07a8e9e75a" containerName="util"
Sep 11 14:26:34.472339 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.472310    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="863d6c38-1c72-49cc-8de6-5b07a8e9e75a" containerName="util"
Sep 11 14:26:34.472571 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.472387    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="863d6c38-1c72-49cc-8de6-5b07a8e9e75a" containerName="extract"
Sep 11 14:26:34.475706 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.475684    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf"
Sep 11 14:26:34.481341 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.481315    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 14:26:34.482250 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.482233    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 14:26:34.520509 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.520453    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf"]
Sep 11 14:26:34.581601 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.581567    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4-tls-certs\") pod \"kube-auth-proxy-769cf48dc6-ndchf\" (UID: \"8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4\") " pod="openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf"
Sep 11 14:26:34.581791 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.581612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2gzj\" (UniqueName: \"kubernetes.io/projected/8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4-kube-api-access-n2gzj\") pod \"kube-auth-proxy-769cf48dc6-ndchf\" (UID: \"8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4\") " pod="openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf"
Sep 11 14:26:34.581791 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.581708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4-tmp\") pod \"kube-auth-proxy-769cf48dc6-ndchf\" (UID: \"8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4\") " pod="openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf"
Sep 11 14:26:34.682275 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.682235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2gzj\" (UniqueName: \"kubernetes.io/projected/8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4-kube-api-access-n2gzj\") pod \"kube-auth-proxy-769cf48dc6-ndchf\" (UID: \"8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4\") " pod="openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf"
Sep 11 14:26:34.682469 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.682306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4-tmp\") pod \"kube-auth-proxy-769cf48dc6-ndchf\" (UID: \"8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4\") " pod="openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf"
Sep 11 14:26:34.682469 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.682359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4-tls-certs\") pod \"kube-auth-proxy-769cf48dc6-ndchf\" (UID: \"8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4\") " pod="openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf"
Sep 11 14:26:34.684839 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.684813    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4-tmp\") pod \"kube-auth-proxy-769cf48dc6-ndchf\" (UID: \"8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4\") " pod="openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf"
Sep 11 14:26:34.685001 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.684991    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4-tls-certs\") pod \"kube-auth-proxy-769cf48dc6-ndchf\" (UID: \"8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4\") " pod="openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf"
Sep 11 14:26:34.696742 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.696721    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2gzj\" (UniqueName: \"kubernetes.io/projected/8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4-kube-api-access-n2gzj\") pod \"kube-auth-proxy-769cf48dc6-ndchf\" (UID: \"8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4\") " pod="openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf"
Sep 11 14:26:34.785344 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:34.785253    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf"
Sep 11 14:26:35.097836 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:26:35.097783    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5504fd_ee0f_4e51_a98b_d5847d5a7cf4.slice/crio-77e81f7127d39ae668eb73cee76f8532fb45539d66299d956f9d2f0936734440 WatchSource:0}: Error finding container 77e81f7127d39ae668eb73cee76f8532fb45539d66299d956f9d2f0936734440: Status 404 returned error can't find the container with id 77e81f7127d39ae668eb73cee76f8532fb45539d66299d956f9d2f0936734440
Sep 11 14:26:35.100111 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:35.100087    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf"]
Sep 11 14:26:35.409911 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:35.409824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf" event={"ID":"8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4","Type":"ContainerStarted","Data":"77e81f7127d39ae668eb73cee76f8532fb45539d66299d956f9d2f0936734440"}
Sep 11 14:26:36.610296 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.610253    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"]
Sep 11 14:26:36.614764 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.614293    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.619019 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.618870    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 14:26:36.619259 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.619234    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 14:26:36.619374 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.619259    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-l2rwz\""
Sep 11 14:26:36.619837 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.619547    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 14:26:36.619837 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.619548    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 14:26:36.655024 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.654949    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"]
Sep 11 14:26:36.702979 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.702943    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.703196 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.703003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.703196 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.703120    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.703196 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.703156    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.703196 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.703184    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6gzz\" (UniqueName: \"kubernetes.io/projected/16195b88-a1c1-4a15-b04c-ecd29701351a-kube-api-access-s6gzz\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.703466 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.703212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.703466 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.703245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16195b88-a1c1-4a15-b04c-ecd29701351a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.804799 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.804759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.804970 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.804826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.804970 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.804909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.804970 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.804946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.805153 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.804975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6gzz\" (UniqueName: \"kubernetes.io/projected/16195b88-a1c1-4a15-b04c-ecd29701351a-kube-api-access-s6gzz\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.805153 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.805006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.805153 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.805067    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16195b88-a1c1-4a15-b04c-ecd29701351a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.805917 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.805843    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.808427 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.808368    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.808427 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.808372    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.809465 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.809439    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16195b88-a1c1-4a15-b04c-ecd29701351a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.809465 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.809460    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.821792 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.821764    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6gzz\" (UniqueName: \"kubernetes.io/projected/16195b88-a1c1-4a15-b04c-ecd29701351a-kube-api-access-s6gzz\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.822862 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.822840    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-h8rcr\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:36.927191 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:36.927106    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:38.415257 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:38.415221    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"]
Sep 11 14:26:38.416321 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:26:38.416290    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16195b88_a1c1_4a15_b04c_ecd29701351a.slice/crio-224db12ff4822e015d4ea9233e251add4e3421d6296a62b6da59e2ab0ac3b95c WatchSource:0}: Error finding container 224db12ff4822e015d4ea9233e251add4e3421d6296a62b6da59e2ab0ac3b95c: Status 404 returned error can't find the container with id 224db12ff4822e015d4ea9233e251add4e3421d6296a62b6da59e2ab0ac3b95c
Sep 11 14:26:38.426763 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:38.426734    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr" event={"ID":"16195b88-a1c1-4a15-b04c-ecd29701351a","Type":"ContainerStarted","Data":"224db12ff4822e015d4ea9233e251add4e3421d6296a62b6da59e2ab0ac3b95c"}
Sep 11 14:26:38.428225 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:38.428202    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf" event={"ID":"8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4","Type":"ContainerStarted","Data":"e58c15387ff7e0d8315d36cf36fa34d23bdf4904b33b6e1fd0bdfb4b33b53133"}
Sep 11 14:26:38.457561 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:38.457515    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-769cf48dc6-ndchf" podStartSLOduration=1.369802463 podStartE2EDuration="4.457498655s" totalImagesPullingTime="3.087696192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:26:38.456674083 +0000 UTC m=+695.489108943" watchObservedRunningTime="2026-09-11 14:26:38.457498655 +0000 UTC m=+695.489933515"
Sep 11 14:26:41.094496 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:41.094458    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:26:41.094750 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:41.094528    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:26:41.447827 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:41.447778    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr" event={"ID":"16195b88-a1c1-4a15-b04c-ecd29701351a","Type":"ContainerStarted","Data":"5cc39ffd1e514f88901b67441ba5bc5a841580e9930dc54057d2f20f4b65490b"}
Sep 11 14:26:41.447982 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:41.447937    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:41.477635 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:41.477591    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr" podStartSLOduration=2.801839436 podStartE2EDuration="5.477573459s" totalImagesPullingTime="2.675734023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:26:41.475818636 +0000 UTC m=+698.508253498" watchObservedRunningTime="2026-09-11 14:26:41.477573459 +0000 UTC m=+698.510008318"
Sep 11 14:26:42.455177 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:42.455144    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-h8rcr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 14:26:42.455542 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:42.455200    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr" podUID="16195b88-a1c1-4a15-b04c-ecd29701351a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 14:26:45.454542 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:45.454509    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:45.776216 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:45.776134    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sslsg"]
Sep 11 14:26:45.780881 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:45.780861    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sslsg"
Sep 11 14:26:45.785317 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:45.785300    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 11 14:26:45.787813 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:45.787793    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-4wmmt\""
Sep 11 14:26:45.833026 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:45.832993    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sslsg"]
Sep 11 14:26:45.891143 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:45.891108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c-tls-certs\") pod \"model-serving-api-54d89bd5fc-sslsg\" (UID: \"3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c\") " pod="opendatahub/model-serving-api-54d89bd5fc-sslsg"
Sep 11 14:26:45.891314 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:45.891168    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqljc\" (UniqueName: \"kubernetes.io/projected/3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c-kube-api-access-sqljc\") pod \"model-serving-api-54d89bd5fc-sslsg\" (UID: \"3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c\") " pod="opendatahub/model-serving-api-54d89bd5fc-sslsg"
Sep 11 14:26:45.992219 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:45.992181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqljc\" (UniqueName: \"kubernetes.io/projected/3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c-kube-api-access-sqljc\") pod \"model-serving-api-54d89bd5fc-sslsg\" (UID: \"3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c\") " pod="opendatahub/model-serving-api-54d89bd5fc-sslsg"
Sep 11 14:26:45.992412 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:45.992306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c-tls-certs\") pod \"model-serving-api-54d89bd5fc-sslsg\" (UID: \"3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c\") " pod="opendatahub/model-serving-api-54d89bd5fc-sslsg"
Sep 11 14:26:45.994990 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:45.994962    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c-tls-certs\") pod \"model-serving-api-54d89bd5fc-sslsg\" (UID: \"3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c\") " pod="opendatahub/model-serving-api-54d89bd5fc-sslsg"
Sep 11 14:26:46.021346 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:46.021315    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqljc\" (UniqueName: \"kubernetes.io/projected/3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c-kube-api-access-sqljc\") pod \"model-serving-api-54d89bd5fc-sslsg\" (UID: \"3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c\") " pod="opendatahub/model-serving-api-54d89bd5fc-sslsg"
Sep 11 14:26:46.091203 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:46.091125    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sslsg"
Sep 11 14:26:46.411027 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:46.410994    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sslsg"]
Sep 11 14:26:46.412079 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:26:46.412030    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bbcbbb6_5f44_4b0d_9a0a_dc45f814659c.slice/crio-1abd51d481bbb673763ccc00e9976623bb62356694325696a56a456a821fbc92 WatchSource:0}: Error finding container 1abd51d481bbb673763ccc00e9976623bb62356694325696a56a456a821fbc92: Status 404 returned error can't find the container with id 1abd51d481bbb673763ccc00e9976623bb62356694325696a56a456a821fbc92
Sep 11 14:26:46.472464 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:46.472427    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sslsg" event={"ID":"3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c","Type":"ContainerStarted","Data":"1abd51d481bbb673763ccc00e9976623bb62356694325696a56a456a821fbc92"}
Sep 11 14:26:49.494461 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:49.494431    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-sslsg"
Sep 11 14:26:49.494873 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:49.494481    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sslsg" event={"ID":"3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c","Type":"ContainerStarted","Data":"0583812d3663daecd88e38b4b06195fcec147cfbc03e8053b813b908ef20e484"}
Sep 11 14:26:49.527187 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:49.527143    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-sslsg" podStartSLOduration=2.510210373 podStartE2EDuration="4.527125218s" totalImagesPullingTime="2.016914845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:26:49.524152957 +0000 UTC m=+706.556587816" watchObservedRunningTime="2026-09-11 14:26:49.527125218 +0000 UTC m=+706.559560078"
Sep 11 14:26:52.848815 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:52.848774    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"]
Sep 11 14:26:52.858811 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:52.858778    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:52.879193 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:52.879160    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"]
Sep 11 14:26:52.954719 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:52.954685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3fce6c10-6e63-4aa9-a298-2c771678c36b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:52.954887 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:52.954731    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fce6c10-6e63-4aa9-a298-2c771678c36b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:52.954887 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:52.954812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3fce6c10-6e63-4aa9-a298-2c771678c36b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:52.954887 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:52.954863    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3fce6c10-6e63-4aa9-a298-2c771678c36b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:52.954887 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:52.954883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3fce6c10-6e63-4aa9-a298-2c771678c36b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:52.955089 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:52.954907    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lz7w\" (UniqueName: \"kubernetes.io/projected/3fce6c10-6e63-4aa9-a298-2c771678c36b-kube-api-access-7lz7w\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:52.955089 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:52.954938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fce6c10-6e63-4aa9-a298-2c771678c36b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.056156 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.056122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3fce6c10-6e63-4aa9-a298-2c771678c36b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.056156 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.056162    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fce6c10-6e63-4aa9-a298-2c771678c36b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.056401 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.056196    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3fce6c10-6e63-4aa9-a298-2c771678c36b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.056401 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.056363    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3fce6c10-6e63-4aa9-a298-2c771678c36b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.056401 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.056395    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3fce6c10-6e63-4aa9-a298-2c771678c36b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.056550 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.056414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lz7w\" (UniqueName: \"kubernetes.io/projected/3fce6c10-6e63-4aa9-a298-2c771678c36b-kube-api-access-7lz7w\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.056550 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.056474    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fce6c10-6e63-4aa9-a298-2c771678c36b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.057211 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.057173    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3fce6c10-6e63-4aa9-a298-2c771678c36b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.058916 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.058892    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3fce6c10-6e63-4aa9-a298-2c771678c36b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.059079 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.058937    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3fce6c10-6e63-4aa9-a298-2c771678c36b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.059278 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.059262    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3fce6c10-6e63-4aa9-a298-2c771678c36b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.059336 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.059260    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fce6c10-6e63-4aa9-a298-2c771678c36b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.109509 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.109432    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lz7w\" (UniqueName: \"kubernetes.io/projected/3fce6c10-6e63-4aa9-a298-2c771678c36b-kube-api-access-7lz7w\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.109744 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.109726    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fce6c10-6e63-4aa9-a298-2c771678c36b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gfwb8\" (UID: \"3fce6c10-6e63-4aa9-a298-2c771678c36b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.172142 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.172115    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:53.505921 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.505863    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"]
Sep 11 14:26:53.510338 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:26:53.510311    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fce6c10_6e63_4aa9_a298_2c771678c36b.slice/crio-eca438d8327e7d87945ca4c7cbd1495f152be4f617aa04edf4a0148866d23b35 WatchSource:0}: Error finding container eca438d8327e7d87945ca4c7cbd1495f152be4f617aa04edf4a0148866d23b35: Status 404 returned error can't find the container with id eca438d8327e7d87945ca4c7cbd1495f152be4f617aa04edf4a0148866d23b35
Sep 11 14:26:53.514071 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.514009    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:26:53.514189 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:53.514123    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:26:54.521236 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:54.521146    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8" event={"ID":"3fce6c10-6e63-4aa9-a298-2c771678c36b","Type":"ContainerStarted","Data":"9d3ed76d5c9b94fa59d555a2792a7cad9eaae01efb85b8be2f6b2731565c0a7e"}
Sep 11 14:26:54.521236 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:54.521196    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8" event={"ID":"3fce6c10-6e63-4aa9-a298-2c771678c36b","Type":"ContainerStarted","Data":"eca438d8327e7d87945ca4c7cbd1495f152be4f617aa04edf4a0148866d23b35"}
Sep 11 14:26:54.521672 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:54.521335    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:54.523072 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:54.523026    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-gfwb8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 14:26:54.523171 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:54.523092    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8" podUID="3fce6c10-6e63-4aa9-a298-2c771678c36b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 14:26:54.590581 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:54.590510    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8" podStartSLOduration=2.590486169 podStartE2EDuration="2.590486169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:26:54.586458479 +0000 UTC m=+711.618893339" watchObservedRunningTime="2026-09-11 14:26:54.590486169 +0000 UTC m=+711.622921031"
Sep 11 14:26:55.526415 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.526391    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gfwb8"
Sep 11 14:26:55.635418 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.635379    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"]
Sep 11 14:26:55.635637 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.635613    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr" podUID="16195b88-a1c1-4a15-b04c-ecd29701351a" containerName="discovery" containerID="cri-o://5cc39ffd1e514f88901b67441ba5bc5a841580e9930dc54057d2f20f4b65490b" gracePeriod=30
Sep 11 14:26:55.893759 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.893724    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:55.983881 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.983848    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-kubeconfig\") pod \"16195b88-a1c1-4a15-b04c-ecd29701351a\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") "
Sep 11 14:26:55.984092 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.983919    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-csr-dns-cert\") pod \"16195b88-a1c1-4a15-b04c-ecd29701351a\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") "
Sep 11 14:26:55.984092 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.984031    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-token\") pod \"16195b88-a1c1-4a15-b04c-ecd29701351a\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") "
Sep 11 14:26:55.984227 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.984093    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6gzz\" (UniqueName: \"kubernetes.io/projected/16195b88-a1c1-4a15-b04c-ecd29701351a-kube-api-access-s6gzz\") pod \"16195b88-a1c1-4a15-b04c-ecd29701351a\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") "
Sep 11 14:26:55.984227 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.984159    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-cacerts\") pod \"16195b88-a1c1-4a15-b04c-ecd29701351a\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") "
Sep 11 14:26:55.984227 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.984189    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-csr-ca-configmap\") pod \"16195b88-a1c1-4a15-b04c-ecd29701351a\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") "
Sep 11 14:26:55.984227 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.984224    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16195b88-a1c1-4a15-b04c-ecd29701351a-local-certs\") pod \"16195b88-a1c1-4a15-b04c-ecd29701351a\" (UID: \"16195b88-a1c1-4a15-b04c-ecd29701351a\") "
Sep 11 14:26:55.984764 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.984726    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "16195b88-a1c1-4a15-b04c-ecd29701351a" (UID: "16195b88-a1c1-4a15-b04c-ecd29701351a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:26:55.986921 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.986893    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "16195b88-a1c1-4a15-b04c-ecd29701351a" (UID: "16195b88-a1c1-4a15-b04c-ecd29701351a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:26:55.987293 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.987266    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-cacerts" (OuterVolumeSpecName: "cacerts") pod "16195b88-a1c1-4a15-b04c-ecd29701351a" (UID: "16195b88-a1c1-4a15-b04c-ecd29701351a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:26:55.987434 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.987292    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "16195b88-a1c1-4a15-b04c-ecd29701351a" (UID: "16195b88-a1c1-4a15-b04c-ecd29701351a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:26:55.987434 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.987313    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16195b88-a1c1-4a15-b04c-ecd29701351a-local-certs" (OuterVolumeSpecName: "local-certs") pod "16195b88-a1c1-4a15-b04c-ecd29701351a" (UID: "16195b88-a1c1-4a15-b04c-ecd29701351a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:26:55.987593 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.987323    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-token" (OuterVolumeSpecName: "istio-token") pod "16195b88-a1c1-4a15-b04c-ecd29701351a" (UID: "16195b88-a1c1-4a15-b04c-ecd29701351a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:26:55.987648 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:55.987573    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16195b88-a1c1-4a15-b04c-ecd29701351a-kube-api-access-s6gzz" (OuterVolumeSpecName: "kube-api-access-s6gzz") pod "16195b88-a1c1-4a15-b04c-ecd29701351a" (UID: "16195b88-a1c1-4a15-b04c-ecd29701351a"). InnerVolumeSpecName "kube-api-access-s6gzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:26:56.085204 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.085128    2582 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16195b88-a1c1-4a15-b04c-ecd29701351a-local-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:26:56.085204 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.085154    2582 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-kubeconfig\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:26:56.085204 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.085165    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-csr-dns-cert\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:26:56.085204 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.085173    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-token\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:26:56.085204 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.085182    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6gzz\" (UniqueName: \"kubernetes.io/projected/16195b88-a1c1-4a15-b04c-ecd29701351a-kube-api-access-s6gzz\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:26:56.085204 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.085190    2582 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16195b88-a1c1-4a15-b04c-ecd29701351a-cacerts\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:26:56.085204 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.085199    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16195b88-a1c1-4a15-b04c-ecd29701351a-istio-csr-ca-configmap\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:26:56.533138 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.533106    2582 generic.go:356] "Generic (PLEG): container finished" podID="16195b88-a1c1-4a15-b04c-ecd29701351a" containerID="5cc39ffd1e514f88901b67441ba5bc5a841580e9930dc54057d2f20f4b65490b" exitCode=0
Sep 11 14:26:56.533536 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.533151    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"
Sep 11 14:26:56.533536 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.533198    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr" event={"ID":"16195b88-a1c1-4a15-b04c-ecd29701351a","Type":"ContainerDied","Data":"5cc39ffd1e514f88901b67441ba5bc5a841580e9930dc54057d2f20f4b65490b"}
Sep 11 14:26:56.533536 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.533241    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr" event={"ID":"16195b88-a1c1-4a15-b04c-ecd29701351a","Type":"ContainerDied","Data":"224db12ff4822e015d4ea9233e251add4e3421d6296a62b6da59e2ab0ac3b95c"}
Sep 11 14:26:56.533536 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.533261    2582 scope.go:117] "RemoveContainer" containerID="5cc39ffd1e514f88901b67441ba5bc5a841580e9930dc54057d2f20f4b65490b"
Sep 11 14:26:56.542683 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.542668    2582 scope.go:117] "RemoveContainer" containerID="5cc39ffd1e514f88901b67441ba5bc5a841580e9930dc54057d2f20f4b65490b"
Sep 11 14:26:56.542951 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:26:56.542934    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cc39ffd1e514f88901b67441ba5bc5a841580e9930dc54057d2f20f4b65490b\": container with ID starting with 5cc39ffd1e514f88901b67441ba5bc5a841580e9930dc54057d2f20f4b65490b not found: ID does not exist" containerID="5cc39ffd1e514f88901b67441ba5bc5a841580e9930dc54057d2f20f4b65490b"
Sep 11 14:26:56.543014 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.542958    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cc39ffd1e514f88901b67441ba5bc5a841580e9930dc54057d2f20f4b65490b"} err="failed to get container status \"5cc39ffd1e514f88901b67441ba5bc5a841580e9930dc54057d2f20f4b65490b\": rpc error: code = NotFound desc = could not find container \"5cc39ffd1e514f88901b67441ba5bc5a841580e9930dc54057d2f20f4b65490b\": container with ID starting with 5cc39ffd1e514f88901b67441ba5bc5a841580e9930dc54057d2f20f4b65490b not found: ID does not exist"
Sep 11 14:26:56.565690 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.565663    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"]
Sep 11 14:26:56.582099 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:56.582072    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h8rcr"]
Sep 11 14:26:57.493920 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:57.493883    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16195b88-a1c1-4a15-b04c-ecd29701351a" path="/var/lib/kubelet/pods/16195b88-a1c1-4a15-b04c-ecd29701351a/volumes"
Sep 11 14:26:58.266546 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.266514    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kr722"]
Sep 11 14:26:58.266953 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.266849    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16195b88-a1c1-4a15-b04c-ecd29701351a" containerName="discovery"
Sep 11 14:26:58.266953 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.266859    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="16195b88-a1c1-4a15-b04c-ecd29701351a" containerName="discovery"
Sep 11 14:26:58.266953 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.266921    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="16195b88-a1c1-4a15-b04c-ecd29701351a" containerName="discovery"
Sep 11 14:26:58.269968 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.269953    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kr722"
Sep 11 14:26:58.277941 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.277919    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-s52kk\""
Sep 11 14:26:58.278084 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.277924    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 14:26:58.293522 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.293497    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kr722"]
Sep 11 14:26:58.305590 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.305566    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c843a96-0ede-4158-943c-e9765b06ee4e-cert\") pod \"kserve-controller-manager-d6f4b65b8-kr722\" (UID: \"3c843a96-0ede-4158-943c-e9765b06ee4e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kr722"
Sep 11 14:26:58.305704 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.305598    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w58kh\" (UniqueName: \"kubernetes.io/projected/3c843a96-0ede-4158-943c-e9765b06ee4e-kube-api-access-w58kh\") pod \"kserve-controller-manager-d6f4b65b8-kr722\" (UID: \"3c843a96-0ede-4158-943c-e9765b06ee4e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kr722"
Sep 11 14:26:58.406635 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.406599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c843a96-0ede-4158-943c-e9765b06ee4e-cert\") pod \"kserve-controller-manager-d6f4b65b8-kr722\" (UID: \"3c843a96-0ede-4158-943c-e9765b06ee4e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kr722"
Sep 11 14:26:58.406635 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.406637    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w58kh\" (UniqueName: \"kubernetes.io/projected/3c843a96-0ede-4158-943c-e9765b06ee4e-kube-api-access-w58kh\") pod \"kserve-controller-manager-d6f4b65b8-kr722\" (UID: \"3c843a96-0ede-4158-943c-e9765b06ee4e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kr722"
Sep 11 14:26:58.409464 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.409430    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c843a96-0ede-4158-943c-e9765b06ee4e-cert\") pod \"kserve-controller-manager-d6f4b65b8-kr722\" (UID: \"3c843a96-0ede-4158-943c-e9765b06ee4e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kr722"
Sep 11 14:26:58.427230 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.427205    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w58kh\" (UniqueName: \"kubernetes.io/projected/3c843a96-0ede-4158-943c-e9765b06ee4e-kube-api-access-w58kh\") pod \"kserve-controller-manager-d6f4b65b8-kr722\" (UID: \"3c843a96-0ede-4158-943c-e9765b06ee4e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kr722"
Sep 11 14:26:58.579755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.579665    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kr722"
Sep 11 14:26:58.870740 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:58.868947    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kr722"]
Sep 11 14:26:58.879268 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:26:58.879171    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c843a96_0ede_4158_943c_e9765b06ee4e.slice/crio-bb3e59b5fe8939f207da001a9e5fe15efcfb482c0413cd1ef453ba6515128f20 WatchSource:0}: Error finding container bb3e59b5fe8939f207da001a9e5fe15efcfb482c0413cd1ef453ba6515128f20: Status 404 returned error can't find the container with id bb3e59b5fe8939f207da001a9e5fe15efcfb482c0413cd1ef453ba6515128f20
Sep 11 14:26:59.551088 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:26:59.551052    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kr722" event={"ID":"3c843a96-0ede-4158-943c-e9765b06ee4e","Type":"ContainerStarted","Data":"bb3e59b5fe8939f207da001a9e5fe15efcfb482c0413cd1ef453ba6515128f20"}
Sep 11 14:27:00.175065 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.175018    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d476d9664-sprnp"]
Sep 11 14:27:00.178668 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.178639    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.224898 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.224865    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a84ccf7-db7b-4966-af3d-10b5a9f27505-console-oauth-config\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.225086 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.224931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a84ccf7-db7b-4966-af3d-10b5a9f27505-console-config\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.225086 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.224957    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a84ccf7-db7b-4966-af3d-10b5a9f27505-service-ca\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.225086 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.225076    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ztvl\" (UniqueName: \"kubernetes.io/projected/8a84ccf7-db7b-4966-af3d-10b5a9f27505-kube-api-access-4ztvl\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.225319 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.225105    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a84ccf7-db7b-4966-af3d-10b5a9f27505-console-serving-cert\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.225319 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.225130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a84ccf7-db7b-4966-af3d-10b5a9f27505-trusted-ca-bundle\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.225319 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.225151    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a84ccf7-db7b-4966-af3d-10b5a9f27505-oauth-serving-cert\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.278652 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.278619    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d476d9664-sprnp"]
Sep 11 14:27:00.326427 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.326391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ztvl\" (UniqueName: \"kubernetes.io/projected/8a84ccf7-db7b-4966-af3d-10b5a9f27505-kube-api-access-4ztvl\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.326618 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.326434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a84ccf7-db7b-4966-af3d-10b5a9f27505-console-serving-cert\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.326618 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.326452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a84ccf7-db7b-4966-af3d-10b5a9f27505-trusted-ca-bundle\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.326618 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.326473    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a84ccf7-db7b-4966-af3d-10b5a9f27505-oauth-serving-cert\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.326618 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.326508    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a84ccf7-db7b-4966-af3d-10b5a9f27505-console-oauth-config\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.326618 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.326556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a84ccf7-db7b-4966-af3d-10b5a9f27505-console-config\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.326618 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.326577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a84ccf7-db7b-4966-af3d-10b5a9f27505-service-ca\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.327355 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.327316    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a84ccf7-db7b-4966-af3d-10b5a9f27505-oauth-serving-cert\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.327464 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.327405    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a84ccf7-db7b-4966-af3d-10b5a9f27505-trusted-ca-bundle\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.327604 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.327547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a84ccf7-db7b-4966-af3d-10b5a9f27505-console-config\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.327649 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.327611    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a84ccf7-db7b-4966-af3d-10b5a9f27505-service-ca\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.329163 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.329140    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a84ccf7-db7b-4966-af3d-10b5a9f27505-console-oauth-config\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.329270 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.329251    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a84ccf7-db7b-4966-af3d-10b5a9f27505-console-serving-cert\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.503600 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.503572    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-sslsg"
Sep 11 14:27:00.515484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.515455    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ztvl\" (UniqueName: \"kubernetes.io/projected/8a84ccf7-db7b-4966-af3d-10b5a9f27505-kube-api-access-4ztvl\") pod \"console-7d476d9664-sprnp\" (UID: \"8a84ccf7-db7b-4966-af3d-10b5a9f27505\") " pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:00.790593 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:00.790478    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:01.533591 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:01.533516    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d476d9664-sprnp"]
Sep 11 14:27:01.536263 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:27:01.536226    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a84ccf7_db7b_4966_af3d_10b5a9f27505.slice/crio-aab60e2ca2ef87bc735c74d2167b48790895cea29434108814c569f84afc0b6f WatchSource:0}: Error finding container aab60e2ca2ef87bc735c74d2167b48790895cea29434108814c569f84afc0b6f: Status 404 returned error can't find the container with id aab60e2ca2ef87bc735c74d2167b48790895cea29434108814c569f84afc0b6f
Sep 11 14:27:01.563314 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:01.563276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d476d9664-sprnp" event={"ID":"8a84ccf7-db7b-4966-af3d-10b5a9f27505","Type":"ContainerStarted","Data":"aab60e2ca2ef87bc735c74d2167b48790895cea29434108814c569f84afc0b6f"}
Sep 11 14:27:01.564787 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:01.564765    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kr722" event={"ID":"3c843a96-0ede-4158-943c-e9765b06ee4e","Type":"ContainerStarted","Data":"1e2e2ec23ae54542eeebfac2eb229918c46067935b3f01fdbd18644cf48449d5"}
Sep 11 14:27:01.564892 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:01.564879    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kr722"
Sep 11 14:27:01.602650 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:01.602603    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kr722" podStartSLOduration=1.18714526 podStartE2EDuration="3.60258698s" totalImagesPullingTime="2.41544172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:01.601586249 +0000 UTC m=+718.634021110" watchObservedRunningTime="2026-09-11 14:27:01.60258698 +0000 UTC m=+718.635021839"
Sep 11 14:27:02.573005 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:02.572967    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d476d9664-sprnp" event={"ID":"8a84ccf7-db7b-4966-af3d-10b5a9f27505","Type":"ContainerStarted","Data":"ba56019ed0947fac0a4a7c4777db995e90b50e5a93a0fe9a8674185c08fb3f44"}
Sep 11 14:27:02.631567 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:02.631504    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d476d9664-sprnp" podStartSLOduration=2.631487385 podStartE2EDuration="2.631487385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:27:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:02.630361302 +0000 UTC m=+719.662796166" watchObservedRunningTime="2026-09-11 14:27:02.631487385 +0000 UTC m=+719.663922245"
Sep 11 14:27:10.791281 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:10.791237    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:10.791666 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:10.791299    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:10.796234 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:10.796211    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:11.620918 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:11.620889    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d476d9664-sprnp"
Sep 11 14:27:11.720290 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:11.720253    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fcfb4f5f6-vmqx6"]
Sep 11 14:27:32.578483 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:32.578449    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kr722"
Sep 11 14:27:36.741651 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:36.741594    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7fcfb4f5f6-vmqx6" podUID="91675628-8d74-491b-8b9e-1bf6abdb4dbd" containerName="console" containerID="cri-o://abedbd68fe779ab65865cd5d76ad2cf06a7da5a2fae34567e3431bc4d608ac4e" gracePeriod=15
Sep 11 14:27:36.983669 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:36.983639    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:27:37.157473 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.157382    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-oauth-config\") pod \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") "
Sep 11 14:27:37.157473 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.157438    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-service-ca\") pod \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") "
Sep 11 14:27:37.157665 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.157479    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-oauth-serving-cert\") pod \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") "
Sep 11 14:27:37.157665 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.157497    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj84p\" (UniqueName: \"kubernetes.io/projected/91675628-8d74-491b-8b9e-1bf6abdb4dbd-kube-api-access-sj84p\") pod \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") "
Sep 11 14:27:37.157665 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.157521    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-trusted-ca-bundle\") pod \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") "
Sep 11 14:27:37.157665 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.157541    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-serving-cert\") pod \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") "
Sep 11 14:27:37.157665 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.157613    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-config\") pod \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\" (UID: \"91675628-8d74-491b-8b9e-1bf6abdb4dbd\") "
Sep 11 14:27:37.157911 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.157863    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "91675628-8d74-491b-8b9e-1bf6abdb4dbd" (UID: "91675628-8d74-491b-8b9e-1bf6abdb4dbd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:27:37.158134 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.158106    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-service-ca" (OuterVolumeSpecName: "service-ca") pod "91675628-8d74-491b-8b9e-1bf6abdb4dbd" (UID: "91675628-8d74-491b-8b9e-1bf6abdb4dbd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:27:37.158134 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.158122    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "91675628-8d74-491b-8b9e-1bf6abdb4dbd" (UID: "91675628-8d74-491b-8b9e-1bf6abdb4dbd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:27:37.158496 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.158152    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-config" (OuterVolumeSpecName: "console-config") pod "91675628-8d74-491b-8b9e-1bf6abdb4dbd" (UID: "91675628-8d74-491b-8b9e-1bf6abdb4dbd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:27:37.159829 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.159804    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "91675628-8d74-491b-8b9e-1bf6abdb4dbd" (UID: "91675628-8d74-491b-8b9e-1bf6abdb4dbd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:27:37.160591 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.160571    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91675628-8d74-491b-8b9e-1bf6abdb4dbd-kube-api-access-sj84p" (OuterVolumeSpecName: "kube-api-access-sj84p") pod "91675628-8d74-491b-8b9e-1bf6abdb4dbd" (UID: "91675628-8d74-491b-8b9e-1bf6abdb4dbd"). InnerVolumeSpecName "kube-api-access-sj84p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:27:37.160591 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.160571    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "91675628-8d74-491b-8b9e-1bf6abdb4dbd" (UID: "91675628-8d74-491b-8b9e-1bf6abdb4dbd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:27:37.259231 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.259198    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-oauth-serving-cert\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:37.259231 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.259228    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj84p\" (UniqueName: \"kubernetes.io/projected/91675628-8d74-491b-8b9e-1bf6abdb4dbd-kube-api-access-sj84p\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:37.259472 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.259243    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-trusted-ca-bundle\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:37.259472 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.259256    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-serving-cert\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:37.259472 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.259267    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-config\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:37.259472 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.259278    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91675628-8d74-491b-8b9e-1bf6abdb4dbd-console-oauth-config\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:37.259472 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.259288    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91675628-8d74-491b-8b9e-1bf6abdb4dbd-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:37.744986 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.744952    2582 generic.go:356] "Generic (PLEG): container finished" podID="91675628-8d74-491b-8b9e-1bf6abdb4dbd" containerID="abedbd68fe779ab65865cd5d76ad2cf06a7da5a2fae34567e3431bc4d608ac4e" exitCode=0
Sep 11 14:27:37.745493 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.745003    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fcfb4f5f6-vmqx6"
Sep 11 14:27:37.745493 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.745067    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fcfb4f5f6-vmqx6" event={"ID":"91675628-8d74-491b-8b9e-1bf6abdb4dbd","Type":"ContainerDied","Data":"abedbd68fe779ab65865cd5d76ad2cf06a7da5a2fae34567e3431bc4d608ac4e"}
Sep 11 14:27:37.745493 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.745137    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fcfb4f5f6-vmqx6" event={"ID":"91675628-8d74-491b-8b9e-1bf6abdb4dbd","Type":"ContainerDied","Data":"bc6bd445c33fac4b31eb5ddc90909c89f9ddd88f72114e31ac769bbcb707eb97"}
Sep 11 14:27:37.745493 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.745170    2582 scope.go:117] "RemoveContainer" containerID="abedbd68fe779ab65865cd5d76ad2cf06a7da5a2fae34567e3431bc4d608ac4e"
Sep 11 14:27:37.755358 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.755331    2582 scope.go:117] "RemoveContainer" containerID="abedbd68fe779ab65865cd5d76ad2cf06a7da5a2fae34567e3431bc4d608ac4e"
Sep 11 14:27:37.755630 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:27:37.755609    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abedbd68fe779ab65865cd5d76ad2cf06a7da5a2fae34567e3431bc4d608ac4e\": container with ID starting with abedbd68fe779ab65865cd5d76ad2cf06a7da5a2fae34567e3431bc4d608ac4e not found: ID does not exist" containerID="abedbd68fe779ab65865cd5d76ad2cf06a7da5a2fae34567e3431bc4d608ac4e"
Sep 11 14:27:37.755751 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.755642    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abedbd68fe779ab65865cd5d76ad2cf06a7da5a2fae34567e3431bc4d608ac4e"} err="failed to get container status \"abedbd68fe779ab65865cd5d76ad2cf06a7da5a2fae34567e3431bc4d608ac4e\": rpc error: code = NotFound desc = could not find container \"abedbd68fe779ab65865cd5d76ad2cf06a7da5a2fae34567e3431bc4d608ac4e\": container with ID starting with abedbd68fe779ab65865cd5d76ad2cf06a7da5a2fae34567e3431bc4d608ac4e not found: ID does not exist"
Sep 11 14:27:37.772748 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.772727    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fcfb4f5f6-vmqx6"]
Sep 11 14:27:37.778246 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:37.778226    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fcfb4f5f6-vmqx6"]
Sep 11 14:27:39.494383 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:39.494347    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91675628-8d74-491b-8b9e-1bf6abdb4dbd" path="/var/lib/kubelet/pods/91675628-8d74-491b-8b9e-1bf6abdb4dbd/volumes"
Sep 11 14:27:50.063632 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.063597    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"]
Sep 11 14:27:50.064225 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.064123    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91675628-8d74-491b-8b9e-1bf6abdb4dbd" containerName="console"
Sep 11 14:27:50.064225 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.064144    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="91675628-8d74-491b-8b9e-1bf6abdb4dbd" containerName="console"
Sep 11 14:27:50.064355 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.064249    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="91675628-8d74-491b-8b9e-1bf6abdb4dbd" containerName="console"
Sep 11 14:27:50.068795 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.068773    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"
Sep 11 14:27:50.072592 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.072575    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 14:27:50.073183 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.073165    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rjv7x\""
Sep 11 14:27:50.073288 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.073170    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 14:27:50.080998 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.080972    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"]
Sep 11 14:27:50.157782 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.157753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rf5d\" (UniqueName: \"kubernetes.io/projected/b9b247c9-1763-42f3-919f-9e97894b14db-kube-api-access-2rf5d\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl\" (UID: \"b9b247c9-1763-42f3-919f-9e97894b14db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"
Sep 11 14:27:50.157944 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.157828    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9b247c9-1763-42f3-919f-9e97894b14db-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl\" (UID: \"b9b247c9-1763-42f3-919f-9e97894b14db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"
Sep 11 14:27:50.157944 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.157850    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9b247c9-1763-42f3-919f-9e97894b14db-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl\" (UID: \"b9b247c9-1763-42f3-919f-9e97894b14db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"
Sep 11 14:27:50.162000 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.161972    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"]
Sep 11 14:27:50.165570 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.165556    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"
Sep 11 14:27:50.184158 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.184128    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"]
Sep 11 14:27:50.258471 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.258437    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9b247c9-1763-42f3-919f-9e97894b14db-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl\" (UID: \"b9b247c9-1763-42f3-919f-9e97894b14db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"
Sep 11 14:27:50.258471 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.258475    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c13c493-7bbf-438a-a271-ffaa176fa380-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb\" (UID: \"3c13c493-7bbf-438a-a271-ffaa176fa380\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"
Sep 11 14:27:50.258730 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.258496    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5ckf\" (UniqueName: \"kubernetes.io/projected/3c13c493-7bbf-438a-a271-ffaa176fa380-kube-api-access-w5ckf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb\" (UID: \"3c13c493-7bbf-438a-a271-ffaa176fa380\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"
Sep 11 14:27:50.258730 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.258523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9b247c9-1763-42f3-919f-9e97894b14db-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl\" (UID: \"b9b247c9-1763-42f3-919f-9e97894b14db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"
Sep 11 14:27:50.258730 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.258655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rf5d\" (UniqueName: \"kubernetes.io/projected/b9b247c9-1763-42f3-919f-9e97894b14db-kube-api-access-2rf5d\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl\" (UID: \"b9b247c9-1763-42f3-919f-9e97894b14db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"
Sep 11 14:27:50.258730 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.258683    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c13c493-7bbf-438a-a271-ffaa176fa380-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb\" (UID: \"3c13c493-7bbf-438a-a271-ffaa176fa380\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"
Sep 11 14:27:50.258948 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.258904    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9b247c9-1763-42f3-919f-9e97894b14db-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl\" (UID: \"b9b247c9-1763-42f3-919f-9e97894b14db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"
Sep 11 14:27:50.258948 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.258932    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9b247c9-1763-42f3-919f-9e97894b14db-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl\" (UID: \"b9b247c9-1763-42f3-919f-9e97894b14db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"
Sep 11 14:27:50.275478 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.275453    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rf5d\" (UniqueName: \"kubernetes.io/projected/b9b247c9-1763-42f3-919f-9e97894b14db-kube-api-access-2rf5d\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl\" (UID: \"b9b247c9-1763-42f3-919f-9e97894b14db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"
Sep 11 14:27:50.286613 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.286584    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"]
Sep 11 14:27:50.290290 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.290272    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"
Sep 11 14:27:50.314102 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.314021    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"]
Sep 11 14:27:50.359135 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.359106    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f594da0-5a34-479b-aea2-766050ceb108-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z\" (UID: \"3f594da0-5a34-479b-aea2-766050ceb108\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"
Sep 11 14:27:50.359278 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.359142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c13c493-7bbf-438a-a271-ffaa176fa380-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb\" (UID: \"3c13c493-7bbf-438a-a271-ffaa176fa380\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"
Sep 11 14:27:50.359278 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.359168    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f594da0-5a34-479b-aea2-766050ceb108-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z\" (UID: \"3f594da0-5a34-479b-aea2-766050ceb108\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"
Sep 11 14:27:50.359370 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.359295    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqd9s\" (UniqueName: \"kubernetes.io/projected/3f594da0-5a34-479b-aea2-766050ceb108-kube-api-access-tqd9s\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z\" (UID: \"3f594da0-5a34-479b-aea2-766050ceb108\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"
Sep 11 14:27:50.359370 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.359316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c13c493-7bbf-438a-a271-ffaa176fa380-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb\" (UID: \"3c13c493-7bbf-438a-a271-ffaa176fa380\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"
Sep 11 14:27:50.359370 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.359332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5ckf\" (UniqueName: \"kubernetes.io/projected/3c13c493-7bbf-438a-a271-ffaa176fa380-kube-api-access-w5ckf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb\" (UID: \"3c13c493-7bbf-438a-a271-ffaa176fa380\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"
Sep 11 14:27:50.359535 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.359514    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c13c493-7bbf-438a-a271-ffaa176fa380-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb\" (UID: \"3c13c493-7bbf-438a-a271-ffaa176fa380\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"
Sep 11 14:27:50.359659 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.359634    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c13c493-7bbf-438a-a271-ffaa176fa380-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb\" (UID: \"3c13c493-7bbf-438a-a271-ffaa176fa380\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"
Sep 11 14:27:50.374337 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.374311    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"]
Sep 11 14:27:50.376017 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.375992    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5ckf\" (UniqueName: \"kubernetes.io/projected/3c13c493-7bbf-438a-a271-ffaa176fa380-kube-api-access-w5ckf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb\" (UID: \"3c13c493-7bbf-438a-a271-ffaa176fa380\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"
Sep 11 14:27:50.377976 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.377959    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"
Sep 11 14:27:50.378068 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.378031    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"
Sep 11 14:27:50.392936 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.392911    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"]
Sep 11 14:27:50.460100 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.460072    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb\" (UID: \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"
Sep 11 14:27:50.460245 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.460143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqd9s\" (UniqueName: \"kubernetes.io/projected/3f594da0-5a34-479b-aea2-766050ceb108-kube-api-access-tqd9s\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z\" (UID: \"3f594da0-5a34-479b-aea2-766050ceb108\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"
Sep 11 14:27:50.460245 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.460162    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb\" (UID: \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"
Sep 11 14:27:50.460245 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.460191    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f594da0-5a34-479b-aea2-766050ceb108-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z\" (UID: \"3f594da0-5a34-479b-aea2-766050ceb108\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"
Sep 11 14:27:50.460245 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.460213    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khnht\" (UniqueName: \"kubernetes.io/projected/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-kube-api-access-khnht\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb\" (UID: \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"
Sep 11 14:27:50.460245 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.460237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f594da0-5a34-479b-aea2-766050ceb108-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z\" (UID: \"3f594da0-5a34-479b-aea2-766050ceb108\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"
Sep 11 14:27:50.460560 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.460542    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f594da0-5a34-479b-aea2-766050ceb108-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z\" (UID: \"3f594da0-5a34-479b-aea2-766050ceb108\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"
Sep 11 14:27:50.460739 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.460718    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f594da0-5a34-479b-aea2-766050ceb108-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z\" (UID: \"3f594da0-5a34-479b-aea2-766050ceb108\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"
Sep 11 14:27:50.473639 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.473607    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqd9s\" (UniqueName: \"kubernetes.io/projected/3f594da0-5a34-479b-aea2-766050ceb108-kube-api-access-tqd9s\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z\" (UID: \"3f594da0-5a34-479b-aea2-766050ceb108\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"
Sep 11 14:27:50.473765 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.473750    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"
Sep 11 14:27:50.561408 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.561381    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khnht\" (UniqueName: \"kubernetes.io/projected/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-kube-api-access-khnht\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb\" (UID: \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"
Sep 11 14:27:50.561540 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.561435    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb\" (UID: \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"
Sep 11 14:27:50.561540 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.561490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb\" (UID: \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"
Sep 11 14:27:50.561905 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.561883    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb\" (UID: \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"
Sep 11 14:27:50.561905 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.561897    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb\" (UID: \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"
Sep 11 14:27:50.572542 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.572481    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khnht\" (UniqueName: \"kubernetes.io/projected/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-kube-api-access-khnht\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb\" (UID: \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"
Sep 11 14:27:50.599334 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.599307    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"
Sep 11 14:27:50.662224 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.662195    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"]
Sep 11 14:27:50.663733 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:27:50.663707    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b247c9_1763_42f3_919f_9e97894b14db.slice/crio-da43a85925ccfb56ba605219417079c895f7f515561e00f66336780d908157be WatchSource:0}: Error finding container da43a85925ccfb56ba605219417079c895f7f515561e00f66336780d908157be: Status 404 returned error can't find the container with id da43a85925ccfb56ba605219417079c895f7f515561e00f66336780d908157be
Sep 11 14:27:50.706954 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.706928    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"
Sep 11 14:27:50.752143 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.752097    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"]
Sep 11 14:27:50.753245 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:27:50.753215    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c13c493_7bbf_438a_a271_ffaa176fa380.slice/crio-403788cb657e93499e2631459858f472bf54e373dea399177a57320620723a98 WatchSource:0}: Error finding container 403788cb657e93499e2631459858f472bf54e373dea399177a57320620723a98: Status 404 returned error can't find the container with id 403788cb657e93499e2631459858f472bf54e373dea399177a57320620723a98
Sep 11 14:27:50.810598 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.810562    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb" event={"ID":"3c13c493-7bbf-438a-a271-ffaa176fa380","Type":"ContainerStarted","Data":"403788cb657e93499e2631459858f472bf54e373dea399177a57320620723a98"}
Sep 11 14:27:50.812090 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.812065    2582 generic.go:356] "Generic (PLEG): container finished" podID="b9b247c9-1763-42f3-919f-9e97894b14db" containerID="f78656f805542fb74ca7e4050f5b127a88de08887738542c13ae08d9cd3542f2" exitCode=0
Sep 11 14:27:50.812187 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.812155    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl" event={"ID":"b9b247c9-1763-42f3-919f-9e97894b14db","Type":"ContainerDied","Data":"f78656f805542fb74ca7e4050f5b127a88de08887738542c13ae08d9cd3542f2"}
Sep 11 14:27:50.812231 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.812196    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl" event={"ID":"b9b247c9-1763-42f3-919f-9e97894b14db","Type":"ContainerStarted","Data":"da43a85925ccfb56ba605219417079c895f7f515561e00f66336780d908157be"}
Sep 11 14:27:50.877070 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.877025    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"]
Sep 11 14:27:50.878893 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:27:50.878868    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f594da0_5a34_479b_aea2_766050ceb108.slice/crio-75590b83a99304b6e1cc94497a392302e930593acdc8ff9a1fef8ef79f1c241d WatchSource:0}: Error finding container 75590b83a99304b6e1cc94497a392302e930593acdc8ff9a1fef8ef79f1c241d: Status 404 returned error can't find the container with id 75590b83a99304b6e1cc94497a392302e930593acdc8ff9a1fef8ef79f1c241d
Sep 11 14:27:50.983415 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:50.983389    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"]
Sep 11 14:27:51.024907 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:27:51.024877    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc28dfd_c5ab_4f0e_8cc0_e3f6a44c68c8.slice/crio-5e0a2e3949ab4f9049617736de719e25bc6d23194cdc5fd337b28ee9b7c8ca4a WatchSource:0}: Error finding container 5e0a2e3949ab4f9049617736de719e25bc6d23194cdc5fd337b28ee9b7c8ca4a: Status 404 returned error can't find the container with id 5e0a2e3949ab4f9049617736de719e25bc6d23194cdc5fd337b28ee9b7c8ca4a
Sep 11 14:27:51.818448 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:51.818404    2582 generic.go:356] "Generic (PLEG): container finished" podID="3c13c493-7bbf-438a-a271-ffaa176fa380" containerID="4913c8f0089e405731fd10bbdbbf5374129fbdbe9992d24f3278f9b161272f27" exitCode=0
Sep 11 14:27:51.818448 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:51.818441    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb" event={"ID":"3c13c493-7bbf-438a-a271-ffaa176fa380","Type":"ContainerDied","Data":"4913c8f0089e405731fd10bbdbbf5374129fbdbe9992d24f3278f9b161272f27"}
Sep 11 14:27:51.820270 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:51.820247    2582 generic.go:356] "Generic (PLEG): container finished" podID="3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8" containerID="93ab0faa60a5a0c47e304486d6ff0f90e3717c1731fc72673aab0443a7ea88f6" exitCode=0
Sep 11 14:27:51.820364 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:51.820346    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb" event={"ID":"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8","Type":"ContainerDied","Data":"93ab0faa60a5a0c47e304486d6ff0f90e3717c1731fc72673aab0443a7ea88f6"}
Sep 11 14:27:51.820436 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:51.820388    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb" event={"ID":"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8","Type":"ContainerStarted","Data":"5e0a2e3949ab4f9049617736de719e25bc6d23194cdc5fd337b28ee9b7c8ca4a"}
Sep 11 14:27:51.822133 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:51.822110    2582 generic.go:356] "Generic (PLEG): container finished" podID="3f594da0-5a34-479b-aea2-766050ceb108" containerID="55b214d8e4e3ce3768fc6dc7f9a2e100055db90d1481baf91ee28cee7e1ddbe0" exitCode=0
Sep 11 14:27:51.822208 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:51.822143    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z" event={"ID":"3f594da0-5a34-479b-aea2-766050ceb108","Type":"ContainerDied","Data":"55b214d8e4e3ce3768fc6dc7f9a2e100055db90d1481baf91ee28cee7e1ddbe0"}
Sep 11 14:27:51.822208 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:51.822174    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z" event={"ID":"3f594da0-5a34-479b-aea2-766050ceb108","Type":"ContainerStarted","Data":"75590b83a99304b6e1cc94497a392302e930593acdc8ff9a1fef8ef79f1c241d"}
Sep 11 14:27:52.829896 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:52.829868    2582 generic.go:356] "Generic (PLEG): container finished" podID="b9b247c9-1763-42f3-919f-9e97894b14db" containerID="0bf31499186d228eea3e1fb40ac4ed5bdfe463854eb1c3e3e799cb9cc22b90c0" exitCode=0
Sep 11 14:27:52.830220 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:52.829939    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl" event={"ID":"b9b247c9-1763-42f3-919f-9e97894b14db","Type":"ContainerDied","Data":"0bf31499186d228eea3e1fb40ac4ed5bdfe463854eb1c3e3e799cb9cc22b90c0"}
Sep 11 14:27:53.837768 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:53.837725    2582 generic.go:356] "Generic (PLEG): container finished" podID="3f594da0-5a34-479b-aea2-766050ceb108" containerID="42f054520d0d1f142d24244fb83851d2c7b81e985f4f461b07accf1a7d2b872f" exitCode=0
Sep 11 14:27:53.838217 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:53.837809    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z" event={"ID":"3f594da0-5a34-479b-aea2-766050ceb108","Type":"ContainerDied","Data":"42f054520d0d1f142d24244fb83851d2c7b81e985f4f461b07accf1a7d2b872f"}
Sep 11 14:27:53.840335 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:53.840310    2582 generic.go:356] "Generic (PLEG): container finished" podID="b9b247c9-1763-42f3-919f-9e97894b14db" containerID="2ba62c44707d529ac1ffbd0a02413e1f7d16c0de461cc8032be834f81577d7cb" exitCode=0
Sep 11 14:27:53.840463 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:53.840444    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl" event={"ID":"b9b247c9-1763-42f3-919f-9e97894b14db","Type":"ContainerDied","Data":"2ba62c44707d529ac1ffbd0a02413e1f7d16c0de461cc8032be834f81577d7cb"}
Sep 11 14:27:53.842266 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:53.842245    2582 generic.go:356] "Generic (PLEG): container finished" podID="3c13c493-7bbf-438a-a271-ffaa176fa380" containerID="fef6d404fea834e1d74b1d23befc9320530b04480c8bbd7f7c092f73a7bf95f0" exitCode=0
Sep 11 14:27:53.842365 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:53.842307    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb" event={"ID":"3c13c493-7bbf-438a-a271-ffaa176fa380","Type":"ContainerDied","Data":"fef6d404fea834e1d74b1d23befc9320530b04480c8bbd7f7c092f73a7bf95f0"}
Sep 11 14:27:53.844387 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:53.844366    2582 generic.go:356] "Generic (PLEG): container finished" podID="3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8" containerID="38c5ee38739dba33a6c45281be28b9538ea8a7193f43e7e2f1441477df6037b2" exitCode=0
Sep 11 14:27:53.844475 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:53.844425    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb" event={"ID":"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8","Type":"ContainerDied","Data":"38c5ee38739dba33a6c45281be28b9538ea8a7193f43e7e2f1441477df6037b2"}
Sep 11 14:27:54.857950 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:54.857913    2582 generic.go:356] "Generic (PLEG): container finished" podID="3c13c493-7bbf-438a-a271-ffaa176fa380" containerID="d39867cc3dc4aa155b1181eca789beda77181cb60dd00a487931e1c9048599be" exitCode=0
Sep 11 14:27:54.858349 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:54.857986    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb" event={"ID":"3c13c493-7bbf-438a-a271-ffaa176fa380","Type":"ContainerDied","Data":"d39867cc3dc4aa155b1181eca789beda77181cb60dd00a487931e1c9048599be"}
Sep 11 14:27:54.860112 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:54.860091    2582 generic.go:356] "Generic (PLEG): container finished" podID="3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8" containerID="f8173e5594a880de2dabbd2683359244692c98684caf26238917318d45ff215f" exitCode=0
Sep 11 14:27:54.860226 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:54.860167    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb" event={"ID":"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8","Type":"ContainerDied","Data":"f8173e5594a880de2dabbd2683359244692c98684caf26238917318d45ff215f"}
Sep 11 14:27:54.862196 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:54.862175    2582 generic.go:356] "Generic (PLEG): container finished" podID="3f594da0-5a34-479b-aea2-766050ceb108" containerID="b8555aa80b0f22761c9b8b4f766607156dbf600c23b24eb87be1ab1d3e7a9d0b" exitCode=0
Sep 11 14:27:54.862286 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:54.862249    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z" event={"ID":"3f594da0-5a34-479b-aea2-766050ceb108","Type":"ContainerDied","Data":"b8555aa80b0f22761c9b8b4f766607156dbf600c23b24eb87be1ab1d3e7a9d0b"}
Sep 11 14:27:55.002055 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:55.002017    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"
Sep 11 14:27:55.108557 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:55.108464    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9b247c9-1763-42f3-919f-9e97894b14db-util\") pod \"b9b247c9-1763-42f3-919f-9e97894b14db\" (UID: \"b9b247c9-1763-42f3-919f-9e97894b14db\") "
Sep 11 14:27:55.108557 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:55.108537    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rf5d\" (UniqueName: \"kubernetes.io/projected/b9b247c9-1763-42f3-919f-9e97894b14db-kube-api-access-2rf5d\") pod \"b9b247c9-1763-42f3-919f-9e97894b14db\" (UID: \"b9b247c9-1763-42f3-919f-9e97894b14db\") "
Sep 11 14:27:55.108756 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:55.108572    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9b247c9-1763-42f3-919f-9e97894b14db-bundle\") pod \"b9b247c9-1763-42f3-919f-9e97894b14db\" (UID: \"b9b247c9-1763-42f3-919f-9e97894b14db\") "
Sep 11 14:27:55.109240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:55.109166    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b247c9-1763-42f3-919f-9e97894b14db-bundle" (OuterVolumeSpecName: "bundle") pod "b9b247c9-1763-42f3-919f-9e97894b14db" (UID: "b9b247c9-1763-42f3-919f-9e97894b14db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:27:55.110896 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:55.110870    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9b247c9-1763-42f3-919f-9e97894b14db-kube-api-access-2rf5d" (OuterVolumeSpecName: "kube-api-access-2rf5d") pod "b9b247c9-1763-42f3-919f-9e97894b14db" (UID: "b9b247c9-1763-42f3-919f-9e97894b14db"). InnerVolumeSpecName "kube-api-access-2rf5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:27:55.114325 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:55.114305    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b247c9-1763-42f3-919f-9e97894b14db-util" (OuterVolumeSpecName: "util") pod "b9b247c9-1763-42f3-919f-9e97894b14db" (UID: "b9b247c9-1763-42f3-919f-9e97894b14db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:27:55.210163 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:55.210110    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9b247c9-1763-42f3-919f-9e97894b14db-util\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:55.210163 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:55.210157    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rf5d\" (UniqueName: \"kubernetes.io/projected/b9b247c9-1763-42f3-919f-9e97894b14db-kube-api-access-2rf5d\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:55.210163 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:55.210169    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9b247c9-1763-42f3-919f-9e97894b14db-bundle\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:55.869517 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:55.869433    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl"
Sep 11 14:27:55.869517 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:55.869449    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d758djl" event={"ID":"b9b247c9-1763-42f3-919f-9e97894b14db","Type":"ContainerDied","Data":"da43a85925ccfb56ba605219417079c895f7f515561e00f66336780d908157be"}
Sep 11 14:27:55.869517 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:55.869500    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da43a85925ccfb56ba605219417079c895f7f515561e00f66336780d908157be"
Sep 11 14:27:56.015386 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.015356    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"
Sep 11 14:27:56.038629 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.038585    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"
Sep 11 14:27:56.053954 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.053927    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"
Sep 11 14:27:56.118277 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.118244    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f594da0-5a34-479b-aea2-766050ceb108-util\") pod \"3f594da0-5a34-479b-aea2-766050ceb108\" (UID: \"3f594da0-5a34-479b-aea2-766050ceb108\") "
Sep 11 14:27:56.118439 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.118310    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqd9s\" (UniqueName: \"kubernetes.io/projected/3f594da0-5a34-479b-aea2-766050ceb108-kube-api-access-tqd9s\") pod \"3f594da0-5a34-479b-aea2-766050ceb108\" (UID: \"3f594da0-5a34-479b-aea2-766050ceb108\") "
Sep 11 14:27:56.118439 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.118344    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c13c493-7bbf-438a-a271-ffaa176fa380-bundle\") pod \"3c13c493-7bbf-438a-a271-ffaa176fa380\" (UID: \"3c13c493-7bbf-438a-a271-ffaa176fa380\") "
Sep 11 14:27:56.118439 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.118382    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-util\") pod \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\" (UID: \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\") "
Sep 11 14:27:56.118439 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.118414    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khnht\" (UniqueName: \"kubernetes.io/projected/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-kube-api-access-khnht\") pod \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\" (UID: \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\") "
Sep 11 14:27:56.118672 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.118447    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5ckf\" (UniqueName: \"kubernetes.io/projected/3c13c493-7bbf-438a-a271-ffaa176fa380-kube-api-access-w5ckf\") pod \"3c13c493-7bbf-438a-a271-ffaa176fa380\" (UID: \"3c13c493-7bbf-438a-a271-ffaa176fa380\") "
Sep 11 14:27:56.118672 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.118477    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f594da0-5a34-479b-aea2-766050ceb108-bundle\") pod \"3f594da0-5a34-479b-aea2-766050ceb108\" (UID: \"3f594da0-5a34-479b-aea2-766050ceb108\") "
Sep 11 14:27:56.118672 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.118525    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-bundle\") pod \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\" (UID: \"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8\") "
Sep 11 14:27:56.118672 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.118650    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c13c493-7bbf-438a-a271-ffaa176fa380-util\") pod \"3c13c493-7bbf-438a-a271-ffaa176fa380\" (UID: \"3c13c493-7bbf-438a-a271-ffaa176fa380\") "
Sep 11 14:27:56.119329 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.119267    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c13c493-7bbf-438a-a271-ffaa176fa380-bundle" (OuterVolumeSpecName: "bundle") pod "3c13c493-7bbf-438a-a271-ffaa176fa380" (UID: "3c13c493-7bbf-438a-a271-ffaa176fa380"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:27:56.119610 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.119528    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f594da0-5a34-479b-aea2-766050ceb108-bundle" (OuterVolumeSpecName: "bundle") pod "3f594da0-5a34-479b-aea2-766050ceb108" (UID: "3f594da0-5a34-479b-aea2-766050ceb108"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:27:56.119884 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.119823    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-bundle" (OuterVolumeSpecName: "bundle") pod "3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8" (UID: "3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:27:56.120825 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.120797    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-kube-api-access-khnht" (OuterVolumeSpecName: "kube-api-access-khnht") pod "3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8" (UID: "3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8"). InnerVolumeSpecName "kube-api-access-khnht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:27:56.121018 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.121001    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f594da0-5a34-479b-aea2-766050ceb108-kube-api-access-tqd9s" (OuterVolumeSpecName: "kube-api-access-tqd9s") pod "3f594da0-5a34-479b-aea2-766050ceb108" (UID: "3f594da0-5a34-479b-aea2-766050ceb108"). InnerVolumeSpecName "kube-api-access-tqd9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:27:56.121344 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.121326    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c13c493-7bbf-438a-a271-ffaa176fa380-kube-api-access-w5ckf" (OuterVolumeSpecName: "kube-api-access-w5ckf") pod "3c13c493-7bbf-438a-a271-ffaa176fa380" (UID: "3c13c493-7bbf-438a-a271-ffaa176fa380"). InnerVolumeSpecName "kube-api-access-w5ckf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:27:56.124731 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.124693    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-util" (OuterVolumeSpecName: "util") pod "3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8" (UID: "3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:27:56.219903 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.219874    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqd9s\" (UniqueName: \"kubernetes.io/projected/3f594da0-5a34-479b-aea2-766050ceb108-kube-api-access-tqd9s\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:56.219903 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.219900    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c13c493-7bbf-438a-a271-ffaa176fa380-bundle\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:56.219903 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.219910    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-util\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:56.220128 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.219918    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khnht\" (UniqueName: \"kubernetes.io/projected/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-kube-api-access-khnht\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:56.220128 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.219928    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5ckf\" (UniqueName: \"kubernetes.io/projected/3c13c493-7bbf-438a-a271-ffaa176fa380-kube-api-access-w5ckf\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:56.220128 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.219936    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f594da0-5a34-479b-aea2-766050ceb108-bundle\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:56.220128 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.219944    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8-bundle\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:56.261354 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.261320    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c13c493-7bbf-438a-a271-ffaa176fa380-util" (OuterVolumeSpecName: "util") pod "3c13c493-7bbf-438a-a271-ffaa176fa380" (UID: "3c13c493-7bbf-438a-a271-ffaa176fa380"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:27:56.264597 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.264574    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f594da0-5a34-479b-aea2-766050ceb108-util" (OuterVolumeSpecName: "util") pod "3f594da0-5a34-479b-aea2-766050ceb108" (UID: "3f594da0-5a34-479b-aea2-766050ceb108"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:27:56.320914 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.320883    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c13c493-7bbf-438a-a271-ffaa176fa380-util\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:56.320914 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.320912    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f594da0-5a34-479b-aea2-766050ceb108-util\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:27:56.876279 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.876252    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z"
Sep 11 14:27:56.876764 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.876279    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw2v4z" event={"ID":"3f594da0-5a34-479b-aea2-766050ceb108","Type":"ContainerDied","Data":"75590b83a99304b6e1cc94497a392302e930593acdc8ff9a1fef8ef79f1c241d"}
Sep 11 14:27:56.876764 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.876335    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75590b83a99304b6e1cc94497a392302e930593acdc8ff9a1fef8ef79f1c241d"
Sep 11 14:27:56.878344 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.878320    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb"
Sep 11 14:27:56.878452 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.878341    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n2tvb" event={"ID":"3c13c493-7bbf-438a-a271-ffaa176fa380","Type":"ContainerDied","Data":"403788cb657e93499e2631459858f472bf54e373dea399177a57320620723a98"}
Sep 11 14:27:56.878452 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.878379    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="403788cb657e93499e2631459858f472bf54e373dea399177a57320620723a98"
Sep 11 14:27:56.880482 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.880457    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb" event={"ID":"3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8","Type":"ContainerDied","Data":"5e0a2e3949ab4f9049617736de719e25bc6d23194cdc5fd337b28ee9b7c8ca4a"}
Sep 11 14:27:56.880590 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.880494    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e0a2e3949ab4f9049617736de719e25bc6d23194cdc5fd337b28ee9b7c8ca4a"
Sep 11 14:27:56.880590 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:27:56.880465    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cf57gb"
Sep 11 14:28:05.440696 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.440652    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bs2sx"]
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.440984    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c13c493-7bbf-438a-a271-ffaa176fa380" containerName="util"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.440995    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c13c493-7bbf-438a-a271-ffaa176fa380" containerName="util"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441004    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8" containerName="pull"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441009    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8" containerName="pull"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441016    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f594da0-5a34-479b-aea2-766050ceb108" containerName="extract"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441022    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f594da0-5a34-479b-aea2-766050ceb108" containerName="extract"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441029    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9b247c9-1763-42f3-919f-9e97894b14db" containerName="pull"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441048    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9b247c9-1763-42f3-919f-9e97894b14db" containerName="pull"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441055    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f594da0-5a34-479b-aea2-766050ceb108" containerName="pull"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441060    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f594da0-5a34-479b-aea2-766050ceb108" containerName="pull"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441078    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8" containerName="extract"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441083    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8" containerName="extract"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441089    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9b247c9-1763-42f3-919f-9e97894b14db" containerName="util"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441094    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9b247c9-1763-42f3-919f-9e97894b14db" containerName="util"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441099    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8" containerName="util"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441104    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8" containerName="util"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441109    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c13c493-7bbf-438a-a271-ffaa176fa380" containerName="pull"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441113    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c13c493-7bbf-438a-a271-ffaa176fa380" containerName="pull"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441118    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9b247c9-1763-42f3-919f-9e97894b14db" containerName="extract"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441123    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9b247c9-1763-42f3-919f-9e97894b14db" containerName="extract"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441130    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c13c493-7bbf-438a-a271-ffaa176fa380" containerName="extract"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441135    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c13c493-7bbf-438a-a271-ffaa176fa380" containerName="extract"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441142    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f594da0-5a34-479b-aea2-766050ceb108" containerName="util"
Sep 11 14:28:05.441130 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441146    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f594da0-5a34-479b-aea2-766050ceb108" containerName="util"
Sep 11 14:28:05.441895 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441195    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9b247c9-1763-42f3-919f-9e97894b14db" containerName="extract"
Sep 11 14:28:05.441895 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441202    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f594da0-5a34-479b-aea2-766050ceb108" containerName="extract"
Sep 11 14:28:05.441895 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441210    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c13c493-7bbf-438a-a271-ffaa176fa380" containerName="extract"
Sep 11 14:28:05.441895 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.441220    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc28dfd-c5ab-4f0e-8cc0-e3f6a44c68c8" containerName="extract"
Sep 11 14:28:05.445536 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.445516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-bs2sx"
Sep 11 14:28:05.448869 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.448842    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 14:28:05.448999 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.448986    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 14:28:05.449687 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.449670    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-9bcqc\""
Sep 11 14:28:05.470650 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.470628    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bs2sx"]
Sep 11 14:28:05.506425 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.506397    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzrh7\" (UniqueName: \"kubernetes.io/projected/301af0e9-5555-4cd7-b985-ae43c9d55b66-kube-api-access-lzrh7\") pod \"authorino-operator-76b478bd78-bs2sx\" (UID: \"301af0e9-5555-4cd7-b985-ae43c9d55b66\") " pod="kuadrant-system/authorino-operator-76b478bd78-bs2sx"
Sep 11 14:28:05.607198 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.607160    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzrh7\" (UniqueName: \"kubernetes.io/projected/301af0e9-5555-4cd7-b985-ae43c9d55b66-kube-api-access-lzrh7\") pod \"authorino-operator-76b478bd78-bs2sx\" (UID: \"301af0e9-5555-4cd7-b985-ae43c9d55b66\") " pod="kuadrant-system/authorino-operator-76b478bd78-bs2sx"
Sep 11 14:28:05.680503 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.680468    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzrh7\" (UniqueName: \"kubernetes.io/projected/301af0e9-5555-4cd7-b985-ae43c9d55b66-kube-api-access-lzrh7\") pod \"authorino-operator-76b478bd78-bs2sx\" (UID: \"301af0e9-5555-4cd7-b985-ae43c9d55b66\") " pod="kuadrant-system/authorino-operator-76b478bd78-bs2sx"
Sep 11 14:28:05.755924 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:05.755843    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-bs2sx"
Sep 11 14:28:06.073575 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:28:06.073542    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod301af0e9_5555_4cd7_b985_ae43c9d55b66.slice/crio-aba80ff19c867e54ec20243db5df9194deac6658da7c286260cc22123721a5ba WatchSource:0}: Error finding container aba80ff19c867e54ec20243db5df9194deac6658da7c286260cc22123721a5ba: Status 404 returned error can't find the container with id aba80ff19c867e54ec20243db5df9194deac6658da7c286260cc22123721a5ba
Sep 11 14:28:06.086189 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:06.086168    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bs2sx"]
Sep 11 14:28:06.937660 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:06.937620    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-bs2sx" event={"ID":"301af0e9-5555-4cd7-b985-ae43c9d55b66","Type":"ContainerStarted","Data":"aba80ff19c867e54ec20243db5df9194deac6658da7c286260cc22123721a5ba"}
Sep 11 14:28:08.954403 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:08.954361    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-bs2sx" event={"ID":"301af0e9-5555-4cd7-b985-ae43c9d55b66","Type":"ContainerStarted","Data":"2c5d26853e69bacec8c6a2f131bf9d435207398346e9da7c0378da164a2fc4f4"}
Sep 11 14:28:08.954781 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:08.954496    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-bs2sx"
Sep 11 14:28:08.989820 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:08.989772    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-bs2sx" podStartSLOduration=1.51623646 podStartE2EDuration="3.989757568s" totalImagesPullingTime="2.473521108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:28:08.9875054 +0000 UTC m=+786.019940259" watchObservedRunningTime="2026-09-11 14:28:08.989757568 +0000 UTC m=+786.022192427"
Sep 11 14:28:19.961783 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:28:19.961756    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-bs2sx"
Sep 11 14:29:13.213186 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:13.213145    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-b5ktv"]
Sep 11 14:29:13.216760 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:13.216739    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-b5ktv"
Sep 11 14:29:13.221784 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:13.221754    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-df2n6\""
Sep 11 14:29:13.222572 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:13.222550    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 14:29:13.230878 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:13.230853    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-b5ktv"]
Sep 11 14:29:13.304567 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:13.304538    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-b5ktv"]
Sep 11 14:29:13.311628 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:13.311599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp775\" (UniqueName: \"kubernetes.io/projected/fbf7878c-723f-4d19-8b98-f3bd084cfabb-kube-api-access-hp775\") pod \"limitador-limitador-8588749977-b5ktv\" (UID: \"fbf7878c-723f-4d19-8b98-f3bd084cfabb\") " pod="kuadrant-system/limitador-limitador-8588749977-b5ktv"
Sep 11 14:29:13.311790 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:13.311646    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fbf7878c-723f-4d19-8b98-f3bd084cfabb-config-file\") pod \"limitador-limitador-8588749977-b5ktv\" (UID: \"fbf7878c-723f-4d19-8b98-f3bd084cfabb\") " pod="kuadrant-system/limitador-limitador-8588749977-b5ktv"
Sep 11 14:29:13.412801 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:13.412763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp775\" (UniqueName: \"kubernetes.io/projected/fbf7878c-723f-4d19-8b98-f3bd084cfabb-kube-api-access-hp775\") pod \"limitador-limitador-8588749977-b5ktv\" (UID: \"fbf7878c-723f-4d19-8b98-f3bd084cfabb\") " pod="kuadrant-system/limitador-limitador-8588749977-b5ktv"
Sep 11 14:29:13.412952 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:13.412830    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fbf7878c-723f-4d19-8b98-f3bd084cfabb-config-file\") pod \"limitador-limitador-8588749977-b5ktv\" (UID: \"fbf7878c-723f-4d19-8b98-f3bd084cfabb\") " pod="kuadrant-system/limitador-limitador-8588749977-b5ktv"
Sep 11 14:29:13.413466 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:13.413448    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fbf7878c-723f-4d19-8b98-f3bd084cfabb-config-file\") pod \"limitador-limitador-8588749977-b5ktv\" (UID: \"fbf7878c-723f-4d19-8b98-f3bd084cfabb\") " pod="kuadrant-system/limitador-limitador-8588749977-b5ktv"
Sep 11 14:29:13.429189 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:13.429168    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp775\" (UniqueName: \"kubernetes.io/projected/fbf7878c-723f-4d19-8b98-f3bd084cfabb-kube-api-access-hp775\") pod \"limitador-limitador-8588749977-b5ktv\" (UID: \"fbf7878c-723f-4d19-8b98-f3bd084cfabb\") " pod="kuadrant-system/limitador-limitador-8588749977-b5ktv"
Sep 11 14:29:13.526610 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:13.526539    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-b5ktv"
Sep 11 14:29:13.823363 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:13.823336    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-b5ktv"]
Sep 11 14:29:13.826304 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:29:13.826268    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf7878c_723f_4d19_8b98_f3bd084cfabb.slice/crio-f14ea14dc4d06caa0181b9ad04ae623899617a189e10436399ee64177b2dcb60 WatchSource:0}: Error finding container f14ea14dc4d06caa0181b9ad04ae623899617a189e10436399ee64177b2dcb60: Status 404 returned error can't find the container with id f14ea14dc4d06caa0181b9ad04ae623899617a189e10436399ee64177b2dcb60
Sep 11 14:29:14.293641 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:14.293605    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-b5ktv" event={"ID":"fbf7878c-723f-4d19-8b98-f3bd084cfabb","Type":"ContainerStarted","Data":"f14ea14dc4d06caa0181b9ad04ae623899617a189e10436399ee64177b2dcb60"}
Sep 11 14:29:15.300306 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:15.300208    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-b5ktv" event={"ID":"fbf7878c-723f-4d19-8b98-f3bd084cfabb","Type":"ContainerStarted","Data":"164329e2b2b53540ea6f76153186437e4d66fcf3b9cdc9c2ff6c314fb84fd7c7"}
Sep 11 14:29:15.300768 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:15.300329    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-b5ktv"
Sep 11 14:29:15.320061 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:15.319858    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-b5ktv" podStartSLOduration=1.130621831 podStartE2EDuration="2.319840918s" totalImagesPullingTime="1.189219087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:29:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:29:15.319317747 +0000 UTC m=+852.351752607" watchObservedRunningTime="2026-09-11 14:29:15.319840918 +0000 UTC m=+852.352275778"
Sep 11 14:29:26.306290 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:26.306261    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-b5ktv"
Sep 11 14:29:27.488340 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:27.488306    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-b5ktv"]
Sep 11 14:29:27.488842 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:27.488600    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-b5ktv" podUID="fbf7878c-723f-4d19-8b98-f3bd084cfabb" containerName="limitador" containerID="cri-o://164329e2b2b53540ea6f76153186437e4d66fcf3b9cdc9c2ff6c314fb84fd7c7" gracePeriod=30
Sep 11 14:29:28.035617 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.035590    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-b5ktv"
Sep 11 14:29:28.130294 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.130218    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fbf7878c-723f-4d19-8b98-f3bd084cfabb-config-file\") pod \"fbf7878c-723f-4d19-8b98-f3bd084cfabb\" (UID: \"fbf7878c-723f-4d19-8b98-f3bd084cfabb\") "
Sep 11 14:29:28.130294 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.130291    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp775\" (UniqueName: \"kubernetes.io/projected/fbf7878c-723f-4d19-8b98-f3bd084cfabb-kube-api-access-hp775\") pod \"fbf7878c-723f-4d19-8b98-f3bd084cfabb\" (UID: \"fbf7878c-723f-4d19-8b98-f3bd084cfabb\") "
Sep 11 14:29:28.130615 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.130590    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbf7878c-723f-4d19-8b98-f3bd084cfabb-config-file" (OuterVolumeSpecName: "config-file") pod "fbf7878c-723f-4d19-8b98-f3bd084cfabb" (UID: "fbf7878c-723f-4d19-8b98-f3bd084cfabb"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:29:28.132659 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.132637    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbf7878c-723f-4d19-8b98-f3bd084cfabb-kube-api-access-hp775" (OuterVolumeSpecName: "kube-api-access-hp775") pod "fbf7878c-723f-4d19-8b98-f3bd084cfabb" (UID: "fbf7878c-723f-4d19-8b98-f3bd084cfabb"). InnerVolumeSpecName "kube-api-access-hp775". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:29:28.231774 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.231740    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp775\" (UniqueName: \"kubernetes.io/projected/fbf7878c-723f-4d19-8b98-f3bd084cfabb-kube-api-access-hp775\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:29:28.231774 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.231768    2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fbf7878c-723f-4d19-8b98-f3bd084cfabb-config-file\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:29:28.371423 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.371394    2582 generic.go:356] "Generic (PLEG): container finished" podID="fbf7878c-723f-4d19-8b98-f3bd084cfabb" containerID="164329e2b2b53540ea6f76153186437e4d66fcf3b9cdc9c2ff6c314fb84fd7c7" exitCode=0
Sep 11 14:29:28.371584 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.371439    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-b5ktv"
Sep 11 14:29:28.371584 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.371445    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-b5ktv" event={"ID":"fbf7878c-723f-4d19-8b98-f3bd084cfabb","Type":"ContainerDied","Data":"164329e2b2b53540ea6f76153186437e4d66fcf3b9cdc9c2ff6c314fb84fd7c7"}
Sep 11 14:29:28.371584 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.371487    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-b5ktv" event={"ID":"fbf7878c-723f-4d19-8b98-f3bd084cfabb","Type":"ContainerDied","Data":"f14ea14dc4d06caa0181b9ad04ae623899617a189e10436399ee64177b2dcb60"}
Sep 11 14:29:28.371584 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.371510    2582 scope.go:117] "RemoveContainer" containerID="164329e2b2b53540ea6f76153186437e4d66fcf3b9cdc9c2ff6c314fb84fd7c7"
Sep 11 14:29:28.384654 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.384635    2582 scope.go:117] "RemoveContainer" containerID="164329e2b2b53540ea6f76153186437e4d66fcf3b9cdc9c2ff6c314fb84fd7c7"
Sep 11 14:29:28.385013 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:29:28.384989    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"164329e2b2b53540ea6f76153186437e4d66fcf3b9cdc9c2ff6c314fb84fd7c7\": container with ID starting with 164329e2b2b53540ea6f76153186437e4d66fcf3b9cdc9c2ff6c314fb84fd7c7 not found: ID does not exist" containerID="164329e2b2b53540ea6f76153186437e4d66fcf3b9cdc9c2ff6c314fb84fd7c7"
Sep 11 14:29:28.385115 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.385023    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"164329e2b2b53540ea6f76153186437e4d66fcf3b9cdc9c2ff6c314fb84fd7c7"} err="failed to get container status \"164329e2b2b53540ea6f76153186437e4d66fcf3b9cdc9c2ff6c314fb84fd7c7\": rpc error: code = NotFound desc = could not find container \"164329e2b2b53540ea6f76153186437e4d66fcf3b9cdc9c2ff6c314fb84fd7c7\": container with ID starting with 164329e2b2b53540ea6f76153186437e4d66fcf3b9cdc9c2ff6c314fb84fd7c7 not found: ID does not exist"
Sep 11 14:29:28.398587 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.398560    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-b5ktv"]
Sep 11 14:29:28.403623 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:28.403603    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-b5ktv"]
Sep 11 14:29:29.494867 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:29.494836    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbf7878c-723f-4d19-8b98-f3bd084cfabb" path="/var/lib/kubelet/pods/fbf7878c-723f-4d19-8b98-f3bd084cfabb/volumes"
Sep 11 14:29:33.432119 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.432086    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b"]
Sep 11 14:29:33.432558 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.432435    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbf7878c-723f-4d19-8b98-f3bd084cfabb" containerName="limitador"
Sep 11 14:29:33.432558 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.432446    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbf7878c-723f-4d19-8b98-f3bd084cfabb" containerName="limitador"
Sep 11 14:29:33.432558 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.432514    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbf7878c-723f-4d19-8b98-f3bd084cfabb" containerName="limitador"
Sep 11 14:29:33.436691 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.436671    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b"
Sep 11 14:29:33.441486 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.441460    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 14:29:33.441616 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.441510    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 14:29:33.441919 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.441900    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-4cp5t\""
Sep 11 14:29:33.442010 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.441901    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:29:33.445364 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.445340    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b"]
Sep 11 14:29:33.483952 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.483914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/55602491-99e2-4057-bedf-cec7306c3809-data\") pod \"postgres-69fb4594cf-5kk6b\" (UID: \"55602491-99e2-4057-bedf-cec7306c3809\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b"
Sep 11 14:29:33.484139 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.483959    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngc5w\" (UniqueName: \"kubernetes.io/projected/55602491-99e2-4057-bedf-cec7306c3809-kube-api-access-ngc5w\") pod \"postgres-69fb4594cf-5kk6b\" (UID: \"55602491-99e2-4057-bedf-cec7306c3809\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b"
Sep 11 14:29:33.584914 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.584879    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/55602491-99e2-4057-bedf-cec7306c3809-data\") pod \"postgres-69fb4594cf-5kk6b\" (UID: \"55602491-99e2-4057-bedf-cec7306c3809\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b"
Sep 11 14:29:33.584914 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.584919    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngc5w\" (UniqueName: \"kubernetes.io/projected/55602491-99e2-4057-bedf-cec7306c3809-kube-api-access-ngc5w\") pod \"postgres-69fb4594cf-5kk6b\" (UID: \"55602491-99e2-4057-bedf-cec7306c3809\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b"
Sep 11 14:29:33.585360 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.585343    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/55602491-99e2-4057-bedf-cec7306c3809-data\") pod \"postgres-69fb4594cf-5kk6b\" (UID: \"55602491-99e2-4057-bedf-cec7306c3809\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b"
Sep 11 14:29:33.593428 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.593404    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngc5w\" (UniqueName: \"kubernetes.io/projected/55602491-99e2-4057-bedf-cec7306c3809-kube-api-access-ngc5w\") pod \"postgres-69fb4594cf-5kk6b\" (UID: \"55602491-99e2-4057-bedf-cec7306c3809\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b"
Sep 11 14:29:33.747857 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:33.747779    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b"
Sep 11 14:29:34.028403 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:34.028378    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b"]
Sep 11 14:29:34.030655 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:29:34.030627    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55602491_99e2_4057_bedf_cec7306c3809.slice/crio-db75600dc2c52b8a3fb3c88fa2e27969de8c81a5c17e6a237a44597b97212c27 WatchSource:0}: Error finding container db75600dc2c52b8a3fb3c88fa2e27969de8c81a5c17e6a237a44597b97212c27: Status 404 returned error can't find the container with id db75600dc2c52b8a3fb3c88fa2e27969de8c81a5c17e6a237a44597b97212c27
Sep 11 14:29:34.404639 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:34.404557    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b" event={"ID":"55602491-99e2-4057-bedf-cec7306c3809","Type":"ContainerStarted","Data":"db75600dc2c52b8a3fb3c88fa2e27969de8c81a5c17e6a237a44597b97212c27"}
Sep 11 14:29:39.438881 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:39.438846    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b" event={"ID":"55602491-99e2-4057-bedf-cec7306c3809","Type":"ContainerStarted","Data":"35bb94b0b44164b22aa1473aec5a05031b622b383a7f069f98b51ce2a625037a"}
Sep 11 14:29:39.439355 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:39.438939    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b"
Sep 11 14:29:39.460181 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:39.460129    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b" podStartSLOduration=1.501459045 podStartE2EDuration="6.460111562s" totalImagesPullingTime="4.958652517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:29:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:29:39.460086294 +0000 UTC m=+876.492521154" watchObservedRunningTime="2026-09-11 14:29:39.460111562 +0000 UTC m=+876.492546421"
Sep 11 14:29:45.474294 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:45.474256    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5kk6b"
Sep 11 14:29:53.597796 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.597751    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-666785d86c-wvns9"]
Sep 11 14:29:53.624289 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.624258    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-666785d86c-wvns9"]
Sep 11 14:29:53.624458 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.624393    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:29:53.626762 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.626739    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-94frr\""
Sep 11 14:29:53.626888 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.626834    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 14:29:53.626888 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.626878    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 14:29:53.627436 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.627422    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 14:29:53.763853 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.763823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-metrics-certs\") pod \"maas-controller-666785d86c-wvns9\" (UID: \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\") " pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:29:53.764073 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.763879    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-webhook-cert\") pod \"maas-controller-666785d86c-wvns9\" (UID: \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\") " pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:29:53.764073 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.763910    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlgxc\" (UniqueName: \"kubernetes.io/projected/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-kube-api-access-zlgxc\") pod \"maas-controller-666785d86c-wvns9\" (UID: \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\") " pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:29:53.798815 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.798777    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7969dc79c9-wrh5q"]
Sep 11 14:29:53.802647 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.802622    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:29:53.819585 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.819555    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7969dc79c9-wrh5q"]
Sep 11 14:29:53.865459 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.865375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-metrics-certs\") pod \"maas-controller-666785d86c-wvns9\" (UID: \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\") " pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:29:53.865459 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.865443    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-webhook-cert\") pod \"maas-controller-666785d86c-wvns9\" (UID: \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\") " pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:29:53.865651 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.865482    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlgxc\" (UniqueName: \"kubernetes.io/projected/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-kube-api-access-zlgxc\") pod \"maas-controller-666785d86c-wvns9\" (UID: \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\") " pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:29:53.868207 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.868187    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-webhook-cert\") pod \"maas-controller-666785d86c-wvns9\" (UID: \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\") " pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:29:53.868289 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.868264    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-metrics-certs\") pod \"maas-controller-666785d86c-wvns9\" (UID: \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\") " pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:29:53.875115 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.875091    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlgxc\" (UniqueName: \"kubernetes.io/projected/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-kube-api-access-zlgxc\") pod \"maas-controller-666785d86c-wvns9\" (UID: \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\") " pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:29:53.937967 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.937925    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:29:53.966648 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.966616    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxc6z\" (UniqueName: \"kubernetes.io/projected/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-kube-api-access-kxc6z\") pod \"maas-controller-7969dc79c9-wrh5q\" (UID: \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\") " pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:29:53.966794 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.966654    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-webhook-cert\") pod \"maas-controller-7969dc79c9-wrh5q\" (UID: \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\") " pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:29:53.966794 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:53.966739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-metrics-certs\") pod \"maas-controller-7969dc79c9-wrh5q\" (UID: \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\") " pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:29:54.067516 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:54.067479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-metrics-certs\") pod \"maas-controller-7969dc79c9-wrh5q\" (UID: \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\") " pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:29:54.067683 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:54.067573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxc6z\" (UniqueName: \"kubernetes.io/projected/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-kube-api-access-kxc6z\") pod \"maas-controller-7969dc79c9-wrh5q\" (UID: \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\") " pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:29:54.067683 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:54.067600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-webhook-cert\") pod \"maas-controller-7969dc79c9-wrh5q\" (UID: \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\") " pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:29:54.070261 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:54.070233    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-webhook-cert\") pod \"maas-controller-7969dc79c9-wrh5q\" (UID: \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\") " pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:29:54.070413 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:54.070391    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-metrics-certs\") pod \"maas-controller-7969dc79c9-wrh5q\" (UID: \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\") " pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:29:54.077204 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:54.077178    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxc6z\" (UniqueName: \"kubernetes.io/projected/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-kube-api-access-kxc6z\") pod \"maas-controller-7969dc79c9-wrh5q\" (UID: \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\") " pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:29:54.114023 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:54.113987    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:29:54.215078 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:54.215028    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-666785d86c-wvns9"]
Sep 11 14:29:54.217010 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:29:54.216984    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e507f6_be59_486c_a4d5_e6cb6d8870a1.slice/crio-21c81cfd4395072a4b31c92181cd9f4e74c5aa06eca2e03bf25f7e94a11e0bc2 WatchSource:0}: Error finding container 21c81cfd4395072a4b31c92181cd9f4e74c5aa06eca2e03bf25f7e94a11e0bc2: Status 404 returned error can't find the container with id 21c81cfd4395072a4b31c92181cd9f4e74c5aa06eca2e03bf25f7e94a11e0bc2
Sep 11 14:29:54.218383 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:54.218367    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:29:54.400601 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:54.400574    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7969dc79c9-wrh5q"]
Sep 11 14:29:54.402990 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:29:54.402963    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed6d239_e5ab_4f1a_ac37_84f7ec25a4f1.slice/crio-b4a25ce140a9efd34ba8741515c19354dac445f23c2f29bec230ada739c0a649 WatchSource:0}: Error finding container b4a25ce140a9efd34ba8741515c19354dac445f23c2f29bec230ada739c0a649: Status 404 returned error can't find the container with id b4a25ce140a9efd34ba8741515c19354dac445f23c2f29bec230ada739c0a649
Sep 11 14:29:54.530380 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:54.530341    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7969dc79c9-wrh5q" event={"ID":"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1","Type":"ContainerStarted","Data":"b4a25ce140a9efd34ba8741515c19354dac445f23c2f29bec230ada739c0a649"}
Sep 11 14:29:54.531577 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:54.531556    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666785d86c-wvns9" event={"ID":"a9e507f6-be59-486c-a4d5-e6cb6d8870a1","Type":"ContainerStarted","Data":"21c81cfd4395072a4b31c92181cd9f4e74c5aa06eca2e03bf25f7e94a11e0bc2"}
Sep 11 14:29:57.553310 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:57.553277    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7969dc79c9-wrh5q" event={"ID":"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1","Type":"ContainerStarted","Data":"0d6add88678b1e97b83da13b89258cecb43703c0d3bd9781e4be8056c9a9a72a"}
Sep 11 14:29:57.553769 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:57.553356    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:29:57.554894 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:57.554867    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666785d86c-wvns9" event={"ID":"a9e507f6-be59-486c-a4d5-e6cb6d8870a1","Type":"ContainerStarted","Data":"9dba939f0abab75d54025c8c27e0d284be294af9c761131928f9eba0909cbd25"}
Sep 11 14:29:57.555024 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:57.555002    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:29:57.580272 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:57.580231    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7969dc79c9-wrh5q" podStartSLOduration=2.051233698 podStartE2EDuration="4.580216749s" totalImagesPullingTime="2.528983051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:29:57.577951953 +0000 UTC m=+894.610386814" watchObservedRunningTime="2026-09-11 14:29:57.580216749 +0000 UTC m=+894.612651624"
Sep 11 14:29:57.603822 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:29:57.603776    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-666785d86c-wvns9" podStartSLOduration=1.896261792 podStartE2EDuration="4.60376269s" totalImagesPullingTime="2.707500898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:29:57.600890003 +0000 UTC m=+894.633324863" watchObservedRunningTime="2026-09-11 14:29:57.60376269 +0000 UTC m=+894.636197604"
Sep 11 14:30:08.562129 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:08.562093    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:30:08.562601 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:08.562182    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:30:08.678550 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:08.678500    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-666785d86c-wvns9"]
Sep 11 14:30:08.678867 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:08.678809    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-666785d86c-wvns9" podUID="a9e507f6-be59-486c-a4d5-e6cb6d8870a1" containerName="manager" containerID="cri-o://9dba939f0abab75d54025c8c27e0d284be294af9c761131928f9eba0909cbd25" gracePeriod=30
Sep 11 14:30:08.926636 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:08.926609    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:30:09.109329 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.109242    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-webhook-cert\") pod \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\" (UID: \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\") "
Sep 11 14:30:09.109500 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.109358    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-metrics-certs\") pod \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\" (UID: \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\") "
Sep 11 14:30:09.109500 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.109395    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlgxc\" (UniqueName: \"kubernetes.io/projected/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-kube-api-access-zlgxc\") pod \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\" (UID: \"a9e507f6-be59-486c-a4d5-e6cb6d8870a1\") "
Sep 11 14:30:09.111685 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.111651    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a9e507f6-be59-486c-a4d5-e6cb6d8870a1" (UID: "a9e507f6-be59-486c-a4d5-e6cb6d8870a1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:30:09.111814 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.111680    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-kube-api-access-zlgxc" (OuterVolumeSpecName: "kube-api-access-zlgxc") pod "a9e507f6-be59-486c-a4d5-e6cb6d8870a1" (UID: "a9e507f6-be59-486c-a4d5-e6cb6d8870a1"). InnerVolumeSpecName "kube-api-access-zlgxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:30:09.111814 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.111752    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a9e507f6-be59-486c-a4d5-e6cb6d8870a1" (UID: "a9e507f6-be59-486c-a4d5-e6cb6d8870a1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:30:09.210920 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.210885    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:30:09.210920 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.210914    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlgxc\" (UniqueName: \"kubernetes.io/projected/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-kube-api-access-zlgxc\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:30:09.210920 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.210925    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9e507f6-be59-486c-a4d5-e6cb6d8870a1-webhook-cert\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:30:09.619397 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.619360    2582 generic.go:356] "Generic (PLEG): container finished" podID="a9e507f6-be59-486c-a4d5-e6cb6d8870a1" containerID="9dba939f0abab75d54025c8c27e0d284be294af9c761131928f9eba0909cbd25" exitCode=0
Sep 11 14:30:09.619397 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.619400    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666785d86c-wvns9" event={"ID":"a9e507f6-be59-486c-a4d5-e6cb6d8870a1","Type":"ContainerDied","Data":"9dba939f0abab75d54025c8c27e0d284be294af9c761131928f9eba0909cbd25"}
Sep 11 14:30:09.619939 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.619410    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666785d86c-wvns9"
Sep 11 14:30:09.619939 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.619441    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666785d86c-wvns9" event={"ID":"a9e507f6-be59-486c-a4d5-e6cb6d8870a1","Type":"ContainerDied","Data":"21c81cfd4395072a4b31c92181cd9f4e74c5aa06eca2e03bf25f7e94a11e0bc2"}
Sep 11 14:30:09.619939 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.619463    2582 scope.go:117] "RemoveContainer" containerID="9dba939f0abab75d54025c8c27e0d284be294af9c761131928f9eba0909cbd25"
Sep 11 14:30:09.628367 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.628349    2582 scope.go:117] "RemoveContainer" containerID="9dba939f0abab75d54025c8c27e0d284be294af9c761131928f9eba0909cbd25"
Sep 11 14:30:09.628652 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:30:09.628633    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dba939f0abab75d54025c8c27e0d284be294af9c761131928f9eba0909cbd25\": container with ID starting with 9dba939f0abab75d54025c8c27e0d284be294af9c761131928f9eba0909cbd25 not found: ID does not exist" containerID="9dba939f0abab75d54025c8c27e0d284be294af9c761131928f9eba0909cbd25"
Sep 11 14:30:09.628715 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.628672    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dba939f0abab75d54025c8c27e0d284be294af9c761131928f9eba0909cbd25"} err="failed to get container status \"9dba939f0abab75d54025c8c27e0d284be294af9c761131928f9eba0909cbd25\": rpc error: code = NotFound desc = could not find container \"9dba939f0abab75d54025c8c27e0d284be294af9c761131928f9eba0909cbd25\": container with ID starting with 9dba939f0abab75d54025c8c27e0d284be294af9c761131928f9eba0909cbd25 not found: ID does not exist"
Sep 11 14:30:09.638838 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.638809    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-666785d86c-wvns9"]
Sep 11 14:30:09.640872 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:09.640851    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-666785d86c-wvns9"]
Sep 11 14:30:11.494860 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:11.494823    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9e507f6-be59-486c-a4d5-e6cb6d8870a1" path="/var/lib/kubelet/pods/a9e507f6-be59-486c-a4d5-e6cb6d8870a1/volumes"
Sep 11 14:30:30.086329 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.086291    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"]
Sep 11 14:30:30.086790 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.086675    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9e507f6-be59-486c-a4d5-e6cb6d8870a1" containerName="manager"
Sep 11 14:30:30.086790 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.086690    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9e507f6-be59-486c-a4d5-e6cb6d8870a1" containerName="manager"
Sep 11 14:30:30.086790 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.086768    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9e507f6-be59-486c-a4d5-e6cb6d8870a1" containerName="manager"
Sep 11 14:30:30.089913 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.089894    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:30.097650 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.097624    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 14:30:30.097766 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.097647    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 14:30:30.107100 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.107075    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"]
Sep 11 14:30:30.189921 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.189881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-openshift-service-ca\") pod \"maas-api-7c5d78f8bc-2hghm\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:30.190109 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.189989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-metrics-certs\") pod \"maas-api-7c5d78f8bc-2hghm\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:30.190109 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.190024    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9tc5\" (UniqueName: \"kubernetes.io/projected/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-kube-api-access-w9tc5\") pod \"maas-api-7c5d78f8bc-2hghm\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:30.190204 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.190145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-maas-api-tls\") pod \"maas-api-7c5d78f8bc-2hghm\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:30.290861 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.290827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-maas-api-tls\") pod \"maas-api-7c5d78f8bc-2hghm\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:30.291029 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.290872    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-openshift-service-ca\") pod \"maas-api-7c5d78f8bc-2hghm\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:30.291029 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.290922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-metrics-certs\") pod \"maas-api-7c5d78f8bc-2hghm\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:30.291029 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.290946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9tc5\" (UniqueName: \"kubernetes.io/projected/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-kube-api-access-w9tc5\") pod \"maas-api-7c5d78f8bc-2hghm\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:30.291576 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.291554    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-openshift-service-ca\") pod \"maas-api-7c5d78f8bc-2hghm\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:30.293619 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.293593    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-metrics-certs\") pod \"maas-api-7c5d78f8bc-2hghm\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:30.293706 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.293597    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-maas-api-tls\") pod \"maas-api-7c5d78f8bc-2hghm\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:30.302079 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.302058    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9tc5\" (UniqueName: \"kubernetes.io/projected/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-kube-api-access-w9tc5\") pod \"maas-api-7c5d78f8bc-2hghm\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:30.400689 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.400588    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:30.703099 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.703072    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"]
Sep 11 14:30:30.705514 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:30:30.705486    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b51fa8f_a5cb_40cf_966b_4019a4fbb25a.slice/crio-6a04cdd9cc824fa3cf08f05bbede788f94b668e21a2abcd8ca53ba65c79b9f35 WatchSource:0}: Error finding container 6a04cdd9cc824fa3cf08f05bbede788f94b668e21a2abcd8ca53ba65c79b9f35: Status 404 returned error can't find the container with id 6a04cdd9cc824fa3cf08f05bbede788f94b668e21a2abcd8ca53ba65c79b9f35
Sep 11 14:30:30.738104 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:30.738073    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm" event={"ID":"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a","Type":"ContainerStarted","Data":"6a04cdd9cc824fa3cf08f05bbede788f94b668e21a2abcd8ca53ba65c79b9f35"}
Sep 11 14:30:31.136287 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:31.136209    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4"]
Sep 11 14:30:31.140306 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:31.140288    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4"
Sep 11 14:30:31.144156 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:31.144135    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 14:30:31.163220 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:31.163194    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4"]
Sep 11 14:30:31.199612 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:31.199529    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kctr5\" (UniqueName: \"kubernetes.io/projected/77489681-9840-475f-82ae-36d5b3df39c1-kube-api-access-kctr5\") pod \"payload-pre-processing-59fbc47bf8-vfbj4\" (UID: \"77489681-9840-475f-82ae-36d5b3df39c1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4"
Sep 11 14:30:31.199772 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:31.199725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77489681-9840-475f-82ae-36d5b3df39c1-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-vfbj4\" (UID: \"77489681-9840-475f-82ae-36d5b3df39c1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4"
Sep 11 14:30:31.301147 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:31.301114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77489681-9840-475f-82ae-36d5b3df39c1-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-vfbj4\" (UID: \"77489681-9840-475f-82ae-36d5b3df39c1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4"
Sep 11 14:30:31.301297 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:31.301204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kctr5\" (UniqueName: \"kubernetes.io/projected/77489681-9840-475f-82ae-36d5b3df39c1-kube-api-access-kctr5\") pod \"payload-pre-processing-59fbc47bf8-vfbj4\" (UID: \"77489681-9840-475f-82ae-36d5b3df39c1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4"
Sep 11 14:30:31.301906 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:31.301887    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77489681-9840-475f-82ae-36d5b3df39c1-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-vfbj4\" (UID: \"77489681-9840-475f-82ae-36d5b3df39c1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4"
Sep 11 14:30:31.319262 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:31.319237    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kctr5\" (UniqueName: \"kubernetes.io/projected/77489681-9840-475f-82ae-36d5b3df39c1-kube-api-access-kctr5\") pod \"payload-pre-processing-59fbc47bf8-vfbj4\" (UID: \"77489681-9840-475f-82ae-36d5b3df39c1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4"
Sep 11 14:30:31.450235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:31.450198    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4"
Sep 11 14:30:31.775192 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:31.775164    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4"]
Sep 11 14:30:31.777338 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:30:31.777299    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77489681_9840_475f_82ae_36d5b3df39c1.slice/crio-d74f55c1b7b727223d5be3bcdb3857c7c0af1d018a8fde157ea1dd11e4769408 WatchSource:0}: Error finding container d74f55c1b7b727223d5be3bcdb3857c7c0af1d018a8fde157ea1dd11e4769408: Status 404 returned error can't find the container with id d74f55c1b7b727223d5be3bcdb3857c7c0af1d018a8fde157ea1dd11e4769408
Sep 11 14:30:32.753646 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:32.753596    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm" event={"ID":"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a","Type":"ContainerStarted","Data":"c094de50b16fc8fe12a0522b785336ca46e811efc80b56f67cad2d88253e0834"}
Sep 11 14:30:32.754153 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:32.753719    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:32.755196 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:32.755150    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4" event={"ID":"77489681-9840-475f-82ae-36d5b3df39c1","Type":"ContainerStarted","Data":"d74f55c1b7b727223d5be3bcdb3857c7c0af1d018a8fde157ea1dd11e4769408"}
Sep 11 14:30:32.791392 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:32.791308    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm" podStartSLOduration=1.154399005 podStartE2EDuration="2.791286928s" totalImagesPullingTime="1.636887923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:30:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:30:32.788804179 +0000 UTC m=+929.821239040" watchObservedRunningTime="2026-09-11 14:30:32.791286928 +0000 UTC m=+929.823721791"
Sep 11 14:30:33.762827 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:33.762782    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4" event={"ID":"77489681-9840-475f-82ae-36d5b3df39c1","Type":"ContainerStarted","Data":"552247bda69b4a2f858267362da98c0fa3ca4918a4cd16066af097ec6589b55f"}
Sep 11 14:30:33.763306 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:33.762938    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4"
Sep 11 14:30:33.798254 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:33.798197    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4" podStartSLOduration=0.970396789 podStartE2EDuration="2.798180099s" totalImagesPullingTime="1.82778331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:30:33.796226557 +0000 UTC m=+930.828661420" watchObservedRunningTime="2026-09-11 14:30:33.798180099 +0000 UTC m=+930.830614960"
Sep 11 14:30:38.768679 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:38.768643    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:30:44.769825 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:44.769793    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vfbj4"
Sep 11 14:30:49.709109 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.709071    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"]
Sep 11 14:30:49.713791 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.713772    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.717057 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.717005    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 14:30:49.717233 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.717170    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 14:30:49.717696 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.717679    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n6hc4\""
Sep 11 14:30:49.717791 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.717714    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 14:30:49.738012 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.737987    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"]
Sep 11 14:30:49.866569 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.866540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/103c1a68-2cea-4d52-ad85-76c0c389bf94-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.866569 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.866574    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/103c1a68-2cea-4d52-ad85-76c0c389bf94-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.866776 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.866604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6ncw\" (UniqueName: \"kubernetes.io/projected/103c1a68-2cea-4d52-ad85-76c0c389bf94-kube-api-access-m6ncw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.866776 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.866718    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/103c1a68-2cea-4d52-ad85-76c0c389bf94-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.866776 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.866757    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/103c1a68-2cea-4d52-ad85-76c0c389bf94-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.866893 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.866814    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/103c1a68-2cea-4d52-ad85-76c0c389bf94-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.967418 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.967326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/103c1a68-2cea-4d52-ad85-76c0c389bf94-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.967418 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.967395    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/103c1a68-2cea-4d52-ad85-76c0c389bf94-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.967636 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.967459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/103c1a68-2cea-4d52-ad85-76c0c389bf94-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.967636 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.967511    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/103c1a68-2cea-4d52-ad85-76c0c389bf94-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.967636 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.967543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/103c1a68-2cea-4d52-ad85-76c0c389bf94-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.967636 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.967587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6ncw\" (UniqueName: \"kubernetes.io/projected/103c1a68-2cea-4d52-ad85-76c0c389bf94-kube-api-access-m6ncw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.967862 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.967632    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/103c1a68-2cea-4d52-ad85-76c0c389bf94-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.967916 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.967865    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/103c1a68-2cea-4d52-ad85-76c0c389bf94-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.967916 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.967899    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/103c1a68-2cea-4d52-ad85-76c0c389bf94-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.970129 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.970108    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/103c1a68-2cea-4d52-ad85-76c0c389bf94-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.970238 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.970116    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/103c1a68-2cea-4d52-ad85-76c0c389bf94-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:49.979231 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:49.979203    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6ncw\" (UniqueName: \"kubernetes.io/projected/103c1a68-2cea-4d52-ad85-76c0c389bf94-kube-api-access-m6ncw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c\" (UID: \"103c1a68-2cea-4d52-ad85-76c0c389bf94\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:50.024620 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:50.024579    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:30:50.319856 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:50.319831    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"]
Sep 11 14:30:50.320485 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:30:50.320457    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod103c1a68_2cea_4d52_ad85_76c0c389bf94.slice/crio-e9e3cc17921071f8530ed3dddf1afa4233d18563c8a47792dd32bf73902f2808 WatchSource:0}: Error finding container e9e3cc17921071f8530ed3dddf1afa4233d18563c8a47792dd32bf73902f2808: Status 404 returned error can't find the container with id e9e3cc17921071f8530ed3dddf1afa4233d18563c8a47792dd32bf73902f2808
Sep 11 14:30:50.858599 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:50.858560    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c" event={"ID":"103c1a68-2cea-4d52-ad85-76c0c389bf94","Type":"ContainerStarted","Data":"e9e3cc17921071f8530ed3dddf1afa4233d18563c8a47792dd32bf73902f2808"}
Sep 11 14:30:51.866172 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:51.866127    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c" event={"ID":"103c1a68-2cea-4d52-ad85-76c0c389bf94","Type":"ContainerStarted","Data":"1c755801cf3b61e87d9a59c1796d3fbaa5e23bf4ad9e90ae4b51669ff4441bef"}
Sep 11 14:30:51.891521 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:30:51.891470    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c" podStartSLOduration=1.79732778 podStartE2EDuration="2.891453609s" totalImagesPullingTime="1.094125829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:30:51.889712959 +0000 UTC m=+948.922147819" watchObservedRunningTime="2026-09-11 14:30:51.891453609 +0000 UTC m=+948.923888469"
Sep 11 14:31:00.025432 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:00.025393    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:31:00.027857 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:00.025465    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:31:00.038322 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:00.038298    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:31:00.927484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:00.927456    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c"
Sep 11 14:31:01.432044 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.432011    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"]
Sep 11 14:31:01.435636 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.435620    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.439178 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.439159    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 11 14:31:01.460999 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.460975    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"]
Sep 11 14:31:01.571197 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.571161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/659c3cec-75bb-4b1b-a350-fcafcea085ff-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.571359 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.571203    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/659c3cec-75bb-4b1b-a350-fcafcea085ff-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.571359 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.571235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhfv5\" (UniqueName: \"kubernetes.io/projected/659c3cec-75bb-4b1b-a350-fcafcea085ff-kube-api-access-nhfv5\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.571359 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.571309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/659c3cec-75bb-4b1b-a350-fcafcea085ff-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.571359 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.571349    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/659c3cec-75bb-4b1b-a350-fcafcea085ff-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.571504 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.571425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/659c3cec-75bb-4b1b-a350-fcafcea085ff-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.672316 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.672268    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/659c3cec-75bb-4b1b-a350-fcafcea085ff-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.672504 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.672426    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/659c3cec-75bb-4b1b-a350-fcafcea085ff-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.672768 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.672741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/659c3cec-75bb-4b1b-a350-fcafcea085ff-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.672858 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.672799    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/659c3cec-75bb-4b1b-a350-fcafcea085ff-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.672924 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.672896    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/659c3cec-75bb-4b1b-a350-fcafcea085ff-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.673180 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.673157    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/659c3cec-75bb-4b1b-a350-fcafcea085ff-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.673332 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.673193    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhfv5\" (UniqueName: \"kubernetes.io/projected/659c3cec-75bb-4b1b-a350-fcafcea085ff-kube-api-access-nhfv5\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.673332 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.673237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/659c3cec-75bb-4b1b-a350-fcafcea085ff-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.673552 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.673529    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/659c3cec-75bb-4b1b-a350-fcafcea085ff-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.675233 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.675212    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/659c3cec-75bb-4b1b-a350-fcafcea085ff-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.675574 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.675552    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/659c3cec-75bb-4b1b-a350-fcafcea085ff-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.682836 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.682769    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhfv5\" (UniqueName: \"kubernetes.io/projected/659c3cec-75bb-4b1b-a350-fcafcea085ff-kube-api-access-nhfv5\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv\" (UID: \"659c3cec-75bb-4b1b-a350-fcafcea085ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:01.747093 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:01.747067    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:02.021197 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:02.021171    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"]
Sep 11 14:31:02.023453 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:31:02.023425    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod659c3cec_75bb_4b1b_a350_fcafcea085ff.slice/crio-a060b38eeee210c48aec43b17cc28b222993b69d6135c06822062dfc61fb01ff WatchSource:0}: Error finding container a060b38eeee210c48aec43b17cc28b222993b69d6135c06822062dfc61fb01ff: Status 404 returned error can't find the container with id a060b38eeee210c48aec43b17cc28b222993b69d6135c06822062dfc61fb01ff
Sep 11 14:31:02.930964 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:02.930920    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv" event={"ID":"659c3cec-75bb-4b1b-a350-fcafcea085ff","Type":"ContainerStarted","Data":"9f35113628316cbf6d6d97d1de0878ae2bb3c2cacdd42189c1e98758cfafff5a"}
Sep 11 14:31:02.931437 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:02.930987    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv" event={"ID":"659c3cec-75bb-4b1b-a350-fcafcea085ff","Type":"ContainerStarted","Data":"a060b38eeee210c48aec43b17cc28b222993b69d6135c06822062dfc61fb01ff"}
Sep 11 14:31:02.961324 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:02.961273    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv" podStartSLOduration=1.738708077 podStartE2EDuration="1.961256566s" totalImagesPullingTime="222.548489ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:31:02.960885648 +0000 UTC m=+959.993320510" watchObservedRunningTime="2026-09-11 14:31:02.961256566 +0000 UTC m=+959.993691427"
Sep 11 14:31:11.748133 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:11.748093    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:11.748597 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:11.748178    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:11.760515 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:11.760491    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:11.991108 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:11.991079    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv"
Sep 11 14:31:31.024806 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.024732    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"]
Sep 11 14:31:31.028317 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.028300    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.031351 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.031336    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 11 14:31:31.043009 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.042977    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"]
Sep 11 14:31:31.133996 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.133964    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39334dba-f6c8-408c-b982-658015c144eb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.133996 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.133996    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39334dba-f6c8-408c-b982-658015c144eb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.134218 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.134018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vr78\" (UniqueName: \"kubernetes.io/projected/39334dba-f6c8-408c-b982-658015c144eb-kube-api-access-8vr78\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.134218 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.134130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39334dba-f6c8-408c-b982-658015c144eb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.134218 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.134161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39334dba-f6c8-408c-b982-658015c144eb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.134218 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.134201    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39334dba-f6c8-408c-b982-658015c144eb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.239246 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.239216    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39334dba-f6c8-408c-b982-658015c144eb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.239437 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.239256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39334dba-f6c8-408c-b982-658015c144eb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.239437 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.239361    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39334dba-f6c8-408c-b982-658015c144eb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.239437 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.239417    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39334dba-f6c8-408c-b982-658015c144eb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.239589 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.239450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39334dba-f6c8-408c-b982-658015c144eb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.239589 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.239483    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vr78\" (UniqueName: \"kubernetes.io/projected/39334dba-f6c8-408c-b982-658015c144eb-kube-api-access-8vr78\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.239775 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.239750    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39334dba-f6c8-408c-b982-658015c144eb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.239859 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.239837    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39334dba-f6c8-408c-b982-658015c144eb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.239911 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.239848    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39334dba-f6c8-408c-b982-658015c144eb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.241622 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.241602    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39334dba-f6c8-408c-b982-658015c144eb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.242155 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.242140    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39334dba-f6c8-408c-b982-658015c144eb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.256561 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.256540    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vr78\" (UniqueName: \"kubernetes.io/projected/39334dba-f6c8-408c-b982-658015c144eb-kube-api-access-8vr78\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b\" (UID: \"39334dba-f6c8-408c-b982-658015c144eb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.338861 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.338777    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:31.622514 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:31:31.622481    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39334dba_f6c8_408c_b982_658015c144eb.slice/crio-02baeb0ef400c00ffbb96f3cf50bfbc280e3311432d7c82cf6f39ec3ea972caf WatchSource:0}: Error finding container 02baeb0ef400c00ffbb96f3cf50bfbc280e3311432d7c82cf6f39ec3ea972caf: Status 404 returned error can't find the container with id 02baeb0ef400c00ffbb96f3cf50bfbc280e3311432d7c82cf6f39ec3ea972caf
Sep 11 14:31:31.622647 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:31.622559    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"]
Sep 11 14:31:32.087966 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:32.087924    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b" event={"ID":"39334dba-f6c8-408c-b982-658015c144eb","Type":"ContainerStarted","Data":"4a93d426091e38b51ce3ac4e2204d55c6edde474ad7bf024177c26b5c58cf4c7"}
Sep 11 14:31:32.088490 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:32.087982    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b" event={"ID":"39334dba-f6c8-408c-b982-658015c144eb","Type":"ContainerStarted","Data":"02baeb0ef400c00ffbb96f3cf50bfbc280e3311432d7c82cf6f39ec3ea972caf"}
Sep 11 14:31:32.113077 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:32.113007    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b" podStartSLOduration=1.907722202 podStartE2EDuration="2.112989814s" totalImagesPullingTime="205.267612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:31:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:31:32.110533554 +0000 UTC m=+989.142968414" watchObservedRunningTime="2026-09-11 14:31:32.112989814 +0000 UTC m=+989.145424734"
Sep 11 14:31:41.339113 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:41.339076    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:41.339524 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:41.339138    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:41.351563 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:41.351542    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:31:42.153450 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:31:42.153423    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b"
Sep 11 14:32:55.814097 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:55.814011    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"]
Sep 11 14:32:55.817630 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:55.817609    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:55.823361 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:55.823337    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d4444b-serving-cert\""
Sep 11 14:32:55.824413 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:55.824388    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c5cfn\""
Sep 11 14:32:55.849194 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:55.849156    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"]
Sep 11 14:32:55.930689 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:55.930654    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc87f\" (UniqueName: \"kubernetes.io/projected/943c8703-3bbc-4315-bead-1e21afcba0e6-kube-api-access-kc87f\") pod \"maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:55.930859 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:55.930725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/943c8703-3bbc-4315-bead-1e21afcba0e6-metrics-certs\") pod \"maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:55.930859 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:55.930759    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/943c8703-3bbc-4315-bead-1e21afcba0e6-maas-api-tls\") pod \"maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:55.930859 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:55.930773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/943c8703-3bbc-4315-bead-1e21afcba0e6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:56.031700 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:56.031658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc87f\" (UniqueName: \"kubernetes.io/projected/943c8703-3bbc-4315-bead-1e21afcba0e6-kube-api-access-kc87f\") pod \"maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:56.031859 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:56.031740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/943c8703-3bbc-4315-bead-1e21afcba0e6-metrics-certs\") pod \"maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:56.031859 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:56.031777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/943c8703-3bbc-4315-bead-1e21afcba0e6-maas-api-tls\") pod \"maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:56.031859 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:56.031796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/943c8703-3bbc-4315-bead-1e21afcba0e6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:56.032678 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:56.032641    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/943c8703-3bbc-4315-bead-1e21afcba0e6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:56.034563 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:56.034539    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/943c8703-3bbc-4315-bead-1e21afcba0e6-maas-api-tls\") pod \"maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:56.034563 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:56.034553    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/943c8703-3bbc-4315-bead-1e21afcba0e6-metrics-certs\") pod \"maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:56.042488 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:56.042470    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc87f\" (UniqueName: \"kubernetes.io/projected/943c8703-3bbc-4315-bead-1e21afcba0e6-kube-api-access-kc87f\") pod \"maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:56.128076 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:56.127986    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:56.441920 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:56.441893    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"]
Sep 11 14:32:56.443616 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:32:56.443589    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943c8703_3bbc_4315_bead_1e21afcba0e6.slice/crio-8eba898b1002ec2c51ead2a46f54f229a2d1efe6d77fc9b1484be839e93a19d2 WatchSource:0}: Error finding container 8eba898b1002ec2c51ead2a46f54f229a2d1efe6d77fc9b1484be839e93a19d2: Status 404 returned error can't find the container with id 8eba898b1002ec2c51ead2a46f54f229a2d1efe6d77fc9b1484be839e93a19d2
Sep 11 14:32:56.596939 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:56.596901    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp" event={"ID":"943c8703-3bbc-4315-bead-1e21afcba0e6","Type":"ContainerStarted","Data":"8eba898b1002ec2c51ead2a46f54f229a2d1efe6d77fc9b1484be839e93a19d2"}
Sep 11 14:32:57.604974 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:57.604937    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp" event={"ID":"943c8703-3bbc-4315-bead-1e21afcba0e6","Type":"ContainerStarted","Data":"a9103726a1f3791c7b28c5824cb477a375103dcbea398d596129bcac0c1676ff"}
Sep 11 14:32:57.605377 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:57.605003    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:32:57.678049 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:32:57.677994    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp" podStartSLOduration=2.148646449 podStartE2EDuration="2.677975014s" totalImagesPullingTime="529.328565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:32:57.658019622 +0000 UTC m=+1074.690454493" watchObservedRunningTime="2026-09-11 14:32:57.677975014 +0000 UTC m=+1074.710409873"
Sep 11 14:33:03.615669 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:03.615641    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:33:07.823791 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:07.823755    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"]
Sep 11 14:33:07.827596 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:07.827577    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:07.830663 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:07.830641    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-c322a2-serving-cert\""
Sep 11 14:33:07.946932 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:07.946893    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-maas-api-tls\") pod \"maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:07.947161 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:07.946939    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r5wm\" (UniqueName: \"kubernetes.io/projected/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-kube-api-access-7r5wm\") pod \"maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:07.947161 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:07.946970    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-metrics-certs\") pod \"maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:07.947161 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:07.947029    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-openshift-service-ca\") pod \"maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:07.953950 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:07.953921    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"]
Sep 11 14:33:08.047994 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:08.047923    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-maas-api-tls\") pod \"maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:08.047994 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:08.048005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r5wm\" (UniqueName: \"kubernetes.io/projected/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-kube-api-access-7r5wm\") pod \"maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:08.048288 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:08.048064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-metrics-certs\") pod \"maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:08.048288 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:08.048103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-openshift-service-ca\") pod \"maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:08.048288 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:33:08.048117    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-serving-cert: secret "maas-api-e2e-autores-c322a2-serving-cert" not found
Sep 11 14:33:08.048288 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:33:08.048187    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-maas-api-tls podName:8a55c592-f6b8-42c6-bcab-1ab047fd9ea6 nodeName:}" failed. No retries permitted until 2026-09-11 14:33:08.548167149 +0000 UTC m=+1085.580601997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-maas-api-tls") pod "maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg" (UID: "8a55c592-f6b8-42c6-bcab-1ab047fd9ea6") : secret "maas-api-e2e-autores-c322a2-serving-cert" not found
Sep 11 14:33:08.048905 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:08.048878    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-openshift-service-ca\") pod \"maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:08.050751 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:08.050732    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-metrics-certs\") pod \"maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:08.073675 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:08.073646    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r5wm\" (UniqueName: \"kubernetes.io/projected/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-kube-api-access-7r5wm\") pod \"maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:08.553587 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:08.553531    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-maas-api-tls\") pod \"maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:08.556156 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:08.556134    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-maas-api-tls\") pod \"maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:08.738488 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:08.738459    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:09.055082 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:09.055000    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"]
Sep 11 14:33:09.057667 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:33:09.057633    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a55c592_f6b8_42c6_bcab_1ab047fd9ea6.slice/crio-e1c5fe234117414230f91e2d3312567c2ec3d452b923eca90cbaefcb1ab27891 WatchSource:0}: Error finding container e1c5fe234117414230f91e2d3312567c2ec3d452b923eca90cbaefcb1ab27891: Status 404 returned error can't find the container with id e1c5fe234117414230f91e2d3312567c2ec3d452b923eca90cbaefcb1ab27891
Sep 11 14:33:09.673963 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:09.673927    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg" event={"ID":"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6","Type":"ContainerStarted","Data":"4357c5e206420c1eae6f8f0d56729049da1cd4dac6499671f309906598c3ca83"}
Sep 11 14:33:09.674154 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:09.673981    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg" event={"ID":"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6","Type":"ContainerStarted","Data":"e1c5fe234117414230f91e2d3312567c2ec3d452b923eca90cbaefcb1ab27891"}
Sep 11 14:33:09.674154 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:09.674074    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:09.776686 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:09.776579    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg" podStartSLOduration=2.327084445 podStartE2EDuration="2.776560041s" totalImagesPullingTime="449.475596ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:33:09.744691357 +0000 UTC m=+1086.777126217" watchObservedRunningTime="2026-09-11 14:33:09.776560041 +0000 UTC m=+1086.808994901"
Sep 11 14:33:11.135562 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.135530    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"]
Sep 11 14:33:11.139290 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.139271    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:11.143864 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.143841    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ac43663d-serving-cert\""
Sep 11 14:33:11.169864 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.169842    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"]
Sep 11 14:33:11.284144 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.284104    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8642613-1ff1-4ecc-981d-76b3174a293f-openshift-service-ca\") pod \"maas-api-e2e-ait-ac43663d-946484f48-dhmht\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:11.284144 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.284143    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jzjc\" (UniqueName: \"kubernetes.io/projected/b8642613-1ff1-4ecc-981d-76b3174a293f-kube-api-access-2jzjc\") pod \"maas-api-e2e-ait-ac43663d-946484f48-dhmht\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:11.284386 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.284274    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-metrics-certs\") pod \"maas-api-e2e-ait-ac43663d-946484f48-dhmht\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:11.284386 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.284351    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-maas-api-tls\") pod \"maas-api-e2e-ait-ac43663d-946484f48-dhmht\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:11.384978 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.384943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8642613-1ff1-4ecc-981d-76b3174a293f-openshift-service-ca\") pod \"maas-api-e2e-ait-ac43663d-946484f48-dhmht\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:11.384978 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.384975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jzjc\" (UniqueName: \"kubernetes.io/projected/b8642613-1ff1-4ecc-981d-76b3174a293f-kube-api-access-2jzjc\") pod \"maas-api-e2e-ait-ac43663d-946484f48-dhmht\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:11.385228 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.385076    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-metrics-certs\") pod \"maas-api-e2e-ait-ac43663d-946484f48-dhmht\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:11.385228 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.385151    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-maas-api-tls\") pod \"maas-api-e2e-ait-ac43663d-946484f48-dhmht\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:11.385347 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:33:11.385287    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-serving-cert: secret "maas-api-e2e-ait-ac43663d-serving-cert" not found
Sep 11 14:33:11.385400 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:33:11.385354    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-maas-api-tls podName:b8642613-1ff1-4ecc-981d-76b3174a293f nodeName:}" failed. No retries permitted until 2026-09-11 14:33:11.885333513 +0000 UTC m=+1088.917768352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-maas-api-tls") pod "maas-api-e2e-ait-ac43663d-946484f48-dhmht" (UID: "b8642613-1ff1-4ecc-981d-76b3174a293f") : secret "maas-api-e2e-ait-ac43663d-serving-cert" not found
Sep 11 14:33:11.385727 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.385681    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8642613-1ff1-4ecc-981d-76b3174a293f-openshift-service-ca\") pod \"maas-api-e2e-ait-ac43663d-946484f48-dhmht\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:11.387731 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.387709    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-metrics-certs\") pod \"maas-api-e2e-ait-ac43663d-946484f48-dhmht\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:11.402098 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.402076    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jzjc\" (UniqueName: \"kubernetes.io/projected/b8642613-1ff1-4ecc-981d-76b3174a293f-kube-api-access-2jzjc\") pod \"maas-api-e2e-ait-ac43663d-946484f48-dhmht\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:11.890802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.890767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-maas-api-tls\") pod \"maas-api-e2e-ait-ac43663d-946484f48-dhmht\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:11.893617 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:11.893586    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-maas-api-tls\") pod \"maas-api-e2e-ait-ac43663d-946484f48-dhmht\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:12.049719 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:12.049678    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:12.342223 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:12.342191    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"]
Sep 11 14:33:12.342541 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:33:12.342360    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8642613_1ff1_4ecc_981d_76b3174a293f.slice/crio-a50f7cda61b8b92caf1f6013fd969c456a93b0377542c10e23b17a50423c211f WatchSource:0}: Error finding container a50f7cda61b8b92caf1f6013fd969c456a93b0377542c10e23b17a50423c211f: Status 404 returned error can't find the container with id a50f7cda61b8b92caf1f6013fd969c456a93b0377542c10e23b17a50423c211f
Sep 11 14:33:12.697111 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:12.697070    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht" event={"ID":"b8642613-1ff1-4ecc-981d-76b3174a293f","Type":"ContainerStarted","Data":"a50f7cda61b8b92caf1f6013fd969c456a93b0377542c10e23b17a50423c211f"}
Sep 11 14:33:13.704933 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:13.704899    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht" event={"ID":"b8642613-1ff1-4ecc-981d-76b3174a293f","Type":"ContainerStarted","Data":"ef18e291c06a3028a5fe2f2a2379c041d86328f786e0f586ee9f21604dcca445"}
Sep 11 14:33:13.705460 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:13.704963    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:13.811501 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:13.811440    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht" podStartSLOduration=2.495933345 podStartE2EDuration="2.811423973s" totalImagesPullingTime="315.490628ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:33:13.809435948 +0000 UTC m=+1090.841870808" watchObservedRunningTime="2026-09-11 14:33:13.811423973 +0000 UTC m=+1090.843858833"
Sep 11 14:33:15.685758 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:15.685729    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:33:19.716357 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.716327    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:19.833895 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.833856    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"]
Sep 11 14:33:19.838749 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.838725    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:19.842842 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.842820    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-5b0917-serving-cert\""
Sep 11 14:33:19.869280 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.869240    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-metrics-certs\") pod \"maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:19.869444 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.869304    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54klp\" (UniqueName: \"kubernetes.io/projected/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-kube-api-access-54klp\") pod \"maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:19.869444 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.869384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-maas-api-tls\") pod \"maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:19.869531 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.869464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:19.878484 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.877966    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"]
Sep 11 14:33:19.970932 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.970846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:19.970932 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.970909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-metrics-certs\") pod \"maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:19.971214 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.970994    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54klp\" (UniqueName: \"kubernetes.io/projected/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-kube-api-access-54klp\") pod \"maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:19.971214 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.971032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-maas-api-tls\") pod \"maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:19.971214 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:33:19.971167    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-serving-cert: secret "maas-api-e2e-inf-b-5b0917-serving-cert" not found
Sep 11 14:33:19.971395 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:33:19.971240    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-maas-api-tls podName:f5389ca1-a7a2-4008-9673-ee65dc4d8e1b nodeName:}" failed. No retries permitted until 2026-09-11 14:33:20.471219002 +0000 UTC m=+1097.503653840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-maas-api-tls") pod "maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz" (UID: "f5389ca1-a7a2-4008-9673-ee65dc4d8e1b") : secret "maas-api-e2e-inf-b-5b0917-serving-cert" not found
Sep 11 14:33:19.971625 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.971599    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:19.973569 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.973549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-metrics-certs\") pod \"maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:19.997636 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:19.997600    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54klp\" (UniqueName: \"kubernetes.io/projected/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-kube-api-access-54klp\") pod \"maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:20.475192 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:20.475157    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-maas-api-tls\") pod \"maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:20.477554 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:20.477530    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-maas-api-tls\") pod \"maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:20.758096 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:20.757989    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:21.060976 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:21.060896    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"]
Sep 11 14:33:21.103131 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:33:21.103097    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5389ca1_a7a2_4008_9673_ee65dc4d8e1b.slice/crio-4d28307baeae86174e9e39a8c5ef4931532fd98212e42213917af5a6de0ee4c8 WatchSource:0}: Error finding container 4d28307baeae86174e9e39a8c5ef4931532fd98212e42213917af5a6de0ee4c8: Status 404 returned error can't find the container with id 4d28307baeae86174e9e39a8c5ef4931532fd98212e42213917af5a6de0ee4c8
Sep 11 14:33:21.753429 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:21.753384    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz" event={"ID":"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b","Type":"ContainerStarted","Data":"cb976b1ab790053f7b7431e92566c55f9ebc8055125a28b3c0a6c8872ab3fda4"}
Sep 11 14:33:21.753622 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:21.753455    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz" event={"ID":"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b","Type":"ContainerStarted","Data":"4d28307baeae86174e9e39a8c5ef4931532fd98212e42213917af5a6de0ee4c8"}
Sep 11 14:33:21.753622 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:21.753509    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:23.036546 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.036493    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz" podStartSLOduration=3.731130727 podStartE2EDuration="4.036475304s" totalImagesPullingTime="305.344577ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:33:21.908223075 +0000 UTC m=+1098.940657935" watchObservedRunningTime="2026-09-11 14:33:23.036475304 +0000 UTC m=+1100.068910166"
Sep 11 14:33:23.037458 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.037438    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"]
Sep 11 14:33:23.041299 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.041284    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"
Sep 11 14:33:23.047307 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.047282    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-5b0917\""
Sep 11 14:33:23.047430 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.047314    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-5b0917-dockercfg-wb94z\""
Sep 11 14:33:23.071507 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.071477    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"]
Sep 11 14:33:23.101955 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.101924    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qgbr\" (UniqueName: \"kubernetes.io/projected/b18b3286-5971-4b58-9fb2-ea6c6fff062f-kube-api-access-5qgbr\") pod \"payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd\" (UID: \"b18b3286-5971-4b58-9fb2-ea6c6fff062f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"
Sep 11 14:33:23.102132 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.101987    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b18b3286-5971-4b58-9fb2-ea6c6fff062f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd\" (UID: \"b18b3286-5971-4b58-9fb2-ea6c6fff062f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"
Sep 11 14:33:23.202946 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.202908    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qgbr\" (UniqueName: \"kubernetes.io/projected/b18b3286-5971-4b58-9fb2-ea6c6fff062f-kube-api-access-5qgbr\") pod \"payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd\" (UID: \"b18b3286-5971-4b58-9fb2-ea6c6fff062f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"
Sep 11 14:33:23.203162 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.202961    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b18b3286-5971-4b58-9fb2-ea6c6fff062f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd\" (UID: \"b18b3286-5971-4b58-9fb2-ea6c6fff062f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"
Sep 11 14:33:23.203733 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.203706    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b18b3286-5971-4b58-9fb2-ea6c6fff062f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd\" (UID: \"b18b3286-5971-4b58-9fb2-ea6c6fff062f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"
Sep 11 14:33:23.224978 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.224942    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qgbr\" (UniqueName: \"kubernetes.io/projected/b18b3286-5971-4b58-9fb2-ea6c6fff062f-kube-api-access-5qgbr\") pod \"payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd\" (UID: \"b18b3286-5971-4b58-9fb2-ea6c6fff062f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"
Sep 11 14:33:23.351597 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.351500    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"
Sep 11 14:33:23.654410 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.654331    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"]
Sep 11 14:33:23.657700 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:33:23.657673    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18b3286_5971_4b58_9fb2_ea6c6fff062f.slice/crio-4eedd5bbb3849456038e8b39ffa94277e341866db78e0b63ff8e507c4baf756d WatchSource:0}: Error finding container 4eedd5bbb3849456038e8b39ffa94277e341866db78e0b63ff8e507c4baf756d: Status 404 returned error can't find the container with id 4eedd5bbb3849456038e8b39ffa94277e341866db78e0b63ff8e507c4baf756d
Sep 11 14:33:23.769017 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.768982    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd" event={"ID":"b18b3286-5971-4b58-9fb2-ea6c6fff062f","Type":"ContainerStarted","Data":"7fa258cc9ecd45b262655ada1dd525c435505c3f158b408c44075c19d45be79d"}
Sep 11 14:33:23.769236 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.769064    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd" event={"ID":"b18b3286-5971-4b58-9fb2-ea6c6fff062f","Type":"ContainerStarted","Data":"4eedd5bbb3849456038e8b39ffa94277e341866db78e0b63ff8e507c4baf756d"}
Sep 11 14:33:23.769236 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.769121    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"
Sep 11 14:33:23.835156 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:23.831377    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd" podStartSLOduration=1.8313530789999999 podStartE2EDuration="1.831353079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:33:23.826845113 +0000 UTC m=+1100.859279974" watchObservedRunningTime="2026-09-11 14:33:23.831353079 +0000 UTC m=+1100.863787940"
Sep 11 14:33:27.766887 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:27.766853    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:33:34.777245 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:34.777211    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"
Sep 11 14:33:59.185226 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.185184    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"]
Sep 11 14:33:59.185740 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.185401    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht" podUID="b8642613-1ff1-4ecc-981d-76b3174a293f" containerName="maas-api" containerID="cri-o://ef18e291c06a3028a5fe2f2a2379c041d86328f786e0f586ee9f21604dcca445" gracePeriod=30
Sep 11 14:33:59.437935 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.437876    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:59.465360 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.465330    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jzjc\" (UniqueName: \"kubernetes.io/projected/b8642613-1ff1-4ecc-981d-76b3174a293f-kube-api-access-2jzjc\") pod \"b8642613-1ff1-4ecc-981d-76b3174a293f\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") "
Sep 11 14:33:59.465483 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.465401    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-metrics-certs\") pod \"b8642613-1ff1-4ecc-981d-76b3174a293f\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") "
Sep 11 14:33:59.465483 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.465463    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-maas-api-tls\") pod \"b8642613-1ff1-4ecc-981d-76b3174a293f\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") "
Sep 11 14:33:59.465565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.465520    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8642613-1ff1-4ecc-981d-76b3174a293f-openshift-service-ca\") pod \"b8642613-1ff1-4ecc-981d-76b3174a293f\" (UID: \"b8642613-1ff1-4ecc-981d-76b3174a293f\") "
Sep 11 14:33:59.465984 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.465907    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8642613-1ff1-4ecc-981d-76b3174a293f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b8642613-1ff1-4ecc-981d-76b3174a293f" (UID: "b8642613-1ff1-4ecc-981d-76b3174a293f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:33:59.467712 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.467682    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b8642613-1ff1-4ecc-981d-76b3174a293f" (UID: "b8642613-1ff1-4ecc-981d-76b3174a293f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:33:59.467801 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.467719    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b8642613-1ff1-4ecc-981d-76b3174a293f" (UID: "b8642613-1ff1-4ecc-981d-76b3174a293f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:33:59.467801 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.467755    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8642613-1ff1-4ecc-981d-76b3174a293f-kube-api-access-2jzjc" (OuterVolumeSpecName: "kube-api-access-2jzjc") pod "b8642613-1ff1-4ecc-981d-76b3174a293f" (UID: "b8642613-1ff1-4ecc-981d-76b3174a293f"). InnerVolumeSpecName "kube-api-access-2jzjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:33:59.567109 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.567083    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:33:59.567109 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.567107    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8642613-1ff1-4ecc-981d-76b3174a293f-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:33:59.567109 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.567116    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8642613-1ff1-4ecc-981d-76b3174a293f-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:33:59.567317 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.567124    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jzjc\" (UniqueName: \"kubernetes.io/projected/b8642613-1ff1-4ecc-981d-76b3174a293f-kube-api-access-2jzjc\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:33:59.987981 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.987946    2582 generic.go:356] "Generic (PLEG): container finished" podID="b8642613-1ff1-4ecc-981d-76b3174a293f" containerID="ef18e291c06a3028a5fe2f2a2379c041d86328f786e0f586ee9f21604dcca445" exitCode=0
Sep 11 14:33:59.988208 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.988004    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"
Sep 11 14:33:59.988208 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.988061    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht" event={"ID":"b8642613-1ff1-4ecc-981d-76b3174a293f","Type":"ContainerDied","Data":"ef18e291c06a3028a5fe2f2a2379c041d86328f786e0f586ee9f21604dcca445"}
Sep 11 14:33:59.988208 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.988122    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht" event={"ID":"b8642613-1ff1-4ecc-981d-76b3174a293f","Type":"ContainerDied","Data":"a50f7cda61b8b92caf1f6013fd969c456a93b0377542c10e23b17a50423c211f"}
Sep 11 14:33:59.988208 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:33:59.988164    2582 scope.go:117] "RemoveContainer" containerID="ef18e291c06a3028a5fe2f2a2379c041d86328f786e0f586ee9f21604dcca445"
Sep 11 14:34:00.000049 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:00.000004    2582 scope.go:117] "RemoveContainer" containerID="ef18e291c06a3028a5fe2f2a2379c041d86328f786e0f586ee9f21604dcca445"
Sep 11 14:34:00.000532 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:34:00.000507    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef18e291c06a3028a5fe2f2a2379c041d86328f786e0f586ee9f21604dcca445\": container with ID starting with ef18e291c06a3028a5fe2f2a2379c041d86328f786e0f586ee9f21604dcca445 not found: ID does not exist" containerID="ef18e291c06a3028a5fe2f2a2379c041d86328f786e0f586ee9f21604dcca445"
Sep 11 14:34:00.000648 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:00.000543    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef18e291c06a3028a5fe2f2a2379c041d86328f786e0f586ee9f21604dcca445"} err="failed to get container status \"ef18e291c06a3028a5fe2f2a2379c041d86328f786e0f586ee9f21604dcca445\": rpc error: code = NotFound desc = could not find container \"ef18e291c06a3028a5fe2f2a2379c041d86328f786e0f586ee9f21604dcca445\": container with ID starting with ef18e291c06a3028a5fe2f2a2379c041d86328f786e0f586ee9f21604dcca445 not found: ID does not exist"
Sep 11 14:34:00.027788 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:00.027753    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"]
Sep 11 14:34:00.041309 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:00.041279    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ac43663d-946484f48-dhmht"]
Sep 11 14:34:01.494983 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:01.494952    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8642613-1ff1-4ecc-981d-76b3174a293f" path="/var/lib/kubelet/pods/b8642613-1ff1-4ecc-981d-76b3174a293f/volumes"
Sep 11 14:34:09.788786 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.788752    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"]
Sep 11 14:34:09.789223 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.789209    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8642613-1ff1-4ecc-981d-76b3174a293f" containerName="maas-api"
Sep 11 14:34:09.789223 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.789224    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8642613-1ff1-4ecc-981d-76b3174a293f" containerName="maas-api"
Sep 11 14:34:09.789302 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.789286    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8642613-1ff1-4ecc-981d-76b3174a293f" containerName="maas-api"
Sep 11 14:34:09.793746 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.793726    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:09.806597 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.806569    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-d7531909-serving-cert\""
Sep 11 14:34:09.831467 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.831432    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"]
Sep 11 14:34:09.873468 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.873431    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-metrics-certs\") pod \"maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:09.873627 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.873477    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96fnf\" (UniqueName: \"kubernetes.io/projected/9bafff99-2eb6-40ff-b09d-31545d450ad4-kube-api-access-96fnf\") pod \"maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:09.873627 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.873506    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bafff99-2eb6-40ff-b09d-31545d450ad4-openshift-service-ca\") pod \"maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:09.873627 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.873558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-maas-api-tls\") pod \"maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:09.974776 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.974740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-metrics-certs\") pod \"maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:09.974941 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.974784    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96fnf\" (UniqueName: \"kubernetes.io/projected/9bafff99-2eb6-40ff-b09d-31545d450ad4-kube-api-access-96fnf\") pod \"maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:09.974941 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.974826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bafff99-2eb6-40ff-b09d-31545d450ad4-openshift-service-ca\") pod \"maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:09.974941 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.974888    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-maas-api-tls\") pod \"maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:09.975089 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:34:09.975021    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-serving-cert: secret "maas-api-e2e-migrate-d7531909-serving-cert" not found
Sep 11 14:34:09.975147 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:34:09.975126    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-maas-api-tls podName:9bafff99-2eb6-40ff-b09d-31545d450ad4 nodeName:}" failed. No retries permitted until 2026-09-11 14:34:10.475106149 +0000 UTC m=+1147.507541003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-maas-api-tls") pod "maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz" (UID: "9bafff99-2eb6-40ff-b09d-31545d450ad4") : secret "maas-api-e2e-migrate-d7531909-serving-cert" not found
Sep 11 14:34:09.975676 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.975658    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bafff99-2eb6-40ff-b09d-31545d450ad4-openshift-service-ca\") pod \"maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:09.977513 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:09.977497    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-metrics-certs\") pod \"maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:10.025659 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:10.025631    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96fnf\" (UniqueName: \"kubernetes.io/projected/9bafff99-2eb6-40ff-b09d-31545d450ad4-kube-api-access-96fnf\") pod \"maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:10.479366 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:10.479333    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-maas-api-tls\") pod \"maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:10.481892 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:10.481862    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-maas-api-tls\") pod \"maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:10.703595 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:10.703565    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:11.113362 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:34:11.113334    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bafff99_2eb6_40ff_b09d_31545d450ad4.slice/crio-b46e6187733f3ef7bf4932e4734e83ac6d3d51f10ed72681d9641d0d5017ecf6 WatchSource:0}: Error finding container b46e6187733f3ef7bf4932e4734e83ac6d3d51f10ed72681d9641d0d5017ecf6: Status 404 returned error can't find the container with id b46e6187733f3ef7bf4932e4734e83ac6d3d51f10ed72681d9641d0d5017ecf6
Sep 11 14:34:11.131307 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:11.131284    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"]
Sep 11 14:34:12.065234 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:12.065201    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz" event={"ID":"9bafff99-2eb6-40ff-b09d-31545d450ad4","Type":"ContainerStarted","Data":"7c45be8ca01cf771be833406004021838fbf52595fe7c5d680a31e477b82fd0f"}
Sep 11 14:34:12.065411 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:12.065251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz" event={"ID":"9bafff99-2eb6-40ff-b09d-31545d450ad4","Type":"ContainerStarted","Data":"b46e6187733f3ef7bf4932e4734e83ac6d3d51f10ed72681d9641d0d5017ecf6"}
Sep 11 14:34:12.065411 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:12.065304    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:12.137947 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:12.137889    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz" podStartSLOduration=2.800527541 podStartE2EDuration="3.137873994s" totalImagesPullingTime="337.346453ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:34:12.136323038 +0000 UTC m=+1149.168757897" watchObservedRunningTime="2026-09-11 14:34:12.137873994 +0000 UTC m=+1149.170308854"
Sep 11 14:34:18.079927 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:18.079893    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:33.200698 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.200610    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"]
Sep 11 14:34:33.201314 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.200849    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz" podUID="9bafff99-2eb6-40ff-b09d-31545d450ad4" containerName="maas-api" containerID="cri-o://7c45be8ca01cf771be833406004021838fbf52595fe7c5d680a31e477b82fd0f" gracePeriod=30
Sep 11 14:34:33.458342 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.458281    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:33.508879 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.508853    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-maas-api-tls\") pod \"9bafff99-2eb6-40ff-b09d-31545d450ad4\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") "
Sep 11 14:34:33.509064 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.508895    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-metrics-certs\") pod \"9bafff99-2eb6-40ff-b09d-31545d450ad4\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") "
Sep 11 14:34:33.509064 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.509001    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96fnf\" (UniqueName: \"kubernetes.io/projected/9bafff99-2eb6-40ff-b09d-31545d450ad4-kube-api-access-96fnf\") pod \"9bafff99-2eb6-40ff-b09d-31545d450ad4\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") "
Sep 11 14:34:33.509171 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.509138    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bafff99-2eb6-40ff-b09d-31545d450ad4-openshift-service-ca\") pod \"9bafff99-2eb6-40ff-b09d-31545d450ad4\" (UID: \"9bafff99-2eb6-40ff-b09d-31545d450ad4\") "
Sep 11 14:34:33.509846 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.509798    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bafff99-2eb6-40ff-b09d-31545d450ad4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9bafff99-2eb6-40ff-b09d-31545d450ad4" (UID: "9bafff99-2eb6-40ff-b09d-31545d450ad4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:34:33.511809 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.511774    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9bafff99-2eb6-40ff-b09d-31545d450ad4" (UID: "9bafff99-2eb6-40ff-b09d-31545d450ad4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:34:33.511909 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.511845    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9bafff99-2eb6-40ff-b09d-31545d450ad4" (UID: "9bafff99-2eb6-40ff-b09d-31545d450ad4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:34:33.511909 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.511862    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bafff99-2eb6-40ff-b09d-31545d450ad4-kube-api-access-96fnf" (OuterVolumeSpecName: "kube-api-access-96fnf") pod "9bafff99-2eb6-40ff-b09d-31545d450ad4" (UID: "9bafff99-2eb6-40ff-b09d-31545d450ad4"). InnerVolumeSpecName "kube-api-access-96fnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:34:33.611589 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.611555    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:34:33.611589 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.611591    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bafff99-2eb6-40ff-b09d-31545d450ad4-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:34:33.611802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.611604    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96fnf\" (UniqueName: \"kubernetes.io/projected/9bafff99-2eb6-40ff-b09d-31545d450ad4-kube-api-access-96fnf\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:34:33.611802 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:33.611618    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bafff99-2eb6-40ff-b09d-31545d450ad4-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:34:34.195994 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:34.195959    2582 generic.go:356] "Generic (PLEG): container finished" podID="9bafff99-2eb6-40ff-b09d-31545d450ad4" containerID="7c45be8ca01cf771be833406004021838fbf52595fe7c5d680a31e477b82fd0f" exitCode=0
Sep 11 14:34:34.196219 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:34.196000    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"
Sep 11 14:34:34.196219 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:34.196059    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz" event={"ID":"9bafff99-2eb6-40ff-b09d-31545d450ad4","Type":"ContainerDied","Data":"7c45be8ca01cf771be833406004021838fbf52595fe7c5d680a31e477b82fd0f"}
Sep 11 14:34:34.196219 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:34.196113    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz" event={"ID":"9bafff99-2eb6-40ff-b09d-31545d450ad4","Type":"ContainerDied","Data":"b46e6187733f3ef7bf4932e4734e83ac6d3d51f10ed72681d9641d0d5017ecf6"}
Sep 11 14:34:34.196219 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:34.196135    2582 scope.go:117] "RemoveContainer" containerID="7c45be8ca01cf771be833406004021838fbf52595fe7c5d680a31e477b82fd0f"
Sep 11 14:34:34.206244 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:34.206006    2582 scope.go:117] "RemoveContainer" containerID="7c45be8ca01cf771be833406004021838fbf52595fe7c5d680a31e477b82fd0f"
Sep 11 14:34:34.206453 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:34:34.206288    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c45be8ca01cf771be833406004021838fbf52595fe7c5d680a31e477b82fd0f\": container with ID starting with 7c45be8ca01cf771be833406004021838fbf52595fe7c5d680a31e477b82fd0f not found: ID does not exist" containerID="7c45be8ca01cf771be833406004021838fbf52595fe7c5d680a31e477b82fd0f"
Sep 11 14:34:34.206453 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:34.206310    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c45be8ca01cf771be833406004021838fbf52595fe7c5d680a31e477b82fd0f"} err="failed to get container status \"7c45be8ca01cf771be833406004021838fbf52595fe7c5d680a31e477b82fd0f\": rpc error: code = NotFound desc = could not find container \"7c45be8ca01cf771be833406004021838fbf52595fe7c5d680a31e477b82fd0f\": container with ID starting with 7c45be8ca01cf771be833406004021838fbf52595fe7c5d680a31e477b82fd0f not found: ID does not exist"
Sep 11 14:34:34.251898 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:34.251866    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"]
Sep 11 14:34:34.254572 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:34.254550    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d7531909-79d66b67f9-f8vgz"]
Sep 11 14:34:35.495191 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:35.495162    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bafff99-2eb6-40ff-b09d-31545d450ad4" path="/var/lib/kubelet/pods/9bafff99-2eb6-40ff-b09d-31545d450ad4/volumes"
Sep 11 14:34:40.114771 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.114728    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"]
Sep 11 14:34:40.115468 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.115445    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bafff99-2eb6-40ff-b09d-31545d450ad4" containerName="maas-api"
Sep 11 14:34:40.115581 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.115472    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bafff99-2eb6-40ff-b09d-31545d450ad4" containerName="maas-api"
Sep 11 14:34:40.115637 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.115615    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bafff99-2eb6-40ff-b09d-31545d450ad4" containerName="maas-api"
Sep 11 14:34:40.120770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.120746    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:40.125404 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.125381    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c9e2e6b4-serving-cert\""
Sep 11 14:34:40.141025 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.140993    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"]
Sep 11 14:34:40.176844 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.176812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh69n\" (UniqueName: \"kubernetes.io/projected/0710ea3b-1be8-4277-bc7a-b0387ca559d7-kube-api-access-vh69n\") pod \"maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:40.177006 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.176937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-metrics-certs\") pod \"maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:40.177006 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.176967    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0710ea3b-1be8-4277-bc7a-b0387ca559d7-openshift-service-ca\") pod \"maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:40.177108 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.177021    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-maas-api-tls\") pod \"maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:40.278605 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.278566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-metrics-certs\") pod \"maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:40.278605 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.278607    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0710ea3b-1be8-4277-bc7a-b0387ca559d7-openshift-service-ca\") pod \"maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:40.278887 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.278655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-maas-api-tls\") pod \"maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:40.278887 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.278681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh69n\" (UniqueName: \"kubernetes.io/projected/0710ea3b-1be8-4277-bc7a-b0387ca559d7-kube-api-access-vh69n\") pod \"maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:40.278887 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:34:40.278787    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-serving-cert: secret "maas-api-e2e-ait-c9e2e6b4-serving-cert" not found
Sep 11 14:34:40.278887 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:34:40.278868    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-maas-api-tls podName:0710ea3b-1be8-4277-bc7a-b0387ca559d7 nodeName:}" failed. No retries permitted until 2026-09-11 14:34:40.778849998 +0000 UTC m=+1177.811284850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-maas-api-tls") pod "maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn" (UID: "0710ea3b-1be8-4277-bc7a-b0387ca559d7") : secret "maas-api-e2e-ait-c9e2e6b4-serving-cert" not found
Sep 11 14:34:40.279478 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.279456    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0710ea3b-1be8-4277-bc7a-b0387ca559d7-openshift-service-ca\") pod \"maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:40.281303 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.281282    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-metrics-certs\") pod \"maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:40.299816 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.299782    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh69n\" (UniqueName: \"kubernetes.io/projected/0710ea3b-1be8-4277-bc7a-b0387ca559d7-kube-api-access-vh69n\") pod \"maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:40.782619 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.782583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-maas-api-tls\") pod \"maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:40.785222 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:40.785198    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-maas-api-tls\") pod \"maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:41.033863 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:41.033777    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:41.346325 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:34:41.346291    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0710ea3b_1be8_4277_bc7a_b0387ca559d7.slice/crio-2f5dc748f25007416cfd5dc4c8231f66eb818f4511aebcf5de2d0f38a895ded1 WatchSource:0}: Error finding container 2f5dc748f25007416cfd5dc4c8231f66eb818f4511aebcf5de2d0f38a895ded1: Status 404 returned error can't find the container with id 2f5dc748f25007416cfd5dc4c8231f66eb818f4511aebcf5de2d0f38a895ded1
Sep 11 14:34:41.346325 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:41.346326    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"]
Sep 11 14:34:42.254028 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:42.253987    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn" event={"ID":"0710ea3b-1be8-4277-bc7a-b0387ca559d7","Type":"ContainerStarted","Data":"60e463fab85094359b29bab07e01cb8b9b9b503088304d8daf1b2d646636293e"}
Sep 11 14:34:42.254233 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:42.254053    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn" event={"ID":"0710ea3b-1be8-4277-bc7a-b0387ca559d7","Type":"ContainerStarted","Data":"2f5dc748f25007416cfd5dc4c8231f66eb818f4511aebcf5de2d0f38a895ded1"}
Sep 11 14:34:42.254233 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:42.254181    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:42.302991 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:42.302798    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn" podStartSLOduration=1.788780643 podStartE2EDuration="2.302777701s" totalImagesPullingTime="513.997058ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:34:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:34:42.301100895 +0000 UTC m=+1179.333535756" watchObservedRunningTime="2026-09-11 14:34:42.302777701 +0000 UTC m=+1179.335212562"
Sep 11 14:34:48.266171 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:48.266141    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:34:49.053456 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.053422    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"]
Sep 11 14:34:49.053716 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.053671    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg" podUID="8a55c592-f6b8-42c6-bcab-1ab047fd9ea6" containerName="maas-api" containerID="cri-o://4357c5e206420c1eae6f8f0d56729049da1cd4dac6499671f309906598c3ca83" gracePeriod=30
Sep 11 14:34:49.296756 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.296710    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a55c592-f6b8-42c6-bcab-1ab047fd9ea6" containerID="4357c5e206420c1eae6f8f0d56729049da1cd4dac6499671f309906598c3ca83" exitCode=0
Sep 11 14:34:49.297142 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.296786    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg" event={"ID":"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6","Type":"ContainerDied","Data":"4357c5e206420c1eae6f8f0d56729049da1cd4dac6499671f309906598c3ca83"}
Sep 11 14:34:49.320248 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.320224    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:34:49.468984 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.468949    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7r5wm\" (UniqueName: \"kubernetes.io/projected/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-kube-api-access-7r5wm\") pod \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") "
Sep 11 14:34:49.469177 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.469000    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-metrics-certs\") pod \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") "
Sep 11 14:34:49.469177 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.469057    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-maas-api-tls\") pod \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") "
Sep 11 14:34:49.469177 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.469140    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-openshift-service-ca\") pod \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\" (UID: \"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6\") "
Sep 11 14:34:49.469564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.469539    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8a55c592-f6b8-42c6-bcab-1ab047fd9ea6" (UID: "8a55c592-f6b8-42c6-bcab-1ab047fd9ea6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:34:49.471301 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.471271    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8a55c592-f6b8-42c6-bcab-1ab047fd9ea6" (UID: "8a55c592-f6b8-42c6-bcab-1ab047fd9ea6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:34:49.471398 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.471324    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8a55c592-f6b8-42c6-bcab-1ab047fd9ea6" (UID: "8a55c592-f6b8-42c6-bcab-1ab047fd9ea6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:34:49.471398 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.471337    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-kube-api-access-7r5wm" (OuterVolumeSpecName: "kube-api-access-7r5wm") pod "8a55c592-f6b8-42c6-bcab-1ab047fd9ea6" (UID: "8a55c592-f6b8-42c6-bcab-1ab047fd9ea6"). InnerVolumeSpecName "kube-api-access-7r5wm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:34:49.570626 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.570553    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r5wm\" (UniqueName: \"kubernetes.io/projected/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-kube-api-access-7r5wm\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:34:49.570626 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.570579    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:34:49.570626 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.570588    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:34:49.570626 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:49.570596    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:34:50.305074 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:50.305026    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"
Sep 11 14:34:50.305074 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:50.305066    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg" event={"ID":"8a55c592-f6b8-42c6-bcab-1ab047fd9ea6","Type":"ContainerDied","Data":"e1c5fe234117414230f91e2d3312567c2ec3d452b923eca90cbaefcb1ab27891"}
Sep 11 14:34:50.305599 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:50.305130    2582 scope.go:117] "RemoveContainer" containerID="4357c5e206420c1eae6f8f0d56729049da1cd4dac6499671f309906598c3ca83"
Sep 11 14:34:50.335621 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:50.335584    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"]
Sep 11 14:34:50.343362 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:50.343332    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-c322a2-589ccd9dbd-5glkg"]
Sep 11 14:34:51.495235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:34:51.495204    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a55c592-f6b8-42c6-bcab-1ab047fd9ea6" path="/var/lib/kubelet/pods/8a55c592-f6b8-42c6-bcab-1ab047fd9ea6/volumes"
Sep 11 14:35:05.930952 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:05.930918    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"]
Sep 11 14:35:05.931472 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:05.931356    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a55c592-f6b8-42c6-bcab-1ab047fd9ea6" containerName="maas-api"
Sep 11 14:35:05.931472 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:05.931367    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a55c592-f6b8-42c6-bcab-1ab047fd9ea6" containerName="maas-api"
Sep 11 14:35:05.931472 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:05.931436    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a55c592-f6b8-42c6-bcab-1ab047fd9ea6" containerName="maas-api"
Sep 11 14:35:05.935669 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:05.935650    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:05.938840 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:05.938814    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-69a7cf-serving-cert\""
Sep 11 14:35:05.956517 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:05.956485    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"]
Sep 11 14:35:06.039648 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.039608    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-maas-api-tls\") pod \"maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:06.040019 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.039683    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcn86\" (UniqueName: \"kubernetes.io/projected/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-kube-api-access-lcn86\") pod \"maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:06.040019 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.039729    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-metrics-certs\") pod \"maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:06.040019 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.039780    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-openshift-service-ca\") pod \"maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:06.141203 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.141161    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-openshift-service-ca\") pod \"maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:06.141402 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.141318    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-maas-api-tls\") pod \"maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:06.141402 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.141373    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcn86\" (UniqueName: \"kubernetes.io/projected/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-kube-api-access-lcn86\") pod \"maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:06.141402 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.141397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-metrics-certs\") pod \"maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:06.141836 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.141812    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-openshift-service-ca\") pod \"maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:06.143892 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.143869    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-maas-api-tls\") pod \"maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:06.143985 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.143896    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-metrics-certs\") pod \"maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:06.151252 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.151227    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcn86\" (UniqueName: \"kubernetes.io/projected/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-kube-api-access-lcn86\") pod \"maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:06.247613 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.247510    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:06.524878 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.524843    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"]
Sep 11 14:35:06.525681 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:35:06.525652    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3d61d6_f5aa_480b_91a2_6b4988a9d0bb.slice/crio-082b87d6d11ab80cd713337a78c02cebea980475a0b1eb72b0122748a23e4250 WatchSource:0}: Error finding container 082b87d6d11ab80cd713337a78c02cebea980475a0b1eb72b0122748a23e4250: Status 404 returned error can't find the container with id 082b87d6d11ab80cd713337a78c02cebea980475a0b1eb72b0122748a23e4250
Sep 11 14:35:06.527233 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:06.527214    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:35:07.426221 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:07.426136    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5" event={"ID":"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb","Type":"ContainerStarted","Data":"9d6d87501dfdd63773459c7c7b1e6424c04b2d5b1accef5c23d26ba778e7c30e"}
Sep 11 14:35:07.426221 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:07.426192    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5" event={"ID":"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb","Type":"ContainerStarted","Data":"082b87d6d11ab80cd713337a78c02cebea980475a0b1eb72b0122748a23e4250"}
Sep 11 14:35:07.426221 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:07.426221    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:07.465613 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:07.465544    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5" podStartSLOduration=1.9802007050000001 podStartE2EDuration="2.465528444s" totalImagesPullingTime="485.327739ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:35:07.464336578 +0000 UTC m=+1204.496771438" watchObservedRunningTime="2026-09-11 14:35:07.465528444 +0000 UTC m=+1204.497963326"
Sep 11 14:35:12.546161 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:12.546125    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"]
Sep 11 14:35:12.546597 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:12.546328    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn" podUID="0710ea3b-1be8-4277-bc7a-b0387ca559d7" containerName="maas-api" containerID="cri-o://60e463fab85094359b29bab07e01cb8b9b9b503088304d8daf1b2d646636293e" gracePeriod=30
Sep 11 14:35:12.814211 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:12.814187    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:35:12.909591 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:12.909554    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-metrics-certs\") pod \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") "
Sep 11 14:35:12.909779 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:12.909624    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0710ea3b-1be8-4277-bc7a-b0387ca559d7-openshift-service-ca\") pod \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") "
Sep 11 14:35:12.909779 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:12.909646    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh69n\" (UniqueName: \"kubernetes.io/projected/0710ea3b-1be8-4277-bc7a-b0387ca559d7-kube-api-access-vh69n\") pod \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") "
Sep 11 14:35:12.909779 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:12.909661    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-maas-api-tls\") pod \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\" (UID: \"0710ea3b-1be8-4277-bc7a-b0387ca559d7\") "
Sep 11 14:35:12.910117 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:12.910086    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0710ea3b-1be8-4277-bc7a-b0387ca559d7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0710ea3b-1be8-4277-bc7a-b0387ca559d7" (UID: "0710ea3b-1be8-4277-bc7a-b0387ca559d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:35:12.912139 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:12.912093    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0710ea3b-1be8-4277-bc7a-b0387ca559d7-kube-api-access-vh69n" (OuterVolumeSpecName: "kube-api-access-vh69n") pod "0710ea3b-1be8-4277-bc7a-b0387ca559d7" (UID: "0710ea3b-1be8-4277-bc7a-b0387ca559d7"). InnerVolumeSpecName "kube-api-access-vh69n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:35:12.912244 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:12.912217    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0710ea3b-1be8-4277-bc7a-b0387ca559d7" (UID: "0710ea3b-1be8-4277-bc7a-b0387ca559d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:35:12.912244 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:12.912232    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0710ea3b-1be8-4277-bc7a-b0387ca559d7" (UID: "0710ea3b-1be8-4277-bc7a-b0387ca559d7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:35:13.010791 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:13.010750    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:35:13.010791 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:13.010788    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0710ea3b-1be8-4277-bc7a-b0387ca559d7-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:35:13.011070 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:13.010802    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh69n\" (UniqueName: \"kubernetes.io/projected/0710ea3b-1be8-4277-bc7a-b0387ca559d7-kube-api-access-vh69n\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:35:13.011070 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:13.010816    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0710ea3b-1be8-4277-bc7a-b0387ca559d7-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:35:13.438079 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:13.438030    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:35:13.463502 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:13.463464    2582 generic.go:356] "Generic (PLEG): container finished" podID="0710ea3b-1be8-4277-bc7a-b0387ca559d7" containerID="60e463fab85094359b29bab07e01cb8b9b9b503088304d8daf1b2d646636293e" exitCode=0
Sep 11 14:35:13.463685 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:13.463543    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"
Sep 11 14:35:13.463685 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:13.463545    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn" event={"ID":"0710ea3b-1be8-4277-bc7a-b0387ca559d7","Type":"ContainerDied","Data":"60e463fab85094359b29bab07e01cb8b9b9b503088304d8daf1b2d646636293e"}
Sep 11 14:35:13.463685 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:13.463609    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn" event={"ID":"0710ea3b-1be8-4277-bc7a-b0387ca559d7","Type":"ContainerDied","Data":"2f5dc748f25007416cfd5dc4c8231f66eb818f4511aebcf5de2d0f38a895ded1"}
Sep 11 14:35:13.463685 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:13.463644    2582 scope.go:117] "RemoveContainer" containerID="60e463fab85094359b29bab07e01cb8b9b9b503088304d8daf1b2d646636293e"
Sep 11 14:35:13.474742 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:13.474714    2582 scope.go:117] "RemoveContainer" containerID="60e463fab85094359b29bab07e01cb8b9b9b503088304d8daf1b2d646636293e"
Sep 11 14:35:13.474997 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:35:13.474977    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60e463fab85094359b29bab07e01cb8b9b9b503088304d8daf1b2d646636293e\": container with ID starting with 60e463fab85094359b29bab07e01cb8b9b9b503088304d8daf1b2d646636293e not found: ID does not exist" containerID="60e463fab85094359b29bab07e01cb8b9b9b503088304d8daf1b2d646636293e"
Sep 11 14:35:13.475085 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:13.475004    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60e463fab85094359b29bab07e01cb8b9b9b503088304d8daf1b2d646636293e"} err="failed to get container status \"60e463fab85094359b29bab07e01cb8b9b9b503088304d8daf1b2d646636293e\": rpc error: code = NotFound desc = could not find container \"60e463fab85094359b29bab07e01cb8b9b9b503088304d8daf1b2d646636293e\": container with ID starting with 60e463fab85094359b29bab07e01cb8b9b9b503088304d8daf1b2d646636293e not found: ID does not exist"
Sep 11 14:35:13.509113 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:13.509084    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"]
Sep 11 14:35:13.515193 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:13.515161    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9e2e6b4-657cc5576-crxwn"]
Sep 11 14:35:15.496798 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:15.496761    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0710ea3b-1be8-4277-bc7a-b0387ca559d7" path="/var/lib/kubelet/pods/0710ea3b-1be8-4277-bc7a-b0387ca559d7/volumes"
Sep 11 14:35:20.326738 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.326698    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"]
Sep 11 14:35:20.327193 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.327137    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0710ea3b-1be8-4277-bc7a-b0387ca559d7" containerName="maas-api"
Sep 11 14:35:20.327193 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.327148    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0710ea3b-1be8-4277-bc7a-b0387ca559d7" containerName="maas-api"
Sep 11 14:35:20.327312 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.327236    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0710ea3b-1be8-4277-bc7a-b0387ca559d7" containerName="maas-api"
Sep 11 14:35:20.331796 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.331773    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:20.342652 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.342632    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-15594dcc-serving-cert\""
Sep 11 14:35:20.390571 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.390536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-metrics-certs\") pod \"maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:20.390716 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.390577    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-maas-api-tls\") pod \"maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:20.390716 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.390676    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g6ch\" (UniqueName: \"kubernetes.io/projected/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-kube-api-access-4g6ch\") pod \"maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:20.390816 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.390767    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-openshift-service-ca\") pod \"maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:20.440013 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.439986    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"]
Sep 11 14:35:20.492224 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.492188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-metrics-certs\") pod \"maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:20.492224 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.492228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-maas-api-tls\") pod \"maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:20.492442 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:35:20.492334    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-serving-cert: secret "maas-api-e2e-derive-15594dcc-serving-cert" not found
Sep 11 14:35:20.492442 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.492377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g6ch\" (UniqueName: \"kubernetes.io/projected/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-kube-api-access-4g6ch\") pod \"maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:20.492442 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:35:20.492384    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-maas-api-tls podName:03cc12cc-5a07-47af-bafb-4c60f1cc3eab nodeName:}" failed. No retries permitted until 2026-09-11 14:35:20.992368721 +0000 UTC m=+1218.024803562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-maas-api-tls") pod "maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7" (UID: "03cc12cc-5a07-47af-bafb-4c60f1cc3eab") : secret "maas-api-e2e-derive-15594dcc-serving-cert" not found
Sep 11 14:35:20.492559 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.492475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-openshift-service-ca\") pod \"maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:20.493207 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.493178    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-openshift-service-ca\") pod \"maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:20.494913 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.494891    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-metrics-certs\") pod \"maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:20.524717 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.524683    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g6ch\" (UniqueName: \"kubernetes.io/projected/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-kube-api-access-4g6ch\") pod \"maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:20.996329 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.996293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-maas-api-tls\") pod \"maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:20.998837 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:20.998811    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-maas-api-tls\") pod \"maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:21.242387 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:21.242337    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:21.677269 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:21.677246    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"]
Sep 11 14:35:21.678756 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:35:21.678732    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03cc12cc_5a07_47af_bafb_4c60f1cc3eab.slice/crio-83ccb63bef35e520fe54c3f3cd45f95bed3025a6e8daddbf33f46b2adc5c614b WatchSource:0}: Error finding container 83ccb63bef35e520fe54c3f3cd45f95bed3025a6e8daddbf33f46b2adc5c614b: Status 404 returned error can't find the container with id 83ccb63bef35e520fe54c3f3cd45f95bed3025a6e8daddbf33f46b2adc5c614b
Sep 11 14:35:22.519416 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:22.519378    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7" event={"ID":"03cc12cc-5a07-47af-bafb-4c60f1cc3eab","Type":"ContainerStarted","Data":"4bf23bf51dd5b6381907556c6baed5079a9e3a8924f27fa6aa642e5aca7cf4b2"}
Sep 11 14:35:22.519598 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:22.519441    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7" event={"ID":"03cc12cc-5a07-47af-bafb-4c60f1cc3eab","Type":"ContainerStarted","Data":"83ccb63bef35e520fe54c3f3cd45f95bed3025a6e8daddbf33f46b2adc5c614b"}
Sep 11 14:35:22.519598 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:22.519472    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:22.710184 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:22.710133    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7" podStartSLOduration=2.324582505 podStartE2EDuration="2.71011487s" totalImagesPullingTime="385.532365ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:35:22.706496677 +0000 UTC m=+1219.738931538" watchObservedRunningTime="2026-09-11 14:35:22.71011487 +0000 UTC m=+1219.742549731"
Sep 11 14:35:28.530054 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:28.530008    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:43.642823 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:43.642782    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"]
Sep 11 14:35:43.643383 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:43.643016    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7" podUID="03cc12cc-5a07-47af-bafb-4c60f1cc3eab" containerName="maas-api" containerID="cri-o://4bf23bf51dd5b6381907556c6baed5079a9e3a8924f27fa6aa642e5aca7cf4b2" gracePeriod=30
Sep 11 14:35:43.902648 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:43.902587    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:44.022749 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.022715    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-openshift-service-ca\") pod \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") "
Sep 11 14:35:44.022925 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.022825    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-maas-api-tls\") pod \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") "
Sep 11 14:35:44.022925 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.022876    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-metrics-certs\") pod \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") "
Sep 11 14:35:44.022925 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.022895    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g6ch\" (UniqueName: \"kubernetes.io/projected/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-kube-api-access-4g6ch\") pod \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\" (UID: \"03cc12cc-5a07-47af-bafb-4c60f1cc3eab\") "
Sep 11 14:35:44.023150 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.023117    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "03cc12cc-5a07-47af-bafb-4c60f1cc3eab" (UID: "03cc12cc-5a07-47af-bafb-4c60f1cc3eab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:35:44.023271 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.023244    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:35:44.025217 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.025182    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-kube-api-access-4g6ch" (OuterVolumeSpecName: "kube-api-access-4g6ch") pod "03cc12cc-5a07-47af-bafb-4c60f1cc3eab" (UID: "03cc12cc-5a07-47af-bafb-4c60f1cc3eab"). InnerVolumeSpecName "kube-api-access-4g6ch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:35:44.025217 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.025192    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "03cc12cc-5a07-47af-bafb-4c60f1cc3eab" (UID: "03cc12cc-5a07-47af-bafb-4c60f1cc3eab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:35:44.025340 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.025269    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "03cc12cc-5a07-47af-bafb-4c60f1cc3eab" (UID: "03cc12cc-5a07-47af-bafb-4c60f1cc3eab"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:35:44.123998 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.123963    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:35:44.123998 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.123991    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g6ch\" (UniqueName: \"kubernetes.io/projected/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-kube-api-access-4g6ch\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:35:44.123998 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.124002    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03cc12cc-5a07-47af-bafb-4c60f1cc3eab-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:35:44.658547 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.658509    2582 generic.go:356] "Generic (PLEG): container finished" podID="03cc12cc-5a07-47af-bafb-4c60f1cc3eab" containerID="4bf23bf51dd5b6381907556c6baed5079a9e3a8924f27fa6aa642e5aca7cf4b2" exitCode=0
Sep 11 14:35:44.658940 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.658555    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"
Sep 11 14:35:44.658940 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.658593    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7" event={"ID":"03cc12cc-5a07-47af-bafb-4c60f1cc3eab","Type":"ContainerDied","Data":"4bf23bf51dd5b6381907556c6baed5079a9e3a8924f27fa6aa642e5aca7cf4b2"}
Sep 11 14:35:44.658940 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.658658    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7" event={"ID":"03cc12cc-5a07-47af-bafb-4c60f1cc3eab","Type":"ContainerDied","Data":"83ccb63bef35e520fe54c3f3cd45f95bed3025a6e8daddbf33f46b2adc5c614b"}
Sep 11 14:35:44.658940 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.658684    2582 scope.go:117] "RemoveContainer" containerID="4bf23bf51dd5b6381907556c6baed5079a9e3a8924f27fa6aa642e5aca7cf4b2"
Sep 11 14:35:44.669863 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.669842    2582 scope.go:117] "RemoveContainer" containerID="4bf23bf51dd5b6381907556c6baed5079a9e3a8924f27fa6aa642e5aca7cf4b2"
Sep 11 14:35:44.670218 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:35:44.670198    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bf23bf51dd5b6381907556c6baed5079a9e3a8924f27fa6aa642e5aca7cf4b2\": container with ID starting with 4bf23bf51dd5b6381907556c6baed5079a9e3a8924f27fa6aa642e5aca7cf4b2 not found: ID does not exist" containerID="4bf23bf51dd5b6381907556c6baed5079a9e3a8924f27fa6aa642e5aca7cf4b2"
Sep 11 14:35:44.670315 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.670228    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bf23bf51dd5b6381907556c6baed5079a9e3a8924f27fa6aa642e5aca7cf4b2"} err="failed to get container status \"4bf23bf51dd5b6381907556c6baed5079a9e3a8924f27fa6aa642e5aca7cf4b2\": rpc error: code = NotFound desc = could not find container \"4bf23bf51dd5b6381907556c6baed5079a9e3a8924f27fa6aa642e5aca7cf4b2\": container with ID starting with 4bf23bf51dd5b6381907556c6baed5079a9e3a8924f27fa6aa642e5aca7cf4b2 not found: ID does not exist"
Sep 11 14:35:44.713782 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.713750    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"]
Sep 11 14:35:44.729979 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:44.729944    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-15594dcc-54c4696f9f-7mds7"]
Sep 11 14:35:45.495960 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:35:45.495868    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03cc12cc-5a07-47af-bafb-4c60f1cc3eab" path="/var/lib/kubelet/pods/03cc12cc-5a07-47af-bafb-4c60f1cc3eab/volumes"
Sep 11 14:36:48.547648 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:48.547616    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"]
Sep 11 14:36:48.548175 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:48.547816    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5" podUID="1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb" containerName="maas-api" containerID="cri-o://9d6d87501dfdd63773459c7c7b1e6424c04b2d5b1accef5c23d26ba778e7c30e" gracePeriod=30
Sep 11 14:36:48.802901 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:48.802839    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:36:48.933085 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:48.933025    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-maas-api-tls\") pod \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") "
Sep 11 14:36:48.933085 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:48.933088    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-openshift-service-ca\") pod \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") "
Sep 11 14:36:48.933371 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:48.933139    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcn86\" (UniqueName: \"kubernetes.io/projected/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-kube-api-access-lcn86\") pod \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") "
Sep 11 14:36:48.933371 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:48.933189    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-metrics-certs\") pod \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\" (UID: \"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb\") "
Sep 11 14:36:48.933640 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:48.933603    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb" (UID: "1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:36:48.935800 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:48.935764    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb" (UID: "1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:36:48.935919 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:48.935816    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb" (UID: "1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:36:48.935919 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:48.935885    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-kube-api-access-lcn86" (OuterVolumeSpecName: "kube-api-access-lcn86") pod "1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb" (UID: "1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb"). InnerVolumeSpecName "kube-api-access-lcn86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:36:49.038161 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:49.035020    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcn86\" (UniqueName: \"kubernetes.io/projected/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-kube-api-access-lcn86\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:36:49.038161 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:49.035088    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:36:49.038161 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:49.035103    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:36:49.038161 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:49.035113    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:36:49.044304 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:49.044267    2582 generic.go:356] "Generic (PLEG): container finished" podID="1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb" containerID="9d6d87501dfdd63773459c7c7b1e6424c04b2d5b1accef5c23d26ba778e7c30e" exitCode=0
Sep 11 14:36:49.044459 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:49.044366    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"
Sep 11 14:36:49.044459 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:49.044358    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5" event={"ID":"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb","Type":"ContainerDied","Data":"9d6d87501dfdd63773459c7c7b1e6424c04b2d5b1accef5c23d26ba778e7c30e"}
Sep 11 14:36:49.044535 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:49.044498    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5" event={"ID":"1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb","Type":"ContainerDied","Data":"082b87d6d11ab80cd713337a78c02cebea980475a0b1eb72b0122748a23e4250"}
Sep 11 14:36:49.044535 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:49.044528    2582 scope.go:117] "RemoveContainer" containerID="9d6d87501dfdd63773459c7c7b1e6424c04b2d5b1accef5c23d26ba778e7c30e"
Sep 11 14:36:49.055370 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:49.055349    2582 scope.go:117] "RemoveContainer" containerID="9d6d87501dfdd63773459c7c7b1e6424c04b2d5b1accef5c23d26ba778e7c30e"
Sep 11 14:36:49.055645 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:36:49.055626    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d6d87501dfdd63773459c7c7b1e6424c04b2d5b1accef5c23d26ba778e7c30e\": container with ID starting with 9d6d87501dfdd63773459c7c7b1e6424c04b2d5b1accef5c23d26ba778e7c30e not found: ID does not exist" containerID="9d6d87501dfdd63773459c7c7b1e6424c04b2d5b1accef5c23d26ba778e7c30e"
Sep 11 14:36:49.055692 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:49.055654    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d6d87501dfdd63773459c7c7b1e6424c04b2d5b1accef5c23d26ba778e7c30e"} err="failed to get container status \"9d6d87501dfdd63773459c7c7b1e6424c04b2d5b1accef5c23d26ba778e7c30e\": rpc error: code = NotFound desc = could not find container \"9d6d87501dfdd63773459c7c7b1e6424c04b2d5b1accef5c23d26ba778e7c30e\": container with ID starting with 9d6d87501dfdd63773459c7c7b1e6424c04b2d5b1accef5c23d26ba778e7c30e not found: ID does not exist"
Sep 11 14:36:49.079800 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:49.079777    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"]
Sep 11 14:36:49.091607 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:49.091584    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-69a7cf-5dcd9f5894-lwgt5"]
Sep 11 14:36:49.495480 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:36:49.495448    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb" path="/var/lib/kubelet/pods/1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb/volumes"
Sep 11 14:37:40.482912 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.482838    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"]
Sep 11 14:37:40.483392 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.483297    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03cc12cc-5a07-47af-bafb-4c60f1cc3eab" containerName="maas-api"
Sep 11 14:37:40.483392 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.483310    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="03cc12cc-5a07-47af-bafb-4c60f1cc3eab" containerName="maas-api"
Sep 11 14:37:40.483392 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.483321    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb" containerName="maas-api"
Sep 11 14:37:40.483392 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.483326    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb" containerName="maas-api"
Sep 11 14:37:40.483547 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.483401    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="03cc12cc-5a07-47af-bafb-4c60f1cc3eab" containerName="maas-api"
Sep 11 14:37:40.483547 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.483409    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3d61d6-f5aa-480b-91a2-6b4988a9d0bb" containerName="maas-api"
Sep 11 14:37:40.486741 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.486724    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:40.489654 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.489632    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-210be13f-serving-cert\""
Sep 11 14:37:40.505733 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.505682    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"]
Sep 11 14:37:40.640280 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.640245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8d8c\" (UniqueName: \"kubernetes.io/projected/75939f17-a6f7-47e7-a691-616dc78e8f29-kube-api-access-r8d8c\") pod \"maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:40.640486 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.640427    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75939f17-a6f7-47e7-a691-616dc78e8f29-metrics-certs\") pod \"maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:40.640558 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.640527    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75939f17-a6f7-47e7-a691-616dc78e8f29-maas-api-tls\") pod \"maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:40.640626 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.640565    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75939f17-a6f7-47e7-a691-616dc78e8f29-openshift-service-ca\") pod \"maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:40.741505 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.741420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8d8c\" (UniqueName: \"kubernetes.io/projected/75939f17-a6f7-47e7-a691-616dc78e8f29-kube-api-access-r8d8c\") pod \"maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:40.741505 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.741476    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75939f17-a6f7-47e7-a691-616dc78e8f29-metrics-certs\") pod \"maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:40.741505 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.741499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75939f17-a6f7-47e7-a691-616dc78e8f29-maas-api-tls\") pod \"maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:40.741756 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.741517    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75939f17-a6f7-47e7-a691-616dc78e8f29-openshift-service-ca\") pod \"maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:40.742138 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.742113    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75939f17-a6f7-47e7-a691-616dc78e8f29-openshift-service-ca\") pod \"maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:40.744277 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.744245    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75939f17-a6f7-47e7-a691-616dc78e8f29-metrics-certs\") pod \"maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:40.744370 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.744248    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75939f17-a6f7-47e7-a691-616dc78e8f29-maas-api-tls\") pod \"maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:40.750430 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.750404    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8d8c\" (UniqueName: \"kubernetes.io/projected/75939f17-a6f7-47e7-a691-616dc78e8f29-kube-api-access-r8d8c\") pod \"maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:40.798636 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:40.798600    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:41.101921 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:41.101895    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"]
Sep 11 14:37:41.103871 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:37:41.103843    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75939f17_a6f7_47e7_a691_616dc78e8f29.slice/crio-239e78bc5f896529fb39de42eb066380217657468be0bd3ad5a29ead35f28d72 WatchSource:0}: Error finding container 239e78bc5f896529fb39de42eb066380217657468be0bd3ad5a29ead35f28d72: Status 404 returned error can't find the container with id 239e78bc5f896529fb39de42eb066380217657468be0bd3ad5a29ead35f28d72
Sep 11 14:37:41.349277 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:41.349244    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb" event={"ID":"75939f17-a6f7-47e7-a691-616dc78e8f29","Type":"ContainerStarted","Data":"239e78bc5f896529fb39de42eb066380217657468be0bd3ad5a29ead35f28d72"}
Sep 11 14:37:42.356244 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:42.356204    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb" event={"ID":"75939f17-a6f7-47e7-a691-616dc78e8f29","Type":"ContainerStarted","Data":"f6ee11e11123d505b69146253f9934d748dd03e1bbd866964063616539d8237a"}
Sep 11 14:37:42.356747 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:42.356415    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:37:42.396796 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:42.396735    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb" podStartSLOduration=1.7898092669999999 podStartE2EDuration="2.396713082s" totalImagesPullingTime="606.903815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:37:42.395184095 +0000 UTC m=+1359.427618956" watchObservedRunningTime="2026-09-11 14:37:42.396713082 +0000 UTC m=+1359.429147945"
Sep 11 14:37:45.895108 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:45.895076    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"]
Sep 11 14:37:45.895472 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:45.895305    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp" podUID="943c8703-3bbc-4315-bead-1e21afcba0e6" containerName="maas-api" containerID="cri-o://a9103726a1f3791c7b28c5824cb477a375103dcbea398d596129bcac0c1676ff" gracePeriod=30
Sep 11 14:37:46.162258 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.162228    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:37:46.297851 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.297818    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/943c8703-3bbc-4315-bead-1e21afcba0e6-maas-api-tls\") pod \"943c8703-3bbc-4315-bead-1e21afcba0e6\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") "
Sep 11 14:37:46.298020 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.297880    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/943c8703-3bbc-4315-bead-1e21afcba0e6-openshift-service-ca\") pod \"943c8703-3bbc-4315-bead-1e21afcba0e6\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") "
Sep 11 14:37:46.298020 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.297944    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/943c8703-3bbc-4315-bead-1e21afcba0e6-metrics-certs\") pod \"943c8703-3bbc-4315-bead-1e21afcba0e6\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") "
Sep 11 14:37:46.298020 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.297993    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kc87f\" (UniqueName: \"kubernetes.io/projected/943c8703-3bbc-4315-bead-1e21afcba0e6-kube-api-access-kc87f\") pod \"943c8703-3bbc-4315-bead-1e21afcba0e6\" (UID: \"943c8703-3bbc-4315-bead-1e21afcba0e6\") "
Sep 11 14:37:46.298351 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.298318    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/943c8703-3bbc-4315-bead-1e21afcba0e6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "943c8703-3bbc-4315-bead-1e21afcba0e6" (UID: "943c8703-3bbc-4315-bead-1e21afcba0e6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:37:46.298486 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.298461    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/943c8703-3bbc-4315-bead-1e21afcba0e6-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:37:46.300283 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.300249    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/943c8703-3bbc-4315-bead-1e21afcba0e6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "943c8703-3bbc-4315-bead-1e21afcba0e6" (UID: "943c8703-3bbc-4315-bead-1e21afcba0e6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:37:46.300283 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.300265    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/943c8703-3bbc-4315-bead-1e21afcba0e6-kube-api-access-kc87f" (OuterVolumeSpecName: "kube-api-access-kc87f") pod "943c8703-3bbc-4315-bead-1e21afcba0e6" (UID: "943c8703-3bbc-4315-bead-1e21afcba0e6"). InnerVolumeSpecName "kube-api-access-kc87f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:37:46.300408 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.300287    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/943c8703-3bbc-4315-bead-1e21afcba0e6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "943c8703-3bbc-4315-bead-1e21afcba0e6" (UID: "943c8703-3bbc-4315-bead-1e21afcba0e6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:37:46.382404 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.382357    2582 generic.go:356] "Generic (PLEG): container finished" podID="943c8703-3bbc-4315-bead-1e21afcba0e6" containerID="a9103726a1f3791c7b28c5824cb477a375103dcbea398d596129bcac0c1676ff" exitCode=0
Sep 11 14:37:46.382594 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.382473    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"
Sep 11 14:37:46.382594 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.382504    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp" event={"ID":"943c8703-3bbc-4315-bead-1e21afcba0e6","Type":"ContainerDied","Data":"a9103726a1f3791c7b28c5824cb477a375103dcbea398d596129bcac0c1676ff"}
Sep 11 14:37:46.382594 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.382581    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp" event={"ID":"943c8703-3bbc-4315-bead-1e21afcba0e6","Type":"ContainerDied","Data":"8eba898b1002ec2c51ead2a46f54f229a2d1efe6d77fc9b1484be839e93a19d2"}
Sep 11 14:37:46.382764 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.382613    2582 scope.go:117] "RemoveContainer" containerID="a9103726a1f3791c7b28c5824cb477a375103dcbea398d596129bcac0c1676ff"
Sep 11 14:37:46.393945 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.393925    2582 scope.go:117] "RemoveContainer" containerID="a9103726a1f3791c7b28c5824cb477a375103dcbea398d596129bcac0c1676ff"
Sep 11 14:37:46.394296 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:37:46.394277    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9103726a1f3791c7b28c5824cb477a375103dcbea398d596129bcac0c1676ff\": container with ID starting with a9103726a1f3791c7b28c5824cb477a375103dcbea398d596129bcac0c1676ff not found: ID does not exist" containerID="a9103726a1f3791c7b28c5824cb477a375103dcbea398d596129bcac0c1676ff"
Sep 11 14:37:46.394366 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.394305    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9103726a1f3791c7b28c5824cb477a375103dcbea398d596129bcac0c1676ff"} err="failed to get container status \"a9103726a1f3791c7b28c5824cb477a375103dcbea398d596129bcac0c1676ff\": rpc error: code = NotFound desc = could not find container \"a9103726a1f3791c7b28c5824cb477a375103dcbea398d596129bcac0c1676ff\": container with ID starting with a9103726a1f3791c7b28c5824cb477a375103dcbea398d596129bcac0c1676ff not found: ID does not exist"
Sep 11 14:37:46.400107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.400029    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/943c8703-3bbc-4315-bead-1e21afcba0e6-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:37:46.400107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.400076    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc87f\" (UniqueName: \"kubernetes.io/projected/943c8703-3bbc-4315-bead-1e21afcba0e6-kube-api-access-kc87f\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:37:46.400107 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.400088    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/943c8703-3bbc-4315-bead-1e21afcba0e6-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:37:46.441336 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.441311    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"]
Sep 11 14:37:46.469265 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:46.469239    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d4444b-5f4d44b9c5-svkpp"]
Sep 11 14:37:47.497786 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:47.497754    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="943c8703-3bbc-4315-bead-1e21afcba0e6" path="/var/lib/kubelet/pods/943c8703-3bbc-4315-bead-1e21afcba0e6/volumes"
Sep 11 14:37:48.367584 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:37:48.367556    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:38:08.326952 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.326913    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"]
Sep 11 14:38:08.327376 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.327134    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz" podUID="f5389ca1-a7a2-4008-9673-ee65dc4d8e1b" containerName="maas-api" containerID="cri-o://cb976b1ab790053f7b7431e92566c55f9ebc8055125a28b3c0a6c8872ab3fda4" gracePeriod=30
Sep 11 14:38:08.469798 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.469760    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"]
Sep 11 14:38:08.470323 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.470287    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd" podUID="b18b3286-5971-4b58-9fb2-ea6c6fff062f" containerName="payload-processing" containerID="cri-o://7fa258cc9ecd45b262655ada1dd525c435505c3f158b408c44075c19d45be79d" gracePeriod=30
Sep 11 14:38:08.516026 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.515992    2582 generic.go:356] "Generic (PLEG): container finished" podID="f5389ca1-a7a2-4008-9673-ee65dc4d8e1b" containerID="cb976b1ab790053f7b7431e92566c55f9ebc8055125a28b3c0a6c8872ab3fda4" exitCode=0
Sep 11 14:38:08.516238 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.516209    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz" event={"ID":"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b","Type":"ContainerDied","Data":"cb976b1ab790053f7b7431e92566c55f9ebc8055125a28b3c0a6c8872ab3fda4"}
Sep 11 14:38:08.610688 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.610662    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:38:08.718003 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.717971    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-maas-api-tls\") pod \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") "
Sep 11 14:38:08.718218 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.718059    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-metrics-certs\") pod \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") "
Sep 11 14:38:08.718218 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.718086    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-openshift-service-ca\") pod \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") "
Sep 11 14:38:08.718218 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.718183    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54klp\" (UniqueName: \"kubernetes.io/projected/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-kube-api-access-54klp\") pod \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\" (UID: \"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b\") "
Sep 11 14:38:08.718527 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.718502    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f5389ca1-a7a2-4008-9673-ee65dc4d8e1b" (UID: "f5389ca1-a7a2-4008-9673-ee65dc4d8e1b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:38:08.720429 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.720402    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-kube-api-access-54klp" (OuterVolumeSpecName: "kube-api-access-54klp") pod "f5389ca1-a7a2-4008-9673-ee65dc4d8e1b" (UID: "f5389ca1-a7a2-4008-9673-ee65dc4d8e1b"). InnerVolumeSpecName "kube-api-access-54klp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:38:08.720519 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.720434    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f5389ca1-a7a2-4008-9673-ee65dc4d8e1b" (UID: "f5389ca1-a7a2-4008-9673-ee65dc4d8e1b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:38:08.720519 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.720462    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f5389ca1-a7a2-4008-9673-ee65dc4d8e1b" (UID: "f5389ca1-a7a2-4008-9673-ee65dc4d8e1b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:38:08.735614 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.735595    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"
Sep 11 14:38:08.818941 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.818907    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b18b3286-5971-4b58-9fb2-ea6c6fff062f-plugins-config-volume\") pod \"b18b3286-5971-4b58-9fb2-ea6c6fff062f\" (UID: \"b18b3286-5971-4b58-9fb2-ea6c6fff062f\") "
Sep 11 14:38:08.819150 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.819026    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qgbr\" (UniqueName: \"kubernetes.io/projected/b18b3286-5971-4b58-9fb2-ea6c6fff062f-kube-api-access-5qgbr\") pod \"b18b3286-5971-4b58-9fb2-ea6c6fff062f\" (UID: \"b18b3286-5971-4b58-9fb2-ea6c6fff062f\") "
Sep 11 14:38:08.819393 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.819359    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b18b3286-5971-4b58-9fb2-ea6c6fff062f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b18b3286-5971-4b58-9fb2-ea6c6fff062f" (UID: "b18b3286-5971-4b58-9fb2-ea6c6fff062f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:38:08.820194 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.820172    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:38:08.820194 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.820194    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b18b3286-5971-4b58-9fb2-ea6c6fff062f-plugins-config-volume\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:38:08.820343 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.820208    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:38:08.820343 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.820221    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:38:08.820343 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.820233    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54klp\" (UniqueName: \"kubernetes.io/projected/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b-kube-api-access-54klp\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:38:08.821383 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.821362    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b18b3286-5971-4b58-9fb2-ea6c6fff062f-kube-api-access-5qgbr" (OuterVolumeSpecName: "kube-api-access-5qgbr") pod "b18b3286-5971-4b58-9fb2-ea6c6fff062f" (UID: "b18b3286-5971-4b58-9fb2-ea6c6fff062f"). InnerVolumeSpecName "kube-api-access-5qgbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:38:08.921298 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:08.921223    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qgbr\" (UniqueName: \"kubernetes.io/projected/b18b3286-5971-4b58-9fb2-ea6c6fff062f-kube-api-access-5qgbr\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:38:09.522721 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:09.522690    2582 generic.go:356] "Generic (PLEG): container finished" podID="b18b3286-5971-4b58-9fb2-ea6c6fff062f" containerID="7fa258cc9ecd45b262655ada1dd525c435505c3f158b408c44075c19d45be79d" exitCode=0
Sep 11 14:38:09.523193 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:09.522735    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"
Sep 11 14:38:09.523193 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:09.522768    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd" event={"ID":"b18b3286-5971-4b58-9fb2-ea6c6fff062f","Type":"ContainerDied","Data":"7fa258cc9ecd45b262655ada1dd525c435505c3f158b408c44075c19d45be79d"}
Sep 11 14:38:09.523193 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:09.522824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd" event={"ID":"b18b3286-5971-4b58-9fb2-ea6c6fff062f","Type":"ContainerDied","Data":"4eedd5bbb3849456038e8b39ffa94277e341866db78e0b63ff8e507c4baf756d"}
Sep 11 14:38:09.523193 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:09.522844    2582 scope.go:117] "RemoveContainer" containerID="7fa258cc9ecd45b262655ada1dd525c435505c3f158b408c44075c19d45be79d"
Sep 11 14:38:09.524604 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:09.524583    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz" event={"ID":"f5389ca1-a7a2-4008-9673-ee65dc4d8e1b","Type":"ContainerDied","Data":"4d28307baeae86174e9e39a8c5ef4931532fd98212e42213917af5a6de0ee4c8"}
Sep 11 14:38:09.524698 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:09.524607    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"
Sep 11 14:38:09.532523 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:09.532501    2582 scope.go:117] "RemoveContainer" containerID="7fa258cc9ecd45b262655ada1dd525c435505c3f158b408c44075c19d45be79d"
Sep 11 14:38:09.532786 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:38:09.532768    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fa258cc9ecd45b262655ada1dd525c435505c3f158b408c44075c19d45be79d\": container with ID starting with 7fa258cc9ecd45b262655ada1dd525c435505c3f158b408c44075c19d45be79d not found: ID does not exist" containerID="7fa258cc9ecd45b262655ada1dd525c435505c3f158b408c44075c19d45be79d"
Sep 11 14:38:09.532846 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:09.532795    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fa258cc9ecd45b262655ada1dd525c435505c3f158b408c44075c19d45be79d"} err="failed to get container status \"7fa258cc9ecd45b262655ada1dd525c435505c3f158b408c44075c19d45be79d\": rpc error: code = NotFound desc = could not find container \"7fa258cc9ecd45b262655ada1dd525c435505c3f158b408c44075c19d45be79d\": container with ID starting with 7fa258cc9ecd45b262655ada1dd525c435505c3f158b408c44075c19d45be79d not found: ID does not exist"
Sep 11 14:38:09.532846 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:09.532811    2582 scope.go:117] "RemoveContainer" containerID="cb976b1ab790053f7b7431e92566c55f9ebc8055125a28b3c0a6c8872ab3fda4"
Sep 11 14:38:09.551660 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:09.551634    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"]
Sep 11 14:38:09.554131 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:09.554110    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5b0917-5867c8d587-5v7dd"]
Sep 11 14:38:09.584749 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:09.584724    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"]
Sep 11 14:38:09.591122 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:09.591101    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5b0917-8698bc55f6-4phbz"]
Sep 11 14:38:11.012606 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.012569    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"]
Sep 11 14:38:11.013131 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.012866    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb" podUID="75939f17-a6f7-47e7-a691-616dc78e8f29" containerName="maas-api" containerID="cri-o://f6ee11e11123d505b69146253f9934d748dd03e1bbd866964063616539d8237a" gracePeriod=30
Sep 11 14:38:11.269634 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.269571    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:38:11.346519 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.346491    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75939f17-a6f7-47e7-a691-616dc78e8f29-openshift-service-ca\") pod \"75939f17-a6f7-47e7-a691-616dc78e8f29\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") "
Sep 11 14:38:11.346688 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.346540    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75939f17-a6f7-47e7-a691-616dc78e8f29-maas-api-tls\") pod \"75939f17-a6f7-47e7-a691-616dc78e8f29\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") "
Sep 11 14:38:11.346688 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.346609    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75939f17-a6f7-47e7-a691-616dc78e8f29-metrics-certs\") pod \"75939f17-a6f7-47e7-a691-616dc78e8f29\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") "
Sep 11 14:38:11.346688 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.346639    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8d8c\" (UniqueName: \"kubernetes.io/projected/75939f17-a6f7-47e7-a691-616dc78e8f29-kube-api-access-r8d8c\") pod \"75939f17-a6f7-47e7-a691-616dc78e8f29\" (UID: \"75939f17-a6f7-47e7-a691-616dc78e8f29\") "
Sep 11 14:38:11.346915 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.346887    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75939f17-a6f7-47e7-a691-616dc78e8f29-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "75939f17-a6f7-47e7-a691-616dc78e8f29" (UID: "75939f17-a6f7-47e7-a691-616dc78e8f29"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:38:11.348954 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.348925    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75939f17-a6f7-47e7-a691-616dc78e8f29-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "75939f17-a6f7-47e7-a691-616dc78e8f29" (UID: "75939f17-a6f7-47e7-a691-616dc78e8f29"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:38:11.349098 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.348950    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75939f17-a6f7-47e7-a691-616dc78e8f29-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "75939f17-a6f7-47e7-a691-616dc78e8f29" (UID: "75939f17-a6f7-47e7-a691-616dc78e8f29"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:38:11.349098 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.349023    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75939f17-a6f7-47e7-a691-616dc78e8f29-kube-api-access-r8d8c" (OuterVolumeSpecName: "kube-api-access-r8d8c") pod "75939f17-a6f7-47e7-a691-616dc78e8f29" (UID: "75939f17-a6f7-47e7-a691-616dc78e8f29"). InnerVolumeSpecName "kube-api-access-r8d8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:38:11.447879 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.447844    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75939f17-a6f7-47e7-a691-616dc78e8f29-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:38:11.447879 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.447873    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75939f17-a6f7-47e7-a691-616dc78e8f29-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:38:11.447879 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.447884    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75939f17-a6f7-47e7-a691-616dc78e8f29-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:38:11.448142 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.447893    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8d8c\" (UniqueName: \"kubernetes.io/projected/75939f17-a6f7-47e7-a691-616dc78e8f29-kube-api-access-r8d8c\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:38:11.495253 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.495219    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b18b3286-5971-4b58-9fb2-ea6c6fff062f" path="/var/lib/kubelet/pods/b18b3286-5971-4b58-9fb2-ea6c6fff062f/volumes"
Sep 11 14:38:11.495656 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.495641    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5389ca1-a7a2-4008-9673-ee65dc4d8e1b" path="/var/lib/kubelet/pods/f5389ca1-a7a2-4008-9673-ee65dc4d8e1b/volumes"
Sep 11 14:38:11.540898 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.540824    2582 generic.go:356] "Generic (PLEG): container finished" podID="75939f17-a6f7-47e7-a691-616dc78e8f29" containerID="f6ee11e11123d505b69146253f9934d748dd03e1bbd866964063616539d8237a" exitCode=0
Sep 11 14:38:11.540898 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.540874    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"
Sep 11 14:38:11.541053 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.540900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb" event={"ID":"75939f17-a6f7-47e7-a691-616dc78e8f29","Type":"ContainerDied","Data":"f6ee11e11123d505b69146253f9934d748dd03e1bbd866964063616539d8237a"}
Sep 11 14:38:11.541053 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.540945    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb" event={"ID":"75939f17-a6f7-47e7-a691-616dc78e8f29","Type":"ContainerDied","Data":"239e78bc5f896529fb39de42eb066380217657468be0bd3ad5a29ead35f28d72"}
Sep 11 14:38:11.541053 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.540970    2582 scope.go:117] "RemoveContainer" containerID="f6ee11e11123d505b69146253f9934d748dd03e1bbd866964063616539d8237a"
Sep 11 14:38:11.553534 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.553455    2582 scope.go:117] "RemoveContainer" containerID="f6ee11e11123d505b69146253f9934d748dd03e1bbd866964063616539d8237a"
Sep 11 14:38:11.554119 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:38:11.554093    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6ee11e11123d505b69146253f9934d748dd03e1bbd866964063616539d8237a\": container with ID starting with f6ee11e11123d505b69146253f9934d748dd03e1bbd866964063616539d8237a not found: ID does not exist" containerID="f6ee11e11123d505b69146253f9934d748dd03e1bbd866964063616539d8237a"
Sep 11 14:38:11.554242 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.554126    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6ee11e11123d505b69146253f9934d748dd03e1bbd866964063616539d8237a"} err="failed to get container status \"f6ee11e11123d505b69146253f9934d748dd03e1bbd866964063616539d8237a\": rpc error: code = NotFound desc = could not find container \"f6ee11e11123d505b69146253f9934d748dd03e1bbd866964063616539d8237a\": container with ID starting with f6ee11e11123d505b69146253f9934d748dd03e1bbd866964063616539d8237a not found: ID does not exist"
Sep 11 14:38:11.574723 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.574695    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"]
Sep 11 14:38:11.586473 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:11.586446    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-210be13f-7bfd8975cf-lk6mb"]
Sep 11 14:38:13.497544 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:13.497511    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75939f17-a6f7-47e7-a691-616dc78e8f29" path="/var/lib/kubelet/pods/75939f17-a6f7-47e7-a691-616dc78e8f29/volumes"
Sep 11 14:38:23.076737 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.076704    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"]
Sep 11 14:38:23.077140 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.077107    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943c8703-3bbc-4315-bead-1e21afcba0e6" containerName="maas-api"
Sep 11 14:38:23.077140 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.077118    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="943c8703-3bbc-4315-bead-1e21afcba0e6" containerName="maas-api"
Sep 11 14:38:23.077140 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.077126    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5389ca1-a7a2-4008-9673-ee65dc4d8e1b" containerName="maas-api"
Sep 11 14:38:23.077140 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.077132    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5389ca1-a7a2-4008-9673-ee65dc4d8e1b" containerName="maas-api"
Sep 11 14:38:23.077140 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.077142    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75939f17-a6f7-47e7-a691-616dc78e8f29" containerName="maas-api"
Sep 11 14:38:23.077309 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.077147    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="75939f17-a6f7-47e7-a691-616dc78e8f29" containerName="maas-api"
Sep 11 14:38:23.077309 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.077163    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18b3286-5971-4b58-9fb2-ea6c6fff062f" containerName="payload-processing"
Sep 11 14:38:23.077309 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.077169    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18b3286-5971-4b58-9fb2-ea6c6fff062f" containerName="payload-processing"
Sep 11 14:38:23.077309 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.077237    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5389ca1-a7a2-4008-9673-ee65dc4d8e1b" containerName="maas-api"
Sep 11 14:38:23.077309 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.077245    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="75939f17-a6f7-47e7-a691-616dc78e8f29" containerName="maas-api"
Sep 11 14:38:23.077309 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.077253    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b18b3286-5971-4b58-9fb2-ea6c6fff062f" containerName="payload-processing"
Sep 11 14:38:23.077309 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.077262    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="943c8703-3bbc-4315-bead-1e21afcba0e6" containerName="maas-api"
Sep 11 14:38:23.081755 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.081737    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:23.090840 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.090820    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c5cfn\""
Sep 11 14:38:23.091443 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.091428    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-8feb68-serving-cert\""
Sep 11 14:38:23.118902 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.118872    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"]
Sep 11 14:38:23.268361 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.268332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/642bcf18-c641-4dc6-8009-6f2d4cb16e05-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:23.268361 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.268365    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/642bcf18-c641-4dc6-8009-6f2d4cb16e05-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:23.268565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.268497    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/642bcf18-c641-4dc6-8009-6f2d4cb16e05-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:23.268604 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.268581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8phv\" (UniqueName: \"kubernetes.io/projected/642bcf18-c641-4dc6-8009-6f2d4cb16e05-kube-api-access-g8phv\") pod \"maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:23.369410 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.369327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8phv\" (UniqueName: \"kubernetes.io/projected/642bcf18-c641-4dc6-8009-6f2d4cb16e05-kube-api-access-g8phv\") pod \"maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:23.369410 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.369375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/642bcf18-c641-4dc6-8009-6f2d4cb16e05-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:23.369410 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.369394    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/642bcf18-c641-4dc6-8009-6f2d4cb16e05-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:23.369701 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.369453    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/642bcf18-c641-4dc6-8009-6f2d4cb16e05-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:23.370090 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.370066    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/642bcf18-c641-4dc6-8009-6f2d4cb16e05-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:23.372071 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.372028    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/642bcf18-c641-4dc6-8009-6f2d4cb16e05-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:23.372204 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.372183    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/642bcf18-c641-4dc6-8009-6f2d4cb16e05-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:23.382979 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.382948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8phv\" (UniqueName: \"kubernetes.io/projected/642bcf18-c641-4dc6-8009-6f2d4cb16e05-kube-api-access-g8phv\") pod \"maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:23.392845 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.392825    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:23.695924 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:23.695897    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"]
Sep 11 14:38:23.696874 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:38:23.696846    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642bcf18_c641_4dc6_8009_6f2d4cb16e05.slice/crio-e37457d9e39d3dfccad43355fed17b69601b4d5ed3937361878210d298263f09 WatchSource:0}: Error finding container e37457d9e39d3dfccad43355fed17b69601b4d5ed3937361878210d298263f09: Status 404 returned error can't find the container with id e37457d9e39d3dfccad43355fed17b69601b4d5ed3937361878210d298263f09
Sep 11 14:38:24.618372 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:24.618325    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w" event={"ID":"642bcf18-c641-4dc6-8009-6f2d4cb16e05","Type":"ContainerStarted","Data":"64261019028f656b08d305174a8ba383c7a3a4e2206d07630290667dccaa106b"}
Sep 11 14:38:24.618762 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:24.618393    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w" event={"ID":"642bcf18-c641-4dc6-8009-6f2d4cb16e05","Type":"ContainerStarted","Data":"e37457d9e39d3dfccad43355fed17b69601b4d5ed3937361878210d298263f09"}
Sep 11 14:38:24.618762 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:24.618506    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:24.682306 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:24.682240    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w" podStartSLOduration=1.216244555 podStartE2EDuration="1.682222318s" totalImagesPullingTime="465.977763ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:38:24.666745995 +0000 UTC m=+1401.699180854" watchObservedRunningTime="2026-09-11 14:38:24.682222318 +0000 UTC m=+1401.714657178"
Sep 11 14:38:30.630939 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:30.630909    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:38:50.742228 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.742195    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"]
Sep 11 14:38:50.746235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.746196    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:50.749303 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.749282    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-28858c-serving-cert\""
Sep 11 14:38:50.768233 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.768187    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"]
Sep 11 14:38:50.836594 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.836560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:50.836594 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.836594    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8mw5\" (UniqueName: \"kubernetes.io/projected/a62db043-d75a-48d1-87ec-06f939559df3-kube-api-access-r8mw5\") pod \"maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:50.836850 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.836674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:50.836850 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.836695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62db043-d75a-48d1-87ec-06f939559df3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:50.937553 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.937518    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:50.937553 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.937558    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8mw5\" (UniqueName: \"kubernetes.io/projected/a62db043-d75a-48d1-87ec-06f939559df3-kube-api-access-r8mw5\") pod \"maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:50.937801 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.937624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:50.937801 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.937647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62db043-d75a-48d1-87ec-06f939559df3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:50.937801 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:38:50.937764    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-serving-cert: secret "maas-api-e2e-shared-a-w2-28858c-serving-cert" not found
Sep 11 14:38:50.937961 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:38:50.937839    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-maas-api-tls podName:a62db043-d75a-48d1-87ec-06f939559df3 nodeName:}" failed. No retries permitted until 2026-09-11 14:38:51.43781785 +0000 UTC m=+1428.470252711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-maas-api-tls") pod "maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7" (UID: "a62db043-d75a-48d1-87ec-06f939559df3") : secret "maas-api-e2e-shared-a-w2-28858c-serving-cert" not found
Sep 11 14:38:50.938323 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.938304    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62db043-d75a-48d1-87ec-06f939559df3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:50.940058 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.940024    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:50.953875 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:50.953853    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8mw5\" (UniqueName: \"kubernetes.io/projected/a62db043-d75a-48d1-87ec-06f939559df3-kube-api-access-r8mw5\") pod \"maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:51.443142 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:51.443102    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:51.445898 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:51.445869    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:51.658339 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:51.658297    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:51.956704 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:51.956679    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"]
Sep 11 14:38:51.958623 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:38:51.958591    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62db043_d75a_48d1_87ec_06f939559df3.slice/crio-f5d25af60910bd66cf59ee5421023fce834c74fc76c9eb809d4562b687db0884 WatchSource:0}: Error finding container f5d25af60910bd66cf59ee5421023fce834c74fc76c9eb809d4562b687db0884: Status 404 returned error can't find the container with id f5d25af60910bd66cf59ee5421023fce834c74fc76c9eb809d4562b687db0884
Sep 11 14:38:52.787067 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:52.787014    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7" event={"ID":"a62db043-d75a-48d1-87ec-06f939559df3","Type":"ContainerStarted","Data":"f5d25af60910bd66cf59ee5421023fce834c74fc76c9eb809d4562b687db0884"}
Sep 11 14:38:53.794326 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:53.794287    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7" event={"ID":"a62db043-d75a-48d1-87ec-06f939559df3","Type":"ContainerStarted","Data":"ad334b7c3f7eb3d2c14684deac193312f84e981bd2ba7038e29547413e26a726"}
Sep 11 14:38:53.794701 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:53.794357    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:38:53.824114 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:53.824063    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7" podStartSLOduration=2.973457191 podStartE2EDuration="3.824047043s" totalImagesPullingTime="850.589852ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:38:53.821239657 +0000 UTC m=+1430.853674514" watchObservedRunningTime="2026-09-11 14:38:53.824047043 +0000 UTC m=+1430.856481894"
Sep 11 14:38:54.776439 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:54.776365    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"]
Sep 11 14:38:54.780088 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:54.780072    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:54.791195 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:54.791170    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-977c12-serving-cert\""
Sep 11 14:38:54.801002 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:54.800972    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"]
Sep 11 14:38:54.877601 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:54.877561    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:54.877601 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:54.877605    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b4cfd9b-4acb-4048-a701-e7c30254123f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:54.877843 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:54.877774    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:54.877903 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:54.877852    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr56f\" (UniqueName: \"kubernetes.io/projected/1b4cfd9b-4acb-4048-a701-e7c30254123f-kube-api-access-tr56f\") pod \"maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:54.979017 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:54.978983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:54.979211 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:54.979055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr56f\" (UniqueName: \"kubernetes.io/projected/1b4cfd9b-4acb-4048-a701-e7c30254123f-kube-api-access-tr56f\") pod \"maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:54.979211 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:54.979124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:54.979211 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:54.979146    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b4cfd9b-4acb-4048-a701-e7c30254123f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:54.979334 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:38:54.979272    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-serving-cert: secret "maas-api-e2e-shared-b-w3-977c12-serving-cert" not found
Sep 11 14:38:54.979334 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:38:54.979330    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-maas-api-tls podName:1b4cfd9b-4acb-4048-a701-e7c30254123f nodeName:}" failed. No retries permitted until 2026-09-11 14:38:55.479314965 +0000 UTC m=+1432.511749808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-maas-api-tls") pod "maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs" (UID: "1b4cfd9b-4acb-4048-a701-e7c30254123f") : secret "maas-api-e2e-shared-b-w3-977c12-serving-cert" not found
Sep 11 14:38:54.979758 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:54.979731    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b4cfd9b-4acb-4048-a701-e7c30254123f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:54.981776 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:54.981745    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:55.004239 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:55.004214    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr56f\" (UniqueName: \"kubernetes.io/projected/1b4cfd9b-4acb-4048-a701-e7c30254123f-kube-api-access-tr56f\") pod \"maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:55.485835 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:55.485786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:55.488241 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:55.488222    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:55.690471 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:55.690417    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:56.006711 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:56.006635    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"]
Sep 11 14:38:56.012436 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:38:56.012402    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b4cfd9b_4acb_4048_a701_e7c30254123f.slice/crio-c3e616ee1827aeb9a0228a1879433a224e949d8fe7edbb914324bc8ef6df42cd WatchSource:0}: Error finding container c3e616ee1827aeb9a0228a1879433a224e949d8fe7edbb914324bc8ef6df42cd: Status 404 returned error can't find the container with id c3e616ee1827aeb9a0228a1879433a224e949d8fe7edbb914324bc8ef6df42cd
Sep 11 14:38:56.823369 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:56.823330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs" event={"ID":"1b4cfd9b-4acb-4048-a701-e7c30254123f","Type":"ContainerStarted","Data":"c49455ae1013301266b73a5f55c2b548248bac831dfc5c9ffc56dc223c9e2ce6"}
Sep 11 14:38:56.823584 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:56.823423    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs" event={"ID":"1b4cfd9b-4acb-4048-a701-e7c30254123f","Type":"ContainerStarted","Data":"c3e616ee1827aeb9a0228a1879433a224e949d8fe7edbb914324bc8ef6df42cd"}
Sep 11 14:38:56.823584 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:56.823459    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:38:56.859526 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:56.859477    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs" podStartSLOduration=2.522927884 podStartE2EDuration="2.859462214s" totalImagesPullingTime="336.53433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:38:56.8577115 +0000 UTC m=+1433.890146362" watchObservedRunningTime="2026-09-11 14:38:56.859462214 +0000 UTC m=+1433.891897077"
Sep 11 14:38:59.808171 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:38:59.808139    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:39:02.835416 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:02.835385    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:39:27.045164 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.045133    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"]
Sep 11 14:39:27.050264 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.050244    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:27.058882 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.058860    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-7eeb45-serving-cert\""
Sep 11 14:39:27.152721 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.152690    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"]
Sep 11 14:39:27.183387 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.183356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffsvv\" (UniqueName: \"kubernetes.io/projected/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-kube-api-access-ffsvv\") pod \"maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:27.183387 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.183390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:27.183591 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.183415    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:27.183591 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.183563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:27.284917 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.284881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffsvv\" (UniqueName: \"kubernetes.io/projected/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-kube-api-access-ffsvv\") pod \"maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:27.284917 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.284918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:27.285223 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.284941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:27.285223 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.285006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:27.285223 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:39:27.285145    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-serving-cert: secret "maas-api-e2e-shared-b-w2-7eeb45-serving-cert" not found
Sep 11 14:39:27.285223 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:39:27.285202    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-maas-api-tls podName:34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb nodeName:}" failed. No retries permitted until 2026-09-11 14:39:27.785187704 +0000 UTC m=+1464.817622542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-maas-api-tls") pod "maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5" (UID: "34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb") : secret "maas-api-e2e-shared-b-w2-7eeb45-serving-cert" not found
Sep 11 14:39:27.285690 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.285664    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:27.287689 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.287667    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:27.301704 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.301647    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffsvv\" (UniqueName: \"kubernetes.io/projected/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-kube-api-access-ffsvv\") pod \"maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:27.789149 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:27.789110    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:27.789321 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:39:27.789274    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-serving-cert: secret "maas-api-e2e-shared-b-w2-7eeb45-serving-cert" not found
Sep 11 14:39:27.789365 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:39:27.789344    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-maas-api-tls podName:34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb nodeName:}" failed. No retries permitted until 2026-09-11 14:39:28.789328465 +0000 UTC m=+1465.821763309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-maas-api-tls") pod "maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5" (UID: "34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb") : secret "maas-api-e2e-shared-b-w2-7eeb45-serving-cert" not found
Sep 11 14:39:28.800845 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:28.800803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:28.803502 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:28.803478    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:28.861454 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:28.861420    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:29.159619 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:29.159594    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"]
Sep 11 14:39:29.161685 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:39:29.161652    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34fd35f5_36d6_4f5f_b53f_4d4ea6c92acb.slice/crio-f10806107d7bb6f0475c55e03d37a715b2ed5f7f2f277d104e5d92b424cc2b1a WatchSource:0}: Error finding container f10806107d7bb6f0475c55e03d37a715b2ed5f7f2f277d104e5d92b424cc2b1a: Status 404 returned error can't find the container with id f10806107d7bb6f0475c55e03d37a715b2ed5f7f2f277d104e5d92b424cc2b1a
Sep 11 14:39:30.031944 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:30.031884    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5" event={"ID":"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb","Type":"ContainerStarted","Data":"b5f3fce19dce876c9c80bf868072ae837ffdb9371787ed6182d726bb0421277a"}
Sep 11 14:39:30.032460 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:30.031954    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5" event={"ID":"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb","Type":"ContainerStarted","Data":"f10806107d7bb6f0475c55e03d37a715b2ed5f7f2f277d104e5d92b424cc2b1a"}
Sep 11 14:39:30.032460 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:30.032160    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:39:30.069688 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:30.069630    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5" podStartSLOduration=2.749898313 podStartE2EDuration="3.069612879s" totalImagesPullingTime="319.714566ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:39:30.065494337 +0000 UTC m=+1467.097929197" watchObservedRunningTime="2026-09-11 14:39:30.069612879 +0000 UTC m=+1467.102047736"
Sep 11 14:39:36.043262 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:39:36.043219    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:40:13.066197 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.066145    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"]
Sep 11 14:40:13.070285 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.070263    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:13.073738 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.073715    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3893129d-serving-cert\""
Sep 11 14:40:13.109168 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.109139    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"]
Sep 11 14:40:13.151421 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.151388    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc79h\" (UniqueName: \"kubernetes.io/projected/da4d7f1e-189d-40a0-8234-fb170f16e7bd-kube-api-access-lc79h\") pod \"maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:13.151582 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.151463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-metrics-certs\") pod \"maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:13.151582 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.151520    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-maas-api-tls\") pod \"maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:13.151582 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.151536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da4d7f1e-189d-40a0-8234-fb170f16e7bd-openshift-service-ca\") pod \"maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:13.252579 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.252543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-metrics-certs\") pod \"maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:13.252782 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.252608    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-maas-api-tls\") pod \"maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:13.252782 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.252632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da4d7f1e-189d-40a0-8234-fb170f16e7bd-openshift-service-ca\") pod \"maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:13.252782 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.252681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc79h\" (UniqueName: \"kubernetes.io/projected/da4d7f1e-189d-40a0-8234-fb170f16e7bd-kube-api-access-lc79h\") pod \"maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:13.252782 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:40:13.252711    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-serving-cert: secret "maas-api-e2e-mt-3893129d-serving-cert" not found
Sep 11 14:40:13.252968 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:40:13.252807    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-maas-api-tls podName:da4d7f1e-189d-40a0-8234-fb170f16e7bd nodeName:}" failed. No retries permitted until 2026-09-11 14:40:13.752783664 +0000 UTC m=+1510.785218505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-maas-api-tls") pod "maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc" (UID: "da4d7f1e-189d-40a0-8234-fb170f16e7bd") : secret "maas-api-e2e-mt-3893129d-serving-cert" not found
Sep 11 14:40:13.253415 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.253394    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da4d7f1e-189d-40a0-8234-fb170f16e7bd-openshift-service-ca\") pod \"maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:13.255229 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.255205    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-metrics-certs\") pod \"maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:13.275577 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.275554    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc79h\" (UniqueName: \"kubernetes.io/projected/da4d7f1e-189d-40a0-8234-fb170f16e7bd-kube-api-access-lc79h\") pod \"maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:13.758140 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.758108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-maas-api-tls\") pod \"maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:13.760603 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.760580    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-maas-api-tls\") pod \"maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:13.981172 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:13.981138    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:14.300551 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:14.300525    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"]
Sep 11 14:40:14.300980 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:40:14.300654    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4d7f1e_189d_40a0_8234_fb170f16e7bd.slice/crio-5ed7086cbb0d984379f0f37156b7209026b3f6c523630e01d4311d40793c717b WatchSource:0}: Error finding container 5ed7086cbb0d984379f0f37156b7209026b3f6c523630e01d4311d40793c717b: Status 404 returned error can't find the container with id 5ed7086cbb0d984379f0f37156b7209026b3f6c523630e01d4311d40793c717b
Sep 11 14:40:14.301934 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:14.301917    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:40:15.308427 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:15.308388    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc" event={"ID":"da4d7f1e-189d-40a0-8234-fb170f16e7bd","Type":"ContainerStarted","Data":"88764fb191f164b73dc9615a78fa3102e578ec7df90d5ba0c42de596e641c6d0"}
Sep 11 14:40:15.308821 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:15.308478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc" event={"ID":"da4d7f1e-189d-40a0-8234-fb170f16e7bd","Type":"ContainerStarted","Data":"5ed7086cbb0d984379f0f37156b7209026b3f6c523630e01d4311d40793c717b"}
Sep 11 14:40:15.308821 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:15.308502    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:40:15.347174 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:15.347120    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc" podStartSLOduration=1.8699873679999999 podStartE2EDuration="2.347104422s" totalImagesPullingTime="477.117054ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:40:15.345608263 +0000 UTC m=+1512.378043123" watchObservedRunningTime="2026-09-11 14:40:15.347104422 +0000 UTC m=+1512.379539352"
Sep 11 14:40:21.319176 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:40:21.319141    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:41:37.181940 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.181906    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"]
Sep 11 14:41:37.182472 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.182217    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc" podUID="da4d7f1e-189d-40a0-8234-fb170f16e7bd" containerName="maas-api" containerID="cri-o://88764fb191f164b73dc9615a78fa3102e578ec7df90d5ba0c42de596e641c6d0" gracePeriod=30
Sep 11 14:41:37.443692 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.443601    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:41:37.565996 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.565968    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da4d7f1e-189d-40a0-8234-fb170f16e7bd-openshift-service-ca\") pod \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") "
Sep 11 14:41:37.566173 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.566048    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-metrics-certs\") pod \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") "
Sep 11 14:41:37.566223 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.566207    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-maas-api-tls\") pod \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") "
Sep 11 14:41:37.566284 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.566240    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc79h\" (UniqueName: \"kubernetes.io/projected/da4d7f1e-189d-40a0-8234-fb170f16e7bd-kube-api-access-lc79h\") pod \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\" (UID: \"da4d7f1e-189d-40a0-8234-fb170f16e7bd\") "
Sep 11 14:41:37.566392 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.566364    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da4d7f1e-189d-40a0-8234-fb170f16e7bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "da4d7f1e-189d-40a0-8234-fb170f16e7bd" (UID: "da4d7f1e-189d-40a0-8234-fb170f16e7bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:41:37.567067 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.567025    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da4d7f1e-189d-40a0-8234-fb170f16e7bd-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:41:37.568506 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.568478    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "da4d7f1e-189d-40a0-8234-fb170f16e7bd" (UID: "da4d7f1e-189d-40a0-8234-fb170f16e7bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:41:37.568651 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.568542    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da4d7f1e-189d-40a0-8234-fb170f16e7bd-kube-api-access-lc79h" (OuterVolumeSpecName: "kube-api-access-lc79h") pod "da4d7f1e-189d-40a0-8234-fb170f16e7bd" (UID: "da4d7f1e-189d-40a0-8234-fb170f16e7bd"). InnerVolumeSpecName "kube-api-access-lc79h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:41:37.568651 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.568608    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "da4d7f1e-189d-40a0-8234-fb170f16e7bd" (UID: "da4d7f1e-189d-40a0-8234-fb170f16e7bd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:41:37.667831 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.667796    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:41:37.667831 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.667823    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da4d7f1e-189d-40a0-8234-fb170f16e7bd-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:41:37.667831 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.667833    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc79h\" (UniqueName: \"kubernetes.io/projected/da4d7f1e-189d-40a0-8234-fb170f16e7bd-kube-api-access-lc79h\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:41:37.789432 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.789344    2582 generic.go:356] "Generic (PLEG): container finished" podID="da4d7f1e-189d-40a0-8234-fb170f16e7bd" containerID="88764fb191f164b73dc9615a78fa3102e578ec7df90d5ba0c42de596e641c6d0" exitCode=0
Sep 11 14:41:37.789432 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.789391    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"
Sep 11 14:41:37.789432 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.789422    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc" event={"ID":"da4d7f1e-189d-40a0-8234-fb170f16e7bd","Type":"ContainerDied","Data":"88764fb191f164b73dc9615a78fa3102e578ec7df90d5ba0c42de596e641c6d0"}
Sep 11 14:41:37.789688 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.789477    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc" event={"ID":"da4d7f1e-189d-40a0-8234-fb170f16e7bd","Type":"ContainerDied","Data":"5ed7086cbb0d984379f0f37156b7209026b3f6c523630e01d4311d40793c717b"}
Sep 11 14:41:37.789688 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.789498    2582 scope.go:117] "RemoveContainer" containerID="88764fb191f164b73dc9615a78fa3102e578ec7df90d5ba0c42de596e641c6d0"
Sep 11 14:41:37.800479 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.800458    2582 scope.go:117] "RemoveContainer" containerID="88764fb191f164b73dc9615a78fa3102e578ec7df90d5ba0c42de596e641c6d0"
Sep 11 14:41:37.800810 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:41:37.800794    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88764fb191f164b73dc9615a78fa3102e578ec7df90d5ba0c42de596e641c6d0\": container with ID starting with 88764fb191f164b73dc9615a78fa3102e578ec7df90d5ba0c42de596e641c6d0 not found: ID does not exist" containerID="88764fb191f164b73dc9615a78fa3102e578ec7df90d5ba0c42de596e641c6d0"
Sep 11 14:41:37.800871 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.800819    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88764fb191f164b73dc9615a78fa3102e578ec7df90d5ba0c42de596e641c6d0"} err="failed to get container status \"88764fb191f164b73dc9615a78fa3102e578ec7df90d5ba0c42de596e641c6d0\": rpc error: code = NotFound desc = could not find container \"88764fb191f164b73dc9615a78fa3102e578ec7df90d5ba0c42de596e641c6d0\": container with ID starting with 88764fb191f164b73dc9615a78fa3102e578ec7df90d5ba0c42de596e641c6d0 not found: ID does not exist"
Sep 11 14:41:37.830015 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.829984    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"]
Sep 11 14:41:37.843180 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:37.843147    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3893129d-85dfcdd7cb-4w8jc"]
Sep 11 14:41:39.494955 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:41:39.494923    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da4d7f1e-189d-40a0-8234-fb170f16e7bd" path="/var/lib/kubelet/pods/da4d7f1e-189d-40a0-8234-fb170f16e7bd/volumes"
Sep 11 14:43:36.290983 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.290904    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"]
Sep 11 14:43:36.291404 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.291359    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da4d7f1e-189d-40a0-8234-fb170f16e7bd" containerName="maas-api"
Sep 11 14:43:36.291404 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.291371    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da4d7f1e-189d-40a0-8234-fb170f16e7bd" containerName="maas-api"
Sep 11 14:43:36.291476 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.291434    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="da4d7f1e-189d-40a0-8234-fb170f16e7bd" containerName="maas-api"
Sep 11 14:43:36.294490 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.294474    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:36.297210 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.297186    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-1af681-serving-cert\""
Sep 11 14:43:36.311697 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.311669    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"]
Sep 11 14:43:36.331064 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.331014    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545390d2-7c96-4f29-8ed9-8f139ee3f67a-maas-api-tls\") pod \"maas-api-e2e-api-a-1af681-548cc54c45-xdl42\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:36.331167 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.331140    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545390d2-7c96-4f29-8ed9-8f139ee3f67a-openshift-service-ca\") pod \"maas-api-e2e-api-a-1af681-548cc54c45-xdl42\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:36.331211 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.331179    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qbqd\" (UniqueName: \"kubernetes.io/projected/545390d2-7c96-4f29-8ed9-8f139ee3f67a-kube-api-access-8qbqd\") pod \"maas-api-e2e-api-a-1af681-548cc54c45-xdl42\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:36.331261 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.331208    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/545390d2-7c96-4f29-8ed9-8f139ee3f67a-metrics-certs\") pod \"maas-api-e2e-api-a-1af681-548cc54c45-xdl42\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:36.432458 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.432423    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qbqd\" (UniqueName: \"kubernetes.io/projected/545390d2-7c96-4f29-8ed9-8f139ee3f67a-kube-api-access-8qbqd\") pod \"maas-api-e2e-api-a-1af681-548cc54c45-xdl42\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:36.432458 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.432461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/545390d2-7c96-4f29-8ed9-8f139ee3f67a-metrics-certs\") pod \"maas-api-e2e-api-a-1af681-548cc54c45-xdl42\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:36.432689 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.432548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545390d2-7c96-4f29-8ed9-8f139ee3f67a-maas-api-tls\") pod \"maas-api-e2e-api-a-1af681-548cc54c45-xdl42\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:36.432689 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.432595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545390d2-7c96-4f29-8ed9-8f139ee3f67a-openshift-service-ca\") pod \"maas-api-e2e-api-a-1af681-548cc54c45-xdl42\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:36.433360 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.433337    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545390d2-7c96-4f29-8ed9-8f139ee3f67a-openshift-service-ca\") pod \"maas-api-e2e-api-a-1af681-548cc54c45-xdl42\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:36.435172 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.435148    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545390d2-7c96-4f29-8ed9-8f139ee3f67a-maas-api-tls\") pod \"maas-api-e2e-api-a-1af681-548cc54c45-xdl42\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:36.435280 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.435185    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/545390d2-7c96-4f29-8ed9-8f139ee3f67a-metrics-certs\") pod \"maas-api-e2e-api-a-1af681-548cc54c45-xdl42\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:36.443759 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.443725    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qbqd\" (UniqueName: \"kubernetes.io/projected/545390d2-7c96-4f29-8ed9-8f139ee3f67a-kube-api-access-8qbqd\") pod \"maas-api-e2e-api-a-1af681-548cc54c45-xdl42\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:36.605709 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.605624    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:36.889469 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:43:36.889436    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545390d2_7c96_4f29_8ed9_8f139ee3f67a.slice/crio-ed7708806eff566ae4bc1ab621b86a982aac6d60a18efebe6d51df8beb1d233f WatchSource:0}: Error finding container ed7708806eff566ae4bc1ab621b86a982aac6d60a18efebe6d51df8beb1d233f: Status 404 returned error can't find the container with id ed7708806eff566ae4bc1ab621b86a982aac6d60a18efebe6d51df8beb1d233f
Sep 11 14:43:36.890247 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:36.890219    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"]
Sep 11 14:43:37.483055 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:37.483003    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42" event={"ID":"545390d2-7c96-4f29-8ed9-8f139ee3f67a","Type":"ContainerStarted","Data":"e5cd4915a196ad3a59491a919c4f7fc2cf9cc8044653f365a8ca247c5331e1b7"}
Sep 11 14:43:37.483444 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:37.483085    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:43:37.483444 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:37.483111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42" event={"ID":"545390d2-7c96-4f29-8ed9-8f139ee3f67a","Type":"ContainerStarted","Data":"ed7708806eff566ae4bc1ab621b86a982aac6d60a18efebe6d51df8beb1d233f"}
Sep 11 14:43:37.504508 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:37.504449    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42" podStartSLOduration=1.067244987 podStartE2EDuration="1.50443228s" totalImagesPullingTime="437.187293ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:43:37.502086565 +0000 UTC m=+1714.534521427" watchObservedRunningTime="2026-09-11 14:43:37.50443228 +0000 UTC m=+1714.536867139"
Sep 11 14:43:43.496808 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:43:43.496781    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:44:07.139201 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.139173    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"]
Sep 11 14:44:07.142862 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.142846    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:07.145953 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.145932    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-fc74dd-serving-cert\""
Sep 11 14:44:07.167833 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.167801    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"]
Sep 11 14:44:07.243915 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.243880    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d422cdd7-cafa-43f0-8529-32f504ae7366-openshift-service-ca\") pod \"maas-api-e2e-api-b-fc74dd-5d74f84987-plslk\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:07.243915 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.243918    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d422cdd7-cafa-43f0-8529-32f504ae7366-metrics-certs\") pod \"maas-api-e2e-api-b-fc74dd-5d74f84987-plslk\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:07.244179 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.244061    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d422cdd7-cafa-43f0-8529-32f504ae7366-maas-api-tls\") pod \"maas-api-e2e-api-b-fc74dd-5d74f84987-plslk\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:07.244179 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.244135    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnl95\" (UniqueName: \"kubernetes.io/projected/d422cdd7-cafa-43f0-8529-32f504ae7366-kube-api-access-xnl95\") pod \"maas-api-e2e-api-b-fc74dd-5d74f84987-plslk\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:07.345054 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.345008    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d422cdd7-cafa-43f0-8529-32f504ae7366-metrics-certs\") pod \"maas-api-e2e-api-b-fc74dd-5d74f84987-plslk\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:07.345229 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.345131    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d422cdd7-cafa-43f0-8529-32f504ae7366-maas-api-tls\") pod \"maas-api-e2e-api-b-fc74dd-5d74f84987-plslk\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:07.345229 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.345175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnl95\" (UniqueName: \"kubernetes.io/projected/d422cdd7-cafa-43f0-8529-32f504ae7366-kube-api-access-xnl95\") pod \"maas-api-e2e-api-b-fc74dd-5d74f84987-plslk\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:07.345343 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.345236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d422cdd7-cafa-43f0-8529-32f504ae7366-openshift-service-ca\") pod \"maas-api-e2e-api-b-fc74dd-5d74f84987-plslk\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:07.345937 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.345909    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d422cdd7-cafa-43f0-8529-32f504ae7366-openshift-service-ca\") pod \"maas-api-e2e-api-b-fc74dd-5d74f84987-plslk\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:07.347678 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.347653    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d422cdd7-cafa-43f0-8529-32f504ae7366-metrics-certs\") pod \"maas-api-e2e-api-b-fc74dd-5d74f84987-plslk\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:07.347787 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.347734    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d422cdd7-cafa-43f0-8529-32f504ae7366-maas-api-tls\") pod \"maas-api-e2e-api-b-fc74dd-5d74f84987-plslk\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:07.375084 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.375062    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnl95\" (UniqueName: \"kubernetes.io/projected/d422cdd7-cafa-43f0-8529-32f504ae7366-kube-api-access-xnl95\") pod \"maas-api-e2e-api-b-fc74dd-5d74f84987-plslk\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:07.454053 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.454012    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:07.768715 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:07.768686    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"]
Sep 11 14:44:07.770558 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:44:07.770529    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd422cdd7_cafa_43f0_8529_32f504ae7366.slice/crio-7ae6ce18bc88da7211995a98e117d475454473971da0f93e05095ccab5e5d380 WatchSource:0}: Error finding container 7ae6ce18bc88da7211995a98e117d475454473971da0f93e05095ccab5e5d380: Status 404 returned error can't find the container with id 7ae6ce18bc88da7211995a98e117d475454473971da0f93e05095ccab5e5d380
Sep 11 14:44:08.665860 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:08.665823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk" event={"ID":"d422cdd7-cafa-43f0-8529-32f504ae7366","Type":"ContainerStarted","Data":"8e430138290c7fc66e9190103c548438d81a7e2a6c55b239bd8f50c930fbaf31"}
Sep 11 14:44:08.666337 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:08.665891    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:08.666337 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:08.665916    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk" event={"ID":"d422cdd7-cafa-43f0-8529-32f504ae7366","Type":"ContainerStarted","Data":"7ae6ce18bc88da7211995a98e117d475454473971da0f93e05095ccab5e5d380"}
Sep 11 14:44:08.704342 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:08.704287    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk" podStartSLOduration=1.435732599 podStartE2EDuration="1.704269385s" totalImagesPullingTime="268.536786ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:44:08.701333461 +0000 UTC m=+1745.733768343" watchObservedRunningTime="2026-09-11 14:44:08.704269385 +0000 UTC m=+1745.736704244"
Sep 11 14:44:14.677927 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:14.677894    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:44:39.274608 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.274575    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"]
Sep 11 14:44:39.275229 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.274872    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42" podUID="545390d2-7c96-4f29-8ed9-8f139ee3f67a" containerName="maas-api" containerID="cri-o://e5cd4915a196ad3a59491a919c4f7fc2cf9cc8044653f365a8ca247c5331e1b7" gracePeriod=30
Sep 11 14:44:39.551657 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.551633    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:44:39.573741 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.573710    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545390d2-7c96-4f29-8ed9-8f139ee3f67a-maas-api-tls\") pod \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") "
Sep 11 14:44:39.573921 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.573773    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qbqd\" (UniqueName: \"kubernetes.io/projected/545390d2-7c96-4f29-8ed9-8f139ee3f67a-kube-api-access-8qbqd\") pod \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") "
Sep 11 14:44:39.573921 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.573849    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/545390d2-7c96-4f29-8ed9-8f139ee3f67a-metrics-certs\") pod \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") "
Sep 11 14:44:39.574120 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.574050    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545390d2-7c96-4f29-8ed9-8f139ee3f67a-openshift-service-ca\") pod \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\" (UID: \"545390d2-7c96-4f29-8ed9-8f139ee3f67a\") "
Sep 11 14:44:39.576206 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.574905    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/545390d2-7c96-4f29-8ed9-8f139ee3f67a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "545390d2-7c96-4f29-8ed9-8f139ee3f67a" (UID: "545390d2-7c96-4f29-8ed9-8f139ee3f67a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:44:39.577879 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.577830    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/545390d2-7c96-4f29-8ed9-8f139ee3f67a-kube-api-access-8qbqd" (OuterVolumeSpecName: "kube-api-access-8qbqd") pod "545390d2-7c96-4f29-8ed9-8f139ee3f67a" (UID: "545390d2-7c96-4f29-8ed9-8f139ee3f67a"). InnerVolumeSpecName "kube-api-access-8qbqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:44:39.578179 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.578149    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/545390d2-7c96-4f29-8ed9-8f139ee3f67a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "545390d2-7c96-4f29-8ed9-8f139ee3f67a" (UID: "545390d2-7c96-4f29-8ed9-8f139ee3f67a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:44:39.578319 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.578293    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/545390d2-7c96-4f29-8ed9-8f139ee3f67a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "545390d2-7c96-4f29-8ed9-8f139ee3f67a" (UID: "545390d2-7c96-4f29-8ed9-8f139ee3f67a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:44:39.676166 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.676131    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545390d2-7c96-4f29-8ed9-8f139ee3f67a-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:44:39.676327 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.676169    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545390d2-7c96-4f29-8ed9-8f139ee3f67a-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:44:39.676327 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.676187    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qbqd\" (UniqueName: \"kubernetes.io/projected/545390d2-7c96-4f29-8ed9-8f139ee3f67a-kube-api-access-8qbqd\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:44:39.676327 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.676202    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/545390d2-7c96-4f29-8ed9-8f139ee3f67a-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:44:39.848352 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.848251    2582 generic.go:356] "Generic (PLEG): container finished" podID="545390d2-7c96-4f29-8ed9-8f139ee3f67a" containerID="e5cd4915a196ad3a59491a919c4f7fc2cf9cc8044653f365a8ca247c5331e1b7" exitCode=0
Sep 11 14:44:39.848352 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.848303    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"
Sep 11 14:44:39.848587 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.848306    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42" event={"ID":"545390d2-7c96-4f29-8ed9-8f139ee3f67a","Type":"ContainerDied","Data":"e5cd4915a196ad3a59491a919c4f7fc2cf9cc8044653f365a8ca247c5331e1b7"}
Sep 11 14:44:39.848587 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.848436    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42" event={"ID":"545390d2-7c96-4f29-8ed9-8f139ee3f67a","Type":"ContainerDied","Data":"ed7708806eff566ae4bc1ab621b86a982aac6d60a18efebe6d51df8beb1d233f"}
Sep 11 14:44:39.848587 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.848464    2582 scope.go:117] "RemoveContainer" containerID="e5cd4915a196ad3a59491a919c4f7fc2cf9cc8044653f365a8ca247c5331e1b7"
Sep 11 14:44:39.858908 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.858890    2582 scope.go:117] "RemoveContainer" containerID="e5cd4915a196ad3a59491a919c4f7fc2cf9cc8044653f365a8ca247c5331e1b7"
Sep 11 14:44:39.859232 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:44:39.859210    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5cd4915a196ad3a59491a919c4f7fc2cf9cc8044653f365a8ca247c5331e1b7\": container with ID starting with e5cd4915a196ad3a59491a919c4f7fc2cf9cc8044653f365a8ca247c5331e1b7 not found: ID does not exist" containerID="e5cd4915a196ad3a59491a919c4f7fc2cf9cc8044653f365a8ca247c5331e1b7"
Sep 11 14:44:39.859332 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.859239    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5cd4915a196ad3a59491a919c4f7fc2cf9cc8044653f365a8ca247c5331e1b7"} err="failed to get container status \"e5cd4915a196ad3a59491a919c4f7fc2cf9cc8044653f365a8ca247c5331e1b7\": rpc error: code = NotFound desc = could not find container \"e5cd4915a196ad3a59491a919c4f7fc2cf9cc8044653f365a8ca247c5331e1b7\": container with ID starting with e5cd4915a196ad3a59491a919c4f7fc2cf9cc8044653f365a8ca247c5331e1b7 not found: ID does not exist"
Sep 11 14:44:39.875120 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.875093    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"]
Sep 11 14:44:39.879565 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:39.879541    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1af681-548cc54c45-xdl42"]
Sep 11 14:44:41.495640 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:44:41.495610    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="545390d2-7c96-4f29-8ed9-8f139ee3f67a" path="/var/lib/kubelet/pods/545390d2-7c96-4f29-8ed9-8f139ee3f67a/volumes"
Sep 11 14:45:03.322600 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.322568    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"]
Sep 11 14:45:03.323029 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.322794    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk" podUID="d422cdd7-cafa-43f0-8529-32f504ae7366" containerName="maas-api" containerID="cri-o://8e430138290c7fc66e9190103c548438d81a7e2a6c55b239bd8f50c930fbaf31" gracePeriod=30
Sep 11 14:45:03.598615 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.598528    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:45:03.717097 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.717070    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d422cdd7-cafa-43f0-8529-32f504ae7366-maas-api-tls\") pod \"d422cdd7-cafa-43f0-8529-32f504ae7366\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") "
Sep 11 14:45:03.717213 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.717160    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d422cdd7-cafa-43f0-8529-32f504ae7366-openshift-service-ca\") pod \"d422cdd7-cafa-43f0-8529-32f504ae7366\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") "
Sep 11 14:45:03.717267 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.717253    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d422cdd7-cafa-43f0-8529-32f504ae7366-metrics-certs\") pod \"d422cdd7-cafa-43f0-8529-32f504ae7366\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") "
Sep 11 14:45:03.717322 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.717288    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnl95\" (UniqueName: \"kubernetes.io/projected/d422cdd7-cafa-43f0-8529-32f504ae7366-kube-api-access-xnl95\") pod \"d422cdd7-cafa-43f0-8529-32f504ae7366\" (UID: \"d422cdd7-cafa-43f0-8529-32f504ae7366\") "
Sep 11 14:45:03.717507 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.717476    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d422cdd7-cafa-43f0-8529-32f504ae7366-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d422cdd7-cafa-43f0-8529-32f504ae7366" (UID: "d422cdd7-cafa-43f0-8529-32f504ae7366"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:45:03.719386 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.719358    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d422cdd7-cafa-43f0-8529-32f504ae7366-kube-api-access-xnl95" (OuterVolumeSpecName: "kube-api-access-xnl95") pod "d422cdd7-cafa-43f0-8529-32f504ae7366" (UID: "d422cdd7-cafa-43f0-8529-32f504ae7366"). InnerVolumeSpecName "kube-api-access-xnl95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:45:03.719491 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.719426    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d422cdd7-cafa-43f0-8529-32f504ae7366-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d422cdd7-cafa-43f0-8529-32f504ae7366" (UID: "d422cdd7-cafa-43f0-8529-32f504ae7366"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:45:03.719491 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.719445    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d422cdd7-cafa-43f0-8529-32f504ae7366-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d422cdd7-cafa-43f0-8529-32f504ae7366" (UID: "d422cdd7-cafa-43f0-8529-32f504ae7366"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:45:03.818211 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.818178    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d422cdd7-cafa-43f0-8529-32f504ae7366-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:45:03.818211 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.818208    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnl95\" (UniqueName: \"kubernetes.io/projected/d422cdd7-cafa-43f0-8529-32f504ae7366-kube-api-access-xnl95\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:45:03.818211 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.818223    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d422cdd7-cafa-43f0-8529-32f504ae7366-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:45:03.818446 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.818237    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d422cdd7-cafa-43f0-8529-32f504ae7366-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:45:03.990440 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.990403    2582 generic.go:356] "Generic (PLEG): container finished" podID="d422cdd7-cafa-43f0-8529-32f504ae7366" containerID="8e430138290c7fc66e9190103c548438d81a7e2a6c55b239bd8f50c930fbaf31" exitCode=0
Sep 11 14:45:03.990629 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.990479    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"
Sep 11 14:45:03.990629 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.990483    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk" event={"ID":"d422cdd7-cafa-43f0-8529-32f504ae7366","Type":"ContainerDied","Data":"8e430138290c7fc66e9190103c548438d81a7e2a6c55b239bd8f50c930fbaf31"}
Sep 11 14:45:03.990629 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.990548    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk" event={"ID":"d422cdd7-cafa-43f0-8529-32f504ae7366","Type":"ContainerDied","Data":"7ae6ce18bc88da7211995a98e117d475454473971da0f93e05095ccab5e5d380"}
Sep 11 14:45:03.990629 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:03.990572    2582 scope.go:117] "RemoveContainer" containerID="8e430138290c7fc66e9190103c548438d81a7e2a6c55b239bd8f50c930fbaf31"
Sep 11 14:45:04.003134 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:04.003064    2582 scope.go:117] "RemoveContainer" containerID="8e430138290c7fc66e9190103c548438d81a7e2a6c55b239bd8f50c930fbaf31"
Sep 11 14:45:04.003564 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:45:04.003542    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e430138290c7fc66e9190103c548438d81a7e2a6c55b239bd8f50c930fbaf31\": container with ID starting with 8e430138290c7fc66e9190103c548438d81a7e2a6c55b239bd8f50c930fbaf31 not found: ID does not exist" containerID="8e430138290c7fc66e9190103c548438d81a7e2a6c55b239bd8f50c930fbaf31"
Sep 11 14:45:04.003629 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:04.003571    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e430138290c7fc66e9190103c548438d81a7e2a6c55b239bd8f50c930fbaf31"} err="failed to get container status \"8e430138290c7fc66e9190103c548438d81a7e2a6c55b239bd8f50c930fbaf31\": rpc error: code = NotFound desc = could not find container \"8e430138290c7fc66e9190103c548438d81a7e2a6c55b239bd8f50c930fbaf31\": container with ID starting with 8e430138290c7fc66e9190103c548438d81a7e2a6c55b239bd8f50c930fbaf31 not found: ID does not exist"
Sep 11 14:45:04.022567 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:04.022534    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"]
Sep 11 14:45:04.029309 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:04.029276    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fc74dd-5d74f84987-plslk"]
Sep 11 14:45:05.494992 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:05.494957    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d422cdd7-cafa-43f0-8529-32f504ae7366" path="/var/lib/kubelet/pods/d422cdd7-cafa-43f0-8529-32f504ae7366/volumes"
Sep 11 14:45:22.049282 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.049233    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"]
Sep 11 14:45:22.049728 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.049468    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7" podUID="a62db043-d75a-48d1-87ec-06f939559df3" containerName="maas-api" containerID="cri-o://ad334b7c3f7eb3d2c14684deac193312f84e981bd2ba7038e29547413e26a726" gracePeriod=30
Sep 11 14:45:22.306582 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.306220    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:45:22.398517 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.398482    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-metrics-certs\") pod \"a62db043-d75a-48d1-87ec-06f939559df3\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") "
Sep 11 14:45:22.398691 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.398530    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-maas-api-tls\") pod \"a62db043-d75a-48d1-87ec-06f939559df3\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") "
Sep 11 14:45:22.398691 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.398561    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62db043-d75a-48d1-87ec-06f939559df3-openshift-service-ca\") pod \"a62db043-d75a-48d1-87ec-06f939559df3\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") "
Sep 11 14:45:22.398691 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.398622    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8mw5\" (UniqueName: \"kubernetes.io/projected/a62db043-d75a-48d1-87ec-06f939559df3-kube-api-access-r8mw5\") pod \"a62db043-d75a-48d1-87ec-06f939559df3\" (UID: \"a62db043-d75a-48d1-87ec-06f939559df3\") "
Sep 11 14:45:22.399017 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.398991    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a62db043-d75a-48d1-87ec-06f939559df3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a62db043-d75a-48d1-87ec-06f939559df3" (UID: "a62db043-d75a-48d1-87ec-06f939559df3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:45:22.400832 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.400808    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a62db043-d75a-48d1-87ec-06f939559df3" (UID: "a62db043-d75a-48d1-87ec-06f939559df3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:45:22.400956 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.400858    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a62db043-d75a-48d1-87ec-06f939559df3" (UID: "a62db043-d75a-48d1-87ec-06f939559df3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:45:22.400956 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.400865    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a62db043-d75a-48d1-87ec-06f939559df3-kube-api-access-r8mw5" (OuterVolumeSpecName: "kube-api-access-r8mw5") pod "a62db043-d75a-48d1-87ec-06f939559df3" (UID: "a62db043-d75a-48d1-87ec-06f939559df3"). InnerVolumeSpecName "kube-api-access-r8mw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:45:22.499284 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.499247    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:45:22.499284 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.499278    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62db043-d75a-48d1-87ec-06f939559df3-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:45:22.499480 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.499287    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8mw5\" (UniqueName: \"kubernetes.io/projected/a62db043-d75a-48d1-87ec-06f939559df3-kube-api-access-r8mw5\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:45:22.499480 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:22.499316    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a62db043-d75a-48d1-87ec-06f939559df3-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:45:23.103554 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:23.103509    2582 generic.go:356] "Generic (PLEG): container finished" podID="a62db043-d75a-48d1-87ec-06f939559df3" containerID="ad334b7c3f7eb3d2c14684deac193312f84e981bd2ba7038e29547413e26a726" exitCode=0
Sep 11 14:45:23.103554 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:23.103558    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"
Sep 11 14:45:23.104125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:23.103552    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7" event={"ID":"a62db043-d75a-48d1-87ec-06f939559df3","Type":"ContainerDied","Data":"ad334b7c3f7eb3d2c14684deac193312f84e981bd2ba7038e29547413e26a726"}
Sep 11 14:45:23.104125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:23.103684    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7" event={"ID":"a62db043-d75a-48d1-87ec-06f939559df3","Type":"ContainerDied","Data":"f5d25af60910bd66cf59ee5421023fce834c74fc76c9eb809d4562b687db0884"}
Sep 11 14:45:23.104125 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:23.103708    2582 scope.go:117] "RemoveContainer" containerID="ad334b7c3f7eb3d2c14684deac193312f84e981bd2ba7038e29547413e26a726"
Sep 11 14:45:23.114182 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:23.114162    2582 scope.go:117] "RemoveContainer" containerID="ad334b7c3f7eb3d2c14684deac193312f84e981bd2ba7038e29547413e26a726"
Sep 11 14:45:23.114484 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:45:23.114464    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad334b7c3f7eb3d2c14684deac193312f84e981bd2ba7038e29547413e26a726\": container with ID starting with ad334b7c3f7eb3d2c14684deac193312f84e981bd2ba7038e29547413e26a726 not found: ID does not exist" containerID="ad334b7c3f7eb3d2c14684deac193312f84e981bd2ba7038e29547413e26a726"
Sep 11 14:45:23.114547 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:23.114494    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad334b7c3f7eb3d2c14684deac193312f84e981bd2ba7038e29547413e26a726"} err="failed to get container status \"ad334b7c3f7eb3d2c14684deac193312f84e981bd2ba7038e29547413e26a726\": rpc error: code = NotFound desc = could not find container \"ad334b7c3f7eb3d2c14684deac193312f84e981bd2ba7038e29547413e26a726\": container with ID starting with ad334b7c3f7eb3d2c14684deac193312f84e981bd2ba7038e29547413e26a726 not found: ID does not exist"
Sep 11 14:45:23.128786 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:23.128754    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"]
Sep 11 14:45:23.132062 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:23.132028    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-28858c-7d9c9589f-l4rt7"]
Sep 11 14:45:23.497157 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:23.497116    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a62db043-d75a-48d1-87ec-06f939559df3" path="/var/lib/kubelet/pods/a62db043-d75a-48d1-87ec-06f939559df3/volumes"
Sep 11 14:45:40.876626 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:40.876595    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"]
Sep 11 14:45:40.877123 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:40.876852    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5" podUID="34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb" containerName="maas-api" containerID="cri-o://b5f3fce19dce876c9c80bf868072ae837ffdb9371787ed6182d726bb0421277a" gracePeriod=30
Sep 11 14:45:41.038406 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.038347    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5" podUID="34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.65:8443/health\": dial tcp 10.133.0.65:8443: connect: connection refused"
Sep 11 14:45:41.138337 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.138277    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:45:41.212477 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.212447    2582 generic.go:356] "Generic (PLEG): container finished" podID="34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb" containerID="b5f3fce19dce876c9c80bf868072ae837ffdb9371787ed6182d726bb0421277a" exitCode=0
Sep 11 14:45:41.212659 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.212497    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"
Sep 11 14:45:41.212659 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.212500    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5" event={"ID":"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb","Type":"ContainerDied","Data":"b5f3fce19dce876c9c80bf868072ae837ffdb9371787ed6182d726bb0421277a"}
Sep 11 14:45:41.212659 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.212639    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5" event={"ID":"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb","Type":"ContainerDied","Data":"f10806107d7bb6f0475c55e03d37a715b2ed5f7f2f277d104e5d92b424cc2b1a"}
Sep 11 14:45:41.212828 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.212677    2582 scope.go:117] "RemoveContainer" containerID="b5f3fce19dce876c9c80bf868072ae837ffdb9371787ed6182d726bb0421277a"
Sep 11 14:45:41.222675 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.222659    2582 scope.go:117] "RemoveContainer" containerID="b5f3fce19dce876c9c80bf868072ae837ffdb9371787ed6182d726bb0421277a"
Sep 11 14:45:41.222999 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:45:41.222961    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5f3fce19dce876c9c80bf868072ae837ffdb9371787ed6182d726bb0421277a\": container with ID starting with b5f3fce19dce876c9c80bf868072ae837ffdb9371787ed6182d726bb0421277a not found: ID does not exist" containerID="b5f3fce19dce876c9c80bf868072ae837ffdb9371787ed6182d726bb0421277a"
Sep 11 14:45:41.223131 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.222999    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5f3fce19dce876c9c80bf868072ae837ffdb9371787ed6182d726bb0421277a"} err="failed to get container status \"b5f3fce19dce876c9c80bf868072ae837ffdb9371787ed6182d726bb0421277a\": rpc error: code = NotFound desc = could not find container \"b5f3fce19dce876c9c80bf868072ae837ffdb9371787ed6182d726bb0421277a\": container with ID starting with b5f3fce19dce876c9c80bf868072ae837ffdb9371787ed6182d726bb0421277a not found: ID does not exist"
Sep 11 14:45:41.286355 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.286316    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-metrics-certs\") pod \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") "
Sep 11 14:45:41.286553 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.286382    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffsvv\" (UniqueName: \"kubernetes.io/projected/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-kube-api-access-ffsvv\") pod \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") "
Sep 11 14:45:41.286553 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.286423    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-maas-api-tls\") pod \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") "
Sep 11 14:45:41.286553 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.286495    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-openshift-service-ca\") pod \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\" (UID: \"34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb\") "
Sep 11 14:45:41.286947 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.286918    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb" (UID: "34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:45:41.288797 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.288767    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb" (UID: "34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:45:41.288908 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.288839    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb" (UID: "34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:45:41.288957 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.288933    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-kube-api-access-ffsvv" (OuterVolumeSpecName: "kube-api-access-ffsvv") pod "34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb" (UID: "34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb"). InnerVolumeSpecName "kube-api-access-ffsvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:45:41.387905 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.387869    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:45:41.387905 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.387900    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:45:41.388120 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.387918    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffsvv\" (UniqueName: \"kubernetes.io/projected/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-kube-api-access-ffsvv\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:45:41.388120 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.387931    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:45:41.545024 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.544990    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"]
Sep 11 14:45:41.578235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:41.578205    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7eeb45-858dc6dc84-6rnp5"]
Sep 11 14:45:43.495212 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:45:43.495179    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb" path="/var/lib/kubelet/pods/34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb/volumes"
Sep 11 14:46:06.988886 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.988850    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"]
Sep 11 14:46:06.989476 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.989454    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb" containerName="maas-api"
Sep 11 14:46:06.989564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.989479    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb" containerName="maas-api"
Sep 11 14:46:06.989564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.989491    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d422cdd7-cafa-43f0-8529-32f504ae7366" containerName="maas-api"
Sep 11 14:46:06.989564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.989502    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d422cdd7-cafa-43f0-8529-32f504ae7366" containerName="maas-api"
Sep 11 14:46:06.989564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.989520    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="545390d2-7c96-4f29-8ed9-8f139ee3f67a" containerName="maas-api"
Sep 11 14:46:06.989564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.989529    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="545390d2-7c96-4f29-8ed9-8f139ee3f67a" containerName="maas-api"
Sep 11 14:46:06.989564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.989564    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a62db043-d75a-48d1-87ec-06f939559df3" containerName="maas-api"
Sep 11 14:46:06.989867 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.989572    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a62db043-d75a-48d1-87ec-06f939559df3" containerName="maas-api"
Sep 11 14:46:06.989867 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.989682    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="34fd35f5-36d6-4f5f-b53f-4d4ea6c92acb" containerName="maas-api"
Sep 11 14:46:06.989867 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.989694    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a62db043-d75a-48d1-87ec-06f939559df3" containerName="maas-api"
Sep 11 14:46:06.989867 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.989702    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="545390d2-7c96-4f29-8ed9-8f139ee3f67a" containerName="maas-api"
Sep 11 14:46:06.989867 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.989718    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d422cdd7-cafa-43f0-8529-32f504ae7366" containerName="maas-api"
Sep 11 14:46:06.993144 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.993121    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:06.995699 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:06.995680    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-9fedd5-serving-cert\""
Sep 11 14:46:07.011379 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.011352    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"]
Sep 11 14:46:07.143782 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.143742    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4045e5bd-1101-499a-94ba-6cf08421be04-metrics-certs\") pod \"maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:07.143980 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.143809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4045e5bd-1101-499a-94ba-6cf08421be04-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:07.143980 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.143838    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmkf7\" (UniqueName: \"kubernetes.io/projected/4045e5bd-1101-499a-94ba-6cf08421be04-kube-api-access-pmkf7\") pod \"maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:07.143980 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.143908    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4045e5bd-1101-499a-94ba-6cf08421be04-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:07.245216 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.245128    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4045e5bd-1101-499a-94ba-6cf08421be04-metrics-certs\") pod \"maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:07.245216 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.245185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4045e5bd-1101-499a-94ba-6cf08421be04-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:07.245216 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.245211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmkf7\" (UniqueName: \"kubernetes.io/projected/4045e5bd-1101-499a-94ba-6cf08421be04-kube-api-access-pmkf7\") pod \"maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:07.245510 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.245256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4045e5bd-1101-499a-94ba-6cf08421be04-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:07.245923 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.245892    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4045e5bd-1101-499a-94ba-6cf08421be04-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:07.247760 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.247733    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4045e5bd-1101-499a-94ba-6cf08421be04-metrics-certs\") pod \"maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:07.247906 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.247885    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4045e5bd-1101-499a-94ba-6cf08421be04-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:07.271910 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.271881    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmkf7\" (UniqueName: \"kubernetes.io/projected/4045e5bd-1101-499a-94ba-6cf08421be04-kube-api-access-pmkf7\") pod \"maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:07.304051 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.304014    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:07.587862 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.587840    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"]
Sep 11 14:46:07.589447 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:46:07.589417    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4045e5bd_1101_499a_94ba_6cf08421be04.slice/crio-3660fd6322c61fafced4709ea603dde60d32445416f9e8467834b47d844204a0 WatchSource:0}: Error finding container 3660fd6322c61fafced4709ea603dde60d32445416f9e8467834b47d844204a0: Status 404 returned error can't find the container with id 3660fd6322c61fafced4709ea603dde60d32445416f9e8467834b47d844204a0
Sep 11 14:46:07.590826 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:07.590805    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:46:08.372728 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:08.372689    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b" event={"ID":"4045e5bd-1101-499a-94ba-6cf08421be04","Type":"ContainerStarted","Data":"3660fd6322c61fafced4709ea603dde60d32445416f9e8467834b47d844204a0"}
Sep 11 14:46:09.379554 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:09.379508    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b" event={"ID":"4045e5bd-1101-499a-94ba-6cf08421be04","Type":"ContainerStarted","Data":"6f0ee2d69607d96555df329aca86b5fe962dfaf154690042f15451f51b8e5137"}
Sep 11 14:46:09.379943 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:09.379657    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:09.418488 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:09.418429    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b" podStartSLOduration=2.676184846 podStartE2EDuration="3.418412739s" totalImagesPullingTime="742.227893ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:46:09.41739942 +0000 UTC m=+1866.449834280" watchObservedRunningTime="2026-09-11 14:46:09.418412739 +0000 UTC m=+1866.450847598"
Sep 11 14:46:15.391385 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:15.391357    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:46:40.578738 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.578653    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"]
Sep 11 14:46:40.582447 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.582426    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:40.585278 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.585234    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-92ca78-serving-cert\""
Sep 11 14:46:40.593072 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.593028    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"]
Sep 11 14:46:40.664198 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.664166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1442d-fba1-4d4f-b524-d7aa6e69169e-metrics-certs\") pod \"maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:40.664388 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.664206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jvgt\" (UniqueName: \"kubernetes.io/projected/eef1442d-fba1-4d4f-b524-d7aa6e69169e-kube-api-access-5jvgt\") pod \"maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:40.664388 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.664298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef1442d-fba1-4d4f-b524-d7aa6e69169e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:40.664388 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.664361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef1442d-fba1-4d4f-b524-d7aa6e69169e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:40.764983 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.764944    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1442d-fba1-4d4f-b524-d7aa6e69169e-metrics-certs\") pod \"maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:40.764983 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.764988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jvgt\" (UniqueName: \"kubernetes.io/projected/eef1442d-fba1-4d4f-b524-d7aa6e69169e-kube-api-access-5jvgt\") pod \"maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:40.765288 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.765049    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef1442d-fba1-4d4f-b524-d7aa6e69169e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:40.765288 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.765092    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef1442d-fba1-4d4f-b524-d7aa6e69169e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:40.765786 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.765763    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef1442d-fba1-4d4f-b524-d7aa6e69169e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:40.767515 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.767485    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1442d-fba1-4d4f-b524-d7aa6e69169e-metrics-certs\") pod \"maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:40.767620 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.767601    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef1442d-fba1-4d4f-b524-d7aa6e69169e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:40.774553 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.774522    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jvgt\" (UniqueName: \"kubernetes.io/projected/eef1442d-fba1-4d4f-b524-d7aa6e69169e-kube-api-access-5jvgt\") pod \"maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:40.896008 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:40.895926    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:41.172181 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:41.172154    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"]
Sep 11 14:46:41.173680 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:46:41.173598    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef1442d_fba1_4d4f_b524_d7aa6e69169e.slice/crio-837189322f680a5b3849025ca99400e52e50d3449479b684e7501f35665af3ac WatchSource:0}: Error finding container 837189322f680a5b3849025ca99400e52e50d3449479b684e7501f35665af3ac: Status 404 returned error can't find the container with id 837189322f680a5b3849025ca99400e52e50d3449479b684e7501f35665af3ac
Sep 11 14:46:41.565652 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:41.565614    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8" event={"ID":"eef1442d-fba1-4d4f-b524-d7aa6e69169e","Type":"ContainerStarted","Data":"837189322f680a5b3849025ca99400e52e50d3449479b684e7501f35665af3ac"}
Sep 11 14:46:42.573746 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:42.573700    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8" event={"ID":"eef1442d-fba1-4d4f-b524-d7aa6e69169e","Type":"ContainerStarted","Data":"c8a753c718042f2ecb3cc2a3f6ba7d26b5229b379fac301091978b7838bd720e"}
Sep 11 14:46:42.574227 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:42.573777    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:46:42.596073 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:42.596013    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8" podStartSLOduration=2.203222243 podStartE2EDuration="2.595998505s" totalImagesPullingTime="392.776262ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:46:42.594513576 +0000 UTC m=+1899.626948440" watchObservedRunningTime="2026-09-11 14:46:42.595998505 +0000 UTC m=+1899.628433365"
Sep 11 14:46:48.585791 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:46:48.585762    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:48:06.768604 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:06.768525    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"]
Sep 11 14:48:06.772997 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:06.772969    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:06.775156 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:06.775129    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-55ef8c-serving-cert\""
Sep 11 14:48:06.784795 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:06.784766    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"]
Sep 11 14:48:06.895348 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:06.895302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmcsm\" (UniqueName: \"kubernetes.io/projected/1997de34-79bb-47cf-8891-b4fe0f2f79e5-kube-api-access-vmcsm\") pod \"maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:06.895348 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:06.895356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:06.895560 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:06.895410    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:06.895560 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:06.895528    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1997de34-79bb-47cf-8891-b4fe0f2f79e5-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:06.996207 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:06.996161    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1997de34-79bb-47cf-8891-b4fe0f2f79e5-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:06.996404 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:06.996224    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmcsm\" (UniqueName: \"kubernetes.io/projected/1997de34-79bb-47cf-8891-b4fe0f2f79e5-kube-api-access-vmcsm\") pod \"maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:06.996404 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:06.996258    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:06.996404 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:06.996299    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:06.996533 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:48:06.996451    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-serving-cert: secret "maas-api-e2e-ipp-cleanup-55ef8c-serving-cert" not found
Sep 11 14:48:06.996533 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:48:06.996523    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-maas-api-tls podName:1997de34-79bb-47cf-8891-b4fe0f2f79e5 nodeName:}" failed. No retries permitted until 2026-09-11 14:48:07.496503837 +0000 UTC m=+1984.528938678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp" (UID: "1997de34-79bb-47cf-8891-b4fe0f2f79e5") : secret "maas-api-e2e-ipp-cleanup-55ef8c-serving-cert" not found
Sep 11 14:48:06.997064 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:06.997008    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1997de34-79bb-47cf-8891-b4fe0f2f79e5-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:06.998843 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:06.998821    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:07.006643 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:07.006614    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmcsm\" (UniqueName: \"kubernetes.io/projected/1997de34-79bb-47cf-8891-b4fe0f2f79e5-kube-api-access-vmcsm\") pod \"maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:07.501693 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:07.501656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:07.504154 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:07.504136    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:07.684893 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:07.684859    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:07.967609 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:07.967583    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"]
Sep 11 14:48:07.969428 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:48:07.969404    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1997de34_79bb_47cf_8891_b4fe0f2f79e5.slice/crio-8ff05e1c479c730140c5a7f4ec7621c6bad87f249301298e112099120fe8506b WatchSource:0}: Error finding container 8ff05e1c479c730140c5a7f4ec7621c6bad87f249301298e112099120fe8506b: Status 404 returned error can't find the container with id 8ff05e1c479c730140c5a7f4ec7621c6bad87f249301298e112099120fe8506b
Sep 11 14:48:08.064137 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:08.064098    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp" event={"ID":"1997de34-79bb-47cf-8891-b4fe0f2f79e5","Type":"ContainerStarted","Data":"8ff05e1c479c730140c5a7f4ec7621c6bad87f249301298e112099120fe8506b"}
Sep 11 14:48:09.071564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:09.071529    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp" event={"ID":"1997de34-79bb-47cf-8891-b4fe0f2f79e5","Type":"ContainerStarted","Data":"44e88af0501e628697dfe7b2b2bbe0d8d2de8f7d205ad8887b0a6d74e4a6da1d"}
Sep 11 14:48:09.072011 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:09.071611    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:09.093534 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:09.093485    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp" podStartSLOduration=2.605910155 podStartE2EDuration="3.093471672s" totalImagesPullingTime="487.561517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:48:09.089938952 +0000 UTC m=+1986.122373815" watchObservedRunningTime="2026-09-11 14:48:09.093471672 +0000 UTC m=+1986.125906532"
Sep 11 14:48:15.082775 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:15.082740    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:44.724182 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:44.724152    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"]
Sep 11 14:48:44.724678 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:44.724367    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp" podUID="1997de34-79bb-47cf-8891-b4fe0f2f79e5" containerName="maas-api" containerID="cri-o://44e88af0501e628697dfe7b2b2bbe0d8d2de8f7d205ad8887b0a6d74e4a6da1d" gracePeriod=30
Sep 11 14:48:44.984761 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:44.984703    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:45.082980 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.082943    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-maas-api-tls\") pod \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") "
Sep 11 14:48:45.083242 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.083018    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmcsm\" (UniqueName: \"kubernetes.io/projected/1997de34-79bb-47cf-8891-b4fe0f2f79e5-kube-api-access-vmcsm\") pod \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") "
Sep 11 14:48:45.083242 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.083119    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1997de34-79bb-47cf-8891-b4fe0f2f79e5-openshift-service-ca\") pod \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") "
Sep 11 14:48:45.083242 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.083176    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-metrics-certs\") pod \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\" (UID: \"1997de34-79bb-47cf-8891-b4fe0f2f79e5\") "
Sep 11 14:48:45.083784 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.083745    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1997de34-79bb-47cf-8891-b4fe0f2f79e5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1997de34-79bb-47cf-8891-b4fe0f2f79e5" (UID: "1997de34-79bb-47cf-8891-b4fe0f2f79e5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:48:45.086018 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.085989    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1997de34-79bb-47cf-8891-b4fe0f2f79e5" (UID: "1997de34-79bb-47cf-8891-b4fe0f2f79e5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:48:45.086261 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.086229    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1997de34-79bb-47cf-8891-b4fe0f2f79e5-kube-api-access-vmcsm" (OuterVolumeSpecName: "kube-api-access-vmcsm") pod "1997de34-79bb-47cf-8891-b4fe0f2f79e5" (UID: "1997de34-79bb-47cf-8891-b4fe0f2f79e5"). InnerVolumeSpecName "kube-api-access-vmcsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:48:45.086381 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.086361    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1997de34-79bb-47cf-8891-b4fe0f2f79e5" (UID: "1997de34-79bb-47cf-8891-b4fe0f2f79e5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:48:45.184718 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.184677    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1997de34-79bb-47cf-8891-b4fe0f2f79e5-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:48:45.184718 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.184712    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:48:45.184718 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.184725    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1997de34-79bb-47cf-8891-b4fe0f2f79e5-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:48:45.184963 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.184736    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmcsm\" (UniqueName: \"kubernetes.io/projected/1997de34-79bb-47cf-8891-b4fe0f2f79e5-kube-api-access-vmcsm\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:48:45.278412 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.278320    2582 generic.go:356] "Generic (PLEG): container finished" podID="1997de34-79bb-47cf-8891-b4fe0f2f79e5" containerID="44e88af0501e628697dfe7b2b2bbe0d8d2de8f7d205ad8887b0a6d74e4a6da1d" exitCode=0
Sep 11 14:48:45.278412 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.278365    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"
Sep 11 14:48:45.278671 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.278410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp" event={"ID":"1997de34-79bb-47cf-8891-b4fe0f2f79e5","Type":"ContainerDied","Data":"44e88af0501e628697dfe7b2b2bbe0d8d2de8f7d205ad8887b0a6d74e4a6da1d"}
Sep 11 14:48:45.278671 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.278488    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp" event={"ID":"1997de34-79bb-47cf-8891-b4fe0f2f79e5","Type":"ContainerDied","Data":"8ff05e1c479c730140c5a7f4ec7621c6bad87f249301298e112099120fe8506b"}
Sep 11 14:48:45.278671 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.278521    2582 scope.go:117] "RemoveContainer" containerID="44e88af0501e628697dfe7b2b2bbe0d8d2de8f7d205ad8887b0a6d74e4a6da1d"
Sep 11 14:48:45.288878 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.288861    2582 scope.go:117] "RemoveContainer" containerID="44e88af0501e628697dfe7b2b2bbe0d8d2de8f7d205ad8887b0a6d74e4a6da1d"
Sep 11 14:48:45.289260 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:48:45.289240    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44e88af0501e628697dfe7b2b2bbe0d8d2de8f7d205ad8887b0a6d74e4a6da1d\": container with ID starting with 44e88af0501e628697dfe7b2b2bbe0d8d2de8f7d205ad8887b0a6d74e4a6da1d not found: ID does not exist" containerID="44e88af0501e628697dfe7b2b2bbe0d8d2de8f7d205ad8887b0a6d74e4a6da1d"
Sep 11 14:48:45.289328 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.289269    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e88af0501e628697dfe7b2b2bbe0d8d2de8f7d205ad8887b0a6d74e4a6da1d"} err="failed to get container status \"44e88af0501e628697dfe7b2b2bbe0d8d2de8f7d205ad8887b0a6d74e4a6da1d\": rpc error: code = NotFound desc = could not find container \"44e88af0501e628697dfe7b2b2bbe0d8d2de8f7d205ad8887b0a6d74e4a6da1d\": container with ID starting with 44e88af0501e628697dfe7b2b2bbe0d8d2de8f7d205ad8887b0a6d74e4a6da1d not found: ID does not exist"
Sep 11 14:48:45.304368 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.304343    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"]
Sep 11 14:48:45.308985 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.308959    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-55ef8c-7fd74696c4-zrklp"]
Sep 11 14:48:45.495314 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:48:45.495285    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1997de34-79bb-47cf-8891-b4fe0f2f79e5" path="/var/lib/kubelet/pods/1997de34-79bb-47cf-8891-b4fe0f2f79e5/volumes"
Sep 11 14:49:12.050706 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.050673    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"]
Sep 11 14:49:12.051224 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.050862    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b" podUID="4045e5bd-1101-499a-94ba-6cf08421be04" containerName="maas-api" containerID="cri-o://6f0ee2d69607d96555df329aca86b5fe962dfaf154690042f15451f51b8e5137" gracePeriod=30
Sep 11 14:49:12.314986 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.314915    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:49:12.352278 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.352248    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4045e5bd-1101-499a-94ba-6cf08421be04-maas-api-tls\") pod \"4045e5bd-1101-499a-94ba-6cf08421be04\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") "
Sep 11 14:49:12.352432 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.352416    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4045e5bd-1101-499a-94ba-6cf08421be04-openshift-service-ca\") pod \"4045e5bd-1101-499a-94ba-6cf08421be04\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") "
Sep 11 14:49:12.352497 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.352471    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmkf7\" (UniqueName: \"kubernetes.io/projected/4045e5bd-1101-499a-94ba-6cf08421be04-kube-api-access-pmkf7\") pod \"4045e5bd-1101-499a-94ba-6cf08421be04\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") "
Sep 11 14:49:12.352542 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.352499    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4045e5bd-1101-499a-94ba-6cf08421be04-metrics-certs\") pod \"4045e5bd-1101-499a-94ba-6cf08421be04\" (UID: \"4045e5bd-1101-499a-94ba-6cf08421be04\") "
Sep 11 14:49:12.352692 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.352667    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4045e5bd-1101-499a-94ba-6cf08421be04-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4045e5bd-1101-499a-94ba-6cf08421be04" (UID: "4045e5bd-1101-499a-94ba-6cf08421be04"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:49:12.352963 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.352941    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4045e5bd-1101-499a-94ba-6cf08421be04-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:49:12.354637 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.354604    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4045e5bd-1101-499a-94ba-6cf08421be04-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4045e5bd-1101-499a-94ba-6cf08421be04" (UID: "4045e5bd-1101-499a-94ba-6cf08421be04"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:49:12.354738 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.354653    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4045e5bd-1101-499a-94ba-6cf08421be04-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4045e5bd-1101-499a-94ba-6cf08421be04" (UID: "4045e5bd-1101-499a-94ba-6cf08421be04"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:49:12.354738 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.354716    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4045e5bd-1101-499a-94ba-6cf08421be04-kube-api-access-pmkf7" (OuterVolumeSpecName: "kube-api-access-pmkf7") pod "4045e5bd-1101-499a-94ba-6cf08421be04" (UID: "4045e5bd-1101-499a-94ba-6cf08421be04"). InnerVolumeSpecName "kube-api-access-pmkf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:49:12.446678 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.446640    2582 generic.go:356] "Generic (PLEG): container finished" podID="4045e5bd-1101-499a-94ba-6cf08421be04" containerID="6f0ee2d69607d96555df329aca86b5fe962dfaf154690042f15451f51b8e5137" exitCode=0
Sep 11 14:49:12.446829 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.446690    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"
Sep 11 14:49:12.446829 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.446725    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b" event={"ID":"4045e5bd-1101-499a-94ba-6cf08421be04","Type":"ContainerDied","Data":"6f0ee2d69607d96555df329aca86b5fe962dfaf154690042f15451f51b8e5137"}
Sep 11 14:49:12.446829 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.446782    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b" event={"ID":"4045e5bd-1101-499a-94ba-6cf08421be04","Type":"ContainerDied","Data":"3660fd6322c61fafced4709ea603dde60d32445416f9e8467834b47d844204a0"}
Sep 11 14:49:12.446829 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.446809    2582 scope.go:117] "RemoveContainer" containerID="6f0ee2d69607d96555df329aca86b5fe962dfaf154690042f15451f51b8e5137"
Sep 11 14:49:12.453770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.453743    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4045e5bd-1101-499a-94ba-6cf08421be04-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:49:12.453901 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.453775    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmkf7\" (UniqueName: \"kubernetes.io/projected/4045e5bd-1101-499a-94ba-6cf08421be04-kube-api-access-pmkf7\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:49:12.453901 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.453789    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4045e5bd-1101-499a-94ba-6cf08421be04-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:49:12.461095 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.461068    2582 scope.go:117] "RemoveContainer" containerID="6f0ee2d69607d96555df329aca86b5fe962dfaf154690042f15451f51b8e5137"
Sep 11 14:49:12.461657 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:49:12.461627    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f0ee2d69607d96555df329aca86b5fe962dfaf154690042f15451f51b8e5137\": container with ID starting with 6f0ee2d69607d96555df329aca86b5fe962dfaf154690042f15451f51b8e5137 not found: ID does not exist" containerID="6f0ee2d69607d96555df329aca86b5fe962dfaf154690042f15451f51b8e5137"
Sep 11 14:49:12.461766 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.461669    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0ee2d69607d96555df329aca86b5fe962dfaf154690042f15451f51b8e5137"} err="failed to get container status \"6f0ee2d69607d96555df329aca86b5fe962dfaf154690042f15451f51b8e5137\": rpc error: code = NotFound desc = could not find container \"6f0ee2d69607d96555df329aca86b5fe962dfaf154690042f15451f51b8e5137\": container with ID starting with 6f0ee2d69607d96555df329aca86b5fe962dfaf154690042f15451f51b8e5137 not found: ID does not exist"
Sep 11 14:49:12.474553 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.474523    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"]
Sep 11 14:49:12.477688 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:12.477665    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9fedd5-86bfd97b5d-5267b"]
Sep 11 14:49:13.495225 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:49:13.495192    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4045e5bd-1101-499a-94ba-6cf08421be04" path="/var/lib/kubelet/pods/4045e5bd-1101-499a-94ba-6cf08421be04/volumes"
Sep 11 14:50:12.877574 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:12.877539    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"]
Sep 11 14:50:12.878168 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:12.877786    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8" podUID="eef1442d-fba1-4d4f-b524-d7aa6e69169e" containerName="maas-api" containerID="cri-o://c8a753c718042f2ecb3cc2a3f6ba7d26b5229b379fac301091978b7838bd720e" gracePeriod=30
Sep 11 14:50:13.130091 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.130001    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:50:13.252114 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.252087    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef1442d-fba1-4d4f-b524-d7aa6e69169e-openshift-service-ca\") pod \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") "
Sep 11 14:50:13.252306 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.252133    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1442d-fba1-4d4f-b524-d7aa6e69169e-metrics-certs\") pod \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") "
Sep 11 14:50:13.252306 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.252186    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jvgt\" (UniqueName: \"kubernetes.io/projected/eef1442d-fba1-4d4f-b524-d7aa6e69169e-kube-api-access-5jvgt\") pod \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") "
Sep 11 14:50:13.252429 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.252342    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef1442d-fba1-4d4f-b524-d7aa6e69169e-maas-api-tls\") pod \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\" (UID: \"eef1442d-fba1-4d4f-b524-d7aa6e69169e\") "
Sep 11 14:50:13.252572 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.252539    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eef1442d-fba1-4d4f-b524-d7aa6e69169e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eef1442d-fba1-4d4f-b524-d7aa6e69169e" (UID: "eef1442d-fba1-4d4f-b524-d7aa6e69169e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:50:13.252825 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.252805    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef1442d-fba1-4d4f-b524-d7aa6e69169e-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:50:13.254635 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.254599    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef1442d-fba1-4d4f-b524-d7aa6e69169e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eef1442d-fba1-4d4f-b524-d7aa6e69169e" (UID: "eef1442d-fba1-4d4f-b524-d7aa6e69169e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:50:13.254742 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.254667    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef1442d-fba1-4d4f-b524-d7aa6e69169e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "eef1442d-fba1-4d4f-b524-d7aa6e69169e" (UID: "eef1442d-fba1-4d4f-b524-d7aa6e69169e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:50:13.254742 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.254670    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef1442d-fba1-4d4f-b524-d7aa6e69169e-kube-api-access-5jvgt" (OuterVolumeSpecName: "kube-api-access-5jvgt") pod "eef1442d-fba1-4d4f-b524-d7aa6e69169e" (UID: "eef1442d-fba1-4d4f-b524-d7aa6e69169e"). InnerVolumeSpecName "kube-api-access-5jvgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:50:13.353668 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.353633    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef1442d-fba1-4d4f-b524-d7aa6e69169e-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:50:13.353668 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.353660    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1442d-fba1-4d4f-b524-d7aa6e69169e-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:50:13.353668 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.353671    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jvgt\" (UniqueName: \"kubernetes.io/projected/eef1442d-fba1-4d4f-b524-d7aa6e69169e-kube-api-access-5jvgt\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:50:13.810422 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.810333    2582 generic.go:356] "Generic (PLEG): container finished" podID="eef1442d-fba1-4d4f-b524-d7aa6e69169e" containerID="c8a753c718042f2ecb3cc2a3f6ba7d26b5229b379fac301091978b7838bd720e" exitCode=0
Sep 11 14:50:13.810422 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.810378    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"
Sep 11 14:50:13.810422 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.810399    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8" event={"ID":"eef1442d-fba1-4d4f-b524-d7aa6e69169e","Type":"ContainerDied","Data":"c8a753c718042f2ecb3cc2a3f6ba7d26b5229b379fac301091978b7838bd720e"}
Sep 11 14:50:13.810665 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.810440    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8" event={"ID":"eef1442d-fba1-4d4f-b524-d7aa6e69169e","Type":"ContainerDied","Data":"837189322f680a5b3849025ca99400e52e50d3449479b684e7501f35665af3ac"}
Sep 11 14:50:13.810665 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.810462    2582 scope.go:117] "RemoveContainer" containerID="c8a753c718042f2ecb3cc2a3f6ba7d26b5229b379fac301091978b7838bd720e"
Sep 11 14:50:13.822003 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.821982    2582 scope.go:117] "RemoveContainer" containerID="c8a753c718042f2ecb3cc2a3f6ba7d26b5229b379fac301091978b7838bd720e"
Sep 11 14:50:13.822458 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:50:13.822434    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8a753c718042f2ecb3cc2a3f6ba7d26b5229b379fac301091978b7838bd720e\": container with ID starting with c8a753c718042f2ecb3cc2a3f6ba7d26b5229b379fac301091978b7838bd720e not found: ID does not exist" containerID="c8a753c718042f2ecb3cc2a3f6ba7d26b5229b379fac301091978b7838bd720e"
Sep 11 14:50:13.822531 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.822468    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8a753c718042f2ecb3cc2a3f6ba7d26b5229b379fac301091978b7838bd720e"} err="failed to get container status \"c8a753c718042f2ecb3cc2a3f6ba7d26b5229b379fac301091978b7838bd720e\": rpc error: code = NotFound desc = could not find container \"c8a753c718042f2ecb3cc2a3f6ba7d26b5229b379fac301091978b7838bd720e\": container with ID starting with c8a753c718042f2ecb3cc2a3f6ba7d26b5229b379fac301091978b7838bd720e not found: ID does not exist"
Sep 11 14:50:13.829421 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.829397    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"]
Sep 11 14:50:13.833785 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:13.833760    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-92ca78-74d8c4c7d4-mbbd8"]
Sep 11 14:50:15.494700 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:15.494669    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eef1442d-fba1-4d4f-b524-d7aa6e69169e" path="/var/lib/kubelet/pods/eef1442d-fba1-4d4f-b524-d7aa6e69169e/volumes"
Sep 11 14:50:31.834237 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:31.834200    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"]
Sep 11 14:50:31.834724 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:31.834428    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w" podUID="642bcf18-c641-4dc6-8009-6f2d4cb16e05" containerName="maas-api" containerID="cri-o://64261019028f656b08d305174a8ba383c7a3a4e2206d07630290667dccaa106b" gracePeriod=30
Sep 11 14:50:32.083296 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.083268    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:50:32.127349 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.127251    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/642bcf18-c641-4dc6-8009-6f2d4cb16e05-maas-api-tls\") pod \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") "
Sep 11 14:50:32.127349 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.127288    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/642bcf18-c641-4dc6-8009-6f2d4cb16e05-openshift-service-ca\") pod \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") "
Sep 11 14:50:32.127349 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.127323    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/642bcf18-c641-4dc6-8009-6f2d4cb16e05-metrics-certs\") pod \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") "
Sep 11 14:50:32.127658 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.127382    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8phv\" (UniqueName: \"kubernetes.io/projected/642bcf18-c641-4dc6-8009-6f2d4cb16e05-kube-api-access-g8phv\") pod \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\" (UID: \"642bcf18-c641-4dc6-8009-6f2d4cb16e05\") "
Sep 11 14:50:32.127730 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.127690    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/642bcf18-c641-4dc6-8009-6f2d4cb16e05-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "642bcf18-c641-4dc6-8009-6f2d4cb16e05" (UID: "642bcf18-c641-4dc6-8009-6f2d4cb16e05"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:50:32.129806 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.129767    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/642bcf18-c641-4dc6-8009-6f2d4cb16e05-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "642bcf18-c641-4dc6-8009-6f2d4cb16e05" (UID: "642bcf18-c641-4dc6-8009-6f2d4cb16e05"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:50:32.129947 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.129841    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/642bcf18-c641-4dc6-8009-6f2d4cb16e05-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "642bcf18-c641-4dc6-8009-6f2d4cb16e05" (UID: "642bcf18-c641-4dc6-8009-6f2d4cb16e05"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:50:32.129947 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.129849    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/642bcf18-c641-4dc6-8009-6f2d4cb16e05-kube-api-access-g8phv" (OuterVolumeSpecName: "kube-api-access-g8phv") pod "642bcf18-c641-4dc6-8009-6f2d4cb16e05" (UID: "642bcf18-c641-4dc6-8009-6f2d4cb16e05"). InnerVolumeSpecName "kube-api-access-g8phv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:50:32.228439 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.228399    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8phv\" (UniqueName: \"kubernetes.io/projected/642bcf18-c641-4dc6-8009-6f2d4cb16e05-kube-api-access-g8phv\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:50:32.228439 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.228439    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/642bcf18-c641-4dc6-8009-6f2d4cb16e05-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:50:32.228664 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.228457    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/642bcf18-c641-4dc6-8009-6f2d4cb16e05-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:50:32.228664 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.228470    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/642bcf18-c641-4dc6-8009-6f2d4cb16e05-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:50:32.921246 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.921211    2582 generic.go:356] "Generic (PLEG): container finished" podID="642bcf18-c641-4dc6-8009-6f2d4cb16e05" containerID="64261019028f656b08d305174a8ba383c7a3a4e2206d07630290667dccaa106b" exitCode=0
Sep 11 14:50:32.921640 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.921258    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"
Sep 11 14:50:32.921640 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.921299    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w" event={"ID":"642bcf18-c641-4dc6-8009-6f2d4cb16e05","Type":"ContainerDied","Data":"64261019028f656b08d305174a8ba383c7a3a4e2206d07630290667dccaa106b"}
Sep 11 14:50:32.921640 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.921360    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w" event={"ID":"642bcf18-c641-4dc6-8009-6f2d4cb16e05","Type":"ContainerDied","Data":"e37457d9e39d3dfccad43355fed17b69601b4d5ed3937361878210d298263f09"}
Sep 11 14:50:32.921640 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.921389    2582 scope.go:117] "RemoveContainer" containerID="64261019028f656b08d305174a8ba383c7a3a4e2206d07630290667dccaa106b"
Sep 11 14:50:32.931651 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.931633    2582 scope.go:117] "RemoveContainer" containerID="64261019028f656b08d305174a8ba383c7a3a4e2206d07630290667dccaa106b"
Sep 11 14:50:32.931964 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:50:32.931934    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64261019028f656b08d305174a8ba383c7a3a4e2206d07630290667dccaa106b\": container with ID starting with 64261019028f656b08d305174a8ba383c7a3a4e2206d07630290667dccaa106b not found: ID does not exist" containerID="64261019028f656b08d305174a8ba383c7a3a4e2206d07630290667dccaa106b"
Sep 11 14:50:32.932025 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.931964    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64261019028f656b08d305174a8ba383c7a3a4e2206d07630290667dccaa106b"} err="failed to get container status \"64261019028f656b08d305174a8ba383c7a3a4e2206d07630290667dccaa106b\": rpc error: code = NotFound desc = could not find container \"64261019028f656b08d305174a8ba383c7a3a4e2206d07630290667dccaa106b\": container with ID starting with 64261019028f656b08d305174a8ba383c7a3a4e2206d07630290667dccaa106b not found: ID does not exist"
Sep 11 14:50:32.951713 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.951688    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"]
Sep 11 14:50:32.957271 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:32.957242    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8feb68-7ddc64dbc7-8br9w"]
Sep 11 14:50:33.495876 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:33.495839    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="642bcf18-c641-4dc6-8009-6f2d4cb16e05" path="/var/lib/kubelet/pods/642bcf18-c641-4dc6-8009-6f2d4cb16e05/volumes"
Sep 11 14:50:50.941006 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:50.940968    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"]
Sep 11 14:50:50.941614 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:50.941245    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs" podUID="1b4cfd9b-4acb-4048-a701-e7c30254123f" containerName="maas-api" containerID="cri-o://c49455ae1013301266b73a5f55c2b548248bac831dfc5c9ffc56dc223c9e2ce6" gracePeriod=30
Sep 11 14:50:51.188846 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:51.188812    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:50:51.318078 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:51.317978    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr56f\" (UniqueName: \"kubernetes.io/projected/1b4cfd9b-4acb-4048-a701-e7c30254123f-kube-api-access-tr56f\") pod \"1b4cfd9b-4acb-4048-a701-e7c30254123f\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") "
Sep 11 14:50:51.318078 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:51.318013    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-maas-api-tls\") pod \"1b4cfd9b-4acb-4048-a701-e7c30254123f\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") "
Sep 11 14:50:51.318078 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:51.318032    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b4cfd9b-4acb-4048-a701-e7c30254123f-openshift-service-ca\") pod \"1b4cfd9b-4acb-4048-a701-e7c30254123f\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") "
Sep 11 14:50:51.318378 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:51.318167    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-metrics-certs\") pod \"1b4cfd9b-4acb-4048-a701-e7c30254123f\" (UID: \"1b4cfd9b-4acb-4048-a701-e7c30254123f\") "
Sep 11 14:50:51.318440 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:51.318412    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b4cfd9b-4acb-4048-a701-e7c30254123f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1b4cfd9b-4acb-4048-a701-e7c30254123f" (UID: "1b4cfd9b-4acb-4048-a701-e7c30254123f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:50:51.318591 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:51.318574    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b4cfd9b-4acb-4048-a701-e7c30254123f-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:50:51.320384 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:51.320353    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1b4cfd9b-4acb-4048-a701-e7c30254123f" (UID: "1b4cfd9b-4acb-4048-a701-e7c30254123f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:50:51.320497 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:51.320404    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1b4cfd9b-4acb-4048-a701-e7c30254123f" (UID: "1b4cfd9b-4acb-4048-a701-e7c30254123f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:50:51.320497 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:51.320450    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b4cfd9b-4acb-4048-a701-e7c30254123f-kube-api-access-tr56f" (OuterVolumeSpecName: "kube-api-access-tr56f") pod "1b4cfd9b-4acb-4048-a701-e7c30254123f" (UID: "1b4cfd9b-4acb-4048-a701-e7c30254123f"). InnerVolumeSpecName "kube-api-access-tr56f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:50:51.419763 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:51.419727    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:50:51.419763 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:51.419758    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr56f\" (UniqueName: \"kubernetes.io/projected/1b4cfd9b-4acb-4048-a701-e7c30254123f-kube-api-access-tr56f\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:50:51.419763 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:51.419767    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4cfd9b-4acb-4048-a701-e7c30254123f-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:50:52.030611 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:52.030578    2582 generic.go:356] "Generic (PLEG): container finished" podID="1b4cfd9b-4acb-4048-a701-e7c30254123f" containerID="c49455ae1013301266b73a5f55c2b548248bac831dfc5c9ffc56dc223c9e2ce6" exitCode=0
Sep 11 14:50:52.030611 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:52.030616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs" event={"ID":"1b4cfd9b-4acb-4048-a701-e7c30254123f","Type":"ContainerDied","Data":"c49455ae1013301266b73a5f55c2b548248bac831dfc5c9ffc56dc223c9e2ce6"}
Sep 11 14:50:52.031210 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:52.030633    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"
Sep 11 14:50:52.031210 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:52.030653    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs" event={"ID":"1b4cfd9b-4acb-4048-a701-e7c30254123f","Type":"ContainerDied","Data":"c3e616ee1827aeb9a0228a1879433a224e949d8fe7edbb914324bc8ef6df42cd"}
Sep 11 14:50:52.031210 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:52.030676    2582 scope.go:117] "RemoveContainer" containerID="c49455ae1013301266b73a5f55c2b548248bac831dfc5c9ffc56dc223c9e2ce6"
Sep 11 14:50:52.039808 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:52.039790    2582 scope.go:117] "RemoveContainer" containerID="c49455ae1013301266b73a5f55c2b548248bac831dfc5c9ffc56dc223c9e2ce6"
Sep 11 14:50:52.040131 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:50:52.040102    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c49455ae1013301266b73a5f55c2b548248bac831dfc5c9ffc56dc223c9e2ce6\": container with ID starting with c49455ae1013301266b73a5f55c2b548248bac831dfc5c9ffc56dc223c9e2ce6 not found: ID does not exist" containerID="c49455ae1013301266b73a5f55c2b548248bac831dfc5c9ffc56dc223c9e2ce6"
Sep 11 14:50:52.040198 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:52.040130    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c49455ae1013301266b73a5f55c2b548248bac831dfc5c9ffc56dc223c9e2ce6"} err="failed to get container status \"c49455ae1013301266b73a5f55c2b548248bac831dfc5c9ffc56dc223c9e2ce6\": rpc error: code = NotFound desc = could not find container \"c49455ae1013301266b73a5f55c2b548248bac831dfc5c9ffc56dc223c9e2ce6\": container with ID starting with c49455ae1013301266b73a5f55c2b548248bac831dfc5c9ffc56dc223c9e2ce6 not found: ID does not exist"
Sep 11 14:50:52.053393 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:52.053368    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"]
Sep 11 14:50:52.056598 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:52.056579    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-977c12-5894784d8-bmlcs"]
Sep 11 14:50:53.495099 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:50:53.495064    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b4cfd9b-4acb-4048-a701-e7c30254123f" path="/var/lib/kubelet/pods/1b4cfd9b-4acb-4048-a701-e7c30254123f/volumes"
Sep 11 14:51:01.024705 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:01.024596    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7969dc79c9-wrh5q"]
Sep 11 14:51:01.025165 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:01.024929    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7969dc79c9-wrh5q" podUID="0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1" containerName="manager" containerID="cri-o://0d6add88678b1e97b83da13b89258cecb43703c0d3bd9781e4be8056c9a9a72a" gracePeriod=30
Sep 11 14:51:01.278100 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:01.278022    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:51:01.310215 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:01.310189    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-metrics-certs\") pod \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\" (UID: \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\") "
Sep 11 14:51:01.310345 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:01.310245    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-webhook-cert\") pod \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\" (UID: \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\") "
Sep 11 14:51:01.310384 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:01.310369    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxc6z\" (UniqueName: \"kubernetes.io/projected/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-kube-api-access-kxc6z\") pod \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\" (UID: \"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1\") "
Sep 11 14:51:01.312542 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:01.312512    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1" (UID: "0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:51:01.312680 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:01.312538    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1" (UID: "0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:51:01.312680 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:01.312561    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-kube-api-access-kxc6z" (OuterVolumeSpecName: "kube-api-access-kxc6z") pod "0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1" (UID: "0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1"). InnerVolumeSpecName "kube-api-access-kxc6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:51:01.411196 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:01.411165    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:51:01.411196 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:01.411191    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-webhook-cert\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:51:01.411382 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:01.411211    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxc6z\" (UniqueName: \"kubernetes.io/projected/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1-kube-api-access-kxc6z\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:51:02.087856 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:02.087820    2582 generic.go:356] "Generic (PLEG): container finished" podID="0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1" containerID="0d6add88678b1e97b83da13b89258cecb43703c0d3bd9781e4be8056c9a9a72a" exitCode=0
Sep 11 14:51:02.088311 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:02.087869    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7969dc79c9-wrh5q"
Sep 11 14:51:02.088311 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:02.087909    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7969dc79c9-wrh5q" event={"ID":"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1","Type":"ContainerDied","Data":"0d6add88678b1e97b83da13b89258cecb43703c0d3bd9781e4be8056c9a9a72a"}
Sep 11 14:51:02.088311 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:02.087962    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7969dc79c9-wrh5q" event={"ID":"0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1","Type":"ContainerDied","Data":"b4a25ce140a9efd34ba8741515c19354dac445f23c2f29bec230ada739c0a649"}
Sep 11 14:51:02.088311 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:02.087988    2582 scope.go:117] "RemoveContainer" containerID="0d6add88678b1e97b83da13b89258cecb43703c0d3bd9781e4be8056c9a9a72a"
Sep 11 14:51:02.098263 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:02.098236    2582 scope.go:117] "RemoveContainer" containerID="0d6add88678b1e97b83da13b89258cecb43703c0d3bd9781e4be8056c9a9a72a"
Sep 11 14:51:02.098555 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:51:02.098536    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d6add88678b1e97b83da13b89258cecb43703c0d3bd9781e4be8056c9a9a72a\": container with ID starting with 0d6add88678b1e97b83da13b89258cecb43703c0d3bd9781e4be8056c9a9a72a not found: ID does not exist" containerID="0d6add88678b1e97b83da13b89258cecb43703c0d3bd9781e4be8056c9a9a72a"
Sep 11 14:51:02.098601 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:02.098563    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6add88678b1e97b83da13b89258cecb43703c0d3bd9781e4be8056c9a9a72a"} err="failed to get container status \"0d6add88678b1e97b83da13b89258cecb43703c0d3bd9781e4be8056c9a9a72a\": rpc error: code = NotFound desc = could not find container \"0d6add88678b1e97b83da13b89258cecb43703c0d3bd9781e4be8056c9a9a72a\": container with ID starting with 0d6add88678b1e97b83da13b89258cecb43703c0d3bd9781e4be8056c9a9a72a not found: ID does not exist"
Sep 11 14:51:02.108067 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:02.108022    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7969dc79c9-wrh5q"]
Sep 11 14:51:02.112429 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:02.112408    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7969dc79c9-wrh5q"]
Sep 11 14:51:03.495097 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:51:03.495060    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1" path="/var/lib/kubelet/pods/0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1/volumes"
Sep 11 14:52:02.975068 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975021    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7969dc79c9-74dch"]
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975414    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="642bcf18-c641-4dc6-8009-6f2d4cb16e05" containerName="maas-api"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975426    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="642bcf18-c641-4dc6-8009-6f2d4cb16e05" containerName="maas-api"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975441    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1" containerName="manager"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975447    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1" containerName="manager"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975454    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4045e5bd-1101-499a-94ba-6cf08421be04" containerName="maas-api"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975460    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4045e5bd-1101-499a-94ba-6cf08421be04" containerName="maas-api"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975469    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1997de34-79bb-47cf-8891-b4fe0f2f79e5" containerName="maas-api"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975474    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1997de34-79bb-47cf-8891-b4fe0f2f79e5" containerName="maas-api"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975482    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b4cfd9b-4acb-4048-a701-e7c30254123f" containerName="maas-api"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975487    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b4cfd9b-4acb-4048-a701-e7c30254123f" containerName="maas-api"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975499    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eef1442d-fba1-4d4f-b524-d7aa6e69169e" containerName="maas-api"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975504    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef1442d-fba1-4d4f-b524-d7aa6e69169e" containerName="maas-api"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975558    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ed6d239-e5ab-4f1a-ac37-84f7ec25a4f1" containerName="manager"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975566    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b4cfd9b-4acb-4048-a701-e7c30254123f" containerName="maas-api"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975573    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1997de34-79bb-47cf-8891-b4fe0f2f79e5" containerName="maas-api"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975580    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eef1442d-fba1-4d4f-b524-d7aa6e69169e" containerName="maas-api"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975588    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4045e5bd-1101-499a-94ba-6cf08421be04" containerName="maas-api"
Sep 11 14:52:02.977498 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.975592    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="642bcf18-c641-4dc6-8009-6f2d4cb16e05" containerName="maas-api"
Sep 11 14:52:02.978448 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.978432    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:02.980932 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.980908    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 14:52:02.981097 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.981077    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 14:52:02.982012 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.981990    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-94frr\""
Sep 11 14:52:02.982161 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.982078    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 14:52:02.988979 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:02.988959    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7969dc79c9-74dch"]
Sep 11 14:52:03.076743 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:03.076705    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wxnf\" (UniqueName: \"kubernetes.io/projected/64754f78-6c85-40bd-8b47-91e52e0feb24-kube-api-access-2wxnf\") pod \"maas-controller-7969dc79c9-74dch\" (UID: \"64754f78-6c85-40bd-8b47-91e52e0feb24\") " pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:03.076918 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:03.076750    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64754f78-6c85-40bd-8b47-91e52e0feb24-metrics-certs\") pod \"maas-controller-7969dc79c9-74dch\" (UID: \"64754f78-6c85-40bd-8b47-91e52e0feb24\") " pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:03.076918 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:03.076844    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64754f78-6c85-40bd-8b47-91e52e0feb24-webhook-cert\") pod \"maas-controller-7969dc79c9-74dch\" (UID: \"64754f78-6c85-40bd-8b47-91e52e0feb24\") " pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:03.177431 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:03.177400    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wxnf\" (UniqueName: \"kubernetes.io/projected/64754f78-6c85-40bd-8b47-91e52e0feb24-kube-api-access-2wxnf\") pod \"maas-controller-7969dc79c9-74dch\" (UID: \"64754f78-6c85-40bd-8b47-91e52e0feb24\") " pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:03.177579 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:03.177444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64754f78-6c85-40bd-8b47-91e52e0feb24-metrics-certs\") pod \"maas-controller-7969dc79c9-74dch\" (UID: \"64754f78-6c85-40bd-8b47-91e52e0feb24\") " pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:03.177579 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:03.177488    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64754f78-6c85-40bd-8b47-91e52e0feb24-webhook-cert\") pod \"maas-controller-7969dc79c9-74dch\" (UID: \"64754f78-6c85-40bd-8b47-91e52e0feb24\") " pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:03.180066 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:03.180024    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64754f78-6c85-40bd-8b47-91e52e0feb24-webhook-cert\") pod \"maas-controller-7969dc79c9-74dch\" (UID: \"64754f78-6c85-40bd-8b47-91e52e0feb24\") " pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:03.180175 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:03.180145    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64754f78-6c85-40bd-8b47-91e52e0feb24-metrics-certs\") pod \"maas-controller-7969dc79c9-74dch\" (UID: \"64754f78-6c85-40bd-8b47-91e52e0feb24\") " pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:03.198064 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:03.198022    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wxnf\" (UniqueName: \"kubernetes.io/projected/64754f78-6c85-40bd-8b47-91e52e0feb24-kube-api-access-2wxnf\") pod \"maas-controller-7969dc79c9-74dch\" (UID: \"64754f78-6c85-40bd-8b47-91e52e0feb24\") " pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:03.289988 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:03.289916    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:03.564062 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:03.564019    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7969dc79c9-74dch"]
Sep 11 14:52:03.565333 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:52:03.565303    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64754f78_6c85_40bd_8b47_91e52e0feb24.slice/crio-3ba605bcd5cf86cc0011667232f68b0fef5624e6c19742d2ef0d1b9b0b760f89 WatchSource:0}: Error finding container 3ba605bcd5cf86cc0011667232f68b0fef5624e6c19742d2ef0d1b9b0b760f89: Status 404 returned error can't find the container with id 3ba605bcd5cf86cc0011667232f68b0fef5624e6c19742d2ef0d1b9b0b760f89
Sep 11 14:52:03.566619 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:03.566603    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:52:04.117284 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:04.117259    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 14:52:04.443150 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:04.443113    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7969dc79c9-74dch" event={"ID":"64754f78-6c85-40bd-8b47-91e52e0feb24","Type":"ContainerStarted","Data":"e64db063a490e44a8b2d6ff0191309644e687236d0c03064a89e9df027769c42"}
Sep 11 14:52:04.443296 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:04.443178    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:04.443296 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:04.443204    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7969dc79c9-74dch" event={"ID":"64754f78-6c85-40bd-8b47-91e52e0feb24","Type":"ContainerStarted","Data":"3ba605bcd5cf86cc0011667232f68b0fef5624e6c19742d2ef0d1b9b0b760f89"}
Sep 11 14:52:04.479704 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:04.479649    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7969dc79c9-74dch" podStartSLOduration=1.933978545 podStartE2EDuration="2.479634085s" totalImagesPullingTime="545.65554ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:52:04.477447114 +0000 UTC m=+2221.509881972" watchObservedRunningTime="2026-09-11 14:52:04.479634085 +0000 UTC m=+2221.512068945"
Sep 11 14:52:15.451280 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:15.451244    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:22.689193 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:22.689160    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7969dc79c9-74dch"]
Sep 11 14:52:22.689619 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:22.689357    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7969dc79c9-74dch" podUID="64754f78-6c85-40bd-8b47-91e52e0feb24" containerName="manager" containerID="cri-o://e64db063a490e44a8b2d6ff0191309644e687236d0c03064a89e9df027769c42" gracePeriod=30
Sep 11 14:52:22.939859 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:22.939799    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:23.069350 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.069315    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wxnf\" (UniqueName: \"kubernetes.io/projected/64754f78-6c85-40bd-8b47-91e52e0feb24-kube-api-access-2wxnf\") pod \"64754f78-6c85-40bd-8b47-91e52e0feb24\" (UID: \"64754f78-6c85-40bd-8b47-91e52e0feb24\") "
Sep 11 14:52:23.069513 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.069394    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64754f78-6c85-40bd-8b47-91e52e0feb24-webhook-cert\") pod \"64754f78-6c85-40bd-8b47-91e52e0feb24\" (UID: \"64754f78-6c85-40bd-8b47-91e52e0feb24\") "
Sep 11 14:52:23.069513 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.069425    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64754f78-6c85-40bd-8b47-91e52e0feb24-metrics-certs\") pod \"64754f78-6c85-40bd-8b47-91e52e0feb24\" (UID: \"64754f78-6c85-40bd-8b47-91e52e0feb24\") "
Sep 11 14:52:23.071585 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.071557    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64754f78-6c85-40bd-8b47-91e52e0feb24-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "64754f78-6c85-40bd-8b47-91e52e0feb24" (UID: "64754f78-6c85-40bd-8b47-91e52e0feb24"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:52:23.071585 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.071574    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64754f78-6c85-40bd-8b47-91e52e0feb24-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "64754f78-6c85-40bd-8b47-91e52e0feb24" (UID: "64754f78-6c85-40bd-8b47-91e52e0feb24"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:52:23.071736 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.071695    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64754f78-6c85-40bd-8b47-91e52e0feb24-kube-api-access-2wxnf" (OuterVolumeSpecName: "kube-api-access-2wxnf") pod "64754f78-6c85-40bd-8b47-91e52e0feb24" (UID: "64754f78-6c85-40bd-8b47-91e52e0feb24"). InnerVolumeSpecName "kube-api-access-2wxnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:52:23.170486 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.170448    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wxnf\" (UniqueName: \"kubernetes.io/projected/64754f78-6c85-40bd-8b47-91e52e0feb24-kube-api-access-2wxnf\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:52:23.170486 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.170482    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64754f78-6c85-40bd-8b47-91e52e0feb24-webhook-cert\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:52:23.170486 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.170491    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64754f78-6c85-40bd-8b47-91e52e0feb24-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:52:23.552122 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.552089    2582 generic.go:356] "Generic (PLEG): container finished" podID="64754f78-6c85-40bd-8b47-91e52e0feb24" containerID="e64db063a490e44a8b2d6ff0191309644e687236d0c03064a89e9df027769c42" exitCode=0
Sep 11 14:52:23.552332 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.552145    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7969dc79c9-74dch"
Sep 11 14:52:23.552332 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.552182    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7969dc79c9-74dch" event={"ID":"64754f78-6c85-40bd-8b47-91e52e0feb24","Type":"ContainerDied","Data":"e64db063a490e44a8b2d6ff0191309644e687236d0c03064a89e9df027769c42"}
Sep 11 14:52:23.552332 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.552239    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7969dc79c9-74dch" event={"ID":"64754f78-6c85-40bd-8b47-91e52e0feb24","Type":"ContainerDied","Data":"3ba605bcd5cf86cc0011667232f68b0fef5624e6c19742d2ef0d1b9b0b760f89"}
Sep 11 14:52:23.552332 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.552266    2582 scope.go:117] "RemoveContainer" containerID="e64db063a490e44a8b2d6ff0191309644e687236d0c03064a89e9df027769c42"
Sep 11 14:52:23.561605 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.561586    2582 scope.go:117] "RemoveContainer" containerID="e64db063a490e44a8b2d6ff0191309644e687236d0c03064a89e9df027769c42"
Sep 11 14:52:23.561881 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:52:23.561858    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e64db063a490e44a8b2d6ff0191309644e687236d0c03064a89e9df027769c42\": container with ID starting with e64db063a490e44a8b2d6ff0191309644e687236d0c03064a89e9df027769c42 not found: ID does not exist" containerID="e64db063a490e44a8b2d6ff0191309644e687236d0c03064a89e9df027769c42"
Sep 11 14:52:23.561938 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.561892    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e64db063a490e44a8b2d6ff0191309644e687236d0c03064a89e9df027769c42"} err="failed to get container status \"e64db063a490e44a8b2d6ff0191309644e687236d0c03064a89e9df027769c42\": rpc error: code = NotFound desc = could not find container \"e64db063a490e44a8b2d6ff0191309644e687236d0c03064a89e9df027769c42\": container with ID starting with e64db063a490e44a8b2d6ff0191309644e687236d0c03064a89e9df027769c42 not found: ID does not exist"
Sep 11 14:52:23.570509 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.570478    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7969dc79c9-74dch"]
Sep 11 14:52:23.573654 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:23.573623    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7969dc79c9-74dch"]
Sep 11 14:52:24.432061 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.431966    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7969dc79c9-g448m"]
Sep 11 14:52:24.432414 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.432388    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64754f78-6c85-40bd-8b47-91e52e0feb24" containerName="manager"
Sep 11 14:52:24.432414 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.432401    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="64754f78-6c85-40bd-8b47-91e52e0feb24" containerName="manager"
Sep 11 14:52:24.432493 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.432471    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="64754f78-6c85-40bd-8b47-91e52e0feb24" containerName="manager"
Sep 11 14:52:24.436982 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.436962    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7969dc79c9-g448m"
Sep 11 14:52:24.440489 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.440460    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 14:52:24.440489 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.440480    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 14:52:24.440489 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.440461    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 14:52:24.440701 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.440467    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-94frr\""
Sep 11 14:52:24.448475 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.448453    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7969dc79c9-g448m"]
Sep 11 14:52:24.585564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.585531    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cc6e01e-6a55-4d69-8652-70a5e8726e22-webhook-cert\") pod \"maas-controller-7969dc79c9-g448m\" (UID: \"7cc6e01e-6a55-4d69-8652-70a5e8726e22\") " pod="opendatahub/maas-controller-7969dc79c9-g448m"
Sep 11 14:52:24.585564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.585564    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cc6e01e-6a55-4d69-8652-70a5e8726e22-metrics-certs\") pod \"maas-controller-7969dc79c9-g448m\" (UID: \"7cc6e01e-6a55-4d69-8652-70a5e8726e22\") " pod="opendatahub/maas-controller-7969dc79c9-g448m"
Sep 11 14:52:24.585831 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.585739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qwwc\" (UniqueName: \"kubernetes.io/projected/7cc6e01e-6a55-4d69-8652-70a5e8726e22-kube-api-access-7qwwc\") pod \"maas-controller-7969dc79c9-g448m\" (UID: \"7cc6e01e-6a55-4d69-8652-70a5e8726e22\") " pod="opendatahub/maas-controller-7969dc79c9-g448m"
Sep 11 14:52:24.687072 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.686944    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qwwc\" (UniqueName: \"kubernetes.io/projected/7cc6e01e-6a55-4d69-8652-70a5e8726e22-kube-api-access-7qwwc\") pod \"maas-controller-7969dc79c9-g448m\" (UID: \"7cc6e01e-6a55-4d69-8652-70a5e8726e22\") " pod="opendatahub/maas-controller-7969dc79c9-g448m"
Sep 11 14:52:24.687072 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.687014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cc6e01e-6a55-4d69-8652-70a5e8726e22-webhook-cert\") pod \"maas-controller-7969dc79c9-g448m\" (UID: \"7cc6e01e-6a55-4d69-8652-70a5e8726e22\") " pod="opendatahub/maas-controller-7969dc79c9-g448m"
Sep 11 14:52:24.687072 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.687073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cc6e01e-6a55-4d69-8652-70a5e8726e22-metrics-certs\") pod \"maas-controller-7969dc79c9-g448m\" (UID: \"7cc6e01e-6a55-4d69-8652-70a5e8726e22\") " pod="opendatahub/maas-controller-7969dc79c9-g448m"
Sep 11 14:52:24.689678 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.689654    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cc6e01e-6a55-4d69-8652-70a5e8726e22-webhook-cert\") pod \"maas-controller-7969dc79c9-g448m\" (UID: \"7cc6e01e-6a55-4d69-8652-70a5e8726e22\") " pod="opendatahub/maas-controller-7969dc79c9-g448m"
Sep 11 14:52:24.689783 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.689688    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cc6e01e-6a55-4d69-8652-70a5e8726e22-metrics-certs\") pod \"maas-controller-7969dc79c9-g448m\" (UID: \"7cc6e01e-6a55-4d69-8652-70a5e8726e22\") " pod="opendatahub/maas-controller-7969dc79c9-g448m"
Sep 11 14:52:24.696396 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.696371    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qwwc\" (UniqueName: \"kubernetes.io/projected/7cc6e01e-6a55-4d69-8652-70a5e8726e22-kube-api-access-7qwwc\") pod \"maas-controller-7969dc79c9-g448m\" (UID: \"7cc6e01e-6a55-4d69-8652-70a5e8726e22\") " pod="opendatahub/maas-controller-7969dc79c9-g448m"
Sep 11 14:52:24.747492 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:24.747452    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7969dc79c9-g448m"
Sep 11 14:52:25.021665 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:25.021632    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7969dc79c9-g448m"]
Sep 11 14:52:25.023204 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:52:25.023173    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc6e01e_6a55_4d69_8652_70a5e8726e22.slice/crio-49dc1a5371eb1696dc117e1d5b638ca17c93dced4a7001485e0c9250c57c9ea1 WatchSource:0}: Error finding container 49dc1a5371eb1696dc117e1d5b638ca17c93dced4a7001485e0c9250c57c9ea1: Status 404 returned error can't find the container with id 49dc1a5371eb1696dc117e1d5b638ca17c93dced4a7001485e0c9250c57c9ea1
Sep 11 14:52:25.500197 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:25.498381    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64754f78-6c85-40bd-8b47-91e52e0feb24" path="/var/lib/kubelet/pods/64754f78-6c85-40bd-8b47-91e52e0feb24/volumes"
Sep 11 14:52:25.567550 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:25.567446    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7969dc79c9-g448m" event={"ID":"7cc6e01e-6a55-4d69-8652-70a5e8726e22","Type":"ContainerStarted","Data":"56f8f8c94078b95f4fcf1f1ae7fc9a909fff02c8cc00f7e94f2309aa1743ac32"}
Sep 11 14:52:25.567550 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:25.567516    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7969dc79c9-g448m" event={"ID":"7cc6e01e-6a55-4d69-8652-70a5e8726e22","Type":"ContainerStarted","Data":"49dc1a5371eb1696dc117e1d5b638ca17c93dced4a7001485e0c9250c57c9ea1"}
Sep 11 14:52:25.567752 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:25.567681    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7969dc79c9-g448m"
Sep 11 14:52:25.585457 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:25.585405    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7969dc79c9-g448m" podStartSLOduration=1.3028188649999999 podStartE2EDuration="1.585390067s" totalImagesPullingTime="282.571202ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:52:25.584098686 +0000 UTC m=+2242.616533547" watchObservedRunningTime="2026-09-11 14:52:25.585390067 +0000 UTC m=+2242.617824926"
Sep 11 14:52:36.577020 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:52:36.576990    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7969dc79c9-g448m"
Sep 11 14:56:31.318782 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.318750    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"]
Sep 11 14:56:31.322259 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.322239    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:31.324875 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.324851    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c5cfn\""
Sep 11 14:56:31.335376 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.335352    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"]
Sep 11 14:56:31.416477 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.416439    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f08973-9102-49e7-9fb2-437a3e7df184-openshift-service-ca\") pod \"maas-api-75779b999f-9wzbf\" (UID: \"c3f08973-9102-49e7-9fb2-437a3e7df184\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:31.416694 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.416502    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grf95\" (UniqueName: \"kubernetes.io/projected/c3f08973-9102-49e7-9fb2-437a3e7df184-kube-api-access-grf95\") pod \"maas-api-75779b999f-9wzbf\" (UID: \"c3f08973-9102-49e7-9fb2-437a3e7df184\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:31.416694 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.416640    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f08973-9102-49e7-9fb2-437a3e7df184-maas-api-tls\") pod \"maas-api-75779b999f-9wzbf\" (UID: \"c3f08973-9102-49e7-9fb2-437a3e7df184\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:31.416822 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.416731    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3f08973-9102-49e7-9fb2-437a3e7df184-metrics-certs\") pod \"maas-api-75779b999f-9wzbf\" (UID: \"c3f08973-9102-49e7-9fb2-437a3e7df184\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:31.517442 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.517407    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3f08973-9102-49e7-9fb2-437a3e7df184-metrics-certs\") pod \"maas-api-75779b999f-9wzbf\" (UID: \"c3f08973-9102-49e7-9fb2-437a3e7df184\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:31.517629 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.517450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f08973-9102-49e7-9fb2-437a3e7df184-openshift-service-ca\") pod \"maas-api-75779b999f-9wzbf\" (UID: \"c3f08973-9102-49e7-9fb2-437a3e7df184\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:31.517629 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.517486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grf95\" (UniqueName: \"kubernetes.io/projected/c3f08973-9102-49e7-9fb2-437a3e7df184-kube-api-access-grf95\") pod \"maas-api-75779b999f-9wzbf\" (UID: \"c3f08973-9102-49e7-9fb2-437a3e7df184\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:31.517629 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.517537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f08973-9102-49e7-9fb2-437a3e7df184-maas-api-tls\") pod \"maas-api-75779b999f-9wzbf\" (UID: \"c3f08973-9102-49e7-9fb2-437a3e7df184\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:31.518156 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.518127    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f08973-9102-49e7-9fb2-437a3e7df184-openshift-service-ca\") pod \"maas-api-75779b999f-9wzbf\" (UID: \"c3f08973-9102-49e7-9fb2-437a3e7df184\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:31.520267 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.520238    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3f08973-9102-49e7-9fb2-437a3e7df184-metrics-certs\") pod \"maas-api-75779b999f-9wzbf\" (UID: \"c3f08973-9102-49e7-9fb2-437a3e7df184\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:31.520392 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.520245    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f08973-9102-49e7-9fb2-437a3e7df184-maas-api-tls\") pod \"maas-api-75779b999f-9wzbf\" (UID: \"c3f08973-9102-49e7-9fb2-437a3e7df184\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:31.525604 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.525583    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grf95\" (UniqueName: \"kubernetes.io/projected/c3f08973-9102-49e7-9fb2-437a3e7df184-kube-api-access-grf95\") pod \"maas-api-75779b999f-9wzbf\" (UID: \"c3f08973-9102-49e7-9fb2-437a3e7df184\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:31.634799 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.634719    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:31.914832 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.914809    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"]
Sep 11 14:56:31.917373 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:56:31.917338    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f08973_9102_49e7_9fb2_437a3e7df184.slice/crio-fa582deedb724db07d91a405e04a20030a5b58d92e67a2a323645d5e4671b5d5 WatchSource:0}: Error finding container fa582deedb724db07d91a405e04a20030a5b58d92e67a2a323645d5e4671b5d5: Status 404 returned error can't find the container with id fa582deedb724db07d91a405e04a20030a5b58d92e67a2a323645d5e4671b5d5
Sep 11 14:56:31.945978 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:31.945940    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf" event={"ID":"c3f08973-9102-49e7-9fb2-437a3e7df184","Type":"ContainerStarted","Data":"fa582deedb724db07d91a405e04a20030a5b58d92e67a2a323645d5e4671b5d5"}
Sep 11 14:56:32.953136 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:32.953086    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf" event={"ID":"c3f08973-9102-49e7-9fb2-437a3e7df184","Type":"ContainerStarted","Data":"6b22d797fd9ead78de69a0d9380def24abd26be9f2607092561507c4e6050f2f"}
Sep 11 14:56:32.953584 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:32.953163    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:33.025699 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:33.025650    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf" podStartSLOduration=1.561228292 podStartE2EDuration="2.025632305s" totalImagesPullingTime="464.404013ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:56:33.020427552 +0000 UTC m=+2490.052862412" watchObservedRunningTime="2026-09-11 14:56:33.025632305 +0000 UTC m=+2490.058067165"
Sep 11 14:56:38.969935 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:38.969903    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-75779b999f-9wzbf"
Sep 11 14:56:47.212032 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:47.211996    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"]
Sep 11 14:56:47.212578 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:47.212238    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm" podUID="6b51fa8f-a5cb-40cf-966b-4019a4fbb25a" containerName="maas-api" containerID="cri-o://c094de50b16fc8fe12a0522b785336ca46e811efc80b56f67cad2d88253e0834" gracePeriod=30
Sep 11 14:56:48.469855 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:48.469825    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:56:48.583844 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:48.583759    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9tc5\" (UniqueName: \"kubernetes.io/projected/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-kube-api-access-w9tc5\") pod \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") "
Sep 11 14:56:48.583844 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:48.583826    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-openshift-service-ca\") pod \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") "
Sep 11 14:56:48.584114 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:48.583900    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-maas-api-tls\") pod \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") "
Sep 11 14:56:48.584114 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:48.583970    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-metrics-certs\") pod \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\" (UID: \"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a\") "
Sep 11 14:56:48.584306 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:48.584279    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b51fa8f-a5cb-40cf-966b-4019a4fbb25a" (UID: "6b51fa8f-a5cb-40cf-966b-4019a4fbb25a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:56:48.586213 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:48.586188    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6b51fa8f-a5cb-40cf-966b-4019a4fbb25a" (UID: "6b51fa8f-a5cb-40cf-966b-4019a4fbb25a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:56:48.586322 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:48.586207    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b51fa8f-a5cb-40cf-966b-4019a4fbb25a" (UID: "6b51fa8f-a5cb-40cf-966b-4019a4fbb25a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:56:48.586322 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:48.586265    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-kube-api-access-w9tc5" (OuterVolumeSpecName: "kube-api-access-w9tc5") pod "6b51fa8f-a5cb-40cf-966b-4019a4fbb25a" (UID: "6b51fa8f-a5cb-40cf-966b-4019a4fbb25a"). InnerVolumeSpecName "kube-api-access-w9tc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:56:48.685665 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:48.685631    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-metrics-certs\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:56:48.685665 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:48.685661    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9tc5\" (UniqueName: \"kubernetes.io/projected/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-kube-api-access-w9tc5\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:56:48.685665 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:48.685670    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-openshift-service-ca\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:56:48.685902 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:48.685679    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a-maas-api-tls\") on node \"ip-10-0-142-0.ec2.internal\" DevicePath \"\""
Sep 11 14:56:49.053998 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:49.053960    2582 generic.go:356] "Generic (PLEG): container finished" podID="6b51fa8f-a5cb-40cf-966b-4019a4fbb25a" containerID="c094de50b16fc8fe12a0522b785336ca46e811efc80b56f67cad2d88253e0834" exitCode=0
Sep 11 14:56:49.054195 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:49.054019    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"
Sep 11 14:56:49.054195 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:49.054061    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm" event={"ID":"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a","Type":"ContainerDied","Data":"c094de50b16fc8fe12a0522b785336ca46e811efc80b56f67cad2d88253e0834"}
Sep 11 14:56:49.054195 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:49.054131    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm" event={"ID":"6b51fa8f-a5cb-40cf-966b-4019a4fbb25a","Type":"ContainerDied","Data":"6a04cdd9cc824fa3cf08f05bbede788f94b668e21a2abcd8ca53ba65c79b9f35"}
Sep 11 14:56:49.054195 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:49.054161    2582 scope.go:117] "RemoveContainer" containerID="c094de50b16fc8fe12a0522b785336ca46e811efc80b56f67cad2d88253e0834"
Sep 11 14:56:49.067302 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:49.067282    2582 scope.go:117] "RemoveContainer" containerID="c094de50b16fc8fe12a0522b785336ca46e811efc80b56f67cad2d88253e0834"
Sep 11 14:56:49.067653 ip-10-0-142-0 kubenswrapper[2582]: E0911 14:56:49.067629    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c094de50b16fc8fe12a0522b785336ca46e811efc80b56f67cad2d88253e0834\": container with ID starting with c094de50b16fc8fe12a0522b785336ca46e811efc80b56f67cad2d88253e0834 not found: ID does not exist" containerID="c094de50b16fc8fe12a0522b785336ca46e811efc80b56f67cad2d88253e0834"
Sep 11 14:56:49.067712 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:49.067666    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c094de50b16fc8fe12a0522b785336ca46e811efc80b56f67cad2d88253e0834"} err="failed to get container status \"c094de50b16fc8fe12a0522b785336ca46e811efc80b56f67cad2d88253e0834\": rpc error: code = NotFound desc = could not find container \"c094de50b16fc8fe12a0522b785336ca46e811efc80b56f67cad2d88253e0834\": container with ID starting with c094de50b16fc8fe12a0522b785336ca46e811efc80b56f67cad2d88253e0834 not found: ID does not exist"
Sep 11 14:56:49.088300 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:49.088276    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"]
Sep 11 14:56:49.090905 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:49.090882    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c5d78f8bc-2hghm"]
Sep 11 14:56:49.494639 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:56:49.494611    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b51fa8f-a5cb-40cf-966b-4019a4fbb25a" path="/var/lib/kubelet/pods/6b51fa8f-a5cb-40cf-966b-4019a4fbb25a/volumes"
Sep 11 14:57:06.765760 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:06.765727    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-kr722_3c843a96-0ede-4158-943c-e9765b06ee4e/manager/0.log"
Sep 11 14:57:07.060985 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:07.060908    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7969dc79c9-g448m_7cc6e01e-6a55-4d69-8652-70a5e8726e22/manager/0.log"
Sep 11 14:57:07.187227 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:07.187194    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sslsg_3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c/server/0.log"
Sep 11 14:57:07.741016 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:07.740982    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7f488b8-mrt8n_365badc1-00dc-40fd-9a59-38907dfa6bb6/copy-manifests/0.log"
Sep 11 14:57:07.756837 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:07.756810    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7f488b8-mrt8n_365badc1-00dc-40fd-9a59-38907dfa6bb6/manager/0.log"
Sep 11 14:57:08.096871 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:08.096787    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-75779b999f-9wzbf_c3f08973-9102-49e7-9fb2-437a3e7df184/maas-api/0.log"
Sep 11 14:57:08.460390 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:08.460340    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-5kk6b_55602491-99e2-4057-bedf-cec7306c3809/postgres/0.log"
Sep 11 14:57:09.365858 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:09.365822    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bs2sx_301af0e9-5555-4cd7-b985-ae43c9d55b66/manager/0.log"
Sep 11 14:57:10.466205 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:10.466167    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gfwb8_3fce6c10-6e63-4aa9-a298-2c771678c36b/discovery/0.log"
Sep 11 14:57:10.687693 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:10.687662    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769cf48dc6-ndchf_8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4/kube-auth-proxy/0.log"
Sep 11 14:57:10.934491 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:10.934464    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-vfbj4_77489681-9840-475f-82ae-36d5b3df39c1/payload-pre-processing/0.log"
Sep 11 14:57:11.171501 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:11.171465    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79849455f8-6sjnq_6b373715-10c6-4794-8be8-cf3ece87f800/router/0.log"
Sep 11 14:57:11.498579 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:11.498549    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-ldm4c_103c1a68-2cea-4d52-ad85-76c0c389bf94/main/0.log"
Sep 11 14:57:11.745865 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:11.745830    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-mtwpv_659c3cec-75bb-4b1b-a350-fcafcea085ff/main/0.log"
Sep 11 14:57:11.990076 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:11.990018    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdjn7b_39334dba-f6c8-408c-b982-658015c144eb/main/0.log"
Sep 11 14:57:20.925023 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:20.924989    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-htlrd_a61a2aa3-3169-4b47-8bd8-3567df82ac12/global-pull-secret-syncer/0.log"
Sep 11 14:57:21.138893 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:21.138867    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m6d8t_95a60cea-19ed-4140-8257-87cd771a68cc/konnectivity-agent/0.log"
Sep 11 14:57:21.268787 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:21.268747    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-0.ec2.internal_3051aa755ff5f3c1f618d35112a873c7/haproxy/0.log"
Sep 11 14:57:25.785925 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:25.785893    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bs2sx_301af0e9-5555-4cd7-b985-ae43c9d55b66/manager/0.log"
Sep 11 14:57:27.867934 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:27.867896    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-mtdt4_c60380da-d7cf-4c61-8955-ec4bd09a82ff/kube-state-metrics/0.log"
Sep 11 14:57:27.885621 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:27.885564    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-mtdt4_c60380da-d7cf-4c61-8955-ec4bd09a82ff/kube-rbac-proxy-main/0.log"
Sep 11 14:57:27.915086 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:27.915066    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-mtdt4_c60380da-d7cf-4c61-8955-ec4bd09a82ff/kube-rbac-proxy-self/0.log"
Sep 11 14:57:28.017838 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:28.017807    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-r975q_0326bcf1-cd37-438a-ba32-45d073adbeca/monitoring-plugin/0.log"
Sep 11 14:57:28.070613 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:28.070584    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7w292_39354256-f81b-4c10-8854-f3fdb2f75e9f/node-exporter/0.log"
Sep 11 14:57:28.098575 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:28.098550    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7w292_39354256-f81b-4c10-8854-f3fdb2f75e9f/kube-rbac-proxy/0.log"
Sep 11 14:57:28.125172 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:28.125103    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7w292_39354256-f81b-4c10-8854-f3fdb2f75e9f/init-textfile/0.log"
Sep 11 14:57:28.870937 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:28.870903    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-7c9km_99e2a7be-a4db-4116-a2ba-8528b54a0a4b/prometheus-operator/0.log"
Sep 11 14:57:28.893480 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:28.893458    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-7c9km_99e2a7be-a4db-4116-a2ba-8528b54a0a4b/kube-rbac-proxy/0.log"
Sep 11 14:57:29.062215 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:29.062186    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d49ddb4b7-p7nqk_2a8b5c05-2111-49ce-9abb-a5cbb70e604c/thanos-query/0.log"
Sep 11 14:57:29.083218 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:29.083193    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d49ddb4b7-p7nqk_2a8b5c05-2111-49ce-9abb-a5cbb70e604c/kube-rbac-proxy-web/0.log"
Sep 11 14:57:29.109817 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:29.109794    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d49ddb4b7-p7nqk_2a8b5c05-2111-49ce-9abb-a5cbb70e604c/kube-rbac-proxy/0.log"
Sep 11 14:57:29.135843 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:29.135764    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d49ddb4b7-p7nqk_2a8b5c05-2111-49ce-9abb-a5cbb70e604c/prom-label-proxy/0.log"
Sep 11 14:57:29.164630 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:29.164604    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d49ddb4b7-p7nqk_2a8b5c05-2111-49ce-9abb-a5cbb70e604c/kube-rbac-proxy-rules/0.log"
Sep 11 14:57:29.201173 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:29.201149    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d49ddb4b7-p7nqk_2a8b5c05-2111-49ce-9abb-a5cbb70e604c/kube-rbac-proxy-metrics/0.log"
Sep 11 14:57:31.034240 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.034201    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"]
Sep 11 14:57:31.034813 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.034794    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b51fa8f-a5cb-40cf-966b-4019a4fbb25a" containerName="maas-api"
Sep 11 14:57:31.034872 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.034816    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b51fa8f-a5cb-40cf-966b-4019a4fbb25a" containerName="maas-api"
Sep 11 14:57:31.035135 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.034883    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b51fa8f-a5cb-40cf-966b-4019a4fbb25a" containerName="maas-api"
Sep 11 14:57:31.038218 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.038199    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.040403 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.040382    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4bt5c\"/\"default-dockercfg-2wjmk\""
Sep 11 14:57:31.041179 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.041157    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4bt5c\"/\"kube-root-ca.crt\""
Sep 11 14:57:31.041305 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.041220    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4bt5c\"/\"openshift-service-ca.crt\""
Sep 11 14:57:31.047961 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.047942    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"]
Sep 11 14:57:31.078741 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.078708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxtxc\" (UniqueName: \"kubernetes.io/projected/a3faafef-c99a-4330-8524-f80029fa1827-kube-api-access-lxtxc\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.078903 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.078779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a3faafef-c99a-4330-8524-f80029fa1827-podres\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.078903 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.078833    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3faafef-c99a-4330-8524-f80029fa1827-sys\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.078903 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.078888    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3faafef-c99a-4330-8524-f80029fa1827-lib-modules\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.079058 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.078966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a3faafef-c99a-4330-8524-f80029fa1827-proc\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.179564 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.179535    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3faafef-c99a-4330-8524-f80029fa1827-sys\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.179765 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.179601    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3faafef-c99a-4330-8524-f80029fa1827-lib-modules\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.179765 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.179663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a3faafef-c99a-4330-8524-f80029fa1827-proc\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.179765 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.179675    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3faafef-c99a-4330-8524-f80029fa1827-sys\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.179765 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.179694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxtxc\" (UniqueName: \"kubernetes.io/projected/a3faafef-c99a-4330-8524-f80029fa1827-kube-api-access-lxtxc\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.179765 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.179754    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a3faafef-c99a-4330-8524-f80029fa1827-proc\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.180027 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.179774    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a3faafef-c99a-4330-8524-f80029fa1827-podres\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.180027 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.179786    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3faafef-c99a-4330-8524-f80029fa1827-lib-modules\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.180027 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.179893    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a3faafef-c99a-4330-8524-f80029fa1827-podres\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.188235 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.188212    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxtxc\" (UniqueName: \"kubernetes.io/projected/a3faafef-c99a-4330-8524-f80029fa1827-kube-api-access-lxtxc\") pod \"perf-node-gather-daemonset-slbdw\" (UID: \"a3faafef-c99a-4330-8524-f80029fa1827\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.350255 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.350171    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:31.625111 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.625080    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"]
Sep 11 14:57:31.625977 ip-10-0-142-0 kubenswrapper[2582]: W0911 14:57:31.625953    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda3faafef_c99a_4330_8524_f80029fa1827.slice/crio-776a05fcbe802b880115625ce8d54eff99c564da5a177dd0c4ff7da29922a71c WatchSource:0}: Error finding container 776a05fcbe802b880115625ce8d54eff99c564da5a177dd0c4ff7da29922a71c: Status 404 returned error can't find the container with id 776a05fcbe802b880115625ce8d54eff99c564da5a177dd0c4ff7da29922a71c
Sep 11 14:57:31.741875 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.741847    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d476d9664-sprnp_8a84ccf7-db7b-4966-af3d-10b5a9f27505/console/0.log"
Sep 11 14:57:31.790916 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:31.790884    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-xxptg_d14622a5-67e8-41a3-97a8-c933173005a0/download-server/0.log"
Sep 11 14:57:32.296169 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:32.296136    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw" event={"ID":"a3faafef-c99a-4330-8524-f80029fa1827","Type":"ContainerStarted","Data":"e7a725f266aef704e03bb847c0bce5163d6ef26f1d7fc40a8092efa869ffa7a1"}
Sep 11 14:57:32.296612 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:32.296195    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw" event={"ID":"a3faafef-c99a-4330-8524-f80029fa1827","Type":"ContainerStarted","Data":"776a05fcbe802b880115625ce8d54eff99c564da5a177dd0c4ff7da29922a71c"}
Sep 11 14:57:32.296612 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:32.296278    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:32.317811 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:32.317767    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw" podStartSLOduration=1.317750894 podStartE2EDuration="1.317750894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:57:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:57:32.314895652 +0000 UTC m=+2549.347330513" watchObservedRunningTime="2026-09-11 14:57:32.317750894 +0000 UTC m=+2549.350185754"
Sep 11 14:57:33.654463 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:33.654432    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ck8m8_389be6eb-2f59-42ef-82cb-d0f800ae1748/dns/0.log"
Sep 11 14:57:33.680440 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:33.680391    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ck8m8_389be6eb-2f59-42ef-82cb-d0f800ae1748/kube-rbac-proxy/0.log"
Sep 11 14:57:33.802247 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:33.802213    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l67jz_2459af77-ccb7-4ff6-819c-d1ac79618d37/dns-node-resolver/0.log"
Sep 11 14:57:34.459118 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:34.459089    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-666878b48d-l969n_a0679e92-a5a4-498e-8f8d-f77e13739e4b/registry/0.log"
Sep 11 14:57:34.544719 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:34.544690    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pbmvf_8302613f-a418-483e-8ce5-59b148aef907/node-ca/0.log"
Sep 11 14:57:36.159939 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:36.159889    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gfwb8_3fce6c10-6e63-4aa9-a298-2c771678c36b/discovery/0.log"
Sep 11 14:57:36.324818 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:36.324773    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769cf48dc6-ndchf_8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4/kube-auth-proxy/0.log"
Sep 11 14:57:36.459246 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:36.459215    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-vfbj4_77489681-9840-475f-82ae-36d5b3df39c1/payload-pre-processing/0.log"
Sep 11 14:57:36.606888 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:36.606860    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79849455f8-6sjnq_6b373715-10c6-4794-8be8-cf3ece87f800/router/0.log"
Sep 11 14:57:37.664656 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:37.664610    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n8q7k_71972c3b-22f5-4cd1-8e47-bbfb9c0e0308/serve-healthcheck-canary/0.log"
Sep 11 14:57:38.250004 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:38.249970    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-pjw5x_6d2c7403-c974-4e6d-b59c-3f59341c8b77/insights-operator/0.log"
Sep 11 14:57:38.251164 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:38.251144    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-pjw5x_6d2c7403-c974-4e6d-b59c-3f59341c8b77/insights-operator/1.log"
Sep 11 14:57:38.312019 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:38.311994    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-slbdw"
Sep 11 14:57:38.446404 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:38.446378    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p2dsk_5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd/kube-rbac-proxy/0.log"
Sep 11 14:57:38.500093 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:38.499982    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p2dsk_5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd/exporter/0.log"
Sep 11 14:57:38.540583 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:38.540560    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p2dsk_5c54c5f7-c93a-4b2d-abfd-8abbfd8163fd/extractor/0.log"
Sep 11 14:57:41.488351 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:41.488325    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-kr722_3c843a96-0ede-4158-943c-e9765b06ee4e/manager/0.log"
Sep 11 14:57:41.933768 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:41.933733    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7969dc79c9-g448m_7cc6e01e-6a55-4d69-8652-70a5e8726e22/manager/0.log"
Sep 11 14:57:42.174372 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:42.174343    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sslsg_3bbcbbb6-5f44-4b0d-9a0a-dc45f814659c/server/0.log"
Sep 11 14:57:42.244861 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:42.244781    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gfwb8_3fce6c10-6e63-4aa9-a298-2c771678c36b/discovery/0.log"
Sep 11 14:57:42.588770 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:42.588671    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769cf48dc6-ndchf_8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4/kube-auth-proxy/0.log"
Sep 11 14:57:42.740297 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:42.740262    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-vfbj4_77489681-9840-475f-82ae-36d5b3df39c1/payload-pre-processing/0.log"
Sep 11 14:57:42.821085 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:42.821025    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79849455f8-6sjnq_6b373715-10c6-4794-8be8-cf3ece87f800/router/0.log"
Sep 11 14:57:42.983275 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:42.983244    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7f488b8-mrt8n_365badc1-00dc-40fd-9a59-38907dfa6bb6/manager/0.log"
Sep 11 14:57:43.011102 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:43.011079    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7f488b8-mrt8n_365badc1-00dc-40fd-9a59-38907dfa6bb6/copy-manifests/0.log"
Sep 11 14:57:44.318705 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:44.318677    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-jtsjv_b30d512c-6ddc-4936-8eec-2a0f82f3b8e5/openshift-lws-operator/0.log"
Sep 11 14:57:44.859576 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:44.859544    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gfwb8_3fce6c10-6e63-4aa9-a298-2c771678c36b/discovery/0.log"
Sep 11 14:57:44.992523 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:44.992490    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769cf48dc6-ndchf_8d5504fd-ee0f-4e51-a98b-d5847d5a7cf4/kube-auth-proxy/0.log"
Sep 11 14:57:45.102254 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:45.102217    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-vfbj4_77489681-9840-475f-82ae-36d5b3df39c1/payload-pre-processing/0.log"
Sep 11 14:57:45.181509 ip-10-0-142-0 kubenswrapper[2582]: I0911 14:57:45.181479    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79849455f8-6sjnq_6b373715-10c6-4794-8be8-cf3ece87f800/router/0.log"