Jun 11 16:16:51.275863 ip-10-0-128-162 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 16:16:51.275875 ip-10-0-128-162 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 16:16:51.275883 ip-10-0-128-162 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 16:16:51.276107 ip-10-0-128-162 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 16:17:01.634125 ip-10-0-128-162 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 16:17:01.634140 ip-10-0-128-162 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a7ae3a0b67614f79a5899aa4bec3189f -- Jun 11 16:19:42.532288 ip-10-0-128-162 systemd[1]: Starting Kubernetes Kubelet... Jun 11 16:19:42.954998 ip-10-0-128-162 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:19:42.954998 ip-10-0-128-162 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 16:19:42.954998 ip-10-0-128-162 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:19:42.954998 ip-10-0-128-162 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 16:19:42.954998 ip-10-0-128-162 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:19:42.957611 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.957536 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 16:19:42.962189 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962175 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:42.962189 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962189 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962193 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962198 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962201 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962204 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962207 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962209 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962212 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962215 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962223 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962225 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962228 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962230 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962233 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962237 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962241 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962244 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962247 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962250 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:42.962249 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962253 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962256 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962259 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962262 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962265 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962269 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962272 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962275 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962277 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962280 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962283 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962285 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962288 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962290 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962293 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962295 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962298 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962301 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962303 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:42.962691 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962306 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962308 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962311 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962314 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962317 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962319 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962322 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962326 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962328 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962331 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962333 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962336 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962338 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962341 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962343 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962346 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962349 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962351 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962354 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:42.963515 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962357 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962361 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962363 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962366 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962368 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962371 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962374 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962376 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962378 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962381 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962383 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962387 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962390 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962392 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962395 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962398 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962401 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962404 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962407 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962409 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:42.964000 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962412 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962414 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962417 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962419 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962422 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962424 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962427 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962429 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962432 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962435 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962438 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962440 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962443 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962445 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962448 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962450 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962452 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962455 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962458 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962460 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:42.964511 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.962462 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964580 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964590 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964594 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964598 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964602 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964605 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964608 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964610 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964613 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964616 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964619 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964622 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964624 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964627 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964630 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964632 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964635 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964637 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964640 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:42.964990 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964642 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964645 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964647 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964650 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964652 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964655 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964657 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964670 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964677 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964680 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964683 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964685 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964688 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964690 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964694 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964697 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964700 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964702 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964705 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:42.965529 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964709 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964713 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964716 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964719 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964721 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964724 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964727 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964729 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964732 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964734 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964737 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964739 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964742 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964746 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964749 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964752 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964755 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964758 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964761 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964764 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:42.966006 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964767 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964769 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964772 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964775 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964777 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964780 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964783 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964788 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964790 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964793 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964795 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964798 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964801 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964803 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964806 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964808 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964811 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964814 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964816 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964819 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:42.966520 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964821 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964824 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964826 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964829 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964831 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964834 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964837 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964839 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964842 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964844 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964848 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964851 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964853 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964856 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964858 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964861 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964863 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964866 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964870 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964874 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:42.966996 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.964877 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965277 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965284 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965288 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965291 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965293 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965296 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965298 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965301 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965304 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965306 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965309 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965311 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965314 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965317 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965319 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965323 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965327 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965330 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:42.967498 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965333 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965336 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965339 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965342 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965344 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965347 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965349 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965352 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965355 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965357 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965360 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965363 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965368 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965370 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965373 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965376 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965379 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965381 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965384 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965386 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:42.967948 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965389 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965391 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965394 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965396 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965399 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965401 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965404 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965406 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965409 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965411 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965414 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965417 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965419 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965422 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965424 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965427 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965430 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965432 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965435 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965437 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:42.968452 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965440 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965442 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965444 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965447 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965451 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965454 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965457 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965459 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965461 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965464 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965467 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965469 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965471 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965474 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965476 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965479 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965481 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965484 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965486 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965489 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:42.968953 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965491 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965495 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965497 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965501 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965505 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965508 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965511 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965514 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965517 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965519 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965522 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965525 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965527 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965530 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965533 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965536 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965540 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965543 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965545 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:42.969444 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965548 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.965550 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965628 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965637 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965647 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965653 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965659 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965663 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965670 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965674 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965677 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965680 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965683 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965687 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965690 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965693 2576 flags.go:64] FLAG: --cgroup-root="" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965696 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965699 2576 flags.go:64] FLAG: --client-ca-file="" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965703 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965706 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965709 2576 flags.go:64] FLAG: --cluster-domain="" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965712 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965715 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965718 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 16:19:42.969909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965722 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965725 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965728 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965731 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965734 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965738 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965741 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965743 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965747 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965749 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965754 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965756 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965759 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965762 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965765 2576 flags.go:64] FLAG: --enable-server="true" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965767 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965772 2576 flags.go:64] FLAG: --event-burst="100" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965775 2576 flags.go:64] FLAG: --event-qps="50" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965778 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965781 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965784 2576 flags.go:64] FLAG: --eviction-hard="" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965787 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965790 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965793 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965796 2576 flags.go:64] FLAG: --eviction-soft="" Jun 11 16:19:42.970505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965799 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965802 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965805 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965808 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965811 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965814 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965817 2576 flags.go:64] FLAG: --feature-gates="" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965820 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965823 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965826 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965829 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965832 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965835 2576 flags.go:64] FLAG: --help="false" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965838 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-162.ec2.internal" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965841 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965844 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965847 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965850 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965853 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965856 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965859 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965862 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965865 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 16:19:42.971131 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965868 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965871 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965873 2576 flags.go:64] FLAG: --kube-reserved="" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965876 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965879 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965882 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965885 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965887 2576 flags.go:64] FLAG: --lock-file="" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965890 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965893 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965896 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965901 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965904 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965907 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965910 2576 flags.go:64] FLAG: --logging-format="text" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965913 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965916 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965919 2576 flags.go:64] FLAG: --manifest-url="" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965921 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965925 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965928 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965932 2576 flags.go:64] FLAG: --max-pods="110" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965935 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965938 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965941 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 16:19:42.971726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965943 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965946 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965949 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965952 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965966 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965969 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965972 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965975 2576 flags.go:64] FLAG: --pod-cidr="" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965978 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965983 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965986 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965989 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965992 2576 flags.go:64] FLAG: --port="10250" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965995 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.965997 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02616f2c5c6cdf967" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966001 2576 flags.go:64] FLAG: --qos-reserved="" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966003 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966008 2576 flags.go:64] FLAG: --register-node="true" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966024 2576 flags.go:64] FLAG: --register-with-taints="" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966028 2576 flags.go:64] FLAG: --registry-burst="10" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966031 2576 flags.go:64] FLAG: --registry-qps="5" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966035 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966037 2576 flags.go:64] FLAG: --reserved-memory="" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966041 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966044 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 16:19:42.972364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966047 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966049 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966052 2576 flags.go:64] FLAG: --runonce="false" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966055 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966058 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966061 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966063 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966066 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966069 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966072 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966075 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966077 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966080 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966083 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966086 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966089 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966092 2576 flags.go:64] FLAG: --system-cgroups="" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966094 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966099 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966102 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966105 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966108 2576 flags.go:64] FLAG: --tls-min-version="" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966113 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966116 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966120 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 16:19:42.973056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966123 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966126 2576 flags.go:64] FLAG: --v="2" Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966129 2576 flags.go:64] FLAG: --version="false" Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966134 2576 flags.go:64] FLAG: --vmodule="" Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966137 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.966141 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966266 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966270 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966273 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966276 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966278 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966281 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966284 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966287 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966290 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966294 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966298 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966301 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966304 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966306 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966309 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:42.973666 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966312 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966314 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966318 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966321 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966324 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966327 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966330 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966333 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966337 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966339 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966343 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966346 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966348 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966351 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966354 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966357 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966359 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966362 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966365 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966367 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:42.974265 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966370 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966373 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966375 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966378 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966380 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966384 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966387 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966390 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966393 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966396 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966399 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966402 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966405 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966407 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966410 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966412 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966415 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966417 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966420 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:42.974753 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966422 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966426 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966429 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966433 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966436 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966438 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966441 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966443 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966446 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966449 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966451 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966454 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966457 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966459 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966462 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966464 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966467 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966470 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966472 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966475 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:42.975237 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966477 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966480 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966482 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966485 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966487 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966490 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966492 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966495 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966498 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966500 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966503 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966506 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966508 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966513 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966515 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966522 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966524 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966527 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966530 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966533 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:42.975727 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966536 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966538 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966542 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966545 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.966550 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.967731 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.973993 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.974007 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.974044 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.974052 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974104 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974109 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974112 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974115 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974118 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:42.976229 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974121 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974126 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974129 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974132 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974135 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974138 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974141 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974144 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974147 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974150 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974152 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974155 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974158 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974160 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974162 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974165 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974167 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974170 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974172 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:42.976612 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974175 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974178 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974181 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974184 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974187 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974191 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974194 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974196 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974199 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974201 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974204 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974207 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974209 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974212 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974214 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974217 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974220 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974222 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974225 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:42.977170 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974227 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974230 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974233 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974236 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974238 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974241 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974243 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974246 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974248 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974251 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974253 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974256 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974258 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974261 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974263 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974266 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974269 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974272 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974275 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974278 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:42.977629 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974281 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974284 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974287 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974290 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974292 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974295 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974298 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974300 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974303 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974305 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974308 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974310 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974313 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974315 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974318 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974320 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974323 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974325 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974328 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:42.978149 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974331 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974333 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974336 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974338 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974341 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974343 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974346 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974348 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974351 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974354 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974357 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974362 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974365 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974369 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974372 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974375 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:42.978600 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974377 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.974383 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974487 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974492 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974494 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974498 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974500 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974503 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974506 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974508 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974511 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974513 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974516 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974518 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974521 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:42.978984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974523 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974526 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974528 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974531 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974533 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974536 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974538 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974541 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974543 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974546 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974549 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974551 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974554 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974558 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974561 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974565 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974569 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974572 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974575 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:42.979371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974577 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974580 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974582 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974585 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974587 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974590 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974592 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974595 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974597 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974600 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974602 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974604 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974607 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974609 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974612 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974615 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974617 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974619 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974622 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974624 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:42.979866 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974627 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974629 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974632 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974634 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974637 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974640 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974643 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974645 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974648 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974651 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974653 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974656 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974658 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974661 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974663 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974666 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974668 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974671 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974673 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:42.980374 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974676 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974678 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974681 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974683 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974686 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974688 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974691 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974693 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974696 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974698 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974701 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974703 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974706 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974708 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974710 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974714 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974717 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974721 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974724 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:42.980840 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974727 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:42.981316 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974730 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:42.981316 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974732 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:42.981316 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974735 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:42.981316 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974738 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:42.981316 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974741 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:42.981316 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974743 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:42.981316 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974746 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:42.981316 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:42.974748 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:42.981316 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.974753 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:19:42.981316 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.974845 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 16:19:42.981316 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.976841 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 16:19:42.981316 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.978211 2576 server.go:1019] "Starting client certificate rotation" Jun 11 16:19:42.981316 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.978306 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:19:42.981316 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.978335 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:19:42.981661 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.980884 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:19:42.982214 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.982198 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:19:42.991415 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.991401 2576 log.go:25] "Validated CRI v1 runtime API" Jun 11 16:19:42.995367 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.995350 2576 log.go:25] "Validated CRI v1 image API" Jun 11 16:19:42.996167 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:42.996153 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 16:19:43.000363 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.000340 2576 fs.go:135] Filesystem UUIDs: map[2b0f30bd-d840-438e-8e47-441444d89df1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7a4f83cc-cf93-47b4-87d4-8ee93569369c:/dev/nvme0n1p4] Jun 11 16:19:43.000363 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.000358 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 16:19:43.005343 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.005242 2576 manager.go:216] Machine: {Timestamp:2026-06-11 16:19:43.003965721 +0000 UTC m=+0.352073944 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100886 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26f1224ab097a65949e5dec1a9c678 SystemUUID:ec26f122-4ab0-97a6-5949-e5dec1a9c678 BootID:a7ae3a0b-6761-4f79-a589-9aa4bec3189f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:54:10:0a:d3:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:54:10:0a:d3:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:da:4d:b1:85:e6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 16:19:43.005343 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.005338 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 16:19:43.005445 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.005401 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 16:19:43.007547 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.007506 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 16:19:43.007671 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.007551 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 16:19:43.008410 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.008401 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 16:19:43.008444 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.008412 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 16:19:43.008444 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.008419 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:19:43.009111 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.009101 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:19:43.010002 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.009993 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 16:19:43.013102 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.013090 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:19:43.013210 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.013201 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 16:19:43.013258 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.013249 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 11 16:19:43.013291 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.013263 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 16:19:43.013291 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.013273 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 16:19:43.013291 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.013281 2576 kubelet.go:398] "Adding apiserver pod source" Jun 11 16:19:43.013291 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.013289 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 16:19:43.013581 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.013569 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:19:43.013625 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.013586 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:19:43.015942 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.015927 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 16:19:43.016134 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.016118 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:19:43.017254 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.017241 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 16:19:43.017299 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.017270 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 16:19:43.018110 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.018098 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 16:19:43.018142 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.018114 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 16:19:43.018142 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.018120 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 16:19:43.018142 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.018126 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 16:19:43.018142 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.018133 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 16:19:43.018142 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.018142 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 16:19:43.018273 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.018256 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 16:19:43.018273 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.018262 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 16:19:43.018273 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.018268 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 16:19:43.018273 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.018273 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 16:19:43.018378 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.018291 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 16:19:43.018378 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.018298 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 16:19:43.019839 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.019828 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 16:19:43.019839 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.019838 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 16:19:43.022672 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.022657 2576 server.go:1268] "Started kubelet" Jun 11 16:19:43.022777 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.022731 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 16:19:43.022834 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.022805 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 16:19:43.022892 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.022762 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 16:19:43.023293 ip-10-0-128-162 systemd[1]: Started Kubernetes Kubelet. Jun 11 16:19:43.024588 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.024571 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 16:19:43.025190 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.025176 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 11 16:19:43.029358 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.029341 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 16:19:43.030229 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.030209 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 16:19:43.030229 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.030217 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 16:19:43.030370 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.030321 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-162.ec2.internal\" not found" Jun 11 16:19:43.031089 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.030947 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 16:19:43.031089 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.031083 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 16:19:43.031251 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.031237 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 11 16:19:43.031307 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.031253 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 11 16:19:43.031307 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.031240 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 16:19:43.031538 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.031516 2576 factory.go:55] Registering systemd factory Jun 11 16:19:43.031602 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.031559 2576 factory.go:223] Registration of the systemd container factory successfully Jun 11 16:19:43.031981 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.031956 2576 factory.go:153] Registering CRI-O factory Jun 11 16:19:43.032064 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.031991 2576 factory.go:223] Registration of the crio container factory successfully Jun 11 16:19:43.032111 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.032080 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 16:19:43.032166 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.032110 2576 factory.go:103] Registering Raw factory Jun 11 16:19:43.032166 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.032134 2576 manager.go:1196] Started watching for new ooms in manager Jun 11 16:19:43.032559 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.032542 2576 manager.go:349] Starting recovery of all containers Jun 11 16:19:43.043498 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.043400 2576 manager.go:354] Recovery completed Jun 11 16:19:43.043657 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.043640 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 16:19:43.043847 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.043826 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 16:19:43.044907 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.044887 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 16:19:43.045390 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.045372 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 16:19:43.045884 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.045866 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 16:19:43.046904 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.045430 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-162.ec2.internal.18b81337cdd7ca27 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-162.ec2.internal,UID:ip-10-0-128-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-162.ec2.internal,},FirstTimestamp:2026-06-11 16:19:43.022631463 +0000 UTC m=+0.370739685,LastTimestamp:2026-06-11 16:19:43.022631463 +0000 UTC m=+0.370739685,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-162.ec2.internal,}" Jun 11 16:19:43.047720 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.047704 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:43.049543 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.049525 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:43.049618 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.049552 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:43.049618 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.049562 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:43.050083 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.050066 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 16:19:43.050083 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.050079 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:43.050234 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.050082 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 16:19:43.050234 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.050149 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:19:43.051253 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.051235 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:43.051327 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.051270 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:43.051327 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.051285 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:43.051404 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.051392 2576 policy_none.go:49] "None policy: Start" Jun 11 16:19:43.051439 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.051410 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 16:19:43.051439 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.051420 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 16:19:43.051782 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.051720 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-162.ec2.internal.18b81337cf726275 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-162.ec2.internal,UID:ip-10-0-128-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-162.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-162.ec2.internal,},FirstTimestamp:2026-06-11 16:19:43.049540213 +0000 UTC m=+0.397648435,LastTimestamp:2026-06-11 16:19:43.049540213 +0000 UTC m=+0.397648435,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-162.ec2.internal,}" Jun 11 16:19:43.052441 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.052429 2576 policy_none.go:47] "Start" Jun 11 16:19:43.068985 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.068912 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-162.ec2.internal.18b81337cf72a30e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-162.ec2.internal,UID:ip-10-0-128-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-162.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-162.ec2.internal,},FirstTimestamp:2026-06-11 16:19:43.04955675 +0000 UTC m=+0.397664972,LastTimestamp:2026-06-11 16:19:43.04955675 +0000 UTC m=+0.397664972,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-162.ec2.internal,}" Jun 11 16:19:43.076965 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.076896 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-162.ec2.internal.18b81337cf72c66e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-162.ec2.internal,UID:ip-10-0-128-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-162.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-162.ec2.internal,},FirstTimestamp:2026-06-11 16:19:43.049565806 +0000 UTC m=+0.397674027,LastTimestamp:2026-06-11 16:19:43.049565806 +0000 UTC m=+0.397674027,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-162.ec2.internal,}" Jun 11 16:19:43.093130 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.092326 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-162.ec2.internal.18b81337cf726275\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-162.ec2.internal.18b81337cf726275 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-162.ec2.internal,UID:ip-10-0-128-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-162.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-162.ec2.internal,},FirstTimestamp:2026-06-11 16:19:43.049540213 +0000 UTC m=+0.397648435,LastTimestamp:2026-06-11 16:19:43.051252605 +0000 UTC m=+0.399360828,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-162.ec2.internal,}" Jun 11 16:19:43.093130 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.092796 2576 manager.go:337] "Starting Device Plugin manager" Jun 11 16:19:43.093130 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.092826 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 16:19:43.093130 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.092839 2576 server.go:87] "Starting device plugin registration server" Jun 11 16:19:43.093130 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.093089 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 16:19:43.093130 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.093102 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 16:19:43.093443 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.093177 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 16:19:43.093443 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.093247 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 16:19:43.093443 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.093255 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 16:19:43.093792 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.093773 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 16:19:43.093850 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.093829 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-162.ec2.internal\" not found" Jun 11 16:19:43.094284 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.094258 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 16:19:43.095424 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.095403 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 16:19:43.095515 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.095444 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 16:19:43.095515 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.095466 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 16:19:43.095515 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.095505 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 16:19:43.110686 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.110662 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 11 16:19:43.110776 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.110723 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-162.ec2.internal.18b81337cf72a30e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-162.ec2.internal.18b81337cf72a30e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-162.ec2.internal,UID:ip-10-0-128-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-162.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-162.ec2.internal,},FirstTimestamp:2026-06-11 16:19:43.04955675 +0000 UTC m=+0.397664972,LastTimestamp:2026-06-11 16:19:43.051277302 +0000 UTC m=+0.399385525,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-162.ec2.internal,}" Jun 11 16:19:43.118369 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.118355 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n8k2h" Jun 11 16:19:43.124961 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.124904 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-162.ec2.internal.18b81337cf72c66e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-162.ec2.internal.18b81337cf72c66e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-162.ec2.internal,UID:ip-10-0-128-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-162.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-162.ec2.internal,},FirstTimestamp:2026-06-11 16:19:43.049565806 +0000 UTC m=+0.397674027,LastTimestamp:2026-06-11 16:19:43.051291598 +0000 UTC m=+0.399399824,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-162.ec2.internal,}" Jun 11 16:19:43.131108 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.131093 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n8k2h" Jun 11 16:19:43.193801 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.193784 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:43.194571 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.194557 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:43.194652 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.194582 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:43.194652 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.194593 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:43.194652 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.194611 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.195654 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.195632 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-162.ec2.internal"] Jun 11 16:19:43.195734 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.195689 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:43.196900 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.196886 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:43.196978 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.196911 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:43.196978 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.196925 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:43.198064 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.198052 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:43.198192 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.198179 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.198227 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.198203 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:43.198694 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.198682 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:43.198758 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.198706 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:43.198758 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.198718 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:43.199979 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.199963 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:43.200057 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.199990 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:43.200057 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.200002 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:43.201171 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.201158 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.201214 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.201180 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:43.201852 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.201837 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:43.201912 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.201863 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:43.201912 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.201876 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:43.208606 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.208556 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.208606 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.208581 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-162.ec2.internal\": node \"ip-10-0-128-162.ec2.internal\" not found" Jun 11 16:19:43.221661 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.221639 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-162.ec2.internal\" not found" node="ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.225877 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.225860 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-162.ec2.internal\" not found" node="ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.255989 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.255970 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-162.ec2.internal\" not found" Jun 11 16:19:43.332887 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.332866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/faf94c3b3d7eec40bb37dc3aa123851a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal\" (UID: \"faf94c3b3d7eec40bb37dc3aa123851a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.332953 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.332890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/faf94c3b3d7eec40bb37dc3aa123851a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal\" (UID: \"faf94c3b3d7eec40bb37dc3aa123851a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.332953 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.332908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6cb48f7aa513b56b107622689ce0f5ee-config\") pod \"kube-apiserver-proxy-ip-10-0-128-162.ec2.internal\" (UID: \"6cb48f7aa513b56b107622689ce0f5ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.356341 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.356327 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-162.ec2.internal\" not found" Jun 11 16:19:43.433162 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.433145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/faf94c3b3d7eec40bb37dc3aa123851a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal\" (UID: \"faf94c3b3d7eec40bb37dc3aa123851a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.433228 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.433170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/faf94c3b3d7eec40bb37dc3aa123851a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal\" (UID: \"faf94c3b3d7eec40bb37dc3aa123851a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.433228 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.433187 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6cb48f7aa513b56b107622689ce0f5ee-config\") pod \"kube-apiserver-proxy-ip-10-0-128-162.ec2.internal\" (UID: \"6cb48f7aa513b56b107622689ce0f5ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.433290 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.433227 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6cb48f7aa513b56b107622689ce0f5ee-config\") pod \"kube-apiserver-proxy-ip-10-0-128-162.ec2.internal\" (UID: \"6cb48f7aa513b56b107622689ce0f5ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.433290 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.433252 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/faf94c3b3d7eec40bb37dc3aa123851a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal\" (UID: \"faf94c3b3d7eec40bb37dc3aa123851a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.433290 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.433255 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/faf94c3b3d7eec40bb37dc3aa123851a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal\" (UID: \"faf94c3b3d7eec40bb37dc3aa123851a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.456972 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.456956 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-162.ec2.internal\" not found" Jun 11 16:19:43.526135 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.526080 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.530448 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.530424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-162.ec2.internal" Jun 11 16:19:43.557566 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.557540 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-162.ec2.internal\" not found" Jun 11 16:19:43.658098 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.658076 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-162.ec2.internal\" not found" Jun 11 16:19:43.758633 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.758610 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-162.ec2.internal\" not found" Jun 11 16:19:43.859160 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.859109 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-162.ec2.internal\" not found" Jun 11 16:19:43.959626 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:43.959598 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-162.ec2.internal\" not found" Jun 11 16:19:43.977756 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.977733 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 16:19:43.992157 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:43.992128 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf94c3b3d7eec40bb37dc3aa123851a.slice/crio-b5ce5f3a3a8d077ed73c811ae2fef32331275c61530605ac209f34fbf5ae65b3 WatchSource:0}: Error finding container b5ce5f3a3a8d077ed73c811ae2fef32331275c61530605ac209f34fbf5ae65b3: Status 404 returned error can't find the container with id b5ce5f3a3a8d077ed73c811ae2fef32331275c61530605ac209f34fbf5ae65b3 Jun 11 16:19:43.992437 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:43.992422 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb48f7aa513b56b107622689ce0f5ee.slice/crio-6fc200af075f4007771d5aa599f17c00fc64d6fa9987f9f63a89dd0fa7c1487f WatchSource:0}: Error finding container 6fc200af075f4007771d5aa599f17c00fc64d6fa9987f9f63a89dd0fa7c1487f: Status 404 returned error can't find the container with id 6fc200af075f4007771d5aa599f17c00fc64d6fa9987f9f63a89dd0fa7c1487f Jun 11 16:19:43.998710 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:43.998693 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:19:44.001299 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.001277 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:44.059701 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:44.059676 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-162.ec2.internal\" not found" Jun 11 16:19:44.099266 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.099222 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-162.ec2.internal" event={"ID":"6cb48f7aa513b56b107622689ce0f5ee","Type":"ContainerStarted","Data":"6fc200af075f4007771d5aa599f17c00fc64d6fa9987f9f63a89dd0fa7c1487f"} Jun 11 16:19:44.100289 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.100271 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal" event={"ID":"faf94c3b3d7eec40bb37dc3aa123851a","Type":"ContainerStarted","Data":"b5ce5f3a3a8d077ed73c811ae2fef32331275c61530605ac209f34fbf5ae65b3"} Jun 11 16:19:44.110520 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.110475 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:44.111343 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.111329 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:44.111411 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.111355 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:44.111411 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.111366 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:44.133817 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.133789 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 16:14:43 +0000 UTC" deadline="2028-02-06 13:21:54.60538009 +0000 UTC" Jun 11 16:19:44.133817 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.133814 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14517h2m10.471569283s" Jun 11 16:19:44.144976 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.144955 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:44.230779 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.230744 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal" Jun 11 16:19:44.260440 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.260413 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:19:44.262002 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.261988 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-162.ec2.internal" Jun 11 16:19:44.279354 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.279336 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:19:44.416095 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.416008 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:44.537975 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:44.537941 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:45.014777 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.014754 2576 apiserver.go:52] "Watching apiserver" Jun 11 16:19:45.023807 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.023786 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 16:19:45.024222 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.024202 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-97nhl","kube-system/konnectivity-agent-97sxp","openshift-cluster-node-tuning-operator/tuned-bdm2f","openshift-dns/node-resolver-bjzqb","openshift-image-registry/node-ca-75qf9","openshift-multus/multus-additional-cni-plugins-vjsrv","openshift-multus/multus-wmq2f","openshift-network-diagnostics/network-check-target-fk4d7","kube-system/kube-apiserver-proxy-ip-10-0-128-162.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal","openshift-multus/network-metrics-daemon-9nbg4","openshift-network-operator/iptables-alerter-69cpx","openshift-ovn-kubernetes/ovnkube-node-mf46n"] Jun 11 16:19:45.025541 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.025517 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.026643 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.026626 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-69cpx" Jun 11 16:19:45.027712 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.027696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.028801 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.028707 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bjzqb" Jun 11 16:19:45.030209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.030172 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-75qf9" Jun 11 16:19:45.031242 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.031220 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 16:19:45.033230 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.033181 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 16:19:45.033360 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.033276 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 16:19:45.033360 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.033288 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wrkdn\"" Jun 11 16:19:45.033592 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.033570 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 16:19:45.033705 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.033570 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 16:19:45.033821 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.033798 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.036101 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.035750 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.036682 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.036664 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:19:45.036980 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.036963 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:45.037089 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.037055 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:19:45.038109 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.038091 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-97sxp" Jun 11 16:19:45.039444 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.039429 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.040999 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.040972 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:19:45.041140 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.041061 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:19:45.041719 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.041694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-multus-cni-dir\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.041807 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.041733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-cnibin\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.041807 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.041758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-run-netns\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.041807 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.041784 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncp5g\" (UniqueName: \"kubernetes.io/projected/db0c1e0d-ef22-4054-8329-66ae378c4ce1-kube-api-access-ncp5g\") pod \"node-ca-75qf9\" (UID: \"db0c1e0d-ef22-4054-8329-66ae378c4ce1\") " pod="openshift-image-registry/node-ca-75qf9" Jun 11 16:19:45.041933 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.041811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab9b05d2-18b5-4a07-8cdf-464a3226682b-cni-binary-copy\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.041933 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.041835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f77fef35-d9b6-4219-a2db-22fae96635cb-iptables-alerter-script\") pod \"iptables-alerter-69cpx\" (UID: \"f77fef35-d9b6-4219-a2db-22fae96635cb\") " pod="openshift-network-operator/iptables-alerter-69cpx" Jun 11 16:19:45.041933 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.041859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-sysctl-d\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.041933 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.041904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-sysctl-conf\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.042135 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.041952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-systemd\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.042135 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.041977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32bd93a7-d136-4f72-8d47-b64894403ce6-tmp\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.042135 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.042135 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-var-lib-cni-bin\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.042135 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55xd5\" (UniqueName: \"kubernetes.io/projected/ab9b05d2-18b5-4a07-8cdf-464a3226682b-kube-api-access-55xd5\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.042135 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042085 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-sys\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.042135 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042109 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-var-lib-kubelet\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.042426 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-tuned\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.042426 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-multus-socket-dir-parent\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.042426 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-var-lib-cni-multus\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.042426 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-var-lib-kubelet\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.042426 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042265 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:45.042426 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.042318 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:19:45.042426 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-multus-conf-dir\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.042426 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab9b05d2-18b5-4a07-8cdf-464a3226682b-multus-daemon-config\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.042426 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-588qk\" (UniqueName: \"kubernetes.io/projected/f77fef35-d9b6-4219-a2db-22fae96635cb-kube-api-access-588qk\") pod \"iptables-alerter-69cpx\" (UID: \"f77fef35-d9b6-4219-a2db-22fae96635cb\") " pod="openshift-network-operator/iptables-alerter-69cpx" Jun 11 16:19:45.042426 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-sysconfig\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-cnibin\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042544 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-host\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44w5m\" (UniqueName: \"kubernetes.io/projected/32bd93a7-d136-4f72-8d47-b64894403ce6-kube-api-access-44w5m\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6tcb\" (UniqueName: \"kubernetes.io/projected/afd82990-4b39-4fcb-8f26-39d82a8c9185-kube-api-access-k6tcb\") pod \"node-resolver-bjzqb\" (UID: \"afd82990-4b39-4fcb-8f26-39d82a8c9185\") " pod="openshift-dns/node-resolver-bjzqb" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8dxk\" (UniqueName: \"kubernetes.io/projected/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-kube-api-access-r8dxk\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042723 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-run-multus-certs\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-run\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-lib-modules\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afd82990-4b39-4fcb-8f26-39d82a8c9185-tmp-dir\") pod \"node-resolver-bjzqb\" (UID: \"afd82990-4b39-4fcb-8f26-39d82a8c9185\") " pod="openshift-dns/node-resolver-bjzqb" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-os-release\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-run-k8s-cni-cncf-io\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-hostroot\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-etc-kubernetes\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.042982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f77fef35-d9b6-4219-a2db-22fae96635cb-host-slash\") pod \"iptables-alerter-69cpx\" (UID: \"f77fef35-d9b6-4219-a2db-22fae96635cb\") " pod="openshift-network-operator/iptables-alerter-69cpx" Jun 11 16:19:45.043591 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.042978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-kubernetes\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.043591 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.043028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db0c1e0d-ef22-4054-8329-66ae378c4ce1-serviceca\") pod \"node-ca-75qf9\" (UID: \"db0c1e0d-ef22-4054-8329-66ae378c4ce1\") " pod="openshift-image-registry/node-ca-75qf9" Jun 11 16:19:45.043591 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.043055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-system-cni-dir\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.043591 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.043106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-modprobe-d\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.043591 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.043129 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afd82990-4b39-4fcb-8f26-39d82a8c9185-hosts-file\") pod \"node-resolver-bjzqb\" (UID: \"afd82990-4b39-4fcb-8f26-39d82a8c9185\") " pod="openshift-dns/node-resolver-bjzqb" Jun 11 16:19:45.043591 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.043169 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db0c1e0d-ef22-4054-8329-66ae378c4ce1-host\") pod \"node-ca-75qf9\" (UID: \"db0c1e0d-ef22-4054-8329-66ae378c4ce1\") " pod="openshift-image-registry/node-ca-75qf9" Jun 11 16:19:45.043591 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.043193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-system-cni-dir\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.043591 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.043240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-os-release\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.043591 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.043285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.043591 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.043468 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 16:19:45.045036 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.044999 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 16:19:45.045129 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.045117 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hmqxw\"" Jun 11 16:19:45.045751 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.045732 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 16:19:45.045888 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.045866 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 16:19:45.045961 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.045910 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c68zf\"" Jun 11 16:19:45.046247 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.046230 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 16:19:45.046247 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.046230 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4rkhq\"" Jun 11 16:19:45.046520 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.046502 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 16:19:45.047768 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.047713 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 16:19:45.047768 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.047759 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 16:19:45.049954 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.049765 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 16:19:45.049954 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.049857 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 16:19:45.050145 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.049990 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 16:19:45.050145 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.049990 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 16:19:45.051294 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.051275 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 16:19:45.051382 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.051305 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ctpxw\"" Jun 11 16:19:45.051382 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.051354 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 16:19:45.051481 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.051316 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 16:19:45.051481 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.051436 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 16:19:45.051481 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.051325 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 16:19:45.051654 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.051639 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:19:45.051730 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.051655 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 16:19:45.051730 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.051691 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 16:19:45.051730 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.051700 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 16:19:45.051872 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.051701 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xp7lw\"" Jun 11 16:19:45.051872 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.051748 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2t9t6\"" Jun 11 16:19:45.051951 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.051896 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8dzhv\"" Jun 11 16:19:45.051951 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.051886 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k8w2m\"" Jun 11 16:19:45.052059 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.052052 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 16:19:45.074541 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.074516 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:19:45.108179 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.108156 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ct7fq" Jun 11 16:19:45.123825 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.123804 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ct7fq" Jun 11 16:19:45.132361 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.132346 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 16:19:45.143957 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.143936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-run-multus-certs\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.144059 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.143971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-run\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.144059 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.143992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-lib-modules\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.144059 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-run-ovn\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.144226 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144069 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-run-multus-certs\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.144226 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-cni-netd\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.144226 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-run\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.144226 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144155 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-lib-modules\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.144226 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afd82990-4b39-4fcb-8f26-39d82a8c9185-tmp-dir\") pod \"node-resolver-bjzqb\" (UID: \"afd82990-4b39-4fcb-8f26-39d82a8c9185\") " pod="openshift-dns/node-resolver-bjzqb" Jun 11 16:19:45.144226 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-os-release\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.144511 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-hostroot\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.144511 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f77fef35-d9b6-4219-a2db-22fae96635cb-host-slash\") pod \"iptables-alerter-69cpx\" (UID: \"f77fef35-d9b6-4219-a2db-22fae96635cb\") " pod="openshift-network-operator/iptables-alerter-69cpx" Jun 11 16:19:45.144511 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-kubernetes\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.144511 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct6qv\" (UniqueName: \"kubernetes.io/projected/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-kube-api-access-ct6qv\") pod \"network-metrics-daemon-9nbg4\" (UID: \"419c9be4-5ebc-4f73-83f3-e61cc760f0fa\") " pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:45.144511 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f77fef35-d9b6-4219-a2db-22fae96635cb-host-slash\") pod \"iptables-alerter-69cpx\" (UID: \"f77fef35-d9b6-4219-a2db-22fae96635cb\") " pod="openshift-network-operator/iptables-alerter-69cpx" Jun 11 16:19:45.144511 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144361 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-os-release\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.144511 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd8665d4-17a7-45de-a631-96cd8f57a51d-konnectivity-ca\") pod \"konnectivity-agent-97sxp\" (UID: \"dd8665d4-17a7-45de-a631-96cd8f57a51d\") " pod="kube-system/konnectivity-agent-97sxp" Jun 11 16:19:45.144511 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-socket-dir\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.144511 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db0c1e0d-ef22-4054-8329-66ae378c4ce1-serviceca\") pod \"node-ca-75qf9\" (UID: \"db0c1e0d-ef22-4054-8329-66ae378c4ce1\") " pod="openshift-image-registry/node-ca-75qf9" Jun 11 16:19:45.144511 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-hostroot\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.144511 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144419 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-kubernetes\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.144511 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-system-cni-dir\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g877s\" (UniqueName: \"kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s\") pod \"network-check-target-fk4d7\" (UID: \"b005dffc-32c0-4134-a56c-81f65719baa6\") " pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144553 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-system-cni-dir\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144556 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afd82990-4b39-4fcb-8f26-39d82a8c9185-tmp-dir\") pod \"node-resolver-bjzqb\" (UID: \"afd82990-4b39-4fcb-8f26-39d82a8c9185\") " pod="openshift-dns/node-resolver-bjzqb" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncp5g\" (UniqueName: \"kubernetes.io/projected/db0c1e0d-ef22-4054-8329-66ae378c4ce1-kube-api-access-ncp5g\") pod \"node-ca-75qf9\" (UID: \"db0c1e0d-ef22-4054-8329-66ae378c4ce1\") " pod="openshift-image-registry/node-ca-75qf9" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab9b05d2-18b5-4a07-8cdf-464a3226682b-cni-binary-copy\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f77fef35-d9b6-4219-a2db-22fae96635cb-iptables-alerter-script\") pod \"iptables-alerter-69cpx\" (UID: \"f77fef35-d9b6-4219-a2db-22fae96635cb\") " pod="openshift-network-operator/iptables-alerter-69cpx" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-sysctl-d\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-sysctl-conf\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-log-socket\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55xd5\" (UniqueName: \"kubernetes.io/projected/ab9b05d2-18b5-4a07-8cdf-464a3226682b-kube-api-access-55xd5\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-tuned\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-var-lib-kubelet\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144882 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-multus-conf-dir\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab9b05d2-18b5-4a07-8cdf-464a3226682b-multus-daemon-config\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-588qk\" (UniqueName: \"kubernetes.io/projected/f77fef35-d9b6-4219-a2db-22fae96635cb-kube-api-access-588qk\") pod \"iptables-alerter-69cpx\" (UID: \"f77fef35-d9b6-4219-a2db-22fae96635cb\") " pod="openshift-network-operator/iptables-alerter-69cpx" Jun 11 16:19:45.145079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vntzv\" (UniqueName: \"kubernetes.io/projected/5446b104-cd55-402c-8abc-30a69ce93d99-kube-api-access-vntzv\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs\") pod \"network-metrics-daemon-9nbg4\" (UID: \"419c9be4-5ebc-4f73-83f3-e61cc760f0fa\") " pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.144979 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db0c1e0d-ef22-4054-8329-66ae378c4ce1-serviceca\") pod \"node-ca-75qf9\" (UID: \"db0c1e0d-ef22-4054-8329-66ae378c4ce1\") " pod="openshift-image-registry/node-ca-75qf9" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-var-lib-openvswitch\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6tcb\" (UniqueName: \"kubernetes.io/projected/afd82990-4b39-4fcb-8f26-39d82a8c9185-kube-api-access-k6tcb\") pod \"node-resolver-bjzqb\" (UID: \"afd82990-4b39-4fcb-8f26-39d82a8c9185\") " pod="openshift-dns/node-resolver-bjzqb" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145078 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8dxk\" (UniqueName: \"kubernetes.io/projected/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-kube-api-access-r8dxk\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-run-netns\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-run-systemd\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-cni-bin\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5446b104-cd55-402c-8abc-30a69ce93d99-ovn-node-metrics-cert\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e803ad6b-ecb9-49c8-856f-a83161cd17ba-kubelet-config\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-run-k8s-cni-cncf-io\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-etc-kubernetes\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145225 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-run-openvswitch\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145231 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 16:19:45.145838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqcdl\" (UniqueName: \"kubernetes.io/projected/f873332c-c4d0-4002-9a09-022d2afbb733-kube-api-access-nqcdl\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145272 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-var-lib-kubelet\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145286 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f77fef35-d9b6-4219-a2db-22fae96635cb-iptables-alerter-script\") pod \"iptables-alerter-69cpx\" (UID: \"f77fef35-d9b6-4219-a2db-22fae96635cb\") " pod="openshift-network-operator/iptables-alerter-69cpx" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-modprobe-d\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145315 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-multus-conf-dir\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab9b05d2-18b5-4a07-8cdf-464a3226682b-cni-binary-copy\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-systemd-units\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145403 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-etc-kubernetes\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5446b104-cd55-402c-8abc-30a69ce93d99-env-overrides\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145445 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-modprobe-d\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145454 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-run-k8s-cni-cncf-io\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-device-dir\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afd82990-4b39-4fcb-8f26-39d82a8c9185-hosts-file\") pod \"node-resolver-bjzqb\" (UID: \"afd82990-4b39-4fcb-8f26-39d82a8c9185\") " pod="openshift-dns/node-resolver-bjzqb" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-sysctl-conf\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db0c1e0d-ef22-4054-8329-66ae378c4ce1-host\") pod \"node-ca-75qf9\" (UID: \"db0c1e0d-ef22-4054-8329-66ae378c4ce1\") " pod="openshift-image-registry/node-ca-75qf9" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145583 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-sysctl-d\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.146601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-system-cni-dir\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-os-release\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145716 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db0c1e0d-ef22-4054-8329-66ae378c4ce1-host\") pod \"node-ca-75qf9\" (UID: \"db0c1e0d-ef22-4054-8329-66ae378c4ce1\") " pod="openshift-image-registry/node-ca-75qf9" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-multus-cni-dir\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145783 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-cnibin\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-run-netns\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-os-release\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145901 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab9b05d2-18b5-4a07-8cdf-464a3226682b-multus-daemon-config\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-system-cni-dir\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145951 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145956 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-systemd\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145962 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-multus-cni-dir\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145993 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32bd93a7-d136-4f72-8d47-b64894403ce6-tmp\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145996 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afd82990-4b39-4fcb-8f26-39d82a8c9185-hosts-file\") pod \"node-resolver-bjzqb\" (UID: \"afd82990-4b39-4fcb-8f26-39d82a8c9185\") " pod="openshift-dns/node-resolver-bjzqb" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.145996 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-run-netns\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146040 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-systemd\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.147372 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146057 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-cnibin\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-etc-openvswitch\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146147 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-node-log\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5446b104-cd55-402c-8abc-30a69ce93d99-ovnkube-script-lib\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd8665d4-17a7-45de-a631-96cd8f57a51d-agent-certs\") pod \"konnectivity-agent-97sxp\" (UID: \"dd8665d4-17a7-45de-a631-96cd8f57a51d\") " pod="kube-system/konnectivity-agent-97sxp" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-registration-dir\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-var-lib-cni-bin\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146344 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-var-lib-cni-bin\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-sys\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-var-lib-kubelet\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146430 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e803ad6b-ecb9-49c8-856f-a83161cd17ba-dbus\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-etc-selinux\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146486 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-var-lib-kubelet\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146510 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-sys\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44w5m\" (UniqueName: \"kubernetes.io/projected/32bd93a7-d136-4f72-8d47-b64894403ce6-kube-api-access-44w5m\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.148231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-multus-socket-dir-parent\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-var-lib-cni-multus\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-multus-socket-dir-parent\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146887 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-sysconfig\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146948 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab9b05d2-18b5-4a07-8cdf-464a3226682b-host-var-lib-cni-multus\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.146968 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-sysconfig\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.147029 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-run-ovn-kubernetes\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.147059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5446b104-cd55-402c-8abc-30a69ce93d99-ovnkube-config\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.147087 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.147131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-cnibin\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.147178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-host\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.147203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-kubelet\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.147226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-slash\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.147229 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-cnibin\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.147249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-sys-fs\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.147261 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32bd93a7-d136-4f72-8d47-b64894403ce6-host\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.149007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.148545 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32bd93a7-d136-4f72-8d47-b64894403ce6-etc-tuned\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.149836 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.148585 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32bd93a7-d136-4f72-8d47-b64894403ce6-tmp\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.165655 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.165632 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6tcb\" (UniqueName: \"kubernetes.io/projected/afd82990-4b39-4fcb-8f26-39d82a8c9185-kube-api-access-k6tcb\") pod \"node-resolver-bjzqb\" (UID: \"afd82990-4b39-4fcb-8f26-39d82a8c9185\") " pod="openshift-dns/node-resolver-bjzqb" Jun 11 16:19:45.165760 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.165696 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44w5m\" (UniqueName: \"kubernetes.io/projected/32bd93a7-d136-4f72-8d47-b64894403ce6-kube-api-access-44w5m\") pod \"tuned-bdm2f\" (UID: \"32bd93a7-d136-4f72-8d47-b64894403ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.166698 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.166676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8dxk\" (UniqueName: \"kubernetes.io/projected/f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3-kube-api-access-r8dxk\") pod \"multus-additional-cni-plugins-vjsrv\" (UID: \"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3\") " pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.167645 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.167622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncp5g\" (UniqueName: \"kubernetes.io/projected/db0c1e0d-ef22-4054-8329-66ae378c4ce1-kube-api-access-ncp5g\") pod \"node-ca-75qf9\" (UID: \"db0c1e0d-ef22-4054-8329-66ae378c4ce1\") " pod="openshift-image-registry/node-ca-75qf9" Jun 11 16:19:45.168931 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.168911 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-588qk\" (UniqueName: \"kubernetes.io/projected/f77fef35-d9b6-4219-a2db-22fae96635cb-kube-api-access-588qk\") pod \"iptables-alerter-69cpx\" (UID: \"f77fef35-d9b6-4219-a2db-22fae96635cb\") " pod="openshift-network-operator/iptables-alerter-69cpx" Jun 11 16:19:45.175301 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.175280 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55xd5\" (UniqueName: \"kubernetes.io/projected/ab9b05d2-18b5-4a07-8cdf-464a3226682b-kube-api-access-55xd5\") pod \"multus-wmq2f\" (UID: \"ab9b05d2-18b5-4a07-8cdf-464a3226682b\") " pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.247856 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.247796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-log-socket\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.247856 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.247831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.248056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.247861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vntzv\" (UniqueName: \"kubernetes.io/projected/5446b104-cd55-402c-8abc-30a69ce93d99-kube-api-access-vntzv\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.248056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.247911 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.248056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.247964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs\") pod \"network-metrics-daemon-9nbg4\" (UID: \"419c9be4-5ebc-4f73-83f3-e61cc760f0fa\") " pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:45.248056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.247995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-var-lib-openvswitch\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.248056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-run-netns\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-run-systemd\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248073 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-var-lib-openvswitch\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-cni-bin\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248106 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-run-netns\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.248111 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248124 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-cni-bin\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5446b104-cd55-402c-8abc-30a69ce93d99-ovn-node-metrics-cert\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248148 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-run-systemd\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e803ad6b-ecb9-49c8-856f-a83161cd17ba-kubelet-config\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.248176 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs podName:419c9be4-5ebc-4f73-83f3-e61cc760f0fa nodeName:}" failed. No retries permitted until 2026-06-11 16:19:45.748154894 +0000 UTC m=+3.096263128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs") pod "network-metrics-daemon-9nbg4" (UID: "419c9be4-5ebc-4f73-83f3-e61cc760f0fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248202 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e803ad6b-ecb9-49c8-856f-a83161cd17ba-kubelet-config\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-run-openvswitch\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248262 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqcdl\" (UniqueName: \"kubernetes.io/projected/f873332c-c4d0-4002-9a09-022d2afbb733-kube-api-access-nqcdl\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.248320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-systemd-units\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5446b104-cd55-402c-8abc-30a69ce93d99-env-overrides\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-device-dir\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.248399 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248420 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-systemd-units\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248314 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-run-openvswitch\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.248450 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret podName:e803ad6b-ecb9-49c8-856f-a83161cd17ba nodeName:}" failed. No retries permitted until 2026-06-11 16:19:45.748431778 +0000 UTC m=+3.096539994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret") pod "global-pull-secret-syncer-97nhl" (UID: "e803ad6b-ecb9-49c8-856f-a83161cd17ba") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248452 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-device-dir\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248478 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-etc-openvswitch\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-node-log\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5446b104-cd55-402c-8abc-30a69ce93d99-ovnkube-script-lib\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248539 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-node-log\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd8665d4-17a7-45de-a631-96cd8f57a51d-agent-certs\") pod \"konnectivity-agent-97sxp\" (UID: \"dd8665d4-17a7-45de-a631-96cd8f57a51d\") " pod="kube-system/konnectivity-agent-97sxp" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-registration-dir\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248537 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-etc-openvswitch\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e803ad6b-ecb9-49c8-856f-a83161cd17ba-dbus\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-registration-dir\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.249120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248671 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-etc-selinux\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248704 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-run-ovn-kubernetes\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248726 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5446b104-cd55-402c-8abc-30a69ce93d99-ovnkube-config\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-kubelet\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248797 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e803ad6b-ecb9-49c8-856f-a83161cd17ba-dbus\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-slash\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248839 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-slash\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248889 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-sys-fs\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-etc-selinux\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248933 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248937 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-run-ovn-kubernetes\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5446b104-cd55-402c-8abc-30a69ce93d99-env-overrides\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-sys-fs\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-kubelet\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-run-ovn\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.249005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-run-ovn\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.249871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.249006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-cni-netd\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.250449 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.248003 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-log-socket\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.250449 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.249056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct6qv\" (UniqueName: \"kubernetes.io/projected/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-kube-api-access-ct6qv\") pod \"network-metrics-daemon-9nbg4\" (UID: \"419c9be4-5ebc-4f73-83f3-e61cc760f0fa\") " pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:45.250449 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.249082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd8665d4-17a7-45de-a631-96cd8f57a51d-konnectivity-ca\") pod \"konnectivity-agent-97sxp\" (UID: \"dd8665d4-17a7-45de-a631-96cd8f57a51d\") " pod="kube-system/konnectivity-agent-97sxp" Jun 11 16:19:45.250449 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.249095 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5446b104-cd55-402c-8abc-30a69ce93d99-host-cni-netd\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.250449 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.249106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-socket-dir\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.250449 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.249211 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f873332c-c4d0-4002-9a09-022d2afbb733-socket-dir\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.250449 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.249212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g877s\" (UniqueName: \"kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s\") pod \"network-check-target-fk4d7\" (UID: \"b005dffc-32c0-4134-a56c-81f65719baa6\") " pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:19:45.250449 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.249573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd8665d4-17a7-45de-a631-96cd8f57a51d-konnectivity-ca\") pod \"konnectivity-agent-97sxp\" (UID: \"dd8665d4-17a7-45de-a631-96cd8f57a51d\") " pod="kube-system/konnectivity-agent-97sxp" Jun 11 16:19:45.250449 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.249632 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5446b104-cd55-402c-8abc-30a69ce93d99-ovnkube-script-lib\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.250449 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.249832 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5446b104-cd55-402c-8abc-30a69ce93d99-ovnkube-config\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.250957 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.250938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd8665d4-17a7-45de-a631-96cd8f57a51d-agent-certs\") pod \"konnectivity-agent-97sxp\" (UID: \"dd8665d4-17a7-45de-a631-96cd8f57a51d\") " pod="kube-system/konnectivity-agent-97sxp" Jun 11 16:19:45.251286 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.251265 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5446b104-cd55-402c-8abc-30a69ce93d99-ovn-node-metrics-cert\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.269625 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.269603 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:45.269737 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.269630 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:45.269737 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.269643 2576 projected.go:196] Error preparing data for projected volume kube-api-access-g877s for pod openshift-network-diagnostics/network-check-target-fk4d7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:45.269737 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.269705 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s podName:b005dffc-32c0-4134-a56c-81f65719baa6 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:45.769687824 +0000 UTC m=+3.117796033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g877s" (UniqueName: "kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s") pod "network-check-target-fk4d7" (UID: "b005dffc-32c0-4134-a56c-81f65719baa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:45.269935 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.269920 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqcdl\" (UniqueName: \"kubernetes.io/projected/f873332c-c4d0-4002-9a09-022d2afbb733-kube-api-access-nqcdl\") pod \"aws-ebs-csi-driver-node-g28vc\" (UID: \"f873332c-c4d0-4002-9a09-022d2afbb733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.273445 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.273424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct6qv\" (UniqueName: \"kubernetes.io/projected/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-kube-api-access-ct6qv\") pod \"network-metrics-daemon-9nbg4\" (UID: \"419c9be4-5ebc-4f73-83f3-e61cc760f0fa\") " pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:45.279153 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.279134 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vntzv\" (UniqueName: \"kubernetes.io/projected/5446b104-cd55-402c-8abc-30a69ce93d99-kube-api-access-vntzv\") pod \"ovnkube-node-mf46n\" (UID: \"5446b104-cd55-402c-8abc-30a69ce93d99\") " pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.339490 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.339471 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wmq2f" Jun 11 16:19:45.346911 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.346887 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-69cpx" Jun 11 16:19:45.354857 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.354841 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" Jun 11 16:19:45.360267 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.360252 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bjzqb" Jun 11 16:19:45.367033 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.367001 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-75qf9" Jun 11 16:19:45.373171 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.373154 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vjsrv" Jun 11 16:19:45.379677 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.379661 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:19:45.386859 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.386486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-97sxp" Jun 11 16:19:45.392099 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.392080 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" Jun 11 16:19:45.752807 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.752781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs\") pod \"network-metrics-daemon-9nbg4\" (UID: \"419c9be4-5ebc-4f73-83f3-e61cc760f0fa\") " pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:45.752963 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.752820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:45.752963 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.752919 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:45.752963 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.752938 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:45.753084 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.752977 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs podName:419c9be4-5ebc-4f73-83f3-e61cc760f0fa nodeName:}" failed. No retries permitted until 2026-06-11 16:19:46.752960337 +0000 UTC m=+4.101068566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs") pod "network-metrics-daemon-9nbg4" (UID: "419c9be4-5ebc-4f73-83f3-e61cc760f0fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:45.753084 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.752991 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret podName:e803ad6b-ecb9-49c8-856f-a83161cd17ba nodeName:}" failed. No retries permitted until 2026-06-11 16:19:46.752984939 +0000 UTC m=+4.101093152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret") pod "global-pull-secret-syncer-97nhl" (UID: "e803ad6b-ecb9-49c8-856f-a83161cd17ba") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:45.853947 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:45.853919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g877s\" (UniqueName: \"kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s\") pod \"network-check-target-fk4d7\" (UID: \"b005dffc-32c0-4134-a56c-81f65719baa6\") " pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:19:45.854160 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.854105 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:45.854160 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.854129 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:45.854160 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.854141 2576 projected.go:196] Error preparing data for projected volume kube-api-access-g877s for pod openshift-network-diagnostics/network-check-target-fk4d7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:45.854336 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:45.854205 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s podName:b005dffc-32c0-4134-a56c-81f65719baa6 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:46.854185754 +0000 UTC m=+4.202293963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g877s" (UniqueName: "kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s") pod "network-check-target-fk4d7" (UID: "b005dffc-32c0-4134-a56c-81f65719baa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:45.883316 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:45.883290 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32bd93a7_d136_4f72_8d47_b64894403ce6.slice/crio-7b2a8697865b94c145c5e3077275b132fa1f4b80fdf63d5ca84b47b8ff7a0077 WatchSource:0}: Error finding container 7b2a8697865b94c145c5e3077275b132fa1f4b80fdf63d5ca84b47b8ff7a0077: Status 404 returned error can't find the container with id 7b2a8697865b94c145c5e3077275b132fa1f4b80fdf63d5ca84b47b8ff7a0077 Jun 11 16:19:45.885353 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:45.885329 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5446b104_cd55_402c_8abc_30a69ce93d99.slice/crio-65efcac16ef8ca8fd5c3614362b9aa6fc86a3f9b349a4ac3733de6300aedf4eb WatchSource:0}: Error finding container 65efcac16ef8ca8fd5c3614362b9aa6fc86a3f9b349a4ac3733de6300aedf4eb: Status 404 returned error can't find the container with id 65efcac16ef8ca8fd5c3614362b9aa6fc86a3f9b349a4ac3733de6300aedf4eb Jun 11 16:19:45.889085 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:45.889065 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf873332c_c4d0_4002_9a09_022d2afbb733.slice/crio-8bedaf707bb1e3f3c99fc980d9f4c2444fa4fd58d801a9f7d261a20f075533d8 WatchSource:0}: Error finding container 8bedaf707bb1e3f3c99fc980d9f4c2444fa4fd58d801a9f7d261a20f075533d8: Status 404 returned error can't find the container with id 8bedaf707bb1e3f3c99fc980d9f4c2444fa4fd58d801a9f7d261a20f075533d8 Jun 11 16:19:45.891060 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:45.890832 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9b05d2_18b5_4a07_8cdf_464a3226682b.slice/crio-009fe81262e5601442050d757f20434c99e1dd9285d275ace7d8260f50da8001 WatchSource:0}: Error finding container 009fe81262e5601442050d757f20434c99e1dd9285d275ace7d8260f50da8001: Status 404 returned error can't find the container with id 009fe81262e5601442050d757f20434c99e1dd9285d275ace7d8260f50da8001 Jun 11 16:19:45.892261 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:45.892163 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b8129f_355b_4b7e_bfd4_a4ca652ba0c3.slice/crio-face9e26600c24f2141b17aa0b5cfd0237bb0238d0867fa89c9647146c1d2dc4 WatchSource:0}: Error finding container face9e26600c24f2141b17aa0b5cfd0237bb0238d0867fa89c9647146c1d2dc4: Status 404 returned error can't find the container with id face9e26600c24f2141b17aa0b5cfd0237bb0238d0867fa89c9647146c1d2dc4 Jun 11 16:19:45.894194 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:45.894153 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf77fef35_d9b6_4219_a2db_22fae96635cb.slice/crio-075de75b6785091b7bc0f3b9b45459accdb34f0cd4f9c9fb410c95d7595f6a7e WatchSource:0}: Error finding container 075de75b6785091b7bc0f3b9b45459accdb34f0cd4f9c9fb410c95d7595f6a7e: Status 404 returned error can't find the container with id 075de75b6785091b7bc0f3b9b45459accdb34f0cd4f9c9fb410c95d7595f6a7e Jun 11 16:19:45.895071 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:45.895053 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8665d4_17a7_45de_a631_96cd8f57a51d.slice/crio-59018d8d68554b9f412a9386f912da6cdce0f550d2ab314deef2a4837336b5b3 WatchSource:0}: Error finding container 59018d8d68554b9f412a9386f912da6cdce0f550d2ab314deef2a4837336b5b3: Status 404 returned error can't find the container with id 59018d8d68554b9f412a9386f912da6cdce0f550d2ab314deef2a4837336b5b3 Jun 11 16:19:45.895723 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:45.895706 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0c1e0d_ef22_4054_8329_66ae378c4ce1.slice/crio-ecae40f56238b27ea0df38144f3be432a3346aa34c1b23f33a4cff42c1177213 WatchSource:0}: Error finding container ecae40f56238b27ea0df38144f3be432a3346aa34c1b23f33a4cff42c1177213: Status 404 returned error can't find the container with id ecae40f56238b27ea0df38144f3be432a3346aa34c1b23f33a4cff42c1177213 Jun 11 16:19:45.896773 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:19:45.896670 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafd82990_4b39_4fcb_8f26_39d82a8c9185.slice/crio-594f6bf84d508a6c040fa5d1a97e161b748df0843f70f6b2734226658e7c5024 WatchSource:0}: Error finding container 594f6bf84d508a6c040fa5d1a97e161b748df0843f70f6b2734226658e7c5024: Status 404 returned error can't find the container with id 594f6bf84d508a6c040fa5d1a97e161b748df0843f70f6b2734226658e7c5024 Jun 11 16:19:46.103696 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.103475 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bjzqb" event={"ID":"afd82990-4b39-4fcb-8f26-39d82a8c9185","Type":"ContainerStarted","Data":"594f6bf84d508a6c040fa5d1a97e161b748df0843f70f6b2734226658e7c5024"} Jun 11 16:19:46.104619 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.104589 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-75qf9" event={"ID":"db0c1e0d-ef22-4054-8329-66ae378c4ce1","Type":"ContainerStarted","Data":"ecae40f56238b27ea0df38144f3be432a3346aa34c1b23f33a4cff42c1177213"} Jun 11 16:19:46.105679 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.105653 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" event={"ID":"f873332c-c4d0-4002-9a09-022d2afbb733","Type":"ContainerStarted","Data":"8bedaf707bb1e3f3c99fc980d9f4c2444fa4fd58d801a9f7d261a20f075533d8"} Jun 11 16:19:46.106974 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.106945 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" event={"ID":"5446b104-cd55-402c-8abc-30a69ce93d99","Type":"ContainerStarted","Data":"65efcac16ef8ca8fd5c3614362b9aa6fc86a3f9b349a4ac3733de6300aedf4eb"} Jun 11 16:19:46.107984 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.107963 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-97sxp" event={"ID":"dd8665d4-17a7-45de-a631-96cd8f57a51d","Type":"ContainerStarted","Data":"59018d8d68554b9f412a9386f912da6cdce0f550d2ab314deef2a4837336b5b3"} Jun 11 16:19:46.108978 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.108958 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-69cpx" event={"ID":"f77fef35-d9b6-4219-a2db-22fae96635cb","Type":"ContainerStarted","Data":"075de75b6785091b7bc0f3b9b45459accdb34f0cd4f9c9fb410c95d7595f6a7e"} Jun 11 16:19:46.109859 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.109834 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjsrv" event={"ID":"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3","Type":"ContainerStarted","Data":"face9e26600c24f2141b17aa0b5cfd0237bb0238d0867fa89c9647146c1d2dc4"} Jun 11 16:19:46.110875 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.110858 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wmq2f" event={"ID":"ab9b05d2-18b5-4a07-8cdf-464a3226682b","Type":"ContainerStarted","Data":"009fe81262e5601442050d757f20434c99e1dd9285d275ace7d8260f50da8001"} Jun 11 16:19:46.111839 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.111819 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" event={"ID":"32bd93a7-d136-4f72-8d47-b64894403ce6","Type":"ContainerStarted","Data":"7b2a8697865b94c145c5e3077275b132fa1f4b80fdf63d5ca84b47b8ff7a0077"} Jun 11 16:19:46.113541 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.113522 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-162.ec2.internal" event={"ID":"6cb48f7aa513b56b107622689ce0f5ee","Type":"ContainerStarted","Data":"b111b211c7ff6693ff784c65345b282108cfe16296dc62a354e310e641673fbb"} Jun 11 16:19:46.125679 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.125656 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:14:45 +0000 UTC" deadline="2027-12-11 14:53:06.13593154 +0000 UTC" Jun 11 16:19:46.125679 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.125678 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13150h33m20.010256754s" Jun 11 16:19:46.143418 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.143365 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-162.ec2.internal" podStartSLOduration=2.143348101 podStartE2EDuration="2.143348101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:46.142546289 +0000 UTC m=+3.490654520" watchObservedRunningTime="2026-06-11 16:19:46.143348101 +0000 UTC m=+3.491456329" Jun 11 16:19:46.762224 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.762142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs\") pod \"network-metrics-daemon-9nbg4\" (UID: \"419c9be4-5ebc-4f73-83f3-e61cc760f0fa\") " pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:46.762417 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.762236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:46.762478 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:46.762428 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:46.762528 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:46.762492 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret podName:e803ad6b-ecb9-49c8-856f-a83161cd17ba nodeName:}" failed. No retries permitted until 2026-06-11 16:19:48.762473479 +0000 UTC m=+6.110581691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret") pod "global-pull-secret-syncer-97nhl" (UID: "e803ad6b-ecb9-49c8-856f-a83161cd17ba") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:46.762790 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:46.762704 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:46.762790 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:46.762766 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs podName:419c9be4-5ebc-4f73-83f3-e61cc760f0fa nodeName:}" failed. No retries permitted until 2026-06-11 16:19:48.762749147 +0000 UTC m=+6.110857375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs") pod "network-metrics-daemon-9nbg4" (UID: "419c9be4-5ebc-4f73-83f3-e61cc760f0fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:46.863915 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:46.863319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g877s\" (UniqueName: \"kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s\") pod \"network-check-target-fk4d7\" (UID: \"b005dffc-32c0-4134-a56c-81f65719baa6\") " pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:19:46.863915 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:46.863480 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:46.863915 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:46.863502 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:46.863915 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:46.863515 2576 projected.go:196] Error preparing data for projected volume kube-api-access-g877s for pod openshift-network-diagnostics/network-check-target-fk4d7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:46.863915 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:46.863576 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s podName:b005dffc-32c0-4134-a56c-81f65719baa6 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:48.863559345 +0000 UTC m=+6.211667557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g877s" (UniqueName: "kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s") pod "network-check-target-fk4d7" (UID: "b005dffc-32c0-4134-a56c-81f65719baa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:47.098871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:47.098803 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:47.099034 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:47.098930 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:19:47.099352 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:47.099329 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:47.099450 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:47.099430 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:19:47.099514 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:47.099487 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:19:47.099566 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:47.099550 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:19:47.126220 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:47.126150 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:14:45 +0000 UTC" deadline="2027-12-27 22:17:34.609066942 +0000 UTC" Jun 11 16:19:47.126220 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:47.126195 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13541h57m47.482875317s" Jun 11 16:19:47.127967 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:47.126927 2576 generic.go:356] "Generic (PLEG): container finished" podID="faf94c3b3d7eec40bb37dc3aa123851a" containerID="5bc2a35f4a40c35c6c6d6a5f8300b53f524ab9d4edcc9413c842e39978767f27" exitCode=0 Jun 11 16:19:47.127967 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:47.127797 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal" event={"ID":"faf94c3b3d7eec40bb37dc3aa123851a","Type":"ContainerDied","Data":"5bc2a35f4a40c35c6c6d6a5f8300b53f524ab9d4edcc9413c842e39978767f27"} Jun 11 16:19:48.147516 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:48.147480 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal" event={"ID":"faf94c3b3d7eec40bb37dc3aa123851a","Type":"ContainerStarted","Data":"7d1df1c2b1bb490b4959e65c97a24613ce0072dc285758d09e969553973ecde8"} Jun 11 16:19:48.778940 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:48.778203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs\") pod \"network-metrics-daemon-9nbg4\" (UID: \"419c9be4-5ebc-4f73-83f3-e61cc760f0fa\") " pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:48.778940 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:48.778254 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:48.778940 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:48.778370 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:48.778940 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:48.778425 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret podName:e803ad6b-ecb9-49c8-856f-a83161cd17ba nodeName:}" failed. No retries permitted until 2026-06-11 16:19:52.778407665 +0000 UTC m=+10.126515878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret") pod "global-pull-secret-syncer-97nhl" (UID: "e803ad6b-ecb9-49c8-856f-a83161cd17ba") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:48.778940 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:48.778831 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:48.778940 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:48.778882 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs podName:419c9be4-5ebc-4f73-83f3-e61cc760f0fa nodeName:}" failed. No retries permitted until 2026-06-11 16:19:52.77886621 +0000 UTC m=+10.126974425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs") pod "network-metrics-daemon-9nbg4" (UID: "419c9be4-5ebc-4f73-83f3-e61cc760f0fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:48.878694 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:48.878658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g877s\" (UniqueName: \"kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s\") pod \"network-check-target-fk4d7\" (UID: \"b005dffc-32c0-4134-a56c-81f65719baa6\") " pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:19:48.879306 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:48.878869 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:48.879306 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:48.878892 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:48.879306 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:48.878904 2576 projected.go:196] Error preparing data for projected volume kube-api-access-g877s for pod openshift-network-diagnostics/network-check-target-fk4d7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:48.879306 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:48.878957 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s podName:b005dffc-32c0-4134-a56c-81f65719baa6 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:52.878940411 +0000 UTC m=+10.227048627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g877s" (UniqueName: "kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s") pod "network-check-target-fk4d7" (UID: "b005dffc-32c0-4134-a56c-81f65719baa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:49.096705 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:49.096677 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:49.096828 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:49.096691 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:19:49.096883 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:49.096824 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:19:49.096933 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:49.096873 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:49.097065 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:49.097036 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:19:49.097149 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:49.097111 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:19:51.096516 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:51.096486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:19:51.097067 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:51.096486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:51.097067 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:51.096632 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:19:51.097067 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:51.096497 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:51.097067 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:51.096740 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:19:51.097067 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:51.096805 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:19:52.809559 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:52.809511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs\") pod \"network-metrics-daemon-9nbg4\" (UID: \"419c9be4-5ebc-4f73-83f3-e61cc760f0fa\") " pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:52.810055 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:52.809570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:52.810055 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:52.809687 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:52.810055 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:52.809748 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret podName:e803ad6b-ecb9-49c8-856f-a83161cd17ba nodeName:}" failed. No retries permitted until 2026-06-11 16:20:00.809730118 +0000 UTC m=+18.157838331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret") pod "global-pull-secret-syncer-97nhl" (UID: "e803ad6b-ecb9-49c8-856f-a83161cd17ba") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:52.810231 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:52.810187 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:52.810288 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:52.810245 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs podName:419c9be4-5ebc-4f73-83f3-e61cc760f0fa nodeName:}" failed. No retries permitted until 2026-06-11 16:20:00.810227851 +0000 UTC m=+18.158336065 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs") pod "network-metrics-daemon-9nbg4" (UID: "419c9be4-5ebc-4f73-83f3-e61cc760f0fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:52.910949 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:52.910910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g877s\" (UniqueName: \"kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s\") pod \"network-check-target-fk4d7\" (UID: \"b005dffc-32c0-4134-a56c-81f65719baa6\") " pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:19:52.911147 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:52.911123 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:52.911210 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:52.911152 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:52.911210 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:52.911167 2576 projected.go:196] Error preparing data for projected volume kube-api-access-g877s for pod openshift-network-diagnostics/network-check-target-fk4d7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:52.911312 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:52.911229 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s podName:b005dffc-32c0-4134-a56c-81f65719baa6 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:00.911209672 +0000 UTC m=+18.259317884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g877s" (UniqueName: "kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s") pod "network-check-target-fk4d7" (UID: "b005dffc-32c0-4134-a56c-81f65719baa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:53.097748 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:53.097674 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:19:53.097900 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:53.097782 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:19:53.098030 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:53.097980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:53.098133 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:53.098111 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:19:53.098188 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:53.098121 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:53.098243 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:53.098212 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:19:55.096543 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:55.096135 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:55.096543 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:55.096171 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:19:55.096543 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:55.096139 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:55.096543 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:55.096282 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:19:55.096543 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:55.096406 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:19:55.096543 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:55.096495 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:19:57.096157 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:57.096124 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:57.096596 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:57.096123 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:57.096596 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:57.096254 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:19:57.096596 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:57.096365 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:19:57.096596 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:57.096124 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:19:57.096596 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:57.096518 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:19:59.096086 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:59.096056 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:19:59.096508 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:59.096067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:19:59.096508 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:19:59.096167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:19:59.096508 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:59.096166 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:19:59.096508 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:59.096243 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:19:59.096508 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:19:59.096323 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:20:00.871814 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:00.871776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs\") pod \"network-metrics-daemon-9nbg4\" (UID: \"419c9be4-5ebc-4f73-83f3-e61cc760f0fa\") " pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:20:00.871814 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:00.871824 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:00.872342 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:00.871936 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:00.872342 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:00.871942 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:00.872342 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:00.872000 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret podName:e803ad6b-ecb9-49c8-856f-a83161cd17ba nodeName:}" failed. No retries permitted until 2026-06-11 16:20:16.871980703 +0000 UTC m=+34.220088912 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret") pod "global-pull-secret-syncer-97nhl" (UID: "e803ad6b-ecb9-49c8-856f-a83161cd17ba") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:00.872342 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:00.872033 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs podName:419c9be4-5ebc-4f73-83f3-e61cc760f0fa nodeName:}" failed. No retries permitted until 2026-06-11 16:20:16.87200876 +0000 UTC m=+34.220116969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs") pod "network-metrics-daemon-9nbg4" (UID: "419c9be4-5ebc-4f73-83f3-e61cc760f0fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:00.972678 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:00.972648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g877s\" (UniqueName: \"kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s\") pod \"network-check-target-fk4d7\" (UID: \"b005dffc-32c0-4134-a56c-81f65719baa6\") " pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:00.972848 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:00.972776 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:20:00.972848 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:00.972794 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:20:00.972848 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:00.972807 2576 projected.go:196] Error preparing data for projected volume kube-api-access-g877s for pod openshift-network-diagnostics/network-check-target-fk4d7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:00.972952 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:00.972861 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s podName:b005dffc-32c0-4134-a56c-81f65719baa6 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:16.972844075 +0000 UTC m=+34.320952313 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g877s" (UniqueName: "kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s") pod "network-check-target-fk4d7" (UID: "b005dffc-32c0-4134-a56c-81f65719baa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:01.099000 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:01.098971 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:01.099189 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:01.098972 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:01.099189 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:01.099089 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:20:01.099189 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:01.099098 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:20:01.099350 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:01.099213 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:20:01.099350 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:01.099272 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:20:03.096440 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:03.096366 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:03.096829 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:03.096465 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:03.096829 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:03.096484 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:20:03.096829 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:03.096569 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:20:03.096829 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:03.096597 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:20:03.096829 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:03.096701 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:20:05.096405 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.095996 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:05.097190 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.095996 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:05.097190 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:05.096506 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:20:05.097190 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:05.096571 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:20:05.097190 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.095996 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:20:05.097190 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:05.096661 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:20:05.185492 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.185375 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bjzqb" event={"ID":"afd82990-4b39-4fcb-8f26-39d82a8c9185","Type":"ContainerStarted","Data":"0b3758e2860b1b894e0f93bb81704681dbb3d860956bbb0ed7f363845afa43b7"} Jun 11 16:20:05.187340 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.187307 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-75qf9" event={"ID":"db0c1e0d-ef22-4054-8329-66ae378c4ce1","Type":"ContainerStarted","Data":"abc21430d37a1700171957e687993da7278d58fcd1628d9081c428a621eb768f"} Jun 11 16:20:05.189051 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.189002 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" event={"ID":"f873332c-c4d0-4002-9a09-022d2afbb733","Type":"ContainerStarted","Data":"32be8d6ada096a8f5b4e2f59769d254945f7616c2515305231968dbafe5a22bb"} Jun 11 16:20:05.192636 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.192606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" event={"ID":"5446b104-cd55-402c-8abc-30a69ce93d99","Type":"ContainerStarted","Data":"f8287d7efa5a64bcaa1da7eb89ed9a6ad6cf61a6cc26482b29a1820be7a6d24b"} Jun 11 16:20:05.192720 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.192693 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" event={"ID":"5446b104-cd55-402c-8abc-30a69ce93d99","Type":"ContainerStarted","Data":"cc180568992f21e160eb26de17b288aa66c36f2710e98b74eeb0312b9fd42d7f"} Jun 11 16:20:05.192770 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.192750 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" event={"ID":"5446b104-cd55-402c-8abc-30a69ce93d99","Type":"ContainerStarted","Data":"237eb54e7471cebb48b90cf7c6cc29758d5e2bb062d4d3a5ed3ebdd891e567f9"} Jun 11 16:20:05.192821 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.192798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" event={"ID":"5446b104-cd55-402c-8abc-30a69ce93d99","Type":"ContainerStarted","Data":"1d50bfc601397dac6666825a55c7ee96652786acac1d119d03067fb4ebe48598"} Jun 11 16:20:05.192873 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.192845 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" event={"ID":"5446b104-cd55-402c-8abc-30a69ce93d99","Type":"ContainerStarted","Data":"47fa12f73a4e2a2509c306b3bd16663116ba943289107f630bd42bcd0f39cb0b"} Jun 11 16:20:05.192929 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.192891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" event={"ID":"5446b104-cd55-402c-8abc-30a69ce93d99","Type":"ContainerStarted","Data":"34b62ffd8c0aee9f132731e8946b7ddec068e2a999f51333f3a9183629392a89"} Jun 11 16:20:05.194317 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.194286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-97sxp" event={"ID":"dd8665d4-17a7-45de-a631-96cd8f57a51d","Type":"ContainerStarted","Data":"1d3ae4589ed8c12752be9644511e773c888fe49e68b0029e0e8d13804ffcf4e3"} Jun 11 16:20:05.196169 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.196114 2576 generic.go:356] "Generic (PLEG): container finished" podID="f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3" containerID="f9b5ce2f60585a1422b7138d93c2fd27ebdbc675af214cc27463bdbb7487e368" exitCode=0 Jun 11 16:20:05.196277 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.196169 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjsrv" event={"ID":"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3","Type":"ContainerDied","Data":"f9b5ce2f60585a1422b7138d93c2fd27ebdbc675af214cc27463bdbb7487e368"} Jun 11 16:20:05.198089 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.198065 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wmq2f" event={"ID":"ab9b05d2-18b5-4a07-8cdf-464a3226682b","Type":"ContainerStarted","Data":"3534fd93c943e5e86d930c6fdfae298a02a41798f5007ec70d67986970718520"} Jun 11 16:20:05.199921 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.199700 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" event={"ID":"32bd93a7-d136-4f72-8d47-b64894403ce6","Type":"ContainerStarted","Data":"a6b2784594266310041ea2fb069dd126c8cdc990e758a3b75919afcc703e4452"} Jun 11 16:20:05.202706 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.202628 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-162.ec2.internal" podStartSLOduration=21.202612541 podStartE2EDuration="21.202612541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:48.169145116 +0000 UTC m=+5.517253348" watchObservedRunningTime="2026-06-11 16:20:05.202612541 +0000 UTC m=+22.550720772" Jun 11 16:20:05.203262 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.203227 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bjzqb" podStartSLOduration=3.720761037 podStartE2EDuration="22.203215454s" totalImagesPullingTime="18.482454417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:05.202598693 +0000 UTC m=+22.550706925" watchObservedRunningTime="2026-06-11 16:20:05.203215454 +0000 UTC m=+22.551323686" Jun 11 16:20:05.218514 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.218478 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-75qf9" podStartSLOduration=3.7375117060000003 podStartE2EDuration="22.21846627s" totalImagesPullingTime="18.480954564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:05.21804728 +0000 UTC m=+22.566155511" watchObservedRunningTime="2026-06-11 16:20:05.21846627 +0000 UTC m=+22.566574511" Jun 11 16:20:05.233788 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.233754 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-97sxp" podStartSLOduration=8.03598836 podStartE2EDuration="22.233743156s" totalImagesPullingTime="14.197754796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:05.233553981 +0000 UTC m=+22.581662212" watchObservedRunningTime="2026-06-11 16:20:05.233743156 +0000 UTC m=+22.581851387" Jun 11 16:20:05.252542 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.252506 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bdm2f" podStartSLOduration=3.7562547090000002 podStartE2EDuration="22.252495592s" totalImagesPullingTime="18.496240883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:05.25221798 +0000 UTC m=+22.600326234" watchObservedRunningTime="2026-06-11 16:20:05.252495592 +0000 UTC m=+22.600603823" Jun 11 16:20:05.314823 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.314766 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wmq2f" podStartSLOduration=3.776315211 podStartE2EDuration="22.314749052s" totalImagesPullingTime="18.538433841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:05.31419548 +0000 UTC m=+22.662303710" watchObservedRunningTime="2026-06-11 16:20:05.314749052 +0000 UTC m=+22.662857285" Jun 11 16:20:05.908414 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:05.908385 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 16:20:06.104843 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:06.104657 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T16:20:05.908405296Z","UUID":"e4df6345-a1d0-43e3-b46c-be5cc977edc1","Handler":null,"Name":"","Endpoint":""} Jun 11 16:20:06.106299 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:06.106270 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 16:20:06.106432 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:06.106313 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 16:20:06.165458 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:06.165430 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-97sxp" Jun 11 16:20:06.166073 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:06.166053 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-97sxp" Jun 11 16:20:06.204391 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:06.204356 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" event={"ID":"f873332c-c4d0-4002-9a09-022d2afbb733","Type":"ContainerStarted","Data":"1610f1be09fce65a7b8643c324837df5ad0252be105b502c25120c86ecb53e96"} Jun 11 16:20:06.205971 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:06.205938 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-69cpx" event={"ID":"f77fef35-d9b6-4219-a2db-22fae96635cb","Type":"ContainerStarted","Data":"fe3356257c5f20e947c7a6dacbbd191f7d0dcfbb8a199a7e1443c332d276a372"} Jun 11 16:20:06.225858 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:06.225814 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-69cpx" podStartSLOduration=9.027057739 podStartE2EDuration="23.225794524s" totalImagesPullingTime="14.198736785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:06.225257587 +0000 UTC m=+23.573365819" watchObservedRunningTime="2026-06-11 16:20:06.225794524 +0000 UTC m=+23.573902759" Jun 11 16:20:07.095807 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:07.095775 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:07.095807 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:07.095806 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:20:07.096172 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:07.095782 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:07.096172 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:07.095907 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:20:07.096172 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:07.096039 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:20:07.096172 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:07.096126 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:20:07.207927 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:07.207891 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 16:20:08.212584 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:08.212347 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" event={"ID":"f873332c-c4d0-4002-9a09-022d2afbb733","Type":"ContainerStarted","Data":"bc723873de3bf56df11e1d5928e90473b738778ecfd39ec5dda9dd9bac2ba99c"} Jun 11 16:20:08.216126 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:08.216099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" event={"ID":"5446b104-cd55-402c-8abc-30a69ce93d99","Type":"ContainerStarted","Data":"f6b3e6e572b32e76e132cf9f5faec8424da395b5ce5c9568331a2ebdd57b564f"} Jun 11 16:20:08.234482 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:08.234443 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g28vc" podStartSLOduration=4.231113026 podStartE2EDuration="25.234429659s" totalImagesPullingTime="21.003316633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:08.233823371 +0000 UTC m=+25.581931627" watchObservedRunningTime="2026-06-11 16:20:08.234429659 +0000 UTC m=+25.582537892" Jun 11 16:20:09.099629 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:09.099592 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:20:09.099793 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:09.099743 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:20:09.099793 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:09.099760 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:09.099793 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:09.099747 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:09.099955 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:09.099853 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:20:09.099955 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:09.099946 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:20:10.225362 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:10.225048 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" event={"ID":"5446b104-cd55-402c-8abc-30a69ce93d99","Type":"ContainerStarted","Data":"a1b679592af1a244169c7f0ec6b5c1d3a894b5bea8e43c1e44da5e88819ac467"} Jun 11 16:20:10.225362 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:10.225357 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:20:10.226331 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:10.225405 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:20:10.227196 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:10.227162 2576 generic.go:356] "Generic (PLEG): container finished" podID="f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3" containerID="fa0c2f881636a34d4e545dec648834d4be9e72070dae5af7b26c7341d35acc8b" exitCode=0 Jun 11 16:20:10.227338 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:10.227213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjsrv" event={"ID":"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3","Type":"ContainerDied","Data":"fa0c2f881636a34d4e545dec648834d4be9e72070dae5af7b26c7341d35acc8b"} Jun 11 16:20:10.243120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:10.243099 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:20:10.290393 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:10.290350 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" podStartSLOduration=8.72818238 podStartE2EDuration="27.290336465s" totalImagesPullingTime="18.562154085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:10.261046228 +0000 UTC m=+27.609154459" watchObservedRunningTime="2026-06-11 16:20:10.290336465 +0000 UTC m=+27.638444708" Jun 11 16:20:11.098738 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:11.098706 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:11.098984 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:11.098813 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:11.098984 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:11.098822 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:20:11.098984 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:11.098838 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:20:11.098984 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:11.098952 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:20:11.099276 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:11.099046 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:20:11.229365 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:11.229339 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:20:11.243468 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:11.243446 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:20:11.802559 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:11.802533 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fk4d7"] Jun 11 16:20:11.802822 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:11.802670 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:11.802822 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:11.802751 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:20:11.805670 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:11.805645 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-97nhl"] Jun 11 16:20:11.805795 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:11.805756 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:11.805844 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:11.805832 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:20:11.810747 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:11.810725 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9nbg4"] Jun 11 16:20:11.810850 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:11.810817 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:20:11.810916 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:11.810896 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:20:12.233366 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:12.233285 2576 generic.go:356] "Generic (PLEG): container finished" podID="f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3" containerID="1a7c947d15aef70b07d7e107c3029535ef0f2559398a7b3fddf96b3eff4eb658" exitCode=0 Jun 11 16:20:12.233729 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:12.233385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjsrv" event={"ID":"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3","Type":"ContainerDied","Data":"1a7c947d15aef70b07d7e107c3029535ef0f2559398a7b3fddf96b3eff4eb658"} Jun 11 16:20:13.096704 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:13.096672 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:13.096882 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:13.096761 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:20:14.096119 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:14.096086 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:20:14.096498 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:14.096137 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:14.096498 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:14.096231 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:20:14.096498 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:14.096300 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:20:14.240922 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:14.240893 2576 generic.go:356] "Generic (PLEG): container finished" podID="f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3" containerID="a62d0542bf94098bc71035ae047b588a87b2c4532e7974ecdbd1199c9c26774b" exitCode=0 Jun 11 16:20:14.241116 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:14.240933 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjsrv" event={"ID":"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3","Type":"ContainerDied","Data":"a62d0542bf94098bc71035ae047b588a87b2c4532e7974ecdbd1199c9c26774b"} Jun 11 16:20:15.023415 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:15.023253 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-97sxp" Jun 11 16:20:15.023603 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:15.023500 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 16:20:15.024081 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:15.024057 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-97sxp" Jun 11 16:20:15.096253 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:15.096227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:15.096640 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:15.096346 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97nhl" podUID="e803ad6b-ecb9-49c8-856f-a83161cd17ba" Jun 11 16:20:16.096089 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:16.096059 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:20:16.096274 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:16.096099 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:16.096274 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:16.096185 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9nbg4" podUID="419c9be4-5ebc-4f73-83f3-e61cc760f0fa" Jun 11 16:20:16.096741 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:16.096313 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk4d7" podUID="b005dffc-32c0-4134-a56c-81f65719baa6" Jun 11 16:20:16.900943 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:16.900921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs\") pod \"network-metrics-daemon-9nbg4\" (UID: \"419c9be4-5ebc-4f73-83f3-e61cc760f0fa\") " pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:20:16.901029 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:16.900956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:16.901080 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:16.901068 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:16.901116 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:16.901075 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:16.901152 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:16.901118 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret podName:e803ad6b-ecb9-49c8-856f-a83161cd17ba nodeName:}" failed. No retries permitted until 2026-06-11 16:20:48.90110535 +0000 UTC m=+66.249213559 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret") pod "global-pull-secret-syncer-97nhl" (UID: "e803ad6b-ecb9-49c8-856f-a83161cd17ba") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:16.901152 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:16.901131 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs podName:419c9be4-5ebc-4f73-83f3-e61cc760f0fa nodeName:}" failed. No retries permitted until 2026-06-11 16:20:48.901125191 +0000 UTC m=+66.249233400 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs") pod "network-metrics-daemon-9nbg4" (UID: "419c9be4-5ebc-4f73-83f3-e61cc760f0fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:16.965556 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:16.965537 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-162.ec2.internal" event="NodeReady" Jun 11 16:20:16.965657 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:16.965624 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 16:20:17.001884 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.001861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g877s\" (UniqueName: \"kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s\") pod \"network-check-target-fk4d7\" (UID: \"b005dffc-32c0-4134-a56c-81f65719baa6\") " pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:17.002007 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:17.001975 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:20:17.002007 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:17.001990 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:20:17.002007 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:17.002001 2576 projected.go:196] Error preparing data for projected volume kube-api-access-g877s for pod openshift-network-diagnostics/network-check-target-fk4d7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:17.002156 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:17.002058 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s podName:b005dffc-32c0-4134-a56c-81f65719baa6 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:49.002044054 +0000 UTC m=+66.350152262 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g877s" (UniqueName: "kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s") pod "network-check-target-fk4d7" (UID: "b005dffc-32c0-4134-a56c-81f65719baa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:17.020566 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.020542 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-676c45565-ttl8r"] Jun 11 16:20:17.022502 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.022488 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.025929 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:17.025906 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"registry-dockercfg-qrx8j\" is forbidden: User \"system:node:ip-10-0-128-162.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-128-162.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qrx8j\"" type="*v1.Secret" Jun 11 16:20:17.026063 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:17.026043 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-private-configuration\" is forbidden: User \"system:node:ip-10-0-128-162.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-128-162.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret" Jun 11 16:20:17.026760 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:17.026738 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca\" is forbidden: User \"system:node:ip-10-0-128-162.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-128-162.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" type="*v1.ConfigMap" Jun 11 16:20:17.026918 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:17.026896 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"image-registry-676c45565-ttl8r\" is forbidden: User \"system:node:ip-10-0-128-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-128-162.ec2.internal' and this object" podUID="d2bfb8df-3d23-4264-b30e-d68886fcef57" pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.027026 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:17.026942 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-tls\" is forbidden: User \"system:node:ip-10-0-128-162.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-128-162.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" type="*v1.Secret" Jun 11 16:20:17.027084 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:17.027066 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"installation-pull-secrets\" is forbidden: User \"system:node:ip-10-0-128-162.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-128-162.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" type="*v1.Secret" Jun 11 16:20:17.051921 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.051896 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-676c45565-ttl8r"] Jun 11 16:20:17.058535 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.058516 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6mlxp"] Jun 11 16:20:17.060195 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.060180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:17.065727 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.065706 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5qf6f"] Jun 11 16:20:17.067161 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.067142 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 16:20:17.067743 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.067722 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5qf6f" Jun 11 16:20:17.068547 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.068501 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 16:20:17.068654 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.068640 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7ddd7\"" Jun 11 16:20:17.070781 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.070754 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 16:20:17.070877 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.070824 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5g5xx\"" Jun 11 16:20:17.071683 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.071665 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 16:20:17.071775 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.071691 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 16:20:17.092072 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.092051 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6mlxp"] Jun 11 16:20:17.096692 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.096676 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:17.099525 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.099503 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:20:17.113972 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.113954 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5qf6f"] Jun 11 16:20:17.202686 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.202622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmgzz\" (UniqueName: \"kubernetes.io/projected/a134d59e-6da0-4275-9c4f-ad16541f41b1-kube-api-access-bmgzz\") pod \"ingress-canary-5qf6f\" (UID: \"a134d59e-6da0-4275-9c4f-ad16541f41b1\") " pod="openshift-ingress-canary/ingress-canary-5qf6f" Jun 11 16:20:17.202686 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.202655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.202841 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.202694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvc7k\" (UniqueName: \"kubernetes.io/projected/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-kube-api-access-kvc7k\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:17.202841 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.202727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gs2m\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-kube-api-access-5gs2m\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.202841 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.202762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-image-registry-private-configuration\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.202841 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.202789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-certificates\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.202841 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.202814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-bound-sa-token\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.203105 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.202859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-tmp-dir\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:17.203105 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.202886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-trusted-ca\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.203105 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.202912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2bfb8df-3d23-4264-b30e-d68886fcef57-ca-trust-extracted\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.203105 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.202943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-config-volume\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:17.203105 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.202968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:17.203105 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.203008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a134d59e-6da0-4275-9c4f-ad16541f41b1-cert\") pod \"ingress-canary-5qf6f\" (UID: \"a134d59e-6da0-4275-9c4f-ad16541f41b1\") " pod="openshift-ingress-canary/ingress-canary-5qf6f" Jun 11 16:20:17.203105 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.203050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-installation-pull-secrets\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.303630 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.303609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-config-volume\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:17.303764 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.303640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:17.303764 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.303660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a134d59e-6da0-4275-9c4f-ad16541f41b1-cert\") pod \"ingress-canary-5qf6f\" (UID: \"a134d59e-6da0-4275-9c4f-ad16541f41b1\") " pod="openshift-ingress-canary/ingress-canary-5qf6f" Jun 11 16:20:17.303764 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.303684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-installation-pull-secrets\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.303764 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.303743 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmgzz\" (UniqueName: \"kubernetes.io/projected/a134d59e-6da0-4275-9c4f-ad16541f41b1-kube-api-access-bmgzz\") pod \"ingress-canary-5qf6f\" (UID: \"a134d59e-6da0-4275-9c4f-ad16541f41b1\") " pod="openshift-ingress-canary/ingress-canary-5qf6f" Jun 11 16:20:17.303764 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.303765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.304036 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:17.303775 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:17.304036 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.303800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvc7k\" (UniqueName: \"kubernetes.io/projected/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-kube-api-access-kvc7k\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:17.304036 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:17.303829 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls podName:6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:17.803810253 +0000 UTC m=+35.151918480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls") pod "dns-default-6mlxp" (UID: "6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31") : secret "dns-default-metrics-tls" not found Jun 11 16:20:17.304036 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.303857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gs2m\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-kube-api-access-5gs2m\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.304036 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.303891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-image-registry-private-configuration\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.304036 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.303917 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-certificates\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.304036 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.303940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-bound-sa-token\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.304260 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.304126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-tmp-dir\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:17.304260 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.304153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-trusted-ca\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.304260 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.304191 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2bfb8df-3d23-4264-b30e-d68886fcef57-ca-trust-extracted\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.304260 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.304221 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-config-volume\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:17.304516 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.304491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-tmp-dir\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:17.304607 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.304573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2bfb8df-3d23-4264-b30e-d68886fcef57-ca-trust-extracted\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.304765 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.304745 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-certificates\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.308482 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.308465 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a134d59e-6da0-4275-9c4f-ad16541f41b1-cert\") pod \"ingress-canary-5qf6f\" (UID: \"a134d59e-6da0-4275-9c4f-ad16541f41b1\") " pod="openshift-ingress-canary/ingress-canary-5qf6f" Jun 11 16:20:17.327379 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.327359 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gs2m\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-kube-api-access-5gs2m\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.332162 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.332133 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvc7k\" (UniqueName: \"kubernetes.io/projected/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-kube-api-access-kvc7k\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:17.332595 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.332561 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-bound-sa-token\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:17.332694 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.332639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmgzz\" (UniqueName: \"kubernetes.io/projected/a134d59e-6da0-4275-9c4f-ad16541f41b1-kube-api-access-bmgzz\") pod \"ingress-canary-5qf6f\" (UID: \"a134d59e-6da0-4275-9c4f-ad16541f41b1\") " pod="openshift-ingress-canary/ingress-canary-5qf6f" Jun 11 16:20:17.377402 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.377371 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5qf6f" Jun 11 16:20:17.391630 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.391602 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97sxp_dd8665d4-17a7-45de-a631-96cd8f57a51d/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:17.506161 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.506129 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97sxp_dd8665d4-17a7-45de-a631-96cd8f57a51d/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:17.509468 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.509443 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5qf6f"] Jun 11 16:20:17.513486 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:20:17.513354 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda134d59e_6da0_4275_9c4f_ad16541f41b1.slice/crio-5810b65400669552b533a38f259d7e53bbf1f8247b03a3f94d780a4702c0d455 WatchSource:0}: Error finding container 5810b65400669552b533a38f259d7e53bbf1f8247b03a3f94d780a4702c0d455: Status 404 returned error can't find the container with id 5810b65400669552b533a38f259d7e53bbf1f8247b03a3f94d780a4702c0d455 Jun 11 16:20:17.807800 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:17.807772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:17.807954 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:17.807888 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:17.807954 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:17.807938 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls podName:6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:18.807924889 +0000 UTC m=+36.156033099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls") pod "dns-default-6mlxp" (UID: "6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31") : secret "dns-default-metrics-tls" not found Jun 11 16:20:18.076380 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.076298 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 16:20:18.088111 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.088084 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-image-registry-private-configuration\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:18.096125 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.096097 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:20:18.096321 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.096285 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:18.100399 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.100367 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:20:18.100924 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.100400 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:20:18.100924 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.100529 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:20:18.101687 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.101669 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-49ftn\"" Jun 11 16:20:18.101791 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.101770 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ftdt\"" Jun 11 16:20:18.243877 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.243852 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 16:20:18.244962 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:18.244948 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:20:18.245006 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:18.244963 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676c45565-ttl8r: secret "image-registry-tls" not found Jun 11 16:20:18.245056 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:18.245039 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls podName:d2bfb8df-3d23-4264-b30e-d68886fcef57 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:18.745003348 +0000 UTC m=+36.093111557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls") pod "image-registry-676c45565-ttl8r" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57") : secret "image-registry-tls" not found Jun 11 16:20:18.249517 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.249496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5qf6f" event={"ID":"a134d59e-6da0-4275-9c4f-ad16541f41b1","Type":"ContainerStarted","Data":"5810b65400669552b533a38f259d7e53bbf1f8247b03a3f94d780a4702c0d455"} Jun 11 16:20:18.304780 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:18.304757 2576 secret.go:189] Couldn't get secret openshift-image-registry/installation-pull-secrets: failed to sync secret cache: timed out waiting for the condition Jun 11 16:20:18.304861 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:18.304788 2576 configmap.go:193] Couldn't get configMap openshift-image-registry/trusted-ca: failed to sync configmap cache: timed out waiting for the condition Jun 11 16:20:18.304861 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:18.304820 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-installation-pull-secrets podName:d2bfb8df-3d23-4264-b30e-d68886fcef57 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:18.804804224 +0000 UTC m=+36.152912433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "installation-pull-secrets" (UniqueName: "kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-installation-pull-secrets") pod "image-registry-676c45565-ttl8r" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57") : failed to sync secret cache: timed out waiting for the condition Jun 11 16:20:18.304861 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:18.304839 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-trusted-ca podName:d2bfb8df-3d23-4264-b30e-d68886fcef57 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:18.804826595 +0000 UTC m=+36.152934803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "trusted-ca" (UniqueName: "kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-trusted-ca") pod "image-registry-676c45565-ttl8r" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57") : failed to sync configmap cache: timed out waiting for the condition Jun 11 16:20:18.307832 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.307811 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 16:20:18.372190 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.372124 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qrx8j\"" Jun 11 16:20:18.600312 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.600283 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 16:20:18.815925 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.815885 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-trusted-ca\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:18.816119 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.815945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:18.816119 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.815972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-installation-pull-secrets\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:18.816119 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.816044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:18.816288 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:18.816112 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:18.816288 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:18.816151 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:20:18.816288 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:18.816162 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676c45565-ttl8r: secret "image-registry-tls" not found Jun 11 16:20:18.816288 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:18.816207 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls podName:6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:20.816185454 +0000 UTC m=+38.164293686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls") pod "dns-default-6mlxp" (UID: "6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31") : secret "dns-default-metrics-tls" not found Jun 11 16:20:18.816288 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:18.816228 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls podName:d2bfb8df-3d23-4264-b30e-d68886fcef57 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:19.816219385 +0000 UTC m=+37.164327599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls") pod "image-registry-676c45565-ttl8r" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57") : secret "image-registry-tls" not found Jun 11 16:20:18.816970 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.816946 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-trusted-ca\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:18.819756 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:18.819729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-installation-pull-secrets\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:19.822686 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:19.822653 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:19.823252 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:19.822834 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:20:19.823252 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:19.822860 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676c45565-ttl8r: secret "image-registry-tls" not found Jun 11 16:20:19.823252 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:19.822940 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls podName:d2bfb8df-3d23-4264-b30e-d68886fcef57 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:21.8229198 +0000 UTC m=+39.171028010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls") pod "image-registry-676c45565-ttl8r" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57") : secret "image-registry-tls" not found Jun 11 16:20:20.255857 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:20.255784 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5qf6f" event={"ID":"a134d59e-6da0-4275-9c4f-ad16541f41b1","Type":"ContainerStarted","Data":"d24fc70e8e5f9ad9ea09973c36f2a94bd214e26d24aeef62c4cc3f39557403c3"} Jun 11 16:20:20.276310 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:20.276237 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5qf6f" podStartSLOduration=1.469978828 podStartE2EDuration="3.276218745s" totalImagesPullingTime="1.806239917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:20.27592014 +0000 UTC m=+37.624028372" watchObservedRunningTime="2026-06-11 16:20:20.276218745 +0000 UTC m=+37.624326980" Jun 11 16:20:20.833082 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:20.833038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:20.833508 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:20.833191 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:20.833508 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:20.833257 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls podName:6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:24.833241293 +0000 UTC m=+42.181349502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls") pod "dns-default-6mlxp" (UID: "6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31") : secret "dns-default-metrics-tls" not found Jun 11 16:20:21.842043 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:21.841985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:21.842480 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:21.842143 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:20:21.842480 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:21.842165 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676c45565-ttl8r: secret "image-registry-tls" not found Jun 11 16:20:21.842480 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:21.842239 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls podName:d2bfb8df-3d23-4264-b30e-d68886fcef57 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:25.842216021 +0000 UTC m=+43.190324252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls") pod "image-registry-676c45565-ttl8r" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57") : secret "image-registry-tls" not found Jun 11 16:20:21.966271 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:21.966235 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97sxp_dd8665d4-17a7-45de-a631-96cd8f57a51d/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:22.905402 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:22.905357 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97sxp_dd8665d4-17a7-45de-a631-96cd8f57a51d/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:23.263880 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:23.263850 2576 generic.go:356] "Generic (PLEG): container finished" podID="f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3" containerID="7e8a5b70c375bfba0a375390f32484797e2bef11db0733267a64dcf1c9da0ef7" exitCode=0 Jun 11 16:20:23.264061 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:23.263888 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjsrv" event={"ID":"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3","Type":"ContainerDied","Data":"7e8a5b70c375bfba0a375390f32484797e2bef11db0733267a64dcf1c9da0ef7"} Jun 11 16:20:24.269497 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:24.269462 2576 generic.go:356] "Generic (PLEG): container finished" podID="f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3" containerID="9f8dd715c5eb086d880c31dc5271a765e3fd6f27b0816fbf9e32f36664733cb5" exitCode=0 Jun 11 16:20:24.269874 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:24.269525 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjsrv" event={"ID":"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3","Type":"ContainerDied","Data":"9f8dd715c5eb086d880c31dc5271a765e3fd6f27b0816fbf9e32f36664733cb5"} Jun 11 16:20:24.865132 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:24.865092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:24.865290 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:24.865233 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:24.865331 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:24.865295 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls podName:6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:32.865281269 +0000 UTC m=+50.213389477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls") pod "dns-default-6mlxp" (UID: "6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31") : secret "dns-default-metrics-tls" not found Jun 11 16:20:25.274815 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:25.274733 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjsrv" event={"ID":"f8b8129f-355b-4b7e-bfd4-a4ca652ba0c3","Type":"ContainerStarted","Data":"344b561cafb17f147e9a42639294cdacaff0207316a7e2a00e3206c589fe1b8b"} Jun 11 16:20:25.302577 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:25.302528 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vjsrv" podStartSLOduration=8.940192738 podStartE2EDuration="42.302514827s" totalImagesPullingTime="33.362322089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:25.301188736 +0000 UTC m=+42.649296968" watchObservedRunningTime="2026-06-11 16:20:25.302514827 +0000 UTC m=+42.650623046" Jun 11 16:20:25.871049 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:25.871001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:25.871216 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:25.871146 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:20:25.871216 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:25.871169 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676c45565-ttl8r: secret "image-registry-tls" not found Jun 11 16:20:25.871295 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:25.871220 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls podName:d2bfb8df-3d23-4264-b30e-d68886fcef57 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:33.871206086 +0000 UTC m=+51.219314295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls") pod "image-registry-676c45565-ttl8r" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57") : secret "image-registry-tls" not found Jun 11 16:20:32.920281 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:32.920242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:32.920703 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:32.920411 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:32.920703 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:32.920484 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls podName:6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:48.920468216 +0000 UTC m=+66.268576424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls") pod "dns-default-6mlxp" (UID: "6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31") : secret "dns-default-metrics-tls" not found Jun 11 16:20:33.928098 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:33.928056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:33.928479 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:33.928231 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:20:33.928479 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:33.928253 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676c45565-ttl8r: secret "image-registry-tls" not found Jun 11 16:20:33.928479 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:33.928319 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls podName:d2bfb8df-3d23-4264-b30e-d68886fcef57 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:49.928301974 +0000 UTC m=+67.276410204 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls") pod "image-registry-676c45565-ttl8r" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57") : secret "image-registry-tls" not found Jun 11 16:20:43.245997 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:43.245969 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mf46n" Jun 11 16:20:48.935245 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:48.935192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:20:48.935245 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:48.935245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs\") pod \"network-metrics-daemon-9nbg4\" (UID: \"419c9be4-5ebc-4f73-83f3-e61cc760f0fa\") " pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:20:48.935709 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:48.935268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:48.935709 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:48.935358 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:48.935709 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:48.935431 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls podName:6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:20.935412813 +0000 UTC m=+98.283521021 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls") pod "dns-default-6mlxp" (UID: "6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31") : secret "dns-default-metrics-tls" not found Jun 11 16:20:48.938198 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:48.938173 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:20:48.938333 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:48.938205 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:20:48.945901 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:48.945883 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:20:48.945990 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:48.945932 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs podName:419c9be4-5ebc-4f73-83f3-e61cc760f0fa nodeName:}" failed. No retries permitted until 2026-06-11 16:21:52.945919137 +0000 UTC m=+130.294027346 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs") pod "network-metrics-daemon-9nbg4" (UID: "419c9be4-5ebc-4f73-83f3-e61cc760f0fa") : secret "metrics-daemon-secret" not found Jun 11 16:20:48.948440 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:48.948410 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e803ad6b-ecb9-49c8-856f-a83161cd17ba-original-pull-secret\") pod \"global-pull-secret-syncer-97nhl\" (UID: \"e803ad6b-ecb9-49c8-856f-a83161cd17ba\") " pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:49.035755 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:49.035732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g877s\" (UniqueName: \"kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s\") pod \"network-check-target-fk4d7\" (UID: \"b005dffc-32c0-4134-a56c-81f65719baa6\") " pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:49.038653 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:49.038637 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:20:49.048514 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:49.048498 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:20:49.059205 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:49.059181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g877s\" (UniqueName: \"kubernetes.io/projected/b005dffc-32c0-4134-a56c-81f65719baa6-kube-api-access-g877s\") pod \"network-check-target-fk4d7\" (UID: \"b005dffc-32c0-4134-a56c-81f65719baa6\") " pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:49.205616 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:49.205552 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97nhl" Jun 11 16:20:49.316975 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:49.316954 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ftdt\"" Jun 11 16:20:49.324880 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:49.324864 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:49.326548 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:49.326523 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-97nhl"] Jun 11 16:20:49.329639 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:20:49.329612 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode803ad6b_ecb9_49c8_856f_a83161cd17ba.slice/crio-21a9a9e442d1090d9273f2ab9d4ca17496beb6464e1c27d5ae680093df9e0077 WatchSource:0}: Error finding container 21a9a9e442d1090d9273f2ab9d4ca17496beb6464e1c27d5ae680093df9e0077: Status 404 returned error can't find the container with id 21a9a9e442d1090d9273f2ab9d4ca17496beb6464e1c27d5ae680093df9e0077 Jun 11 16:20:49.334004 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:49.333982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-97nhl" event={"ID":"e803ad6b-ecb9-49c8-856f-a83161cd17ba","Type":"ContainerStarted","Data":"21a9a9e442d1090d9273f2ab9d4ca17496beb6464e1c27d5ae680093df9e0077"} Jun 11 16:20:49.440801 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:49.440775 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fk4d7"] Jun 11 16:20:49.443417 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:20:49.443394 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb005dffc_32c0_4134_a56c_81f65719baa6.slice/crio-b712b8f5bbdb7711d95d03beb7b51004e0e9876a27962fa4be00d9ff881570ac WatchSource:0}: Error finding container b712b8f5bbdb7711d95d03beb7b51004e0e9876a27962fa4be00d9ff881570ac: Status 404 returned error can't find the container with id b712b8f5bbdb7711d95d03beb7b51004e0e9876a27962fa4be00d9ff881570ac Jun 11 16:20:49.942142 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:49.942101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:20:49.942542 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:49.942287 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:20:49.942542 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:49.942307 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676c45565-ttl8r: secret "image-registry-tls" not found Jun 11 16:20:49.942542 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:20:49.942369 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls podName:d2bfb8df-3d23-4264-b30e-d68886fcef57 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:21.942351053 +0000 UTC m=+99.290459263 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls") pod "image-registry-676c45565-ttl8r" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57") : secret "image-registry-tls" not found Jun 11 16:20:50.338700 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:50.338658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fk4d7" event={"ID":"b005dffc-32c0-4134-a56c-81f65719baa6","Type":"ContainerStarted","Data":"b712b8f5bbdb7711d95d03beb7b51004e0e9876a27962fa4be00d9ff881570ac"} Jun 11 16:20:53.347929 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:53.347884 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fk4d7" event={"ID":"b005dffc-32c0-4134-a56c-81f65719baa6","Type":"ContainerStarted","Data":"705404b048f0a973a8915aa28d9bdf850141b6f3b1205b422c3ba4d0bcbf5435"} Jun 11 16:20:53.348349 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:53.348039 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:20:53.367393 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:53.367341 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fk4d7" podStartSLOduration=67.103219947 podStartE2EDuration="1m10.367328094s" totalImagesPullingTime="3.264108147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:53.366045648 +0000 UTC m=+70.714153879" watchObservedRunningTime="2026-06-11 16:20:53.367328094 +0000 UTC m=+70.715436354" Jun 11 16:20:55.354712 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:55.354675 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-97nhl" event={"ID":"e803ad6b-ecb9-49c8-856f-a83161cd17ba","Type":"ContainerStarted","Data":"b0390175621cacb5c54fe727a00d4dc435b796d9e52c3cc5c2894c5e946dfcb7"} Jun 11 16:20:55.373077 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:20:55.373001 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-97nhl" podStartSLOduration=66.844022387 podStartE2EDuration="1m12.372985857s" totalImagesPullingTime="5.52896347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:55.372199955 +0000 UTC m=+72.720308187" watchObservedRunningTime="2026-06-11 16:20:55.372985857 +0000 UTC m=+72.721094099" Jun 11 16:21:01.013411 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.013378 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-bc6777d5f-vtflb"] Jun 11 16:21:01.016156 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.016140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.019116 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.019093 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 16:21:01.020335 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.020316 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-h6psg\"" Jun 11 16:21:01.020701 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.020678 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 16:21:01.021408 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.021380 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 16:21:01.021510 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.021418 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 16:21:01.021649 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.021628 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 16:21:01.021740 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.021675 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 16:21:01.032257 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.032237 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bc6777d5f-vtflb"] Jun 11 16:21:01.124453 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.124430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.124568 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.124463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-default-certificate\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.124568 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.124487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.124568 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.124503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpcqj\" (UniqueName: \"kubernetes.io/projected/945f23b6-8d4c-4437-acf0-1905759b39d6-kube-api-access-cpcqj\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.124714 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.124588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-stats-auth\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.225649 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.225617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-default-certificate\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.225809 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.225655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.225809 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.225672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpcqj\" (UniqueName: \"kubernetes.io/projected/945f23b6-8d4c-4437-acf0-1905759b39d6-kube-api-access-cpcqj\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.225809 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.225692 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-stats-auth\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.225809 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.225764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.225809 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:01.225801 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle podName:945f23b6-8d4c-4437-acf0-1905759b39d6 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:01.725784843 +0000 UTC m=+79.073893056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle") pod "router-default-bc6777d5f-vtflb" (UID: "945f23b6-8d4c-4437-acf0-1905759b39d6") : configmap references non-existent config key: service-ca.crt Jun 11 16:21:01.226109 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:01.225851 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:21:01.226109 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:01.225912 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs podName:945f23b6-8d4c-4437-acf0-1905759b39d6 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:01.725897647 +0000 UTC m=+79.074005856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs") pod "router-default-bc6777d5f-vtflb" (UID: "945f23b6-8d4c-4437-acf0-1905759b39d6") : secret "router-metrics-certs-default" not found Jun 11 16:21:01.228234 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.228205 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-default-certificate\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.228329 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.228277 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-stats-auth\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.239211 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.239188 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpcqj\" (UniqueName: \"kubernetes.io/projected/945f23b6-8d4c-4437-acf0-1905759b39d6-kube-api-access-cpcqj\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.729909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.729873 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.730082 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:01.729973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:01.730133 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:01.730105 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle podName:945f23b6-8d4c-4437-acf0-1905759b39d6 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:02.730085834 +0000 UTC m=+80.078194064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle") pod "router-default-bc6777d5f-vtflb" (UID: "945f23b6-8d4c-4437-acf0-1905759b39d6") : configmap references non-existent config key: service-ca.crt Jun 11 16:21:01.730133 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:01.730120 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:21:01.730204 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:01.730188 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs podName:945f23b6-8d4c-4437-acf0-1905759b39d6 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:02.730174754 +0000 UTC m=+80.078282962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs") pod "router-default-bc6777d5f-vtflb" (UID: "945f23b6-8d4c-4437-acf0-1905759b39d6") : secret "router-metrics-certs-default" not found Jun 11 16:21:02.737702 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:02.737594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:02.737702 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:02.737641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:02.738123 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:02.737766 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:21:02.738123 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:02.737846 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs podName:945f23b6-8d4c-4437-acf0-1905759b39d6 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:04.73782682 +0000 UTC m=+82.085935033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs") pod "router-default-bc6777d5f-vtflb" (UID: "945f23b6-8d4c-4437-acf0-1905759b39d6") : secret "router-metrics-certs-default" not found Jun 11 16:21:02.738123 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:02.737863 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle podName:945f23b6-8d4c-4437-acf0-1905759b39d6 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:04.737855507 +0000 UTC m=+82.085963716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle") pod "router-default-bc6777d5f-vtflb" (UID: "945f23b6-8d4c-4437-acf0-1905759b39d6") : configmap references non-existent config key: service-ca.crt Jun 11 16:21:04.750822 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:04.750765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:04.751232 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:04.750844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:04.751232 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:04.750941 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:21:04.751232 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:04.750970 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle podName:945f23b6-8d4c-4437-acf0-1905759b39d6 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:08.750950442 +0000 UTC m=+86.099058657 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle") pod "router-default-bc6777d5f-vtflb" (UID: "945f23b6-8d4c-4437-acf0-1905759b39d6") : configmap references non-existent config key: service-ca.crt Jun 11 16:21:04.751232 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:04.750991 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs podName:945f23b6-8d4c-4437-acf0-1905759b39d6 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:08.750980518 +0000 UTC m=+86.099088740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs") pod "router-default-bc6777d5f-vtflb" (UID: "945f23b6-8d4c-4437-acf0-1905759b39d6") : secret "router-metrics-certs-default" not found Jun 11 16:21:08.781508 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:08.781467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:08.781965 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:08.781575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:08.781965 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:08.781655 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle podName:945f23b6-8d4c-4437-acf0-1905759b39d6 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:16.781637259 +0000 UTC m=+94.129745470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle") pod "router-default-bc6777d5f-vtflb" (UID: "945f23b6-8d4c-4437-acf0-1905759b39d6") : configmap references non-existent config key: service-ca.crt Jun 11 16:21:08.781965 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:08.781712 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:21:08.781965 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:08.781783 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs podName:945f23b6-8d4c-4437-acf0-1905759b39d6 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:16.781763433 +0000 UTC m=+94.129871645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs") pod "router-default-bc6777d5f-vtflb" (UID: "945f23b6-8d4c-4437-acf0-1905759b39d6") : secret "router-metrics-certs-default" not found Jun 11 16:21:11.252075 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:11.252051 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bjzqb_afd82990-4b39-4fcb-8f26-39d82a8c9185/dns-node-resolver/0.log" Jun 11 16:21:12.052742 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:12.052712 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-75qf9_db0c1e0d-ef22-4054-8329-66ae378c4ce1/node-ca/0.log" Jun 11 16:21:12.852758 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:12.852726 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5qf6f_a134d59e-6da0-4275-9c4f-ad16541f41b1/serve-healthcheck-canary/0.log" Jun 11 16:21:16.841051 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:16.840997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:16.841425 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:16.841071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:16.841425 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:16.841139 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:21:16.841425 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:16.841199 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs podName:945f23b6-8d4c-4437-acf0-1905759b39d6 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:32.84118521 +0000 UTC m=+110.189293419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs") pod "router-default-bc6777d5f-vtflb" (UID: "945f23b6-8d4c-4437-acf0-1905759b39d6") : secret "router-metrics-certs-default" not found Jun 11 16:21:16.841425 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:16.841212 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle podName:945f23b6-8d4c-4437-acf0-1905759b39d6 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:32.841206427 +0000 UTC m=+110.189314636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle") pod "router-default-bc6777d5f-vtflb" (UID: "945f23b6-8d4c-4437-acf0-1905759b39d6") : configmap references non-existent config key: service-ca.crt Jun 11 16:21:20.976130 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:20.976091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:21:20.978423 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:20.978398 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31-metrics-tls\") pod \"dns-default-6mlxp\" (UID: \"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31\") " pod="openshift-dns/dns-default-6mlxp" Jun 11 16:21:21.273078 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:21.272989 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7ddd7\"" Jun 11 16:21:21.279601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:21.279585 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6mlxp" Jun 11 16:21:21.402905 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:21.402877 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6mlxp"] Jun 11 16:21:21.405942 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:21:21.405910 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4f8ff7_1fe0_4b85_8fd3_8abd8cdc6f31.slice/crio-36738a25b2737d60d2aec8790781a172b70e01fba227202a29b6fa52dbcfcbf3 WatchSource:0}: Error finding container 36738a25b2737d60d2aec8790781a172b70e01fba227202a29b6fa52dbcfcbf3: Status 404 returned error can't find the container with id 36738a25b2737d60d2aec8790781a172b70e01fba227202a29b6fa52dbcfcbf3 Jun 11 16:21:21.413651 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:21.413620 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6mlxp" event={"ID":"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31","Type":"ContainerStarted","Data":"36738a25b2737d60d2aec8790781a172b70e01fba227202a29b6fa52dbcfcbf3"} Jun 11 16:21:21.983553 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:21.983524 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:21:21.986275 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:21.986249 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls\") pod \"image-registry-676c45565-ttl8r\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:21:22.133973 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:22.133947 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qrx8j\"" Jun 11 16:21:22.142310 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:22.142291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:21:22.289644 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:22.289614 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-676c45565-ttl8r"] Jun 11 16:21:22.292730 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:21:22.292702 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2bfb8df_3d23_4264_b30e_d68886fcef57.slice/crio-b9c41166999d62c9a26c9d32060ecc6e88478cfa7d2457ab7b7e17db58207d24 WatchSource:0}: Error finding container b9c41166999d62c9a26c9d32060ecc6e88478cfa7d2457ab7b7e17db58207d24: Status 404 returned error can't find the container with id b9c41166999d62c9a26c9d32060ecc6e88478cfa7d2457ab7b7e17db58207d24 Jun 11 16:21:22.418136 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:22.418098 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-676c45565-ttl8r" event={"ID":"d2bfb8df-3d23-4264-b30e-d68886fcef57","Type":"ContainerStarted","Data":"9c3256e7bca4ab53088cde1c6e79fce6cece1486c51857e86fb39ebef78b2576"} Jun 11 16:21:22.418306 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:22.418156 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-676c45565-ttl8r" event={"ID":"d2bfb8df-3d23-4264-b30e-d68886fcef57","Type":"ContainerStarted","Data":"b9c41166999d62c9a26c9d32060ecc6e88478cfa7d2457ab7b7e17db58207d24"} Jun 11 16:21:22.418306 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:22.418212 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:21:22.440517 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:22.440454 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-676c45565-ttl8r" podStartSLOduration=99.440431107 podStartE2EDuration="1m39.440431107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:22.439722337 +0000 UTC m=+99.787830569" watchObservedRunningTime="2026-06-11 16:21:22.440431107 +0000 UTC m=+99.788539324" Jun 11 16:21:23.422763 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:23.422726 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6mlxp" event={"ID":"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31","Type":"ContainerStarted","Data":"89f861cf4450f85bd3e88c950522cee082b7c93c5f30568bd70b62a5ff2e2ac6"} Jun 11 16:21:23.423144 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:23.422822 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6mlxp" event={"ID":"6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31","Type":"ContainerStarted","Data":"ca2123f1d9b8a3d940fe4e52cb6fa89ded5fc345decc3d2bcbf8896b09d78688"} Jun 11 16:21:23.423144 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:23.422951 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6mlxp" Jun 11 16:21:23.442853 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:23.442813 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6mlxp" podStartSLOduration=64.82889112 podStartE2EDuration="1m6.442800954s" totalImagesPullingTime="1.613909834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:23.441031746 +0000 UTC m=+100.789139971" watchObservedRunningTime="2026-06-11 16:21:23.442800954 +0000 UTC m=+100.790909189" Jun 11 16:21:24.353129 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:24.353098 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fk4d7" Jun 11 16:21:32.860577 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:32.860535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:32.861060 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:32.860602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:32.861272 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:32.861247 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/945f23b6-8d4c-4437-acf0-1905759b39d6-service-ca-bundle\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:32.862930 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:32.862911 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/945f23b6-8d4c-4437-acf0-1905759b39d6-metrics-certs\") pod \"router-default-bc6777d5f-vtflb\" (UID: \"945f23b6-8d4c-4437-acf0-1905759b39d6\") " pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:33.124614 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:33.124549 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:33.253106 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:33.253081 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bc6777d5f-vtflb"] Jun 11 16:21:33.253219 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:21:33.253149 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod945f23b6_8d4c_4437_acf0_1905759b39d6.slice/crio-fd7c94c381e34cbb62ba1df7c5ffdaa612de66b9b0dd1b38ac7dfec35d177f78 WatchSource:0}: Error finding container fd7c94c381e34cbb62ba1df7c5ffdaa612de66b9b0dd1b38ac7dfec35d177f78: Status 404 returned error can't find the container with id fd7c94c381e34cbb62ba1df7c5ffdaa612de66b9b0dd1b38ac7dfec35d177f78 Jun 11 16:21:33.428577 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:33.428499 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6mlxp" Jun 11 16:21:33.453567 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:33.453529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bc6777d5f-vtflb" event={"ID":"945f23b6-8d4c-4437-acf0-1905759b39d6","Type":"ContainerStarted","Data":"8355ee041c2798c23db86e58bc6eeaf503562ab206f3b932f7492dabc3812cd5"} Jun 11 16:21:33.453734 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:33.453585 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bc6777d5f-vtflb" event={"ID":"945f23b6-8d4c-4437-acf0-1905759b39d6","Type":"ContainerStarted","Data":"fd7c94c381e34cbb62ba1df7c5ffdaa612de66b9b0dd1b38ac7dfec35d177f78"} Jun 11 16:21:33.474863 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:33.474812 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-bc6777d5f-vtflb" podStartSLOduration=33.47479622 podStartE2EDuration="33.47479622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:33.473948926 +0000 UTC m=+110.822057172" watchObservedRunningTime="2026-06-11 16:21:33.47479622 +0000 UTC m=+110.822904450" Jun 11 16:21:34.125382 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.125345 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:34.127972 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.127941 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865b4664fb-w5s94"] Jun 11 16:21:34.130691 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.130673 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:34.130803 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.130755 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865b4664fb-w5s94" Jun 11 16:21:34.133276 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.133251 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 16:21:34.133419 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.133409 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 16:21:34.134448 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.134432 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 16:21:34.134678 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.134662 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 16:21:34.134770 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.134727 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mc8g2\"" Jun 11 16:21:34.147782 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.147758 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865b4664fb-w5s94"] Jun 11 16:21:34.207796 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.207774 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-tbwkm"] Jun 11 16:21:34.210098 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.210074 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-tbwkm" Jun 11 16:21:34.212872 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.212846 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 16:21:34.213049 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.213026 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-t9lf7\"" Jun 11 16:21:34.213163 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.213131 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 16:21:34.213745 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.213726 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-27k99"] Jun 11 16:21:34.216259 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.216239 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.218667 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.218652 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 16:21:34.218774 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.218700 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 16:21:34.218774 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.218753 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l8tlp\"" Jun 11 16:21:34.218924 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.218909 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 16:21:34.218984 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.218970 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 16:21:34.226194 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.226174 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-tbwkm"] Jun 11 16:21:34.229927 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.229905 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-27k99"] Jun 11 16:21:34.270991 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.270966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4jj6\" (UniqueName: \"kubernetes.io/projected/95d102cc-7d14-4ca6-81d9-73f851c78260-kube-api-access-n4jj6\") pod \"managed-serviceaccount-addon-agent-865b4664fb-w5s94\" (UID: \"95d102cc-7d14-4ca6-81d9-73f851c78260\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865b4664fb-w5s94" Jun 11 16:21:34.271089 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.270997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95d102cc-7d14-4ca6-81d9-73f851c78260-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-865b4664fb-w5s94\" (UID: \"95d102cc-7d14-4ca6-81d9-73f851c78260\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865b4664fb-w5s94" Jun 11 16:21:34.371279 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.371254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxzss\" (UniqueName: \"kubernetes.io/projected/90c74d1b-a21e-495d-9e2c-1c521a9985e4-kube-api-access-fxzss\") pod \"downloads-6657875f97-tbwkm\" (UID: \"90c74d1b-a21e-495d-9e2c-1c521a9985e4\") " pod="openshift-console/downloads-6657875f97-tbwkm" Jun 11 16:21:34.371386 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.371294 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlhn9\" (UniqueName: \"kubernetes.io/projected/29f0d1bb-009d-451d-b890-4df05dae2e69-kube-api-access-dlhn9\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.371386 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.371330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/29f0d1bb-009d-451d-b890-4df05dae2e69-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.371386 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.371362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4jj6\" (UniqueName: \"kubernetes.io/projected/95d102cc-7d14-4ca6-81d9-73f851c78260-kube-api-access-n4jj6\") pod \"managed-serviceaccount-addon-agent-865b4664fb-w5s94\" (UID: \"95d102cc-7d14-4ca6-81d9-73f851c78260\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865b4664fb-w5s94" Jun 11 16:21:34.371549 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.371405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/29f0d1bb-009d-451d-b890-4df05dae2e69-crio-socket\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.371549 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.371436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95d102cc-7d14-4ca6-81d9-73f851c78260-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-865b4664fb-w5s94\" (UID: \"95d102cc-7d14-4ca6-81d9-73f851c78260\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865b4664fb-w5s94" Jun 11 16:21:34.371549 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.371463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/29f0d1bb-009d-451d-b890-4df05dae2e69-data-volume\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.371549 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.371488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/29f0d1bb-009d-451d-b890-4df05dae2e69-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.373962 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.373941 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95d102cc-7d14-4ca6-81d9-73f851c78260-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-865b4664fb-w5s94\" (UID: \"95d102cc-7d14-4ca6-81d9-73f851c78260\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865b4664fb-w5s94" Jun 11 16:21:34.382310 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.382263 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4jj6\" (UniqueName: \"kubernetes.io/projected/95d102cc-7d14-4ca6-81d9-73f851c78260-kube-api-access-n4jj6\") pod \"managed-serviceaccount-addon-agent-865b4664fb-w5s94\" (UID: \"95d102cc-7d14-4ca6-81d9-73f851c78260\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865b4664fb-w5s94" Jun 11 16:21:34.450765 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.450741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865b4664fb-w5s94" Jun 11 16:21:34.457298 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.457283 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:34.458449 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.458433 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-bc6777d5f-vtflb" Jun 11 16:21:34.472363 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.472344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxzss\" (UniqueName: \"kubernetes.io/projected/90c74d1b-a21e-495d-9e2c-1c521a9985e4-kube-api-access-fxzss\") pod \"downloads-6657875f97-tbwkm\" (UID: \"90c74d1b-a21e-495d-9e2c-1c521a9985e4\") " pod="openshift-console/downloads-6657875f97-tbwkm" Jun 11 16:21:34.472474 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.472375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlhn9\" (UniqueName: \"kubernetes.io/projected/29f0d1bb-009d-451d-b890-4df05dae2e69-kube-api-access-dlhn9\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.472474 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.472402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/29f0d1bb-009d-451d-b890-4df05dae2e69-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.472580 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.472462 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/29f0d1bb-009d-451d-b890-4df05dae2e69-crio-socket\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.472580 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.472513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/29f0d1bb-009d-451d-b890-4df05dae2e69-data-volume\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.472580 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.472535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/29f0d1bb-009d-451d-b890-4df05dae2e69-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.472580 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.472541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/29f0d1bb-009d-451d-b890-4df05dae2e69-crio-socket\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.472890 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.472862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/29f0d1bb-009d-451d-b890-4df05dae2e69-data-volume\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.473097 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.473079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/29f0d1bb-009d-451d-b890-4df05dae2e69-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.474820 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.474799 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/29f0d1bb-009d-451d-b890-4df05dae2e69-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.484069 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.484040 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxzss\" (UniqueName: \"kubernetes.io/projected/90c74d1b-a21e-495d-9e2c-1c521a9985e4-kube-api-access-fxzss\") pod \"downloads-6657875f97-tbwkm\" (UID: \"90c74d1b-a21e-495d-9e2c-1c521a9985e4\") " pod="openshift-console/downloads-6657875f97-tbwkm" Jun 11 16:21:34.485840 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.485817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlhn9\" (UniqueName: \"kubernetes.io/projected/29f0d1bb-009d-451d-b890-4df05dae2e69-kube-api-access-dlhn9\") pod \"insights-runtime-extractor-27k99\" (UID: \"29f0d1bb-009d-451d-b890-4df05dae2e69\") " pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.518806 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.518776 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-tbwkm" Jun 11 16:21:34.525493 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.525470 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-27k99" Jun 11 16:21:34.591651 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.591586 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865b4664fb-w5s94"] Jun 11 16:21:34.596984 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:21:34.596941 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95d102cc_7d14_4ca6_81d9_73f851c78260.slice/crio-4a8f6bf05433abd53618e3f428807089b5619a41a4f1797cd402c7712995b8d9 WatchSource:0}: Error finding container 4a8f6bf05433abd53618e3f428807089b5619a41a4f1797cd402c7712995b8d9: Status 404 returned error can't find the container with id 4a8f6bf05433abd53618e3f428807089b5619a41a4f1797cd402c7712995b8d9 Jun 11 16:21:34.670926 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.670865 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-tbwkm"] Jun 11 16:21:34.676090 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:21:34.676062 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c74d1b_a21e_495d_9e2c_1c521a9985e4.slice/crio-33ce1c129d10ae1b49ae1d8b350d016d8ab591ba4b2f455c8f78a0ce364b625d WatchSource:0}: Error finding container 33ce1c129d10ae1b49ae1d8b350d016d8ab591ba4b2f455c8f78a0ce364b625d: Status 404 returned error can't find the container with id 33ce1c129d10ae1b49ae1d8b350d016d8ab591ba4b2f455c8f78a0ce364b625d Jun 11 16:21:34.690055 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:21:34.690031 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f0d1bb_009d_451d_b890_4df05dae2e69.slice/crio-979515f4377f0400c745950d6374fa6de70210f6da1f4f30bb4500dd85c32c03 WatchSource:0}: Error finding container 979515f4377f0400c745950d6374fa6de70210f6da1f4f30bb4500dd85c32c03: Status 404 returned error can't find the container with id 979515f4377f0400c745950d6374fa6de70210f6da1f4f30bb4500dd85c32c03 Jun 11 16:21:34.697291 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:34.697267 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-27k99"] Jun 11 16:21:35.468099 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:35.467982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27k99" event={"ID":"29f0d1bb-009d-451d-b890-4df05dae2e69","Type":"ContainerStarted","Data":"6a4a509598a28946f26fdcb3e18ec98160a68fe021f101114c0918f96f3355c6"} Jun 11 16:21:35.469292 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:35.469229 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27k99" event={"ID":"29f0d1bb-009d-451d-b890-4df05dae2e69","Type":"ContainerStarted","Data":"979515f4377f0400c745950d6374fa6de70210f6da1f4f30bb4500dd85c32c03"} Jun 11 16:21:35.470439 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:35.470410 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-tbwkm" event={"ID":"90c74d1b-a21e-495d-9e2c-1c521a9985e4","Type":"ContainerStarted","Data":"33ce1c129d10ae1b49ae1d8b350d016d8ab591ba4b2f455c8f78a0ce364b625d"} Jun 11 16:21:35.471955 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:35.471929 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865b4664fb-w5s94" event={"ID":"95d102cc-7d14-4ca6-81d9-73f851c78260","Type":"ContainerStarted","Data":"4a8f6bf05433abd53618e3f428807089b5619a41a4f1797cd402c7712995b8d9"} Jun 11 16:21:36.479463 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:36.479381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27k99" event={"ID":"29f0d1bb-009d-451d-b890-4df05dae2e69","Type":"ContainerStarted","Data":"8f94e7f7a2d0c7ce17da9a4e9804c91f07c17d0e0bcd3f0908d6491d68d1a0a5"} Jun 11 16:21:38.488409 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:38.488313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865b4664fb-w5s94" event={"ID":"95d102cc-7d14-4ca6-81d9-73f851c78260","Type":"ContainerStarted","Data":"1b538ff918d1c44d8887439d55c5b81ae3a2e20dd3897a2041b5993a063bf1e8"} Jun 11 16:21:38.490650 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:38.490618 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27k99" event={"ID":"29f0d1bb-009d-451d-b890-4df05dae2e69","Type":"ContainerStarted","Data":"dfe0be31c22d6c2bd5bba409341672dc3ec817b2355ddfa289abb66ab436e4a0"} Jun 11 16:21:38.505762 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:38.505707 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865b4664fb-w5s94" podStartSLOduration=0.954339921 podStartE2EDuration="4.505689517s" totalImagesPullingTime="3.551349596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:38.505280769 +0000 UTC m=+115.853389011" watchObservedRunningTime="2026-06-11 16:21:38.505689517 +0000 UTC m=+115.853797752" Jun 11 16:21:38.525732 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:38.525681 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-27k99" podStartSLOduration=1.242447944 podStartE2EDuration="4.525661035s" totalImagesPullingTime="3.283213091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:21:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:38.524676626 +0000 UTC m=+115.872784858" watchObservedRunningTime="2026-06-11 16:21:38.525661035 +0000 UTC m=+115.873769268" Jun 11 16:21:38.908876 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:38.908842 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c8ff7bc8d-csr9x"] Jun 11 16:21:38.911973 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:38.911952 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:38.917090 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:38.917060 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4n9mv\"" Jun 11 16:21:38.917090 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:38.917076 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 16:21:38.917241 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:38.917078 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 16:21:38.917904 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:38.917878 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 16:21:38.917904 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:38.917900 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 16:21:38.918093 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:38.917881 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 16:21:38.924361 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:38.924342 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c8ff7bc8d-csr9x"] Jun 11 16:21:39.009611 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.009587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hh5q\" (UniqueName: \"kubernetes.io/projected/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-kube-api-access-2hh5q\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.009705 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.009622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-oauth-serving-cert\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.009705 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.009642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-service-ca\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.009705 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.009690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-oauth-config\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.009806 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.009739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-serving-cert\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.009806 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.009761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-config\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.110957 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.110921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-serving-cert\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.110957 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.110963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-config\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.111178 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.111008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hh5q\" (UniqueName: \"kubernetes.io/projected/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-kube-api-access-2hh5q\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.111178 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.111063 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-oauth-serving-cert\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.111178 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.111091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-service-ca\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.111178 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.111122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-oauth-config\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.111654 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.111630 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-config\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.111773 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.111754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-oauth-serving-cert\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.111832 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.111777 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-service-ca\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.113621 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.113597 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-oauth-config\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.113859 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.113841 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-serving-cert\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.138734 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.138714 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hh5q\" (UniqueName: \"kubernetes.io/projected/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-kube-api-access-2hh5q\") pod \"console-c8ff7bc8d-csr9x\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.222951 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.222885 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:39.373895 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.373868 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c8ff7bc8d-csr9x"] Jun 11 16:21:39.376842 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:21:39.376805 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b356c5_71f9_48b8_93f6_a71ddeaf0b8e.slice/crio-91062f7ea5e804d430c647ab1d0386f54ebc5515c5038c1a1b02b1ae512d8ee3 WatchSource:0}: Error finding container 91062f7ea5e804d430c647ab1d0386f54ebc5515c5038c1a1b02b1ae512d8ee3: Status 404 returned error can't find the container with id 91062f7ea5e804d430c647ab1d0386f54ebc5515c5038c1a1b02b1ae512d8ee3 Jun 11 16:21:39.494704 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:39.494631 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c8ff7bc8d-csr9x" event={"ID":"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e","Type":"ContainerStarted","Data":"91062f7ea5e804d430c647ab1d0386f54ebc5515c5038c1a1b02b1ae512d8ee3"} Jun 11 16:21:41.226759 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.226692 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5"] Jun 11 16:21:41.230512 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.230118 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:41.249141 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.248936 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 16:21:41.249141 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.248963 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 16:21:41.250126 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.250101 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 16:21:41.250230 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.250141 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 16:21:41.250483 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.250466 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5tfvv\"" Jun 11 16:21:41.250483 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.250476 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 16:21:41.266424 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.266400 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5"] Jun 11 16:21:41.328978 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.328897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/923c0e61-c047-4c6a-a25a-5c35d59055c4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-m8fj5\" (UID: \"923c0e61-c047-4c6a-a25a-5c35d59055c4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:41.328978 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.328958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/923c0e61-c047-4c6a-a25a-5c35d59055c4-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-m8fj5\" (UID: \"923c0e61-c047-4c6a-a25a-5c35d59055c4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:41.329201 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.328999 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvgrh\" (UniqueName: \"kubernetes.io/projected/923c0e61-c047-4c6a-a25a-5c35d59055c4-kube-api-access-gvgrh\") pod \"prometheus-operator-7f7d445d84-m8fj5\" (UID: \"923c0e61-c047-4c6a-a25a-5c35d59055c4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:41.329201 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.329059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/923c0e61-c047-4c6a-a25a-5c35d59055c4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-m8fj5\" (UID: \"923c0e61-c047-4c6a-a25a-5c35d59055c4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:41.430290 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.430253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/923c0e61-c047-4c6a-a25a-5c35d59055c4-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-m8fj5\" (UID: \"923c0e61-c047-4c6a-a25a-5c35d59055c4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:41.430443 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.430314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvgrh\" (UniqueName: \"kubernetes.io/projected/923c0e61-c047-4c6a-a25a-5c35d59055c4-kube-api-access-gvgrh\") pod \"prometheus-operator-7f7d445d84-m8fj5\" (UID: \"923c0e61-c047-4c6a-a25a-5c35d59055c4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:41.430443 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.430356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/923c0e61-c047-4c6a-a25a-5c35d59055c4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-m8fj5\" (UID: \"923c0e61-c047-4c6a-a25a-5c35d59055c4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:41.430443 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.430422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/923c0e61-c047-4c6a-a25a-5c35d59055c4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-m8fj5\" (UID: \"923c0e61-c047-4c6a-a25a-5c35d59055c4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:41.430597 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:41.430564 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 16:21:41.430646 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:41.430626 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/923c0e61-c047-4c6a-a25a-5c35d59055c4-prometheus-operator-tls podName:923c0e61-c047-4c6a-a25a-5c35d59055c4 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:41.930607302 +0000 UTC m=+119.278715528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/923c0e61-c047-4c6a-a25a-5c35d59055c4-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-m8fj5" (UID: "923c0e61-c047-4c6a-a25a-5c35d59055c4") : secret "prometheus-operator-tls" not found Jun 11 16:21:41.430991 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.430964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/923c0e61-c047-4c6a-a25a-5c35d59055c4-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-m8fj5\" (UID: \"923c0e61-c047-4c6a-a25a-5c35d59055c4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:41.433393 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.433368 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/923c0e61-c047-4c6a-a25a-5c35d59055c4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-m8fj5\" (UID: \"923c0e61-c047-4c6a-a25a-5c35d59055c4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:41.448786 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.448760 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvgrh\" (UniqueName: \"kubernetes.io/projected/923c0e61-c047-4c6a-a25a-5c35d59055c4-kube-api-access-gvgrh\") pod \"prometheus-operator-7f7d445d84-m8fj5\" (UID: \"923c0e61-c047-4c6a-a25a-5c35d59055c4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:41.935370 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.935325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/923c0e61-c047-4c6a-a25a-5c35d59055c4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-m8fj5\" (UID: \"923c0e61-c047-4c6a-a25a-5c35d59055c4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:41.938326 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:41.938270 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/923c0e61-c047-4c6a-a25a-5c35d59055c4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-m8fj5\" (UID: \"923c0e61-c047-4c6a-a25a-5c35d59055c4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:42.141926 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:42.141891 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" Jun 11 16:21:42.148003 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:42.147968 2576 patch_prober.go:28] interesting pod/image-registry-676c45565-ttl8r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:21:42.148166 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:42.148051 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-676c45565-ttl8r" podUID="d2bfb8df-3d23-4264-b30e-d68886fcef57" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:21:42.617245 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:42.617220 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5"] Jun 11 16:21:42.621352 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:21:42.621326 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod923c0e61_c047_4c6a_a25a_5c35d59055c4.slice/crio-537615a3d623c2b28c19e5a300b6d0725e34579b15c5783a69699a82e3334904 WatchSource:0}: Error finding container 537615a3d623c2b28c19e5a300b6d0725e34579b15c5783a69699a82e3334904: Status 404 returned error can't find the container with id 537615a3d623c2b28c19e5a300b6d0725e34579b15c5783a69699a82e3334904 Jun 11 16:21:43.428152 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:43.428124 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:21:43.514263 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:43.514219 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" event={"ID":"923c0e61-c047-4c6a-a25a-5c35d59055c4","Type":"ContainerStarted","Data":"537615a3d623c2b28c19e5a300b6d0725e34579b15c5783a69699a82e3334904"} Jun 11 16:21:43.516543 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:43.516512 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c8ff7bc8d-csr9x" event={"ID":"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e","Type":"ContainerStarted","Data":"7d5dce33f579cc28c82f27f31d2ba4c5fffe6c1e109f6d9c7ecd2e6f37c3b4f1"} Jun 11 16:21:43.544132 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:43.544078 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c8ff7bc8d-csr9x" podStartSLOduration=2.400943244 podStartE2EDuration="5.544058538s" totalImagesPullingTime="3.143115294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:43.543513548 +0000 UTC m=+120.891621779" watchObservedRunningTime="2026-06-11 16:21:43.544058538 +0000 UTC m=+120.892166770" Jun 11 16:21:44.522531 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:44.522486 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" event={"ID":"923c0e61-c047-4c6a-a25a-5c35d59055c4","Type":"ContainerStarted","Data":"ca2f1bffcc674456fdeae8a568be45118bf87524a791bcf50f042a531e8db921"} Jun 11 16:21:44.522943 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:44.522551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" event={"ID":"923c0e61-c047-4c6a-a25a-5c35d59055c4","Type":"ContainerStarted","Data":"fd75f2091f6b64e4971cdf52755723a1642ec343145fbb241a05083dad83e4a1"} Jun 11 16:21:44.542470 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:44.542416 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-m8fj5" podStartSLOduration=2.400808095 podStartE2EDuration="3.542397787s" totalImagesPullingTime="1.141589692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:44.542066873 +0000 UTC m=+121.890175105" watchObservedRunningTime="2026-06-11 16:21:44.542397787 +0000 UTC m=+121.890506019" Jun 11 16:21:45.279939 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.279905 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7656bbf9bb-c68fb"] Jun 11 16:21:45.283065 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.283036 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.293443 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.293420 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 16:21:45.299433 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.299404 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7656bbf9bb-c68fb"] Jun 11 16:21:45.467808 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.467769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-oauth-serving-cert\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.467808 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.467809 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-serving-cert\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.468057 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.467828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-service-ca\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.468057 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.467947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-oauth-config\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.468057 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.468000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-trusted-ca-bundle\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.468057 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.468052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvlx4\" (UniqueName: \"kubernetes.io/projected/35c11863-bfa2-4cf6-bf69-9dfec052556f-kube-api-access-gvlx4\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.468263 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.468094 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-config\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.568679 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.568652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-oauth-serving-cert\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.569104 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.568694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-serving-cert\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.569104 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.568720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-service-ca\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.569104 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.568750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-oauth-config\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.569104 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.568961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-trusted-ca-bundle\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.569104 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.569001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvlx4\" (UniqueName: \"kubernetes.io/projected/35c11863-bfa2-4cf6-bf69-9dfec052556f-kube-api-access-gvlx4\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.569104 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.569051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-config\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.569541 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.569520 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-oauth-serving-cert\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.569616 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.569578 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-service-ca\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.569731 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.569709 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-config\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.570199 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.570178 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-trusted-ca-bundle\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.571476 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.571453 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-oauth-config\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.571741 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.571721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-serving-cert\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.582254 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.582230 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvlx4\" (UniqueName: \"kubernetes.io/projected/35c11863-bfa2-4cf6-bf69-9dfec052556f-kube-api-access-gvlx4\") pod \"console-7656bbf9bb-c68fb\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.593235 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.593213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:45.729857 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:45.729831 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7656bbf9bb-c68fb"] Jun 11 16:21:45.732884 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:21:45.732858 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35c11863_bfa2_4cf6_bf69_9dfec052556f.slice/crio-fe30c4dff08d34a4faa08fa62cc41a02f3c1c61d43dd8cea33ca398ccf48cc47 WatchSource:0}: Error finding container fe30c4dff08d34a4faa08fa62cc41a02f3c1c61d43dd8cea33ca398ccf48cc47: Status 404 returned error can't find the container with id fe30c4dff08d34a4faa08fa62cc41a02f3c1c61d43dd8cea33ca398ccf48cc47 Jun 11 16:21:46.532552 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.532510 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7656bbf9bb-c68fb" event={"ID":"35c11863-bfa2-4cf6-bf69-9dfec052556f","Type":"ContainerStarted","Data":"5e5c892d3cbbae63cfccdbf0eea3f431a0b50fd2f592108dcbbcfd8a78c6ee8f"} Jun 11 16:21:46.532738 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.532573 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7656bbf9bb-c68fb" event={"ID":"35c11863-bfa2-4cf6-bf69-9dfec052556f","Type":"ContainerStarted","Data":"fe30c4dff08d34a4faa08fa62cc41a02f3c1c61d43dd8cea33ca398ccf48cc47"} Jun 11 16:21:46.607520 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.607463 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7656bbf9bb-c68fb" podStartSLOduration=1.607441107 podStartE2EDuration="1.607441107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:46.606833528 +0000 UTC m=+123.954941759" watchObservedRunningTime="2026-06-11 16:21:46.607441107 +0000 UTC m=+123.955549343" Jun 11 16:21:46.693868 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.693830 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf"] Jun 11 16:21:46.698313 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.698288 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" Jun 11 16:21:46.703352 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.703328 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 16:21:46.703498 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.703374 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 16:21:46.703790 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.703770 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-m62vl\"" Jun 11 16:21:46.714343 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.714316 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf"] Jun 11 16:21:46.746603 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.746569 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds"] Jun 11 16:21:46.749980 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.749959 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.752742 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.752720 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d9f9n"] Jun 11 16:21:46.755819 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.755797 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 16:21:46.755917 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.755868 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 16:21:46.755980 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.755967 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wdmff\"" Jun 11 16:21:46.756184 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.756165 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.756397 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.756193 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 16:21:46.766064 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.766042 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 16:21:46.766158 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.766141 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 16:21:46.766461 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.766435 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f9rms\"" Jun 11 16:21:46.767113 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.767097 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 16:21:46.776094 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.776073 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds"] Jun 11 16:21:46.881572 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.881533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7913000-84b9-494b-9d88-dbf8359d90ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.881572 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.881571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-metrics-client-ca\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.881803 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.881615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c7913000-84b9-494b-9d88-dbf8359d90ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.881803 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.881661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.881803 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.881697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8163d10f-bc9b-49b7-99b5-af031d049845-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wtphf\" (UID: \"8163d10f-bc9b-49b7-99b5-af031d049845\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" Jun 11 16:21:46.881803 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.881725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-tls\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.881803 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.881753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.881803 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.881783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8163d10f-bc9b-49b7-99b5-af031d049845-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wtphf\" (UID: \"8163d10f-bc9b-49b7-99b5-af031d049845\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" Jun 11 16:21:46.882169 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.881833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7913000-84b9-494b-9d88-dbf8359d90ef-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.882169 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.881859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-sys\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.882169 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.881901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp4xz\" (UniqueName: \"kubernetes.io/projected/8163d10f-bc9b-49b7-99b5-af031d049845-kube-api-access-fp4xz\") pod \"openshift-state-metrics-65f78d5c66-wtphf\" (UID: \"8163d10f-bc9b-49b7-99b5-af031d049845\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" Jun 11 16:21:46.882169 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.881973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-wtmp\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.882169 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.881998 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pf45\" (UniqueName: \"kubernetes.io/projected/c7913000-84b9-494b-9d88-dbf8359d90ef-kube-api-access-6pf45\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.882169 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.882035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8163d10f-bc9b-49b7-99b5-af031d049845-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wtphf\" (UID: \"8163d10f-bc9b-49b7-99b5-af031d049845\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" Jun 11 16:21:46.882169 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.882079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-root\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.882169 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.882135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7913000-84b9-494b-9d88-dbf8359d90ef-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.882532 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.882184 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-textfile\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.882532 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.882220 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrmnt\" (UniqueName: \"kubernetes.io/projected/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-kube-api-access-jrmnt\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.882532 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.882261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c7913000-84b9-494b-9d88-dbf8359d90ef-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.982741 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.982703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-wtmp\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.982917 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.982747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pf45\" (UniqueName: \"kubernetes.io/projected/c7913000-84b9-494b-9d88-dbf8359d90ef-kube-api-access-6pf45\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.982917 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.982871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8163d10f-bc9b-49b7-99b5-af031d049845-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wtphf\" (UID: \"8163d10f-bc9b-49b7-99b5-af031d049845\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" Jun 11 16:21:46.982917 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.982898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-root\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.982917 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.982910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-wtmp\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.983148 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.982960 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-root\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.983148 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.982964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7913000-84b9-494b-9d88-dbf8359d90ef-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.983148 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.982993 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-textfile\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.983148 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrmnt\" (UniqueName: \"kubernetes.io/projected/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-kube-api-access-jrmnt\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.983148 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c7913000-84b9-494b-9d88-dbf8359d90ef-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.983148 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7913000-84b9-494b-9d88-dbf8359d90ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.983148 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-metrics-client-ca\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.983466 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c7913000-84b9-494b-9d88-dbf8359d90ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.983466 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.983466 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983238 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8163d10f-bc9b-49b7-99b5-af031d049845-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wtphf\" (UID: \"8163d10f-bc9b-49b7-99b5-af031d049845\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" Jun 11 16:21:46.983466 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983262 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-tls\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.983466 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983298 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.983466 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8163d10f-bc9b-49b7-99b5-af031d049845-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wtphf\" (UID: \"8163d10f-bc9b-49b7-99b5-af031d049845\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" Jun 11 16:21:46.983466 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7913000-84b9-494b-9d88-dbf8359d90ef-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.983466 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-sys\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.983466 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983389 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-textfile\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.983466 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp4xz\" (UniqueName: \"kubernetes.io/projected/8163d10f-bc9b-49b7-99b5-af031d049845-kube-api-access-fp4xz\") pod \"openshift-state-metrics-65f78d5c66-wtphf\" (UID: \"8163d10f-bc9b-49b7-99b5-af031d049845\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" Jun 11 16:21:46.983932 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c7913000-84b9-494b-9d88-dbf8359d90ef-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.983987 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983953 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-metrics-client-ca\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.984064 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983985 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.984064 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.983993 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c7913000-84b9-494b-9d88-dbf8359d90ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.984180 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.984076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-sys\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.984180 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:46.984155 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 16:21:46.984284 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:46.984209 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-tls podName:ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:47.484190655 +0000 UTC m=+124.832298869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-tls") pod "node-exporter-d9f9n" (UID: "ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9") : secret "node-exporter-tls" not found Jun 11 16:21:46.984711 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.984640 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7913000-84b9-494b-9d88-dbf8359d90ef-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.984809 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.984714 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8163d10f-bc9b-49b7-99b5-af031d049845-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wtphf\" (UID: \"8163d10f-bc9b-49b7-99b5-af031d049845\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" Jun 11 16:21:46.986123 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.986101 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7913000-84b9-494b-9d88-dbf8359d90ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.986220 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.986109 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8163d10f-bc9b-49b7-99b5-af031d049845-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wtphf\" (UID: \"8163d10f-bc9b-49b7-99b5-af031d049845\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" Jun 11 16:21:46.986397 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.986372 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.986476 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.986439 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7913000-84b9-494b-9d88-dbf8359d90ef-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:46.986842 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.986824 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8163d10f-bc9b-49b7-99b5-af031d049845-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wtphf\" (UID: \"8163d10f-bc9b-49b7-99b5-af031d049845\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" Jun 11 16:21:46.995649 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.995605 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrmnt\" (UniqueName: \"kubernetes.io/projected/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-kube-api-access-jrmnt\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:46.997734 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:46.997712 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pf45\" (UniqueName: \"kubernetes.io/projected/c7913000-84b9-494b-9d88-dbf8359d90ef-kube-api-access-6pf45\") pod \"kube-state-metrics-57bbf8bfb5-pwgds\" (UID: \"c7913000-84b9-494b-9d88-dbf8359d90ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:47.000397 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:47.000373 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp4xz\" (UniqueName: \"kubernetes.io/projected/8163d10f-bc9b-49b7-99b5-af031d049845-kube-api-access-fp4xz\") pod \"openshift-state-metrics-65f78d5c66-wtphf\" (UID: \"8163d10f-bc9b-49b7-99b5-af031d049845\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" Jun 11 16:21:47.009059 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:47.009029 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" Jun 11 16:21:47.062867 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:47.062836 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" Jun 11 16:21:47.487745 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:47.487712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-tls\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:47.490732 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:47.490705 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9-node-exporter-tls\") pod \"node-exporter-d9f9n\" (UID: \"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9\") " pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:47.668784 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:47.668754 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d9f9n" Jun 11 16:21:49.223100 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:49.223059 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:49.223543 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:49.223156 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:49.228094 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:49.228068 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:49.550327 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:49.550297 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:21:51.402132 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:51.402098 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt"] Jun 11 16:21:51.405656 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:51.405627 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt" Jun 11 16:21:51.408822 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:51.408770 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 16:21:51.408976 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:51.408772 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2jfpm\"" Jun 11 16:21:51.415646 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:51.415622 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt"] Jun 11 16:21:51.418067 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:51.418037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/147c6a4c-6693-4389-a659-aac4727b6653-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-cmzgt\" (UID: \"147c6a4c-6693-4389-a659-aac4727b6653\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt" Jun 11 16:21:51.418178 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:51.418111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6xx2\" (UniqueName: \"kubernetes.io/projected/147c6a4c-6693-4389-a659-aac4727b6653-kube-api-access-x6xx2\") pod \"monitoring-plugin-76b68cc874-cmzgt\" (UID: \"147c6a4c-6693-4389-a659-aac4727b6653\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt" Jun 11 16:21:51.518877 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:51.518836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/147c6a4c-6693-4389-a659-aac4727b6653-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-cmzgt\" (UID: \"147c6a4c-6693-4389-a659-aac4727b6653\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt" Jun 11 16:21:51.519073 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:51.518906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6xx2\" (UniqueName: \"kubernetes.io/projected/147c6a4c-6693-4389-a659-aac4727b6653-kube-api-access-x6xx2\") pod \"monitoring-plugin-76b68cc874-cmzgt\" (UID: \"147c6a4c-6693-4389-a659-aac4727b6653\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt" Jun 11 16:21:51.519073 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:51.518982 2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 11 16:21:51.519073 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:21:51.519063 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147c6a4c-6693-4389-a659-aac4727b6653-monitoring-plugin-cert podName:147c6a4c-6693-4389-a659-aac4727b6653 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:52.019044329 +0000 UTC m=+129.367152552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/147c6a4c-6693-4389-a659-aac4727b6653-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-cmzgt" (UID: "147c6a4c-6693-4389-a659-aac4727b6653") : secret "monitoring-plugin-cert" not found Jun 11 16:21:51.533243 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:51.533212 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6xx2\" (UniqueName: \"kubernetes.io/projected/147c6a4c-6693-4389-a659-aac4727b6653-kube-api-access-x6xx2\") pod \"monitoring-plugin-76b68cc874-cmzgt\" (UID: \"147c6a4c-6693-4389-a659-aac4727b6653\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt" Jun 11 16:21:52.024418 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.024386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/147c6a4c-6693-4389-a659-aac4727b6653-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-cmzgt\" (UID: \"147c6a4c-6693-4389-a659-aac4727b6653\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt" Jun 11 16:21:52.026911 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.026887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/147c6a4c-6693-4389-a659-aac4727b6653-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-cmzgt\" (UID: \"147c6a4c-6693-4389-a659-aac4727b6653\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt" Jun 11 16:21:52.316358 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.316330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt" Jun 11 16:21:52.560564 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.560529 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7656bbf9bb-c68fb"] Jun 11 16:21:52.597754 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.597687 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-789577d49c-mqvml"] Jun 11 16:21:52.600973 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.600949 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.618724 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.618698 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789577d49c-mqvml"] Jun 11 16:21:52.629521 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.629496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-oauth-config\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.629639 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.629540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-service-ca\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.629639 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.629613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-serving-cert\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.629760 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.629660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjdfh\" (UniqueName: \"kubernetes.io/projected/4d8a44f5-be1d-4de6-8832-4245e42b5298-kube-api-access-tjdfh\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.629760 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.629707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-config\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.629760 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.629736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-trusted-ca-bundle\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.629930 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.629819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-oauth-serving-cert\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.731188 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.731152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-oauth-config\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.731364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.731197 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-service-ca\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.731439 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.731366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-serving-cert\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.731439 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.731429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjdfh\" (UniqueName: \"kubernetes.io/projected/4d8a44f5-be1d-4de6-8832-4245e42b5298-kube-api-access-tjdfh\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.731528 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.731474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-config\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.731528 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.731503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-trusted-ca-bundle\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.731615 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.731544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-oauth-serving-cert\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.732035 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.731994 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-service-ca\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.732260 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.732232 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-config\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.732394 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.732278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-oauth-serving-cert\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.732687 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.732654 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-trusted-ca-bundle\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.734043 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.733984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-oauth-config\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.734473 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.734447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-serving-cert\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.740301 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.740240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjdfh\" (UniqueName: \"kubernetes.io/projected/4d8a44f5-be1d-4de6-8832-4245e42b5298-kube-api-access-tjdfh\") pod \"console-789577d49c-mqvml\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:52.913132 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:52.912932 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:21:53.034549 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:53.034513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs\") pod \"network-metrics-daemon-9nbg4\" (UID: \"419c9be4-5ebc-4f73-83f3-e61cc760f0fa\") " pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:21:53.039914 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:53.037851 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419c9be4-5ebc-4f73-83f3-e61cc760f0fa-metrics-certs\") pod \"network-metrics-daemon-9nbg4\" (UID: \"419c9be4-5ebc-4f73-83f3-e61cc760f0fa\") " pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:21:53.211243 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:53.211167 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-49ftn\"" Jun 11 16:21:53.219391 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:53.219362 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9nbg4" Jun 11 16:21:53.816371 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:53.816336 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt"] Jun 11 16:21:53.820601 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:21:53.820535 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147c6a4c_6693_4389_a659_aac4727b6653.slice/crio-060857aa24b3fb001d96ab48c0d7151a9594e163fa8c76d725bce0e00517b75c WatchSource:0}: Error finding container 060857aa24b3fb001d96ab48c0d7151a9594e163fa8c76d725bce0e00517b75c: Status 404 returned error can't find the container with id 060857aa24b3fb001d96ab48c0d7151a9594e163fa8c76d725bce0e00517b75c Jun 11 16:21:53.833801 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:53.833731 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789577d49c-mqvml"] Jun 11 16:21:53.837004 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:21:53.836977 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8a44f5_be1d_4de6_8832_4245e42b5298.slice/crio-84b579d709625096b891da90873289466959e7268577894073e5475d00638d96 WatchSource:0}: Error finding container 84b579d709625096b891da90873289466959e7268577894073e5475d00638d96: Status 404 returned error can't find the container with id 84b579d709625096b891da90873289466959e7268577894073e5475d00638d96 Jun 11 16:21:54.070313 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.069517 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds"] Jun 11 16:21:54.073179 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.073031 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf"] Jun 11 16:21:54.073179 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.073095 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9nbg4"] Jun 11 16:21:54.076407 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:21:54.076315 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419c9be4_5ebc_4f73_83f3_e61cc760f0fa.slice/crio-1a0e7a93c06083fbba2ac8c98df3874370bf56d211be9b9c1a2b7501b61da054 WatchSource:0}: Error finding container 1a0e7a93c06083fbba2ac8c98df3874370bf56d211be9b9c1a2b7501b61da054: Status 404 returned error can't find the container with id 1a0e7a93c06083fbba2ac8c98df3874370bf56d211be9b9c1a2b7501b61da054 Jun 11 16:21:54.077116 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:21:54.076892 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8163d10f_bc9b_49b7_99b5_af031d049845.slice/crio-7010a67151fbfdf3088d6ab7f70037e648375dbd29b029de73e6f3573fcba701 WatchSource:0}: Error finding container 7010a67151fbfdf3088d6ab7f70037e648375dbd29b029de73e6f3573fcba701: Status 404 returned error can't find the container with id 7010a67151fbfdf3088d6ab7f70037e648375dbd29b029de73e6f3573fcba701 Jun 11 16:21:54.077378 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:21:54.077346 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7913000_84b9_494b_9d88_dbf8359d90ef.slice/crio-ac9e3ef5dfc6590e827ba90648b68794416e435274d70cb5f86647820d2fca41 WatchSource:0}: Error finding container ac9e3ef5dfc6590e827ba90648b68794416e435274d70cb5f86647820d2fca41: Status 404 returned error can't find the container with id ac9e3ef5dfc6590e827ba90648b68794416e435274d70cb5f86647820d2fca41 Jun 11 16:21:54.574104 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.572360 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789577d49c-mqvml" event={"ID":"4d8a44f5-be1d-4de6-8832-4245e42b5298","Type":"ContainerStarted","Data":"2f6b19240cc863c7d6f43cb2778460a63b54658faea82bffb9d4a4ccebf98367"} Jun 11 16:21:54.574104 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.572427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789577d49c-mqvml" event={"ID":"4d8a44f5-be1d-4de6-8832-4245e42b5298","Type":"ContainerStarted","Data":"84b579d709625096b891da90873289466959e7268577894073e5475d00638d96"} Jun 11 16:21:54.576485 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.575934 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-tbwkm" event={"ID":"90c74d1b-a21e-495d-9e2c-1c521a9985e4","Type":"ContainerStarted","Data":"30378116f2abd040e097636a7a0f975f1396bf6dd134dc3732cedeed6600bf6f"} Jun 11 16:21:54.578510 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.578483 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-tbwkm" Jun 11 16:21:54.579732 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.579685 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" event={"ID":"c7913000-84b9-494b-9d88-dbf8359d90ef","Type":"ContainerStarted","Data":"ac9e3ef5dfc6590e827ba90648b68794416e435274d70cb5f86647820d2fca41"} Jun 11 16:21:54.584007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.583980 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" event={"ID":"8163d10f-bc9b-49b7-99b5-af031d049845","Type":"ContainerStarted","Data":"6d202bb875a6abb8003a23c65b5bdfec78efd0cef9687af28567ef20a7b52365"} Jun 11 16:21:54.584146 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.584056 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" event={"ID":"8163d10f-bc9b-49b7-99b5-af031d049845","Type":"ContainerStarted","Data":"fd532dad1632794f54009d9f419028ae194103ecff5cf4a40181966a8d9b965d"} Jun 11 16:21:54.584146 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.584080 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" event={"ID":"8163d10f-bc9b-49b7-99b5-af031d049845","Type":"ContainerStarted","Data":"7010a67151fbfdf3088d6ab7f70037e648375dbd29b029de73e6f3573fcba701"} Jun 11 16:21:54.586283 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.586132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9nbg4" event={"ID":"419c9be4-5ebc-4f73-83f3-e61cc760f0fa","Type":"ContainerStarted","Data":"1a0e7a93c06083fbba2ac8c98df3874370bf56d211be9b9c1a2b7501b61da054"} Jun 11 16:21:54.587669 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.587606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt" event={"ID":"147c6a4c-6693-4389-a659-aac4727b6653","Type":"ContainerStarted","Data":"060857aa24b3fb001d96ab48c0d7151a9594e163fa8c76d725bce0e00517b75c"} Jun 11 16:21:54.590945 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.589713 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-tbwkm" Jun 11 16:21:54.592141 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.592093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d9f9n" event={"ID":"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9","Type":"ContainerStarted","Data":"fe09cae2c1790e0686f3d4476e65978965754037c3ea008f84dfeebad91b66db"} Jun 11 16:21:54.613726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.613680 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-789577d49c-mqvml" podStartSLOduration=2.613667305 podStartE2EDuration="2.613667305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:54.611988624 +0000 UTC m=+131.960096856" watchObservedRunningTime="2026-06-11 16:21:54.613667305 +0000 UTC m=+131.961775524" Jun 11 16:21:54.667900 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:54.667837 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-tbwkm" podStartSLOduration=1.584389626 podStartE2EDuration="20.667814494s" totalImagesPullingTime="19.083424868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:54.665799518 +0000 UTC m=+132.013907751" watchObservedRunningTime="2026-06-11 16:21:54.667814494 +0000 UTC m=+132.015922726" Jun 11 16:21:55.593809 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:55.593698 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:21:56.516897 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:56.516860 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-676c45565-ttl8r"] Jun 11 16:21:58.611644 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.611602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" event={"ID":"c7913000-84b9-494b-9d88-dbf8359d90ef","Type":"ContainerStarted","Data":"8a9512b47ead43afbec34edcf83ad0904037526a36589879bc4fef0e8afed221"} Jun 11 16:21:58.612143 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.611677 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" event={"ID":"c7913000-84b9-494b-9d88-dbf8359d90ef","Type":"ContainerStarted","Data":"c31752ead139a48f5806e41dbf932df2708cb6c069976316436f0e11f4b36213"} Jun 11 16:21:58.612143 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.611709 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" event={"ID":"c7913000-84b9-494b-9d88-dbf8359d90ef","Type":"ContainerStarted","Data":"2e0aaf21cf62e349c6406a51565ad770e7b83b813296bf9e69193589af7c304e"} Jun 11 16:21:58.614196 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.614162 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" event={"ID":"8163d10f-bc9b-49b7-99b5-af031d049845","Type":"ContainerStarted","Data":"eff7153608abfe99574f02e6ada90b1476677e2432a74801ead3cbfeeca6c0da"} Jun 11 16:21:58.616358 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.616334 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9nbg4" event={"ID":"419c9be4-5ebc-4f73-83f3-e61cc760f0fa","Type":"ContainerStarted","Data":"657f7d5eaf19765728bab9bdc6bc008e2e14537c803fbb8eddbaea9979187d10"} Jun 11 16:21:58.616473 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.616382 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9nbg4" event={"ID":"419c9be4-5ebc-4f73-83f3-e61cc760f0fa","Type":"ContainerStarted","Data":"31328643c69b14c2b1c35d8f72059d8c98113e73199382f32366f8a1d51df38e"} Jun 11 16:21:58.618085 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.618061 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt" event={"ID":"147c6a4c-6693-4389-a659-aac4727b6653","Type":"ContainerStarted","Data":"7a89a773c4655c623141065dc1937b184bd78af23b8f57ee180b448ee7c44481"} Jun 11 16:21:58.618291 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.618266 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt" Jun 11 16:21:58.619893 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.619871 2576 generic.go:356] "Generic (PLEG): container finished" podID="ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9" containerID="591b7afe3b30cd191eecca2485cd061e4fb496f96aa28fb5c2c9b4fb7ff7cc64" exitCode=0 Jun 11 16:21:58.620105 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.619901 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d9f9n" event={"ID":"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9","Type":"ContainerDied","Data":"591b7afe3b30cd191eecca2485cd061e4fb496f96aa28fb5c2c9b4fb7ff7cc64"} Jun 11 16:21:58.624341 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.624320 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt" Jun 11 16:21:58.650702 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.650655 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pwgds" podStartSLOduration=9.091449472 podStartE2EDuration="12.650641386s" totalImagesPullingTime="3.559191914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:58.649361421 +0000 UTC m=+135.997469653" watchObservedRunningTime="2026-06-11 16:21:58.650641386 +0000 UTC m=+135.998749620" Jun 11 16:21:58.679104 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.679052 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wtphf" podStartSLOduration=9.275595519 podStartE2EDuration="12.679032624s" totalImagesPullingTime="3.403437105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:58.677865415 +0000 UTC m=+136.025973649" watchObservedRunningTime="2026-06-11 16:21:58.679032624 +0000 UTC m=+136.027140856" Jun 11 16:21:58.718478 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.718425 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9nbg4" podStartSLOduration=132.159475099 podStartE2EDuration="2m15.718405838s" totalImagesPullingTime="3.558930739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:58.717372616 +0000 UTC m=+136.065480845" watchObservedRunningTime="2026-06-11 16:21:58.718405838 +0000 UTC m=+136.066514070" Jun 11 16:21:58.778871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:58.778811 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-cmzgt" podStartSLOduration=3.965330992 podStartE2EDuration="7.778789895s" totalImagesPullingTime="3.813458903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:58.777418957 +0000 UTC m=+136.125527191" watchObservedRunningTime="2026-06-11 16:21:58.778789895 +0000 UTC m=+136.126898127" Jun 11 16:21:59.630685 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:59.630649 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d9f9n" event={"ID":"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9","Type":"ContainerStarted","Data":"01d408239323840b59a1429073980654bd951c3333d2e012ce6ffa92d7cf7136"} Jun 11 16:21:59.631217 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:59.630712 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d9f9n" event={"ID":"ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9","Type":"ContainerStarted","Data":"2ff81cead2b88be7d0254c1528bde17f87ee1c32ba3cea197ddab990db11c843"} Jun 11 16:21:59.657499 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:21:59.657447 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d9f9n" podStartSLOduration=9.56652987 podStartE2EDuration="13.657428017s" totalImagesPullingTime="3.937011518s" totalInitContainerRuntime="153.886629ms" isStatefulPod=true podCreationTimestamp="2026-06-11 16:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:59.655387656 +0000 UTC m=+137.003495890" watchObservedRunningTime="2026-06-11 16:21:59.657428017 +0000 UTC m=+137.005536250" Jun 11 16:22:02.913946 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:02.913911 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:22:02.914488 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:02.913998 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:22:02.918761 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:02.918741 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:22:03.650328 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:03.650299 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:22:03.703758 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:03.703728 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c8ff7bc8d-csr9x"] Jun 11 16:22:17.581891 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.581851 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7656bbf9bb-c68fb" podUID="35c11863-bfa2-4cf6-bf69-9dfec052556f" containerName="console" containerID="cri-o://5e5c892d3cbbae63cfccdbf0eea3f431a0b50fd2f592108dcbbcfd8a78c6ee8f" gracePeriod=15 Jun 11 16:22:17.706484 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.706457 2576 generic.go:356] "Generic (PLEG): container finished" podID="35c11863-bfa2-4cf6-bf69-9dfec052556f" containerID="5e5c892d3cbbae63cfccdbf0eea3f431a0b50fd2f592108dcbbcfd8a78c6ee8f" exitCode=0 Jun 11 16:22:17.706574 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.706502 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7656bbf9bb-c68fb" event={"ID":"35c11863-bfa2-4cf6-bf69-9dfec052556f","Type":"ContainerDied","Data":"5e5c892d3cbbae63cfccdbf0eea3f431a0b50fd2f592108dcbbcfd8a78c6ee8f"} Jun 11 16:22:17.849117 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.849055 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:22:17.955458 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.955427 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-service-ca\") pod \"35c11863-bfa2-4cf6-bf69-9dfec052556f\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " Jun 11 16:22:17.955627 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.955465 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-config\") pod \"35c11863-bfa2-4cf6-bf69-9dfec052556f\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " Jun 11 16:22:17.955627 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.955506 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-trusted-ca-bundle\") pod \"35c11863-bfa2-4cf6-bf69-9dfec052556f\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " Jun 11 16:22:17.955739 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.955636 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-serving-cert\") pod \"35c11863-bfa2-4cf6-bf69-9dfec052556f\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " Jun 11 16:22:17.955739 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.955721 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-oauth-serving-cert\") pod \"35c11863-bfa2-4cf6-bf69-9dfec052556f\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " Jun 11 16:22:17.955843 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.955759 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-oauth-config\") pod \"35c11863-bfa2-4cf6-bf69-9dfec052556f\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " Jun 11 16:22:17.955843 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.955790 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvlx4\" (UniqueName: \"kubernetes.io/projected/35c11863-bfa2-4cf6-bf69-9dfec052556f-kube-api-access-gvlx4\") pod \"35c11863-bfa2-4cf6-bf69-9dfec052556f\" (UID: \"35c11863-bfa2-4cf6-bf69-9dfec052556f\") " Jun 11 16:22:17.955947 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.955839 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-config" (OuterVolumeSpecName: "console-config") pod "35c11863-bfa2-4cf6-bf69-9dfec052556f" (UID: "35c11863-bfa2-4cf6-bf69-9dfec052556f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:22:17.955947 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.955909 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-service-ca" (OuterVolumeSpecName: "service-ca") pod "35c11863-bfa2-4cf6-bf69-9dfec052556f" (UID: "35c11863-bfa2-4cf6-bf69-9dfec052556f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:22:17.956120 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.956098 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "35c11863-bfa2-4cf6-bf69-9dfec052556f" (UID: "35c11863-bfa2-4cf6-bf69-9dfec052556f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:22:17.956224 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.956206 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-service-ca\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:17.956283 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.956229 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-config\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:17.956283 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.956245 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "35c11863-bfa2-4cf6-bf69-9dfec052556f" (UID: "35c11863-bfa2-4cf6-bf69-9dfec052556f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:22:17.957961 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.957929 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "35c11863-bfa2-4cf6-bf69-9dfec052556f" (UID: "35c11863-bfa2-4cf6-bf69-9dfec052556f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:22:17.958088 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.957990 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "35c11863-bfa2-4cf6-bf69-9dfec052556f" (UID: "35c11863-bfa2-4cf6-bf69-9dfec052556f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:22:17.958088 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:17.958002 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35c11863-bfa2-4cf6-bf69-9dfec052556f-kube-api-access-gvlx4" (OuterVolumeSpecName: "kube-api-access-gvlx4") pod "35c11863-bfa2-4cf6-bf69-9dfec052556f" (UID: "35c11863-bfa2-4cf6-bf69-9dfec052556f"). InnerVolumeSpecName "kube-api-access-gvlx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:22:18.056847 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:18.056819 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-trusted-ca-bundle\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:18.056847 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:18.056843 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-serving-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:18.056978 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:18.056856 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35c11863-bfa2-4cf6-bf69-9dfec052556f-oauth-serving-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:18.056978 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:18.056869 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35c11863-bfa2-4cf6-bf69-9dfec052556f-console-oauth-config\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:18.056978 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:18.056881 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvlx4\" (UniqueName: \"kubernetes.io/projected/35c11863-bfa2-4cf6-bf69-9dfec052556f-kube-api-access-gvlx4\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:18.711604 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:18.711575 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7656bbf9bb-c68fb" Jun 11 16:22:18.711997 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:18.711575 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7656bbf9bb-c68fb" event={"ID":"35c11863-bfa2-4cf6-bf69-9dfec052556f","Type":"ContainerDied","Data":"fe30c4dff08d34a4faa08fa62cc41a02f3c1c61d43dd8cea33ca398ccf48cc47"} Jun 11 16:22:18.711997 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:18.711699 2576 scope.go:117] "RemoveContainer" containerID="5e5c892d3cbbae63cfccdbf0eea3f431a0b50fd2f592108dcbbcfd8a78c6ee8f" Jun 11 16:22:18.737277 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:18.737246 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7656bbf9bb-c68fb"] Jun 11 16:22:18.743626 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:18.743604 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7656bbf9bb-c68fb"] Jun 11 16:22:19.100693 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:19.100662 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35c11863-bfa2-4cf6-bf69-9dfec052556f" path="/var/lib/kubelet/pods/35c11863-bfa2-4cf6-bf69-9dfec052556f/volumes" Jun 11 16:22:21.540252 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.540136 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-676c45565-ttl8r" podUID="d2bfb8df-3d23-4264-b30e-d68886fcef57" containerName="registry" containerID="cri-o://9c3256e7bca4ab53088cde1c6e79fce6cece1486c51857e86fb39ebef78b2576" gracePeriod=30 Jun 11 16:22:21.725532 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.725507 2576 generic.go:356] "Generic (PLEG): container finished" podID="d2bfb8df-3d23-4264-b30e-d68886fcef57" containerID="9c3256e7bca4ab53088cde1c6e79fce6cece1486c51857e86fb39ebef78b2576" exitCode=0 Jun 11 16:22:21.725651 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.725555 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-676c45565-ttl8r" event={"ID":"d2bfb8df-3d23-4264-b30e-d68886fcef57","Type":"ContainerDied","Data":"9c3256e7bca4ab53088cde1c6e79fce6cece1486c51857e86fb39ebef78b2576"} Jun 11 16:22:21.772031 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.771990 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:22:21.889989 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.889957 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls\") pod \"d2bfb8df-3d23-4264-b30e-d68886fcef57\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " Jun 11 16:22:21.890181 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.890031 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-image-registry-private-configuration\") pod \"d2bfb8df-3d23-4264-b30e-d68886fcef57\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " Jun 11 16:22:21.890181 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.890061 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2bfb8df-3d23-4264-b30e-d68886fcef57-ca-trust-extracted\") pod \"d2bfb8df-3d23-4264-b30e-d68886fcef57\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " Jun 11 16:22:21.890181 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.890118 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-installation-pull-secrets\") pod \"d2bfb8df-3d23-4264-b30e-d68886fcef57\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " Jun 11 16:22:21.890181 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.890144 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-bound-sa-token\") pod \"d2bfb8df-3d23-4264-b30e-d68886fcef57\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " Jun 11 16:22:21.890181 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.890172 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-trusted-ca\") pod \"d2bfb8df-3d23-4264-b30e-d68886fcef57\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " Jun 11 16:22:21.890428 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.890202 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gs2m\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-kube-api-access-5gs2m\") pod \"d2bfb8df-3d23-4264-b30e-d68886fcef57\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " Jun 11 16:22:21.890428 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.890251 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-certificates\") pod \"d2bfb8df-3d23-4264-b30e-d68886fcef57\" (UID: \"d2bfb8df-3d23-4264-b30e-d68886fcef57\") " Jun 11 16:22:21.890905 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.890876 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d2bfb8df-3d23-4264-b30e-d68886fcef57" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:22:21.891083 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.890968 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d2bfb8df-3d23-4264-b30e-d68886fcef57" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:22:21.892723 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.892696 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d2bfb8df-3d23-4264-b30e-d68886fcef57" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:22:21.892829 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.892767 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d2bfb8df-3d23-4264-b30e-d68886fcef57" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:22:21.892829 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.892773 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d2bfb8df-3d23-4264-b30e-d68886fcef57" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:22:21.892923 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.892836 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d2bfb8df-3d23-4264-b30e-d68886fcef57" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:22:21.892923 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.892874 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-kube-api-access-5gs2m" (OuterVolumeSpecName: "kube-api-access-5gs2m") pod "d2bfb8df-3d23-4264-b30e-d68886fcef57" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57"). InnerVolumeSpecName "kube-api-access-5gs2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:22:21.898691 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.898669 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2bfb8df-3d23-4264-b30e-d68886fcef57-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d2bfb8df-3d23-4264-b30e-d68886fcef57" (UID: "d2bfb8df-3d23-4264-b30e-d68886fcef57"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:22:21.991343 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.991308 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-bound-sa-token\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:21.991343 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.991338 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-trusted-ca\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:21.991343 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.991347 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gs2m\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-kube-api-access-5gs2m\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:21.991546 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.991359 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-certificates\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:21.991546 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.991368 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2bfb8df-3d23-4264-b30e-d68886fcef57-registry-tls\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:21.991546 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.991378 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-image-registry-private-configuration\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:21.991546 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.991387 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2bfb8df-3d23-4264-b30e-d68886fcef57-ca-trust-extracted\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:21.991546 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:21.991396 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2bfb8df-3d23-4264-b30e-d68886fcef57-installation-pull-secrets\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:22.730152 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:22.730119 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-676c45565-ttl8r" event={"ID":"d2bfb8df-3d23-4264-b30e-d68886fcef57","Type":"ContainerDied","Data":"b9c41166999d62c9a26c9d32060ecc6e88478cfa7d2457ab7b7e17db58207d24"} Jun 11 16:22:22.730562 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:22.730179 2576 scope.go:117] "RemoveContainer" containerID="9c3256e7bca4ab53088cde1c6e79fce6cece1486c51857e86fb39ebef78b2576" Jun 11 16:22:22.730562 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:22.730133 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-676c45565-ttl8r" Jun 11 16:22:22.755518 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:22.755486 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-676c45565-ttl8r"] Jun 11 16:22:22.759600 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:22.759575 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-676c45565-ttl8r"] Jun 11 16:22:23.101371 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:23.101338 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2bfb8df-3d23-4264-b30e-d68886fcef57" path="/var/lib/kubelet/pods/d2bfb8df-3d23-4264-b30e-d68886fcef57/volumes" Jun 11 16:22:28.730686 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:28.730617 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c8ff7bc8d-csr9x" podUID="24b356c5-71f9-48b8-93f6-a71ddeaf0b8e" containerName="console" containerID="cri-o://7d5dce33f579cc28c82f27f31d2ba4c5fffe6c1e109f6d9c7ecd2e6f37c3b4f1" gracePeriod=15 Jun 11 16:22:29.006519 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.006456 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:22:29.145540 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.145509 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-oauth-config\") pod \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " Jun 11 16:22:29.145688 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.145562 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-service-ca\") pod \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " Jun 11 16:22:29.145688 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.145578 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-config\") pod \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " Jun 11 16:22:29.145688 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.145624 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-serving-cert\") pod \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " Jun 11 16:22:29.145688 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.145649 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hh5q\" (UniqueName: \"kubernetes.io/projected/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-kube-api-access-2hh5q\") pod \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " Jun 11 16:22:29.145843 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.145689 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-oauth-serving-cert\") pod \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\" (UID: \"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e\") " Jun 11 16:22:29.146096 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.146067 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-config" (OuterVolumeSpecName: "console-config") pod "24b356c5-71f9-48b8-93f6-a71ddeaf0b8e" (UID: "24b356c5-71f9-48b8-93f6-a71ddeaf0b8e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:22:29.146213 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.146145 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-service-ca" (OuterVolumeSpecName: "service-ca") pod "24b356c5-71f9-48b8-93f6-a71ddeaf0b8e" (UID: "24b356c5-71f9-48b8-93f6-a71ddeaf0b8e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:22:29.146213 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.146179 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "24b356c5-71f9-48b8-93f6-a71ddeaf0b8e" (UID: "24b356c5-71f9-48b8-93f6-a71ddeaf0b8e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:22:29.147798 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.147761 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "24b356c5-71f9-48b8-93f6-a71ddeaf0b8e" (UID: "24b356c5-71f9-48b8-93f6-a71ddeaf0b8e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:22:29.147911 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.147808 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "24b356c5-71f9-48b8-93f6-a71ddeaf0b8e" (UID: "24b356c5-71f9-48b8-93f6-a71ddeaf0b8e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:22:29.147911 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.147880 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-kube-api-access-2hh5q" (OuterVolumeSpecName: "kube-api-access-2hh5q") pod "24b356c5-71f9-48b8-93f6-a71ddeaf0b8e" (UID: "24b356c5-71f9-48b8-93f6-a71ddeaf0b8e"). InnerVolumeSpecName "kube-api-access-2hh5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:22:29.247079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.247041 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hh5q\" (UniqueName: \"kubernetes.io/projected/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-kube-api-access-2hh5q\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:29.247079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.247072 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-oauth-serving-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:29.247257 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.247086 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-oauth-config\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:29.247257 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.247100 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-service-ca\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:29.247257 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.247112 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-config\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:29.247257 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.247125 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e-console-serving-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:22:29.758961 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.758922 2576 generic.go:356] "Generic (PLEG): container finished" podID="24b356c5-71f9-48b8-93f6-a71ddeaf0b8e" containerID="7d5dce33f579cc28c82f27f31d2ba4c5fffe6c1e109f6d9c7ecd2e6f37c3b4f1" exitCode=0 Jun 11 16:22:29.759355 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.758967 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c8ff7bc8d-csr9x" Jun 11 16:22:29.759355 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.759031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c8ff7bc8d-csr9x" event={"ID":"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e","Type":"ContainerDied","Data":"7d5dce33f579cc28c82f27f31d2ba4c5fffe6c1e109f6d9c7ecd2e6f37c3b4f1"} Jun 11 16:22:29.759355 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.759087 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c8ff7bc8d-csr9x" event={"ID":"24b356c5-71f9-48b8-93f6-a71ddeaf0b8e","Type":"ContainerDied","Data":"91062f7ea5e804d430c647ab1d0386f54ebc5515c5038c1a1b02b1ae512d8ee3"} Jun 11 16:22:29.759355 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.759110 2576 scope.go:117] "RemoveContainer" containerID="7d5dce33f579cc28c82f27f31d2ba4c5fffe6c1e109f6d9c7ecd2e6f37c3b4f1" Jun 11 16:22:29.767792 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.767776 2576 scope.go:117] "RemoveContainer" containerID="7d5dce33f579cc28c82f27f31d2ba4c5fffe6c1e109f6d9c7ecd2e6f37c3b4f1" Jun 11 16:22:29.768118 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:22:29.768089 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d5dce33f579cc28c82f27f31d2ba4c5fffe6c1e109f6d9c7ecd2e6f37c3b4f1\": container with ID starting with 7d5dce33f579cc28c82f27f31d2ba4c5fffe6c1e109f6d9c7ecd2e6f37c3b4f1 not found: ID does not exist" containerID="7d5dce33f579cc28c82f27f31d2ba4c5fffe6c1e109f6d9c7ecd2e6f37c3b4f1" Jun 11 16:22:29.768232 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.768117 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d5dce33f579cc28c82f27f31d2ba4c5fffe6c1e109f6d9c7ecd2e6f37c3b4f1"} err="failed to get container status \"7d5dce33f579cc28c82f27f31d2ba4c5fffe6c1e109f6d9c7ecd2e6f37c3b4f1\": rpc error: code = NotFound desc = could not find container \"7d5dce33f579cc28c82f27f31d2ba4c5fffe6c1e109f6d9c7ecd2e6f37c3b4f1\": container with ID starting with 7d5dce33f579cc28c82f27f31d2ba4c5fffe6c1e109f6d9c7ecd2e6f37c3b4f1 not found: ID does not exist" Jun 11 16:22:29.784779 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.784752 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c8ff7bc8d-csr9x"] Jun 11 16:22:29.787567 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:29.787546 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c8ff7bc8d-csr9x"] Jun 11 16:22:31.100494 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:22:31.100460 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24b356c5-71f9-48b8-93f6-a71ddeaf0b8e" path="/var/lib/kubelet/pods/24b356c5-71f9-48b8-93f6-a71ddeaf0b8e/volumes" Jun 11 16:23:11.254785 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.254749 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-85b6dc9799-qgrfn"] Jun 11 16:23:11.255191 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.255040 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2bfb8df-3d23-4264-b30e-d68886fcef57" containerName="registry" Jun 11 16:23:11.255191 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.255052 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2bfb8df-3d23-4264-b30e-d68886fcef57" containerName="registry" Jun 11 16:23:11.255191 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.255068 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b356c5-71f9-48b8-93f6-a71ddeaf0b8e" containerName="console" Jun 11 16:23:11.255191 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.255073 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b356c5-71f9-48b8-93f6-a71ddeaf0b8e" containerName="console" Jun 11 16:23:11.255191 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.255079 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c11863-bfa2-4cf6-bf69-9dfec052556f" containerName="console" Jun 11 16:23:11.255191 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.255084 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c11863-bfa2-4cf6-bf69-9dfec052556f" containerName="console" Jun 11 16:23:11.255191 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.255124 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2bfb8df-3d23-4264-b30e-d68886fcef57" containerName="registry" Jun 11 16:23:11.255191 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.255132 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="35c11863-bfa2-4cf6-bf69-9dfec052556f" containerName="console" Jun 11 16:23:11.255191 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.255138 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b356c5-71f9-48b8-93f6-a71ddeaf0b8e" containerName="console" Jun 11 16:23:11.257767 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.257741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.261486 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.261458 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8k8wg\"" Jun 11 16:23:11.261486 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.261471 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 16:23:11.261660 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.261522 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 16:23:11.261660 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.261475 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 16:23:11.261660 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.261475 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 16:23:11.261935 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.261919 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 16:23:11.268042 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.267852 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 16:23:11.273417 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.273394 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85b6dc9799-qgrfn"] Jun 11 16:23:11.358744 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.358707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1ae5714-5bd1-46c7-b782-6eeddf373554-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.358880 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.358753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1ae5714-5bd1-46c7-b782-6eeddf373554-serving-certs-ca-bundle\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.358880 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.358791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c1ae5714-5bd1-46c7-b782-6eeddf373554-federate-client-tls\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.358880 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.358818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1ae5714-5bd1-46c7-b782-6eeddf373554-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.358880 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.358867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1ae5714-5bd1-46c7-b782-6eeddf373554-metrics-client-ca\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.359113 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.358901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvjwf\" (UniqueName: \"kubernetes.io/projected/c1ae5714-5bd1-46c7-b782-6eeddf373554-kube-api-access-vvjwf\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.359113 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.358990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c1ae5714-5bd1-46c7-b782-6eeddf373554-secret-telemeter-client\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.359113 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.359040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c1ae5714-5bd1-46c7-b782-6eeddf373554-telemeter-client-tls\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.459801 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.459764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvjwf\" (UniqueName: \"kubernetes.io/projected/c1ae5714-5bd1-46c7-b782-6eeddf373554-kube-api-access-vvjwf\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.459954 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.459819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c1ae5714-5bd1-46c7-b782-6eeddf373554-secret-telemeter-client\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.460056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.460031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c1ae5714-5bd1-46c7-b782-6eeddf373554-telemeter-client-tls\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.460123 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.460094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1ae5714-5bd1-46c7-b782-6eeddf373554-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.460178 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.460128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1ae5714-5bd1-46c7-b782-6eeddf373554-serving-certs-ca-bundle\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.460178 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.460162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c1ae5714-5bd1-46c7-b782-6eeddf373554-federate-client-tls\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.460279 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.460194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1ae5714-5bd1-46c7-b782-6eeddf373554-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.460279 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.460247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1ae5714-5bd1-46c7-b782-6eeddf373554-metrics-client-ca\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.460919 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.460886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1ae5714-5bd1-46c7-b782-6eeddf373554-serving-certs-ca-bundle\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.461065 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.460969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1ae5714-5bd1-46c7-b782-6eeddf373554-metrics-client-ca\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.461344 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.461318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1ae5714-5bd1-46c7-b782-6eeddf373554-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.462664 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.462637 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c1ae5714-5bd1-46c7-b782-6eeddf373554-secret-telemeter-client\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.462752 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.462695 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1ae5714-5bd1-46c7-b782-6eeddf373554-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.462791 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.462755 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c1ae5714-5bd1-46c7-b782-6eeddf373554-telemeter-client-tls\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.462791 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.462771 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c1ae5714-5bd1-46c7-b782-6eeddf373554-federate-client-tls\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.469074 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.468992 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvjwf\" (UniqueName: \"kubernetes.io/projected/c1ae5714-5bd1-46c7-b782-6eeddf373554-kube-api-access-vvjwf\") pod \"telemeter-client-85b6dc9799-qgrfn\" (UID: \"c1ae5714-5bd1-46c7-b782-6eeddf373554\") " pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.568465 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.568437 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" Jun 11 16:23:11.713225 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.713197 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85b6dc9799-qgrfn"] Jun 11 16:23:11.716421 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:23:11.716370 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ae5714_5bd1_46c7_b782_6eeddf373554.slice/crio-d5f44726ab94943d8c80691b5e12b57f52f2cc2ee1f92ccedd901954a6b6692a WatchSource:0}: Error finding container d5f44726ab94943d8c80691b5e12b57f52f2cc2ee1f92ccedd901954a6b6692a: Status 404 returned error can't find the container with id d5f44726ab94943d8c80691b5e12b57f52f2cc2ee1f92ccedd901954a6b6692a Jun 11 16:23:11.906483 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:11.906400 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" event={"ID":"c1ae5714-5bd1-46c7-b782-6eeddf373554","Type":"ContainerStarted","Data":"d5f44726ab94943d8c80691b5e12b57f52f2cc2ee1f92ccedd901954a6b6692a"} Jun 11 16:23:13.918093 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:13.918057 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" event={"ID":"c1ae5714-5bd1-46c7-b782-6eeddf373554","Type":"ContainerStarted","Data":"b8e1dbd38754a233517d3cf9abafdcad5e1f9e33df6c91dd7f7f55990ae844e3"} Jun 11 16:23:14.923561 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:14.923523 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" event={"ID":"c1ae5714-5bd1-46c7-b782-6eeddf373554","Type":"ContainerStarted","Data":"c92f90beec5a46ab4fafc4778cfc88225f9e36244f57e3015ebd26a3d994d892"} Jun 11 16:23:14.923933 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:14.923613 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" event={"ID":"c1ae5714-5bd1-46c7-b782-6eeddf373554","Type":"ContainerStarted","Data":"7260be73a637bcd3567526822bee164f2cb941878fb50d87ec01c1a2c41447e7"} Jun 11 16:23:14.951474 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:14.951422 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-85b6dc9799-qgrfn" podStartSLOduration=1.571556815 podStartE2EDuration="3.951408551s" totalImagesPullingTime="2.379851736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:23:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:23:14.948856981 +0000 UTC m=+212.296965212" watchObservedRunningTime="2026-06-11 16:23:14.951408551 +0000 UTC m=+212.299516783" Jun 11 16:23:15.754495 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.754461 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5889b9b8db-lctvk"] Jun 11 16:23:15.756777 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.756758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.776768 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.776743 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5889b9b8db-lctvk"] Jun 11 16:23:15.799278 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.799248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-oauth-serving-cert\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.799388 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.799296 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-oauth-config\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.799388 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.799330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-config\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.799470 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.799404 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-service-ca\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.799470 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.799441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-trusted-ca-bundle\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.799553 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.799468 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-serving-cert\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.799553 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.799485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84wlh\" (UniqueName: \"kubernetes.io/projected/e49ffc84-6b0e-417e-b6d4-d532c24920f6-kube-api-access-84wlh\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.900665 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.900629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-service-ca\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.900818 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.900675 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-trusted-ca-bundle\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.900818 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.900707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-serving-cert\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.900910 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.900871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84wlh\" (UniqueName: \"kubernetes.io/projected/e49ffc84-6b0e-417e-b6d4-d532c24920f6-kube-api-access-84wlh\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.900954 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.900918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-oauth-serving-cert\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.901005 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.900953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-oauth-config\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.901161 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.901134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-config\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.901452 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.901428 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-service-ca\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.901694 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.901667 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-oauth-serving-cert\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.901778 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.901736 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-trusted-ca-bundle\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.901778 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.901755 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-config\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.903198 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.903179 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-oauth-config\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.903332 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.903317 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-serving-cert\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:15.910492 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:15.910474 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84wlh\" (UniqueName: \"kubernetes.io/projected/e49ffc84-6b0e-417e-b6d4-d532c24920f6-kube-api-access-84wlh\") pod \"console-5889b9b8db-lctvk\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:16.065939 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:16.065897 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:16.193796 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:16.193760 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5889b9b8db-lctvk"] Jun 11 16:23:16.196558 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:23:16.196525 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode49ffc84_6b0e_417e_b6d4_d532c24920f6.slice/crio-01e1e00e6cc83bd2b13b0840dca59b886d917fe2afa367dc74da000346740f0f WatchSource:0}: Error finding container 01e1e00e6cc83bd2b13b0840dca59b886d917fe2afa367dc74da000346740f0f: Status 404 returned error can't find the container with id 01e1e00e6cc83bd2b13b0840dca59b886d917fe2afa367dc74da000346740f0f Jun 11 16:23:16.932531 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:16.932487 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5889b9b8db-lctvk" event={"ID":"e49ffc84-6b0e-417e-b6d4-d532c24920f6","Type":"ContainerStarted","Data":"f3289aa90970cdc8a398e886c65606844e69d778bd840adb6051188075bcf3a3"} Jun 11 16:23:16.932710 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:16.932554 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5889b9b8db-lctvk" event={"ID":"e49ffc84-6b0e-417e-b6d4-d532c24920f6","Type":"ContainerStarted","Data":"01e1e00e6cc83bd2b13b0840dca59b886d917fe2afa367dc74da000346740f0f"} Jun 11 16:23:16.953377 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:16.953328 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5889b9b8db-lctvk" podStartSLOduration=1.953314593 podStartE2EDuration="1.953314593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:23:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:23:16.952703201 +0000 UTC m=+214.300811432" watchObservedRunningTime="2026-06-11 16:23:16.953314593 +0000 UTC m=+214.301422871" Jun 11 16:23:26.066948 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:26.066905 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:26.067362 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:26.067004 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:26.071852 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:26.071833 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:26.974595 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:26.974564 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:23:27.029044 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:27.029003 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789577d49c-mqvml"] Jun 11 16:23:52.053672 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.053594 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-789577d49c-mqvml" podUID="4d8a44f5-be1d-4de6-8832-4245e42b5298" containerName="console" containerID="cri-o://2f6b19240cc863c7d6f43cb2778460a63b54658faea82bffb9d4a4ccebf98367" gracePeriod=15 Jun 11 16:23:52.304824 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.304763 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:23:52.473329 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.473289 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-oauth-serving-cert\") pod \"4d8a44f5-be1d-4de6-8832-4245e42b5298\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " Jun 11 16:23:52.473329 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.473336 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-oauth-config\") pod \"4d8a44f5-be1d-4de6-8832-4245e42b5298\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " Jun 11 16:23:52.473543 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.473356 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-config\") pod \"4d8a44f5-be1d-4de6-8832-4245e42b5298\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " Jun 11 16:23:52.473543 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.473381 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjdfh\" (UniqueName: \"kubernetes.io/projected/4d8a44f5-be1d-4de6-8832-4245e42b5298-kube-api-access-tjdfh\") pod \"4d8a44f5-be1d-4de6-8832-4245e42b5298\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " Jun 11 16:23:52.473543 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.473424 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-serving-cert\") pod \"4d8a44f5-be1d-4de6-8832-4245e42b5298\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " Jun 11 16:23:52.473543 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.473457 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-service-ca\") pod \"4d8a44f5-be1d-4de6-8832-4245e42b5298\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " Jun 11 16:23:52.473543 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.473491 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-trusted-ca-bundle\") pod \"4d8a44f5-be1d-4de6-8832-4245e42b5298\" (UID: \"4d8a44f5-be1d-4de6-8832-4245e42b5298\") " Jun 11 16:23:52.473788 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.473642 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4d8a44f5-be1d-4de6-8832-4245e42b5298" (UID: "4d8a44f5-be1d-4de6-8832-4245e42b5298"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:52.473788 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.473750 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-config" (OuterVolumeSpecName: "console-config") pod "4d8a44f5-be1d-4de6-8832-4245e42b5298" (UID: "4d8a44f5-be1d-4de6-8832-4245e42b5298"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:52.473935 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.473898 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4d8a44f5-be1d-4de6-8832-4245e42b5298" (UID: "4d8a44f5-be1d-4de6-8832-4245e42b5298"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:52.474161 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.474140 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-service-ca" (OuterVolumeSpecName: "service-ca") pod "4d8a44f5-be1d-4de6-8832-4245e42b5298" (UID: "4d8a44f5-be1d-4de6-8832-4245e42b5298"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:52.475599 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.475576 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4d8a44f5-be1d-4de6-8832-4245e42b5298" (UID: "4d8a44f5-be1d-4de6-8832-4245e42b5298"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:52.475706 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.475643 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d8a44f5-be1d-4de6-8832-4245e42b5298-kube-api-access-tjdfh" (OuterVolumeSpecName: "kube-api-access-tjdfh") pod "4d8a44f5-be1d-4de6-8832-4245e42b5298" (UID: "4d8a44f5-be1d-4de6-8832-4245e42b5298"). InnerVolumeSpecName "kube-api-access-tjdfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:23:52.475808 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.475785 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4d8a44f5-be1d-4de6-8832-4245e42b5298" (UID: "4d8a44f5-be1d-4de6-8832-4245e42b5298"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:52.574751 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.574698 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-oauth-serving-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:23:52.574751 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.574718 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-oauth-config\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:23:52.574751 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.574728 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-config\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:23:52.574751 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.574738 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjdfh\" (UniqueName: \"kubernetes.io/projected/4d8a44f5-be1d-4de6-8832-4245e42b5298-kube-api-access-tjdfh\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:23:52.574751 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.574746 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d8a44f5-be1d-4de6-8832-4245e42b5298-console-serving-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:23:52.574945 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.574754 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-service-ca\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:23:52.574945 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:52.574762 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d8a44f5-be1d-4de6-8832-4245e42b5298-trusted-ca-bundle\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:23:53.062799 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:53.062760 2576 generic.go:356] "Generic (PLEG): container finished" podID="4d8a44f5-be1d-4de6-8832-4245e42b5298" containerID="2f6b19240cc863c7d6f43cb2778460a63b54658faea82bffb9d4a4ccebf98367" exitCode=0 Jun 11 16:23:53.063220 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:53.062821 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789577d49c-mqvml" event={"ID":"4d8a44f5-be1d-4de6-8832-4245e42b5298","Type":"ContainerDied","Data":"2f6b19240cc863c7d6f43cb2778460a63b54658faea82bffb9d4a4ccebf98367"} Jun 11 16:23:53.063220 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:53.062863 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789577d49c-mqvml" event={"ID":"4d8a44f5-be1d-4de6-8832-4245e42b5298","Type":"ContainerDied","Data":"84b579d709625096b891da90873289466959e7268577894073e5475d00638d96"} Jun 11 16:23:53.063220 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:53.062884 2576 scope.go:117] "RemoveContainer" containerID="2f6b19240cc863c7d6f43cb2778460a63b54658faea82bffb9d4a4ccebf98367" Jun 11 16:23:53.063220 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:53.062821 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789577d49c-mqvml" Jun 11 16:23:53.072137 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:53.072112 2576 scope.go:117] "RemoveContainer" containerID="2f6b19240cc863c7d6f43cb2778460a63b54658faea82bffb9d4a4ccebf98367" Jun 11 16:23:53.072470 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:23:53.072449 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f6b19240cc863c7d6f43cb2778460a63b54658faea82bffb9d4a4ccebf98367\": container with ID starting with 2f6b19240cc863c7d6f43cb2778460a63b54658faea82bffb9d4a4ccebf98367 not found: ID does not exist" containerID="2f6b19240cc863c7d6f43cb2778460a63b54658faea82bffb9d4a4ccebf98367" Jun 11 16:23:53.072525 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:53.072482 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f6b19240cc863c7d6f43cb2778460a63b54658faea82bffb9d4a4ccebf98367"} err="failed to get container status \"2f6b19240cc863c7d6f43cb2778460a63b54658faea82bffb9d4a4ccebf98367\": rpc error: code = NotFound desc = could not find container \"2f6b19240cc863c7d6f43cb2778460a63b54658faea82bffb9d4a4ccebf98367\": container with ID starting with 2f6b19240cc863c7d6f43cb2778460a63b54658faea82bffb9d4a4ccebf98367 not found: ID does not exist" Jun 11 16:23:53.084527 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:53.084491 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789577d49c-mqvml"] Jun 11 16:23:53.088359 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:53.088330 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-789577d49c-mqvml"] Jun 11 16:23:53.100579 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:23:53.100552 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d8a44f5-be1d-4de6-8832-4245e42b5298" path="/var/lib/kubelet/pods/4d8a44f5-be1d-4de6-8832-4245e42b5298/volumes" Jun 11 16:24:22.367230 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.367192 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77b6b9c9fb-xd8bv"] Jun 11 16:24:22.367657 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.367476 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d8a44f5-be1d-4de6-8832-4245e42b5298" containerName="console" Jun 11 16:24:22.367657 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.367492 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d8a44f5-be1d-4de6-8832-4245e42b5298" containerName="console" Jun 11 16:24:22.367657 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.367546 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d8a44f5-be1d-4de6-8832-4245e42b5298" containerName="console" Jun 11 16:24:22.370643 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.370620 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.377676 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.377641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-trusted-ca-bundle\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.377795 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.377691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-serving-cert\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.377795 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.377735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-config\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.377795 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.377781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxhlg\" (UniqueName: \"kubernetes.io/projected/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-kube-api-access-jxhlg\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.377964 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.377833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-service-ca\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.377964 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.377913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-oauth-config\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.378406 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.377981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-oauth-serving-cert\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.384659 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.384633 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77b6b9c9fb-xd8bv"] Jun 11 16:24:22.478705 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.478679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-oauth-config\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.478806 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.478715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-oauth-serving-cert\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.478806 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.478730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-trusted-ca-bundle\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.478806 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.478746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-serving-cert\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.478806 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.478775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-config\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.478995 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.478814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxhlg\" (UniqueName: \"kubernetes.io/projected/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-kube-api-access-jxhlg\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.478995 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.478840 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-service-ca\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.479477 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.479455 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-config\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.479579 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.479507 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-oauth-serving-cert\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.479645 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.479593 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-service-ca\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.479704 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.479674 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-trusted-ca-bundle\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.481331 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.481311 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-serving-cert\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.481331 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.481318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-oauth-config\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.489105 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.489080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxhlg\" (UniqueName: \"kubernetes.io/projected/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-kube-api-access-jxhlg\") pod \"console-77b6b9c9fb-xd8bv\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.680767 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.680678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:22.807146 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:22.807118 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77b6b9c9fb-xd8bv"] Jun 11 16:24:22.809694 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:24:22.809667 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf625ca92_2e5b_4f8d_9612_5c8fa196e9ec.slice/crio-dc113bedd49b681cea8f6e38f6af972c387783f3d8f0f6499ffd50de5c44e45c WatchSource:0}: Error finding container dc113bedd49b681cea8f6e38f6af972c387783f3d8f0f6499ffd50de5c44e45c: Status 404 returned error can't find the container with id dc113bedd49b681cea8f6e38f6af972c387783f3d8f0f6499ffd50de5c44e45c Jun 11 16:24:23.167723 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:23.167686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77b6b9c9fb-xd8bv" event={"ID":"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec","Type":"ContainerStarted","Data":"ec8dd35dc2c21eb11b2c2403ec17d53064c393e54d408c2b34d9ace17f09d387"} Jun 11 16:24:23.167909 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:23.167742 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77b6b9c9fb-xd8bv" event={"ID":"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec","Type":"ContainerStarted","Data":"dc113bedd49b681cea8f6e38f6af972c387783f3d8f0f6499ffd50de5c44e45c"} Jun 11 16:24:23.186809 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:23.186760 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77b6b9c9fb-xd8bv" podStartSLOduration=1.186745384 podStartE2EDuration="1.186745384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:24:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:24:23.185557038 +0000 UTC m=+280.533665271" watchObservedRunningTime="2026-06-11 16:24:23.186745384 +0000 UTC m=+280.534853626" Jun 11 16:24:32.681060 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:32.680993 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:32.681533 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:32.681085 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:32.685682 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:32.685657 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:33.207675 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:33.207641 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:24:33.260840 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:33.260812 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5889b9b8db-lctvk"] Jun 11 16:24:43.054312 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:43.053904 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 16:24:58.288271 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.288213 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5889b9b8db-lctvk" podUID="e49ffc84-6b0e-417e-b6d4-d532c24920f6" containerName="console" containerID="cri-o://f3289aa90970cdc8a398e886c65606844e69d778bd840adb6051188075bcf3a3" gracePeriod=15 Jun 11 16:24:58.527396 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.527374 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:24:58.635929 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.635892 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-serving-cert\") pod \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " Jun 11 16:24:58.636145 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.635948 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84wlh\" (UniqueName: \"kubernetes.io/projected/e49ffc84-6b0e-417e-b6d4-d532c24920f6-kube-api-access-84wlh\") pod \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " Jun 11 16:24:58.636145 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.635978 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-config\") pod \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " Jun 11 16:24:58.636145 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.635994 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-service-ca\") pod \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " Jun 11 16:24:58.636145 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.636048 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-oauth-serving-cert\") pod \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " Jun 11 16:24:58.636145 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.636071 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-trusted-ca-bundle\") pod \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " Jun 11 16:24:58.636417 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.636231 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-oauth-config\") pod \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\" (UID: \"e49ffc84-6b0e-417e-b6d4-d532c24920f6\") " Jun 11 16:24:58.636550 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.636516 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e49ffc84-6b0e-417e-b6d4-d532c24920f6" (UID: "e49ffc84-6b0e-417e-b6d4-d532c24920f6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:24:58.636550 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.636529 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-config" (OuterVolumeSpecName: "console-config") pod "e49ffc84-6b0e-417e-b6d4-d532c24920f6" (UID: "e49ffc84-6b0e-417e-b6d4-d532c24920f6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:24:58.636672 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.636655 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-config\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:24:58.636732 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.636674 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-trusted-ca-bundle\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:24:58.636732 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.636595 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e49ffc84-6b0e-417e-b6d4-d532c24920f6" (UID: "e49ffc84-6b0e-417e-b6d4-d532c24920f6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:24:58.636831 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.636758 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-service-ca" (OuterVolumeSpecName: "service-ca") pod "e49ffc84-6b0e-417e-b6d4-d532c24920f6" (UID: "e49ffc84-6b0e-417e-b6d4-d532c24920f6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:24:58.638212 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.638167 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e49ffc84-6b0e-417e-b6d4-d532c24920f6" (UID: "e49ffc84-6b0e-417e-b6d4-d532c24920f6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:24:58.638316 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.638241 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e49ffc84-6b0e-417e-b6d4-d532c24920f6-kube-api-access-84wlh" (OuterVolumeSpecName: "kube-api-access-84wlh") pod "e49ffc84-6b0e-417e-b6d4-d532c24920f6" (UID: "e49ffc84-6b0e-417e-b6d4-d532c24920f6"). InnerVolumeSpecName "kube-api-access-84wlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:24:58.638316 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.638267 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e49ffc84-6b0e-417e-b6d4-d532c24920f6" (UID: "e49ffc84-6b0e-417e-b6d4-d532c24920f6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:24:58.737430 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.737404 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-oauth-serving-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:24:58.737430 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.737425 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-oauth-config\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:24:58.737555 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.737435 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e49ffc84-6b0e-417e-b6d4-d532c24920f6-console-serving-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:24:58.737555 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.737443 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84wlh\" (UniqueName: \"kubernetes.io/projected/e49ffc84-6b0e-417e-b6d4-d532c24920f6-kube-api-access-84wlh\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:24:58.737555 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:58.737453 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e49ffc84-6b0e-417e-b6d4-d532c24920f6-service-ca\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:24:59.301058 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:59.301006 2576 generic.go:356] "Generic (PLEG): container finished" podID="e49ffc84-6b0e-417e-b6d4-d532c24920f6" containerID="f3289aa90970cdc8a398e886c65606844e69d778bd840adb6051188075bcf3a3" exitCode=0 Jun 11 16:24:59.301450 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:59.301073 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5889b9b8db-lctvk" Jun 11 16:24:59.301450 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:59.301099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5889b9b8db-lctvk" event={"ID":"e49ffc84-6b0e-417e-b6d4-d532c24920f6","Type":"ContainerDied","Data":"f3289aa90970cdc8a398e886c65606844e69d778bd840adb6051188075bcf3a3"} Jun 11 16:24:59.301450 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:59.301145 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5889b9b8db-lctvk" event={"ID":"e49ffc84-6b0e-417e-b6d4-d532c24920f6","Type":"ContainerDied","Data":"01e1e00e6cc83bd2b13b0840dca59b886d917fe2afa367dc74da000346740f0f"} Jun 11 16:24:59.301450 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:59.301167 2576 scope.go:117] "RemoveContainer" containerID="f3289aa90970cdc8a398e886c65606844e69d778bd840adb6051188075bcf3a3" Jun 11 16:24:59.309081 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:59.309065 2576 scope.go:117] "RemoveContainer" containerID="f3289aa90970cdc8a398e886c65606844e69d778bd840adb6051188075bcf3a3" Jun 11 16:24:59.309331 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:24:59.309306 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3289aa90970cdc8a398e886c65606844e69d778bd840adb6051188075bcf3a3\": container with ID starting with f3289aa90970cdc8a398e886c65606844e69d778bd840adb6051188075bcf3a3 not found: ID does not exist" containerID="f3289aa90970cdc8a398e886c65606844e69d778bd840adb6051188075bcf3a3" Jun 11 16:24:59.309421 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:59.309330 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3289aa90970cdc8a398e886c65606844e69d778bd840adb6051188075bcf3a3"} err="failed to get container status \"f3289aa90970cdc8a398e886c65606844e69d778bd840adb6051188075bcf3a3\": rpc error: code = NotFound desc = could not find container \"f3289aa90970cdc8a398e886c65606844e69d778bd840adb6051188075bcf3a3\": container with ID starting with f3289aa90970cdc8a398e886c65606844e69d778bd840adb6051188075bcf3a3 not found: ID does not exist" Jun 11 16:24:59.319207 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:59.319179 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5889b9b8db-lctvk"] Jun 11 16:24:59.325325 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:24:59.325306 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5889b9b8db-lctvk"] Jun 11 16:25:01.101205 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:01.101172 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e49ffc84-6b0e-417e-b6d4-d532c24920f6" path="/var/lib/kubelet/pods/e49ffc84-6b0e-417e-b6d4-d532c24920f6/volumes" Jun 11 16:25:22.341969 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.341937 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd"] Jun 11 16:25:22.342391 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.342215 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e49ffc84-6b0e-417e-b6d4-d532c24920f6" containerName="console" Jun 11 16:25:22.342391 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.342226 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e49ffc84-6b0e-417e-b6d4-d532c24920f6" containerName="console" Jun 11 16:25:22.342391 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.342282 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e49ffc84-6b0e-417e-b6d4-d532c24920f6" containerName="console" Jun 11 16:25:22.345284 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.345268 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" Jun 11 16:25:22.348124 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.348094 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:25:22.349318 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.349300 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:25:22.349415 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.349300 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-848q4\"" Jun 11 16:25:22.356582 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.356561 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd"] Jun 11 16:25:22.418972 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.418947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b70d82-562e-4d5c-92bf-d3d81b422006-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd\" (UID: \"32b70d82-562e-4d5c-92bf-d3d81b422006\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" Jun 11 16:25:22.419107 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.418993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b70d82-562e-4d5c-92bf-d3d81b422006-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd\" (UID: \"32b70d82-562e-4d5c-92bf-d3d81b422006\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" Jun 11 16:25:22.419107 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.419064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmwqq\" (UniqueName: \"kubernetes.io/projected/32b70d82-562e-4d5c-92bf-d3d81b422006-kube-api-access-vmwqq\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd\" (UID: \"32b70d82-562e-4d5c-92bf-d3d81b422006\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" Jun 11 16:25:22.519548 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.519515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b70d82-562e-4d5c-92bf-d3d81b422006-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd\" (UID: \"32b70d82-562e-4d5c-92bf-d3d81b422006\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" Jun 11 16:25:22.519691 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.519563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b70d82-562e-4d5c-92bf-d3d81b422006-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd\" (UID: \"32b70d82-562e-4d5c-92bf-d3d81b422006\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" Jun 11 16:25:22.519691 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.519590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmwqq\" (UniqueName: \"kubernetes.io/projected/32b70d82-562e-4d5c-92bf-d3d81b422006-kube-api-access-vmwqq\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd\" (UID: \"32b70d82-562e-4d5c-92bf-d3d81b422006\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" Jun 11 16:25:22.519875 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.519857 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b70d82-562e-4d5c-92bf-d3d81b422006-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd\" (UID: \"32b70d82-562e-4d5c-92bf-d3d81b422006\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" Jun 11 16:25:22.519946 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.519930 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b70d82-562e-4d5c-92bf-d3d81b422006-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd\" (UID: \"32b70d82-562e-4d5c-92bf-d3d81b422006\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" Jun 11 16:25:22.528363 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.528340 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmwqq\" (UniqueName: \"kubernetes.io/projected/32b70d82-562e-4d5c-92bf-d3d81b422006-kube-api-access-vmwqq\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd\" (UID: \"32b70d82-562e-4d5c-92bf-d3d81b422006\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" Jun 11 16:25:22.654932 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.654869 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" Jun 11 16:25:22.781646 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.781611 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd"] Jun 11 16:25:22.784371 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:25:22.784342 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b70d82_562e_4d5c_92bf_d3d81b422006.slice/crio-47735fb7d5bb5ae778f117483ac936a026b53ee8c4e01905158ff5028010e751 WatchSource:0}: Error finding container 47735fb7d5bb5ae778f117483ac936a026b53ee8c4e01905158ff5028010e751: Status 404 returned error can't find the container with id 47735fb7d5bb5ae778f117483ac936a026b53ee8c4e01905158ff5028010e751 Jun 11 16:25:22.786314 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:22.786295 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:25:23.389024 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:23.388988 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" event={"ID":"32b70d82-562e-4d5c-92bf-d3d81b422006","Type":"ContainerStarted","Data":"47735fb7d5bb5ae778f117483ac936a026b53ee8c4e01905158ff5028010e751"} Jun 11 16:25:31.420851 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:31.420761 2576 generic.go:356] "Generic (PLEG): container finished" podID="32b70d82-562e-4d5c-92bf-d3d81b422006" containerID="65e7331fe966015dce922f979843df1d8708fd123baee6d662c0f69ccb8ed2c0" exitCode=0 Jun 11 16:25:31.421216 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:31.420856 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" event={"ID":"32b70d82-562e-4d5c-92bf-d3d81b422006","Type":"ContainerDied","Data":"65e7331fe966015dce922f979843df1d8708fd123baee6d662c0f69ccb8ed2c0"} Jun 11 16:25:32.426422 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:32.426385 2576 generic.go:356] "Generic (PLEG): container finished" podID="32b70d82-562e-4d5c-92bf-d3d81b422006" containerID="05c865f351db17ca5a382eb1f65231b345106348998045ff061e0672e77b21b2" exitCode=0 Jun 11 16:25:32.426747 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:32.426468 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" event={"ID":"32b70d82-562e-4d5c-92bf-d3d81b422006","Type":"ContainerDied","Data":"05c865f351db17ca5a382eb1f65231b345106348998045ff061e0672e77b21b2"} Jun 11 16:25:41.462704 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:41.462666 2576 generic.go:356] "Generic (PLEG): container finished" podID="32b70d82-562e-4d5c-92bf-d3d81b422006" containerID="122f9dd1bde77f297afba98793cc3bf95f0c9e3436c87826ebcfa416a0795585" exitCode=0 Jun 11 16:25:41.463158 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:41.462748 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" event={"ID":"32b70d82-562e-4d5c-92bf-d3d81b422006","Type":"ContainerDied","Data":"122f9dd1bde77f297afba98793cc3bf95f0c9e3436c87826ebcfa416a0795585"} Jun 11 16:25:42.588269 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:42.588242 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" Jun 11 16:25:42.684009 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:42.683976 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmwqq\" (UniqueName: \"kubernetes.io/projected/32b70d82-562e-4d5c-92bf-d3d81b422006-kube-api-access-vmwqq\") pod \"32b70d82-562e-4d5c-92bf-d3d81b422006\" (UID: \"32b70d82-562e-4d5c-92bf-d3d81b422006\") " Jun 11 16:25:42.684179 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:42.684029 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b70d82-562e-4d5c-92bf-d3d81b422006-bundle\") pod \"32b70d82-562e-4d5c-92bf-d3d81b422006\" (UID: \"32b70d82-562e-4d5c-92bf-d3d81b422006\") " Jun 11 16:25:42.684179 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:42.684049 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b70d82-562e-4d5c-92bf-d3d81b422006-util\") pod \"32b70d82-562e-4d5c-92bf-d3d81b422006\" (UID: \"32b70d82-562e-4d5c-92bf-d3d81b422006\") " Jun 11 16:25:42.684861 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:42.684825 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32b70d82-562e-4d5c-92bf-d3d81b422006-bundle" (OuterVolumeSpecName: "bundle") pod "32b70d82-562e-4d5c-92bf-d3d81b422006" (UID: "32b70d82-562e-4d5c-92bf-d3d81b422006"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:25:42.686245 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:42.686218 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32b70d82-562e-4d5c-92bf-d3d81b422006-kube-api-access-vmwqq" (OuterVolumeSpecName: "kube-api-access-vmwqq") pod "32b70d82-562e-4d5c-92bf-d3d81b422006" (UID: "32b70d82-562e-4d5c-92bf-d3d81b422006"). InnerVolumeSpecName "kube-api-access-vmwqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:25:42.689142 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:42.689117 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32b70d82-562e-4d5c-92bf-d3d81b422006-util" (OuterVolumeSpecName: "util") pod "32b70d82-562e-4d5c-92bf-d3d81b422006" (UID: "32b70d82-562e-4d5c-92bf-d3d81b422006"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:25:42.785101 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:42.785037 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmwqq\" (UniqueName: \"kubernetes.io/projected/32b70d82-562e-4d5c-92bf-d3d81b422006-kube-api-access-vmwqq\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:25:42.785101 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:42.785069 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b70d82-562e-4d5c-92bf-d3d81b422006-bundle\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:25:42.785101 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:42.785080 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b70d82-562e-4d5c-92bf-d3d81b422006-util\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:25:43.471634 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:43.471555 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" event={"ID":"32b70d82-562e-4d5c-92bf-d3d81b422006","Type":"ContainerDied","Data":"47735fb7d5bb5ae778f117483ac936a026b53ee8c4e01905158ff5028010e751"} Jun 11 16:25:43.471634 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:43.471608 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47735fb7d5bb5ae778f117483ac936a026b53ee8c4e01905158ff5028010e751" Jun 11 16:25:43.471634 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:43.471562 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr4jgd" Jun 11 16:25:56.393230 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.393187 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc"] Jun 11 16:25:56.393793 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.393587 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b70d82-562e-4d5c-92bf-d3d81b422006" containerName="pull" Jun 11 16:25:56.393793 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.393604 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b70d82-562e-4d5c-92bf-d3d81b422006" containerName="pull" Jun 11 16:25:56.393793 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.393621 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b70d82-562e-4d5c-92bf-d3d81b422006" containerName="util" Jun 11 16:25:56.393793 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.393631 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b70d82-562e-4d5c-92bf-d3d81b422006" containerName="util" Jun 11 16:25:56.393793 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.393639 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b70d82-562e-4d5c-92bf-d3d81b422006" containerName="extract" Jun 11 16:25:56.393793 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.393647 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b70d82-562e-4d5c-92bf-d3d81b422006" containerName="extract" Jun 11 16:25:56.393793 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.393724 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="32b70d82-562e-4d5c-92bf-d3d81b422006" containerName="extract" Jun 11 16:25:56.396611 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.396589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" Jun 11 16:25:56.400133 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.400104 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:25:56.400406 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.400389 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-848q4\"" Jun 11 16:25:56.401337 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.401322 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:25:56.409174 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.409151 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc"] Jun 11 16:25:56.470394 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.470358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ffd0024-f119-4870-8152-f8680e797368-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc\" (UID: \"5ffd0024-f119-4870-8152-f8680e797368\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" Jun 11 16:25:56.470553 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.470409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ffd0024-f119-4870-8152-f8680e797368-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc\" (UID: \"5ffd0024-f119-4870-8152-f8680e797368\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" Jun 11 16:25:56.470553 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.470433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbtbj\" (UniqueName: \"kubernetes.io/projected/5ffd0024-f119-4870-8152-f8680e797368-kube-api-access-fbtbj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc\" (UID: \"5ffd0024-f119-4870-8152-f8680e797368\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" Jun 11 16:25:56.571530 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.571499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ffd0024-f119-4870-8152-f8680e797368-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc\" (UID: \"5ffd0024-f119-4870-8152-f8680e797368\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" Jun 11 16:25:56.571687 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.571543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ffd0024-f119-4870-8152-f8680e797368-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc\" (UID: \"5ffd0024-f119-4870-8152-f8680e797368\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" Jun 11 16:25:56.571687 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.571571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbtbj\" (UniqueName: \"kubernetes.io/projected/5ffd0024-f119-4870-8152-f8680e797368-kube-api-access-fbtbj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc\" (UID: \"5ffd0024-f119-4870-8152-f8680e797368\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" Jun 11 16:25:56.571935 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.571917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ffd0024-f119-4870-8152-f8680e797368-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc\" (UID: \"5ffd0024-f119-4870-8152-f8680e797368\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" Jun 11 16:25:56.571974 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.571948 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ffd0024-f119-4870-8152-f8680e797368-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc\" (UID: \"5ffd0024-f119-4870-8152-f8680e797368\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" Jun 11 16:25:56.581690 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.581662 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbtbj\" (UniqueName: \"kubernetes.io/projected/5ffd0024-f119-4870-8152-f8680e797368-kube-api-access-fbtbj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc\" (UID: \"5ffd0024-f119-4870-8152-f8680e797368\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" Jun 11 16:25:56.705531 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.705457 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" Jun 11 16:25:56.836561 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:56.836492 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc"] Jun 11 16:25:56.838745 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:25:56.838716 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ffd0024_f119_4870_8152_f8680e797368.slice/crio-2b0b5d29d6a4a213059bb4cad136990b7f287e4838dbe2ac156ca60d3528b13c WatchSource:0}: Error finding container 2b0b5d29d6a4a213059bb4cad136990b7f287e4838dbe2ac156ca60d3528b13c: Status 404 returned error can't find the container with id 2b0b5d29d6a4a213059bb4cad136990b7f287e4838dbe2ac156ca60d3528b13c Jun 11 16:25:57.530345 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:57.530311 2576 generic.go:356] "Generic (PLEG): container finished" podID="5ffd0024-f119-4870-8152-f8680e797368" containerID="8ff2e3ce6f8ffaea8a0489e5153fecf085a7b65918a0b451846fceeaa2caf217" exitCode=0 Jun 11 16:25:57.530725 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:57.530397 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" event={"ID":"5ffd0024-f119-4870-8152-f8680e797368","Type":"ContainerDied","Data":"8ff2e3ce6f8ffaea8a0489e5153fecf085a7b65918a0b451846fceeaa2caf217"} Jun 11 16:25:57.530725 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:57.530444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" event={"ID":"5ffd0024-f119-4870-8152-f8680e797368","Type":"ContainerStarted","Data":"2b0b5d29d6a4a213059bb4cad136990b7f287e4838dbe2ac156ca60d3528b13c"} Jun 11 16:25:58.769776 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:58.769736 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4"] Jun 11 16:25:58.772077 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:58.772053 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4" Jun 11 16:25:58.775414 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:58.775397 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 16:25:58.776816 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:58.776793 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-s7qlq\"" Jun 11 16:25:58.776946 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:58.776920 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 16:25:58.785062 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:58.785036 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt4bg\" (UniqueName: \"kubernetes.io/projected/bca426db-a256-4404-85d3-8da36ff92887-kube-api-access-zt4bg\") pod \"cert-manager-webhook-7dc76cbb94-rwzt4\" (UID: \"bca426db-a256-4404-85d3-8da36ff92887\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4" Jun 11 16:25:58.785178 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:58.785078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bca426db-a256-4404-85d3-8da36ff92887-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-rwzt4\" (UID: \"bca426db-a256-4404-85d3-8da36ff92887\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4" Jun 11 16:25:58.785479 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:58.785452 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4"] Jun 11 16:25:58.886364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:58.886335 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt4bg\" (UniqueName: \"kubernetes.io/projected/bca426db-a256-4404-85d3-8da36ff92887-kube-api-access-zt4bg\") pod \"cert-manager-webhook-7dc76cbb94-rwzt4\" (UID: \"bca426db-a256-4404-85d3-8da36ff92887\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4" Jun 11 16:25:58.886364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:58.886367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bca426db-a256-4404-85d3-8da36ff92887-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-rwzt4\" (UID: \"bca426db-a256-4404-85d3-8da36ff92887\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4" Jun 11 16:25:58.895504 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:58.895447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bca426db-a256-4404-85d3-8da36ff92887-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-rwzt4\" (UID: \"bca426db-a256-4404-85d3-8da36ff92887\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4" Jun 11 16:25:58.895768 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:58.895750 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt4bg\" (UniqueName: \"kubernetes.io/projected/bca426db-a256-4404-85d3-8da36ff92887-kube-api-access-zt4bg\") pod \"cert-manager-webhook-7dc76cbb94-rwzt4\" (UID: \"bca426db-a256-4404-85d3-8da36ff92887\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4" Jun 11 16:25:59.081766 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:59.081727 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4" Jun 11 16:25:59.868241 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:25:59.868075 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4"] Jun 11 16:25:59.870531 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:25:59.870506 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbca426db_a256_4404_85d3_8da36ff92887.slice/crio-fd713ad2f7bc0d7dc4b00015b9e9578a6d096fe7261222d0fd50d7a66fe4aeb9 WatchSource:0}: Error finding container fd713ad2f7bc0d7dc4b00015b9e9578a6d096fe7261222d0fd50d7a66fe4aeb9: Status 404 returned error can't find the container with id fd713ad2f7bc0d7dc4b00015b9e9578a6d096fe7261222d0fd50d7a66fe4aeb9 Jun 11 16:26:00.544240 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:00.544205 2576 generic.go:356] "Generic (PLEG): container finished" podID="5ffd0024-f119-4870-8152-f8680e797368" containerID="e1116cf2a9621084c17973e1c7d89001cd84a645e047672860a064aa49fdd9a5" exitCode=0 Jun 11 16:26:00.544422 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:00.544249 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" event={"ID":"5ffd0024-f119-4870-8152-f8680e797368","Type":"ContainerDied","Data":"e1116cf2a9621084c17973e1c7d89001cd84a645e047672860a064aa49fdd9a5"} Jun 11 16:26:00.545522 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:00.545498 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4" event={"ID":"bca426db-a256-4404-85d3-8da36ff92887","Type":"ContainerStarted","Data":"fd713ad2f7bc0d7dc4b00015b9e9578a6d096fe7261222d0fd50d7a66fe4aeb9"} Jun 11 16:26:01.551681 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:01.551644 2576 generic.go:356] "Generic (PLEG): container finished" podID="5ffd0024-f119-4870-8152-f8680e797368" containerID="e93be49a0852c224fe9dab5d29b13f779efc1ee5e0ad28d4d68f9801e42632e9" exitCode=0 Jun 11 16:26:01.552060 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:01.551724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" event={"ID":"5ffd0024-f119-4870-8152-f8680e797368","Type":"ContainerDied","Data":"e93be49a0852c224fe9dab5d29b13f779efc1ee5e0ad28d4d68f9801e42632e9"} Jun 11 16:26:03.080103 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.080078 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" Jun 11 16:26:03.117997 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.117967 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ffd0024-f119-4870-8152-f8680e797368-util\") pod \"5ffd0024-f119-4870-8152-f8680e797368\" (UID: \"5ffd0024-f119-4870-8152-f8680e797368\") " Jun 11 16:26:03.118150 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.118025 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbtbj\" (UniqueName: \"kubernetes.io/projected/5ffd0024-f119-4870-8152-f8680e797368-kube-api-access-fbtbj\") pod \"5ffd0024-f119-4870-8152-f8680e797368\" (UID: \"5ffd0024-f119-4870-8152-f8680e797368\") " Jun 11 16:26:03.118150 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.118080 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ffd0024-f119-4870-8152-f8680e797368-bundle\") pod \"5ffd0024-f119-4870-8152-f8680e797368\" (UID: \"5ffd0024-f119-4870-8152-f8680e797368\") " Jun 11 16:26:03.118678 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.118499 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ffd0024-f119-4870-8152-f8680e797368-bundle" (OuterVolumeSpecName: "bundle") pod "5ffd0024-f119-4870-8152-f8680e797368" (UID: "5ffd0024-f119-4870-8152-f8680e797368"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:26:03.120651 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.120627 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ffd0024-f119-4870-8152-f8680e797368-kube-api-access-fbtbj" (OuterVolumeSpecName: "kube-api-access-fbtbj") pod "5ffd0024-f119-4870-8152-f8680e797368" (UID: "5ffd0024-f119-4870-8152-f8680e797368"). InnerVolumeSpecName "kube-api-access-fbtbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:26:03.123116 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.123073 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ffd0024-f119-4870-8152-f8680e797368-util" (OuterVolumeSpecName: "util") pod "5ffd0024-f119-4870-8152-f8680e797368" (UID: "5ffd0024-f119-4870-8152-f8680e797368"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:26:03.218654 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.218624 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ffd0024-f119-4870-8152-f8680e797368-util\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:26:03.218654 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.218650 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbtbj\" (UniqueName: \"kubernetes.io/projected/5ffd0024-f119-4870-8152-f8680e797368-kube-api-access-fbtbj\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:26:03.218654 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.218661 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ffd0024-f119-4870-8152-f8680e797368-bundle\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:26:03.560711 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.560678 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" Jun 11 16:26:03.560884 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.560671 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgczc" event={"ID":"5ffd0024-f119-4870-8152-f8680e797368","Type":"ContainerDied","Data":"2b0b5d29d6a4a213059bb4cad136990b7f287e4838dbe2ac156ca60d3528b13c"} Jun 11 16:26:03.560884 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.560808 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b0b5d29d6a4a213059bb4cad136990b7f287e4838dbe2ac156ca60d3528b13c" Jun 11 16:26:03.562209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.562186 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4" event={"ID":"bca426db-a256-4404-85d3-8da36ff92887","Type":"ContainerStarted","Data":"9b85a2623a373b26ef7befb01b00f3b66181132c4a41c31208c29553fa15b0e8"} Jun 11 16:26:03.562326 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.562312 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4" Jun 11 16:26:03.580113 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:03.580070 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4" podStartSLOduration=2.327461902 podStartE2EDuration="5.580050188s" totalImagesPullingTime="3.252588286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:25:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:26:03.579786723 +0000 UTC m=+380.927894956" watchObservedRunningTime="2026-06-11 16:26:03.580050188 +0000 UTC m=+380.928158423" Jun 11 16:26:08.273538 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.273503 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4fzvm"] Jun 11 16:26:08.273924 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.273754 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ffd0024-f119-4870-8152-f8680e797368" containerName="util" Jun 11 16:26:08.273924 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.273765 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ffd0024-f119-4870-8152-f8680e797368" containerName="util" Jun 11 16:26:08.273924 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.273772 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ffd0024-f119-4870-8152-f8680e797368" containerName="extract" Jun 11 16:26:08.273924 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.273777 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ffd0024-f119-4870-8152-f8680e797368" containerName="extract" Jun 11 16:26:08.273924 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.273790 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ffd0024-f119-4870-8152-f8680e797368" containerName="pull" Jun 11 16:26:08.273924 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.273796 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ffd0024-f119-4870-8152-f8680e797368" containerName="pull" Jun 11 16:26:08.273924 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.273847 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ffd0024-f119-4870-8152-f8680e797368" containerName="extract" Jun 11 16:26:08.276630 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.276614 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4fzvm" Jun 11 16:26:08.279383 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.279355 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 16:26:08.279493 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.279443 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-h2crk\"" Jun 11 16:26:08.280474 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.280460 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:26:08.290738 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.290716 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4fzvm"] Jun 11 16:26:08.358326 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.358292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b0e0269-4ed2-4745-9810-f9d735af2813-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4fzvm\" (UID: \"2b0e0269-4ed2-4745-9810-f9d735af2813\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4fzvm" Jun 11 16:26:08.358481 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.358347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dddv\" (UniqueName: \"kubernetes.io/projected/2b0e0269-4ed2-4745-9810-f9d735af2813-kube-api-access-9dddv\") pod \"openshift-lws-operator-fd8ccff4c-4fzvm\" (UID: \"2b0e0269-4ed2-4745-9810-f9d735af2813\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4fzvm" Jun 11 16:26:08.459642 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.459600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dddv\" (UniqueName: \"kubernetes.io/projected/2b0e0269-4ed2-4745-9810-f9d735af2813-kube-api-access-9dddv\") pod \"openshift-lws-operator-fd8ccff4c-4fzvm\" (UID: \"2b0e0269-4ed2-4745-9810-f9d735af2813\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4fzvm" Jun 11 16:26:08.459804 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.459689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b0e0269-4ed2-4745-9810-f9d735af2813-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4fzvm\" (UID: \"2b0e0269-4ed2-4745-9810-f9d735af2813\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4fzvm" Jun 11 16:26:08.460142 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.460122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b0e0269-4ed2-4745-9810-f9d735af2813-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4fzvm\" (UID: \"2b0e0269-4ed2-4745-9810-f9d735af2813\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4fzvm" Jun 11 16:26:08.468669 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.468652 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dddv\" (UniqueName: \"kubernetes.io/projected/2b0e0269-4ed2-4745-9810-f9d735af2813-kube-api-access-9dddv\") pod \"openshift-lws-operator-fd8ccff4c-4fzvm\" (UID: \"2b0e0269-4ed2-4745-9810-f9d735af2813\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4fzvm" Jun 11 16:26:08.585644 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.585612 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4fzvm" Jun 11 16:26:08.711165 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:08.711126 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4fzvm"] Jun 11 16:26:08.713570 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:26:08.713541 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b0e0269_4ed2_4745_9810_f9d735af2813.slice/crio-4e10950a3051b93bbf6b216f3c3378c658ec6d231bc43f21ae48d805d7640b13 WatchSource:0}: Error finding container 4e10950a3051b93bbf6b216f3c3378c658ec6d231bc43f21ae48d805d7640b13: Status 404 returned error can't find the container with id 4e10950a3051b93bbf6b216f3c3378c658ec6d231bc43f21ae48d805d7640b13 Jun 11 16:26:09.568068 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:09.568037 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rwzt4" Jun 11 16:26:09.584579 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:09.584553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4fzvm" event={"ID":"2b0e0269-4ed2-4745-9810-f9d735af2813","Type":"ContainerStarted","Data":"4e10950a3051b93bbf6b216f3c3378c658ec6d231bc43f21ae48d805d7640b13"} Jun 11 16:26:11.594282 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:11.594246 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4fzvm" event={"ID":"2b0e0269-4ed2-4745-9810-f9d735af2813","Type":"ContainerStarted","Data":"cd7cf0f04da63bbd442bb26a91fefb2b47476d00e2708d28447516ee728d5a69"} Jun 11 16:26:11.615279 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:11.615232 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4fzvm" podStartSLOduration=1.297558887 podStartE2EDuration="3.615216719s" totalImagesPullingTime="2.317657832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:26:11.613803988 +0000 UTC m=+388.961912221" watchObservedRunningTime="2026-06-11 16:26:11.615216719 +0000 UTC m=+388.963324951" Jun 11 16:26:14.490895 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.490857 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb"] Jun 11 16:26:14.494398 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.494378 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" Jun 11 16:26:14.497102 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.497077 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-848q4\"" Jun 11 16:26:14.497228 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.497118 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:26:14.498160 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.498141 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:26:14.503915 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.503891 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb"] Jun 11 16:26:14.608726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.608686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9kxw\" (UniqueName: \"kubernetes.io/projected/00da6142-d515-42b2-8db8-b255740c5d7e-kube-api-access-b9kxw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb\" (UID: \"00da6142-d515-42b2-8db8-b255740c5d7e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" Jun 11 16:26:14.608726 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.608734 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00da6142-d515-42b2-8db8-b255740c5d7e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb\" (UID: \"00da6142-d515-42b2-8db8-b255740c5d7e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" Jun 11 16:26:14.608951 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.608868 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00da6142-d515-42b2-8db8-b255740c5d7e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb\" (UID: \"00da6142-d515-42b2-8db8-b255740c5d7e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" Jun 11 16:26:14.709761 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.709714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00da6142-d515-42b2-8db8-b255740c5d7e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb\" (UID: \"00da6142-d515-42b2-8db8-b255740c5d7e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" Jun 11 16:26:14.709761 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.709771 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9kxw\" (UniqueName: \"kubernetes.io/projected/00da6142-d515-42b2-8db8-b255740c5d7e-kube-api-access-b9kxw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb\" (UID: \"00da6142-d515-42b2-8db8-b255740c5d7e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" Jun 11 16:26:14.709930 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.709792 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00da6142-d515-42b2-8db8-b255740c5d7e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb\" (UID: \"00da6142-d515-42b2-8db8-b255740c5d7e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" Jun 11 16:26:14.710124 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.710105 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00da6142-d515-42b2-8db8-b255740c5d7e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb\" (UID: \"00da6142-d515-42b2-8db8-b255740c5d7e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" Jun 11 16:26:14.710168 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.710136 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00da6142-d515-42b2-8db8-b255740c5d7e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb\" (UID: \"00da6142-d515-42b2-8db8-b255740c5d7e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" Jun 11 16:26:14.718032 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.717984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9kxw\" (UniqueName: \"kubernetes.io/projected/00da6142-d515-42b2-8db8-b255740c5d7e-kube-api-access-b9kxw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb\" (UID: \"00da6142-d515-42b2-8db8-b255740c5d7e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" Jun 11 16:26:14.803972 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.803949 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" Jun 11 16:26:14.934354 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:14.934330 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb"] Jun 11 16:26:14.936795 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:26:14.936762 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00da6142_d515_42b2_8db8_b255740c5d7e.slice/crio-2055494403e797b47c8d7c331e24aee021d6dc4a2533767ed4b64e2f65e2ddc5 WatchSource:0}: Error finding container 2055494403e797b47c8d7c331e24aee021d6dc4a2533767ed4b64e2f65e2ddc5: Status 404 returned error can't find the container with id 2055494403e797b47c8d7c331e24aee021d6dc4a2533767ed4b64e2f65e2ddc5 Jun 11 16:26:15.610780 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:15.610747 2576 generic.go:356] "Generic (PLEG): container finished" podID="00da6142-d515-42b2-8db8-b255740c5d7e" containerID="89e3611a29cd1f7b4937d104e4fa9410b77b7fd3e8721e1a5478dec012a29ec7" exitCode=0 Jun 11 16:26:15.610780 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:15.610783 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" event={"ID":"00da6142-d515-42b2-8db8-b255740c5d7e","Type":"ContainerDied","Data":"89e3611a29cd1f7b4937d104e4fa9410b77b7fd3e8721e1a5478dec012a29ec7"} Jun 11 16:26:15.611220 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:15.610818 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" event={"ID":"00da6142-d515-42b2-8db8-b255740c5d7e","Type":"ContainerStarted","Data":"2055494403e797b47c8d7c331e24aee021d6dc4a2533767ed4b64e2f65e2ddc5"} Jun 11 16:26:16.616684 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:16.616652 2576 generic.go:356] "Generic (PLEG): container finished" podID="00da6142-d515-42b2-8db8-b255740c5d7e" containerID="fef607f01d7553edecb1765c1a71ca7e977e0aa281d2381135b08d318397dcac" exitCode=0 Jun 11 16:26:16.617069 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:16.616744 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" event={"ID":"00da6142-d515-42b2-8db8-b255740c5d7e","Type":"ContainerDied","Data":"fef607f01d7553edecb1765c1a71ca7e977e0aa281d2381135b08d318397dcac"} Jun 11 16:26:17.622861 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:17.622822 2576 generic.go:356] "Generic (PLEG): container finished" podID="00da6142-d515-42b2-8db8-b255740c5d7e" containerID="1f2f8665d8693dd7f36952ad80d90556bd74d8ce8b8d5e35b25c30b29fb4c972" exitCode=0 Jun 11 16:26:17.623250 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:17.622912 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" event={"ID":"00da6142-d515-42b2-8db8-b255740c5d7e","Type":"ContainerDied","Data":"1f2f8665d8693dd7f36952ad80d90556bd74d8ce8b8d5e35b25c30b29fb4c972"} Jun 11 16:26:18.749912 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:18.749889 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" Jun 11 16:26:18.843056 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:18.843030 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9kxw\" (UniqueName: \"kubernetes.io/projected/00da6142-d515-42b2-8db8-b255740c5d7e-kube-api-access-b9kxw\") pod \"00da6142-d515-42b2-8db8-b255740c5d7e\" (UID: \"00da6142-d515-42b2-8db8-b255740c5d7e\") " Jun 11 16:26:18.843185 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:18.843065 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00da6142-d515-42b2-8db8-b255740c5d7e-bundle\") pod \"00da6142-d515-42b2-8db8-b255740c5d7e\" (UID: \"00da6142-d515-42b2-8db8-b255740c5d7e\") " Jun 11 16:26:18.843185 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:18.843082 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00da6142-d515-42b2-8db8-b255740c5d7e-util\") pod \"00da6142-d515-42b2-8db8-b255740c5d7e\" (UID: \"00da6142-d515-42b2-8db8-b255740c5d7e\") " Jun 11 16:26:18.843748 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:18.843718 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00da6142-d515-42b2-8db8-b255740c5d7e-bundle" (OuterVolumeSpecName: "bundle") pod "00da6142-d515-42b2-8db8-b255740c5d7e" (UID: "00da6142-d515-42b2-8db8-b255740c5d7e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:26:18.844998 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:18.844963 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00da6142-d515-42b2-8db8-b255740c5d7e-kube-api-access-b9kxw" (OuterVolumeSpecName: "kube-api-access-b9kxw") pod "00da6142-d515-42b2-8db8-b255740c5d7e" (UID: "00da6142-d515-42b2-8db8-b255740c5d7e"). InnerVolumeSpecName "kube-api-access-b9kxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:26:18.848755 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:18.848670 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00da6142-d515-42b2-8db8-b255740c5d7e-util" (OuterVolumeSpecName: "util") pod "00da6142-d515-42b2-8db8-b255740c5d7e" (UID: "00da6142-d515-42b2-8db8-b255740c5d7e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:26:18.943856 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:18.943805 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9kxw\" (UniqueName: \"kubernetes.io/projected/00da6142-d515-42b2-8db8-b255740c5d7e-kube-api-access-b9kxw\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:26:18.943856 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:18.943826 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00da6142-d515-42b2-8db8-b255740c5d7e-bundle\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:26:18.943856 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:18.943836 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00da6142-d515-42b2-8db8-b255740c5d7e-util\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:26:19.632269 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:19.632233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" event={"ID":"00da6142-d515-42b2-8db8-b255740c5d7e","Type":"ContainerDied","Data":"2055494403e797b47c8d7c331e24aee021d6dc4a2533767ed4b64e2f65e2ddc5"} Jun 11 16:26:19.632269 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:19.632254 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf5pcb" Jun 11 16:26:19.632473 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:19.632282 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2055494403e797b47c8d7c331e24aee021d6dc4a2533767ed4b64e2f65e2ddc5" Jun 11 16:26:31.166553 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.166515 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs"] Jun 11 16:26:31.166986 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.166840 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00da6142-d515-42b2-8db8-b255740c5d7e" containerName="util" Jun 11 16:26:31.166986 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.166855 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="00da6142-d515-42b2-8db8-b255740c5d7e" containerName="util" Jun 11 16:26:31.166986 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.166872 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00da6142-d515-42b2-8db8-b255740c5d7e" containerName="pull" Jun 11 16:26:31.166986 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.166877 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="00da6142-d515-42b2-8db8-b255740c5d7e" containerName="pull" Jun 11 16:26:31.166986 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.166884 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00da6142-d515-42b2-8db8-b255740c5d7e" containerName="extract" Jun 11 16:26:31.166986 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.166891 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="00da6142-d515-42b2-8db8-b255740c5d7e" containerName="extract" Jun 11 16:26:31.166986 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.166952 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="00da6142-d515-42b2-8db8-b255740c5d7e" containerName="extract" Jun 11 16:26:31.171235 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.171219 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.173924 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.173902 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 16:26:31.174514 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.174494 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 16:26:31.174607 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.174522 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 16:26:31.174607 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.174500 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 16:26:31.175164 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.175143 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9wbjt\"" Jun 11 16:26:31.189676 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.189652 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs"] Jun 11 16:26:31.231304 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.231249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0817c373-b9b9-440d-a5b2-18a11197c3eb-tmp\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.231304 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.231291 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0817c373-b9b9-440d-a5b2-18a11197c3eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.231547 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.231452 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0817c373-b9b9-440d-a5b2-18a11197c3eb-manifests\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.231613 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.231537 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0817c373-b9b9-440d-a5b2-18a11197c3eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.231669 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.231653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjlrv\" (UniqueName: \"kubernetes.io/projected/0817c373-b9b9-440d-a5b2-18a11197c3eb-kube-api-access-bjlrv\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.332529 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.332495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0817c373-b9b9-440d-a5b2-18a11197c3eb-tmp\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.332529 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.332530 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0817c373-b9b9-440d-a5b2-18a11197c3eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.332740 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.332556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0817c373-b9b9-440d-a5b2-18a11197c3eb-manifests\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.332740 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.332583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0817c373-b9b9-440d-a5b2-18a11197c3eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.332740 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.332626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjlrv\" (UniqueName: \"kubernetes.io/projected/0817c373-b9b9-440d-a5b2-18a11197c3eb-kube-api-access-bjlrv\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.332978 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.332955 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0817c373-b9b9-440d-a5b2-18a11197c3eb-manifests\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.334937 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.334906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0817c373-b9b9-440d-a5b2-18a11197c3eb-tmp\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.335094 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.335070 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0817c373-b9b9-440d-a5b2-18a11197c3eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.335140 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.335082 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0817c373-b9b9-440d-a5b2-18a11197c3eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.343340 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.343315 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjlrv\" (UniqueName: \"kubernetes.io/projected/0817c373-b9b9-440d-a5b2-18a11197c3eb-kube-api-access-bjlrv\") pod \"opendatahub-operator-controller-manager-bc59bf699-qr5xs\" (UID: \"0817c373-b9b9-440d-a5b2-18a11197c3eb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.482565 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.482508 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:31.614536 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.614506 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs"] Jun 11 16:26:31.617716 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:26:31.617690 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0817c373_b9b9_440d_a5b2_18a11197c3eb.slice/crio-ff1061cb548a2b496e96e819e091f7cfff461115fe180a25d183fcdae10e70f3 WatchSource:0}: Error finding container ff1061cb548a2b496e96e819e091f7cfff461115fe180a25d183fcdae10e70f3: Status 404 returned error can't find the container with id ff1061cb548a2b496e96e819e091f7cfff461115fe180a25d183fcdae10e70f3 Jun 11 16:26:31.678618 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:31.678589 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" event={"ID":"0817c373-b9b9-440d-a5b2-18a11197c3eb","Type":"ContainerStarted","Data":"ff1061cb548a2b496e96e819e091f7cfff461115fe180a25d183fcdae10e70f3"} Jun 11 16:26:34.695153 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:34.695124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" event={"ID":"0817c373-b9b9-440d-a5b2-18a11197c3eb","Type":"ContainerStarted","Data":"2d05903646a15449786dd7d0549adf6dd11f29bd031868c1ddd45486a44c3917"} Jun 11 16:26:36.704575 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:36.704541 2576 generic.go:356] "Generic (PLEG): container finished" podID="0817c373-b9b9-440d-a5b2-18a11197c3eb" containerID="2d05903646a15449786dd7d0549adf6dd11f29bd031868c1ddd45486a44c3917" exitCode=0 Jun 11 16:26:36.704962 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:36.704582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" event={"ID":"0817c373-b9b9-440d-a5b2-18a11197c3eb","Type":"ContainerDied","Data":"2d05903646a15449786dd7d0549adf6dd11f29bd031868c1ddd45486a44c3917"} Jun 11 16:26:37.710193 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:37.710154 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" event={"ID":"0817c373-b9b9-440d-a5b2-18a11197c3eb","Type":"ContainerStarted","Data":"6fc94a519e269be683c325b9f5bebcd3b9fb62509832eba18ab8607f42a99cbc"} Jun 11 16:26:37.710577 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:37.710379 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:37.739818 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:37.739764 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" podStartSLOduration=2.331408484 podStartE2EDuration="6.739747437s" totalImagesPullingTime="3.354724198s" totalInitContainerRuntime="1.053614755s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:26:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:26:37.738855492 +0000 UTC m=+415.086963714" watchObservedRunningTime="2026-06-11 16:26:37.739747437 +0000 UTC m=+415.087855679" Jun 11 16:26:48.608364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.608322 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr"] Jun 11 16:26:48.618900 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.618867 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:48.622502 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.622471 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 16:26:48.623789 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.623761 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 16:26:48.623789 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.623790 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7jgvt\"" Jun 11 16:26:48.624226 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.624208 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 16:26:48.625095 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.625074 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr"] Jun 11 16:26:48.716651 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.716618 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-qr5xs" Jun 11 16:26:48.781294 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.781249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e163fa8-fa4b-475d-832b-78ce153fdb3f-cert\") pod \"lws-controller-manager-595bc765c4-c7hjr\" (UID: \"5e163fa8-fa4b-475d-832b-78ce153fdb3f\") " pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:48.781456 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.781340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e163fa8-fa4b-475d-832b-78ce153fdb3f-metrics-cert\") pod \"lws-controller-manager-595bc765c4-c7hjr\" (UID: \"5e163fa8-fa4b-475d-832b-78ce153fdb3f\") " pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:48.781456 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.781375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q8bv\" (UniqueName: \"kubernetes.io/projected/5e163fa8-fa4b-475d-832b-78ce153fdb3f-kube-api-access-5q8bv\") pod \"lws-controller-manager-595bc765c4-c7hjr\" (UID: \"5e163fa8-fa4b-475d-832b-78ce153fdb3f\") " pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:48.781456 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.781438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5e163fa8-fa4b-475d-832b-78ce153fdb3f-manager-config\") pod \"lws-controller-manager-595bc765c4-c7hjr\" (UID: \"5e163fa8-fa4b-475d-832b-78ce153fdb3f\") " pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:48.882087 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.881967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5e163fa8-fa4b-475d-832b-78ce153fdb3f-manager-config\") pod \"lws-controller-manager-595bc765c4-c7hjr\" (UID: \"5e163fa8-fa4b-475d-832b-78ce153fdb3f\") " pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:48.882087 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.882082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e163fa8-fa4b-475d-832b-78ce153fdb3f-cert\") pod \"lws-controller-manager-595bc765c4-c7hjr\" (UID: \"5e163fa8-fa4b-475d-832b-78ce153fdb3f\") " pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:48.882348 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.882172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e163fa8-fa4b-475d-832b-78ce153fdb3f-metrics-cert\") pod \"lws-controller-manager-595bc765c4-c7hjr\" (UID: \"5e163fa8-fa4b-475d-832b-78ce153fdb3f\") " pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:48.882348 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.882196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q8bv\" (UniqueName: \"kubernetes.io/projected/5e163fa8-fa4b-475d-832b-78ce153fdb3f-kube-api-access-5q8bv\") pod \"lws-controller-manager-595bc765c4-c7hjr\" (UID: \"5e163fa8-fa4b-475d-832b-78ce153fdb3f\") " pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:48.882775 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.882752 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5e163fa8-fa4b-475d-832b-78ce153fdb3f-manager-config\") pod \"lws-controller-manager-595bc765c4-c7hjr\" (UID: \"5e163fa8-fa4b-475d-832b-78ce153fdb3f\") " pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:48.884513 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.884495 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e163fa8-fa4b-475d-832b-78ce153fdb3f-cert\") pod \"lws-controller-manager-595bc765c4-c7hjr\" (UID: \"5e163fa8-fa4b-475d-832b-78ce153fdb3f\") " pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:48.884631 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.884614 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e163fa8-fa4b-475d-832b-78ce153fdb3f-metrics-cert\") pod \"lws-controller-manager-595bc765c4-c7hjr\" (UID: \"5e163fa8-fa4b-475d-832b-78ce153fdb3f\") " pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:48.892264 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.892242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q8bv\" (UniqueName: \"kubernetes.io/projected/5e163fa8-fa4b-475d-832b-78ce153fdb3f-kube-api-access-5q8bv\") pod \"lws-controller-manager-595bc765c4-c7hjr\" (UID: \"5e163fa8-fa4b-475d-832b-78ce153fdb3f\") " pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:48.929380 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:48.929344 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:49.076833 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:49.076803 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr"] Jun 11 16:26:49.079234 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:26:49.079192 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e163fa8_fa4b_475d_832b_78ce153fdb3f.slice/crio-3c8e68ab0a26138271c2a71e20f6b30e7103d8e785746919b2de20f57c93f9d2 WatchSource:0}: Error finding container 3c8e68ab0a26138271c2a71e20f6b30e7103d8e785746919b2de20f57c93f9d2: Status 404 returned error can't find the container with id 3c8e68ab0a26138271c2a71e20f6b30e7103d8e785746919b2de20f57c93f9d2 Jun 11 16:26:49.765946 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:49.765903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" event={"ID":"5e163fa8-fa4b-475d-832b-78ce153fdb3f","Type":"ContainerStarted","Data":"3c8e68ab0a26138271c2a71e20f6b30e7103d8e785746919b2de20f57c93f9d2"} Jun 11 16:26:50.771586 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:50.771549 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" event={"ID":"5e163fa8-fa4b-475d-832b-78ce153fdb3f","Type":"ContainerStarted","Data":"9d952f93dd7fa36552d45a1ac16563fba5ec5afce2bca05064599d7b0b31b784"} Jun 11 16:26:50.771959 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:50.771661 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:26:52.845643 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:52.845593 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" podStartSLOduration=3.293883755 podStartE2EDuration="4.845570538s" totalImagesPullingTime="1.551686783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:26:50.801139755 +0000 UTC m=+428.149248015" watchObservedRunningTime="2026-06-11 16:26:52.845570538 +0000 UTC m=+430.193678780" Jun 11 16:26:52.846059 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:52.845922 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft"] Jun 11 16:26:52.849419 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:52.849398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" Jun 11 16:26:52.852450 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:52.852432 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:26:52.852450 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:52.852447 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-848q4\"" Jun 11 16:26:52.853533 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:52.853515 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:26:52.860795 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:52.860770 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft"] Jun 11 16:26:53.017958 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:53.017921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft\" (UID: \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" Jun 11 16:26:53.018147 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:53.018039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft\" (UID: \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" Jun 11 16:26:53.018147 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:53.018063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwts7\" (UniqueName: \"kubernetes.io/projected/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-kube-api-access-hwts7\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft\" (UID: \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" Jun 11 16:26:53.119418 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:53.119326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft\" (UID: \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" Jun 11 16:26:53.119418 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:53.119372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwts7\" (UniqueName: \"kubernetes.io/projected/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-kube-api-access-hwts7\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft\" (UID: \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" Jun 11 16:26:53.119602 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:53.119513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft\" (UID: \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" Jun 11 16:26:53.119857 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:53.119834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft\" (UID: \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" Jun 11 16:26:53.119897 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:53.119853 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft\" (UID: \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" Jun 11 16:26:53.128923 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:53.128887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwts7\" (UniqueName: \"kubernetes.io/projected/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-kube-api-access-hwts7\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft\" (UID: \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" Jun 11 16:26:53.158575 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:53.158534 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" Jun 11 16:26:53.310674 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:53.310651 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft"] Jun 11 16:26:53.312596 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:26:53.312568 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbdded1b_9081_48d4_aeed_b9ebe3cdf817.slice/crio-716e021a93856fc283ad00b9b80d8ef704acd83bbefbd839e098b0c551b456e9 WatchSource:0}: Error finding container 716e021a93856fc283ad00b9b80d8ef704acd83bbefbd839e098b0c551b456e9: Status 404 returned error can't find the container with id 716e021a93856fc283ad00b9b80d8ef704acd83bbefbd839e098b0c551b456e9 Jun 11 16:26:53.786652 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:53.786582 2576 generic.go:356] "Generic (PLEG): container finished" podID="bbdded1b-9081-48d4-aeed-b9ebe3cdf817" containerID="dd9750eb824ab39651bf6df43171979676e3b29508e14104dc2ae9bb7317961e" exitCode=0 Jun 11 16:26:53.786652 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:53.786633 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" event={"ID":"bbdded1b-9081-48d4-aeed-b9ebe3cdf817","Type":"ContainerDied","Data":"dd9750eb824ab39651bf6df43171979676e3b29508e14104dc2ae9bb7317961e"} Jun 11 16:26:53.786856 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:53.786686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" event={"ID":"bbdded1b-9081-48d4-aeed-b9ebe3cdf817","Type":"ContainerStarted","Data":"716e021a93856fc283ad00b9b80d8ef704acd83bbefbd839e098b0c551b456e9"} Jun 11 16:26:54.793006 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:54.792911 2576 generic.go:356] "Generic (PLEG): container finished" podID="bbdded1b-9081-48d4-aeed-b9ebe3cdf817" containerID="25da09d497bda1917aeff566da1f1dd6889c401149cffd701a3cfd86805c0aa4" exitCode=0 Jun 11 16:26:54.793393 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:54.792998 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" event={"ID":"bbdded1b-9081-48d4-aeed-b9ebe3cdf817","Type":"ContainerDied","Data":"25da09d497bda1917aeff566da1f1dd6889c401149cffd701a3cfd86805c0aa4"} Jun 11 16:26:55.799945 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:55.799906 2576 generic.go:356] "Generic (PLEG): container finished" podID="bbdded1b-9081-48d4-aeed-b9ebe3cdf817" containerID="57d7207b97866b4f85cb4183d84958f0c69beed1c835eee7f678c71686ff5adb" exitCode=0 Jun 11 16:26:55.800352 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:55.799997 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" event={"ID":"bbdded1b-9081-48d4-aeed-b9ebe3cdf817","Type":"ContainerDied","Data":"57d7207b97866b4f85cb4183d84958f0c69beed1c835eee7f678c71686ff5adb"} Jun 11 16:26:56.937838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:56.937810 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" Jun 11 16:26:57.054194 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:57.054130 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwts7\" (UniqueName: \"kubernetes.io/projected/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-kube-api-access-hwts7\") pod \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\" (UID: \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\") " Jun 11 16:26:57.054400 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:57.054236 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-bundle\") pod \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\" (UID: \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\") " Jun 11 16:26:57.054400 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:57.054274 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-util\") pod \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\" (UID: \"bbdded1b-9081-48d4-aeed-b9ebe3cdf817\") " Jun 11 16:26:57.055149 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:57.055120 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-bundle" (OuterVolumeSpecName: "bundle") pod "bbdded1b-9081-48d4-aeed-b9ebe3cdf817" (UID: "bbdded1b-9081-48d4-aeed-b9ebe3cdf817"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:26:57.056326 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:57.056296 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-kube-api-access-hwts7" (OuterVolumeSpecName: "kube-api-access-hwts7") pod "bbdded1b-9081-48d4-aeed-b9ebe3cdf817" (UID: "bbdded1b-9081-48d4-aeed-b9ebe3cdf817"). InnerVolumeSpecName "kube-api-access-hwts7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:26:57.059594 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:57.059537 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-util" (OuterVolumeSpecName: "util") pod "bbdded1b-9081-48d4-aeed-b9ebe3cdf817" (UID: "bbdded1b-9081-48d4-aeed-b9ebe3cdf817"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:26:57.155306 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:57.155266 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwts7\" (UniqueName: \"kubernetes.io/projected/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-kube-api-access-hwts7\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:26:57.155306 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:57.155302 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-bundle\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:26:57.155306 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:57.155313 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbdded1b-9081-48d4-aeed-b9ebe3cdf817-util\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:26:57.814476 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:57.814448 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" Jun 11 16:26:57.814645 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:57.814452 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c7vft" event={"ID":"bbdded1b-9081-48d4-aeed-b9ebe3cdf817","Type":"ContainerDied","Data":"716e021a93856fc283ad00b9b80d8ef704acd83bbefbd839e098b0c551b456e9"} Jun 11 16:26:57.814645 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:26:57.814563 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="716e021a93856fc283ad00b9b80d8ef704acd83bbefbd839e098b0c551b456e9" Jun 11 16:27:01.778212 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:01.778183 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-595bc765c4-c7hjr" Jun 11 16:27:02.740510 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.740413 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4"] Jun 11 16:27:02.740779 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.740762 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbdded1b-9081-48d4-aeed-b9ebe3cdf817" containerName="pull" Jun 11 16:27:02.740823 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.740783 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbdded1b-9081-48d4-aeed-b9ebe3cdf817" containerName="pull" Jun 11 16:27:02.740823 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.740800 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbdded1b-9081-48d4-aeed-b9ebe3cdf817" containerName="util" Jun 11 16:27:02.740823 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.740805 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbdded1b-9081-48d4-aeed-b9ebe3cdf817" containerName="util" Jun 11 16:27:02.740823 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.740818 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbdded1b-9081-48d4-aeed-b9ebe3cdf817" containerName="extract" Jun 11 16:27:02.740823 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.740824 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbdded1b-9081-48d4-aeed-b9ebe3cdf817" containerName="extract" Jun 11 16:27:02.740974 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.740875 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbdded1b-9081-48d4-aeed-b9ebe3cdf817" containerName="extract" Jun 11 16:27:02.743612 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.743594 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" Jun 11 16:27:02.746764 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.746741 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:27:02.746869 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:27:02.746799 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4\" is forbidden: User \"system:node:ip-10-0-128-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-128-162.ec2.internal' and this object" podUID="e8d79b0e-c628-4c71-8a98-6ad44495b66c" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" Jun 11 16:27:02.747910 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.747893 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:27:02.747993 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.747894 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-848q4\"" Jun 11 16:27:02.773322 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.773297 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4"] Jun 11 16:27:02.805971 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.805941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m28qp\" (UniqueName: \"kubernetes.io/projected/e8d79b0e-c628-4c71-8a98-6ad44495b66c-kube-api-access-m28qp\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4\" (UID: \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" Jun 11 16:27:02.806356 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.805980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8d79b0e-c628-4c71-8a98-6ad44495b66c-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4\" (UID: \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" Jun 11 16:27:02.806356 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.806004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8d79b0e-c628-4c71-8a98-6ad44495b66c-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4\" (UID: \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" Jun 11 16:27:02.906689 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.906647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8d79b0e-c628-4c71-8a98-6ad44495b66c-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4\" (UID: \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" Jun 11 16:27:02.906689 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.906694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8d79b0e-c628-4c71-8a98-6ad44495b66c-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4\" (UID: \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" Jun 11 16:27:02.906951 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.906763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m28qp\" (UniqueName: \"kubernetes.io/projected/e8d79b0e-c628-4c71-8a98-6ad44495b66c-kube-api-access-m28qp\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4\" (UID: \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" Jun 11 16:27:02.907144 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.907120 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8d79b0e-c628-4c71-8a98-6ad44495b66c-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4\" (UID: \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" Jun 11 16:27:02.907216 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.907145 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8d79b0e-c628-4c71-8a98-6ad44495b66c-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4\" (UID: \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" Jun 11 16:27:02.957395 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:02.957357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m28qp\" (UniqueName: \"kubernetes.io/projected/e8d79b0e-c628-4c71-8a98-6ad44495b66c-kube-api-access-m28qp\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4\" (UID: \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" Jun 11 16:27:03.052444 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:03.052405 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" Jun 11 16:27:03.222040 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:03.221968 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4"] Jun 11 16:27:03.224837 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:27:03.224806 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d79b0e_c628_4c71_8a98_6ad44495b66c.slice/crio-13109134ce52018aded3dfe07926b6b4a98944795072cbf30afb729163f4fe2e WatchSource:0}: Error finding container 13109134ce52018aded3dfe07926b6b4a98944795072cbf30afb729163f4fe2e: Status 404 returned error can't find the container with id 13109134ce52018aded3dfe07926b6b4a98944795072cbf30afb729163f4fe2e Jun 11 16:27:03.842440 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:03.842404 2576 generic.go:356] "Generic (PLEG): container finished" podID="e8d79b0e-c628-4c71-8a98-6ad44495b66c" containerID="20b2790dca18d059179b21a99571a3eddcb5e0ca84196a73224be299323ed140" exitCode=0 Jun 11 16:27:03.842821 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:03.842463 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" event={"ID":"e8d79b0e-c628-4c71-8a98-6ad44495b66c","Type":"ContainerDied","Data":"20b2790dca18d059179b21a99571a3eddcb5e0ca84196a73224be299323ed140"} Jun 11 16:27:03.842821 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:03.842502 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" event={"ID":"e8d79b0e-c628-4c71-8a98-6ad44495b66c","Type":"ContainerStarted","Data":"13109134ce52018aded3dfe07926b6b4a98944795072cbf30afb729163f4fe2e"} Jun 11 16:27:04.848829 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:04.848796 2576 generic.go:356] "Generic (PLEG): container finished" podID="e8d79b0e-c628-4c71-8a98-6ad44495b66c" containerID="839800a7ddd643609daa8610155114ea26d66279b481c21f0f2763e561d9a7ae" exitCode=0 Jun 11 16:27:04.849227 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:04.848853 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" event={"ID":"e8d79b0e-c628-4c71-8a98-6ad44495b66c","Type":"ContainerDied","Data":"839800a7ddd643609daa8610155114ea26d66279b481c21f0f2763e561d9a7ae"} Jun 11 16:27:05.855090 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:05.855052 2576 generic.go:356] "Generic (PLEG): container finished" podID="e8d79b0e-c628-4c71-8a98-6ad44495b66c" containerID="14bf56541dbc701769eec7c6d2a3c64d430ace4a570be55088d67a8ad67e3317" exitCode=0 Jun 11 16:27:05.855449 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:05.855144 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" event={"ID":"e8d79b0e-c628-4c71-8a98-6ad44495b66c","Type":"ContainerDied","Data":"14bf56541dbc701769eec7c6d2a3c64d430ace4a570be55088d67a8ad67e3317"} Jun 11 16:27:06.997121 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:06.997092 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" Jun 11 16:27:07.038654 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.038620 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m28qp\" (UniqueName: \"kubernetes.io/projected/e8d79b0e-c628-4c71-8a98-6ad44495b66c-kube-api-access-m28qp\") pod \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\" (UID: \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\") " Jun 11 16:27:07.038888 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.038698 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8d79b0e-c628-4c71-8a98-6ad44495b66c-util\") pod \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\" (UID: \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\") " Jun 11 16:27:07.038888 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.038733 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8d79b0e-c628-4c71-8a98-6ad44495b66c-bundle\") pod \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\" (UID: \"e8d79b0e-c628-4c71-8a98-6ad44495b66c\") " Jun 11 16:27:07.039932 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.039899 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8d79b0e-c628-4c71-8a98-6ad44495b66c-bundle" (OuterVolumeSpecName: "bundle") pod "e8d79b0e-c628-4c71-8a98-6ad44495b66c" (UID: "e8d79b0e-c628-4c71-8a98-6ad44495b66c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:27:07.040911 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.040883 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8d79b0e-c628-4c71-8a98-6ad44495b66c-kube-api-access-m28qp" (OuterVolumeSpecName: "kube-api-access-m28qp") pod "e8d79b0e-c628-4c71-8a98-6ad44495b66c" (UID: "e8d79b0e-c628-4c71-8a98-6ad44495b66c"). InnerVolumeSpecName "kube-api-access-m28qp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:27:07.045230 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.045194 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8d79b0e-c628-4c71-8a98-6ad44495b66c-util" (OuterVolumeSpecName: "util") pod "e8d79b0e-c628-4c71-8a98-6ad44495b66c" (UID: "e8d79b0e-c628-4c71-8a98-6ad44495b66c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:27:07.140091 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.139981 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m28qp\" (UniqueName: \"kubernetes.io/projected/e8d79b0e-c628-4c71-8a98-6ad44495b66c-kube-api-access-m28qp\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:27:07.140091 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.140028 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8d79b0e-c628-4c71-8a98-6ad44495b66c-util\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:27:07.140091 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.140043 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8d79b0e-c628-4c71-8a98-6ad44495b66c-bundle\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:27:07.866697 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.866657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" event={"ID":"e8d79b0e-c628-4c71-8a98-6ad44495b66c","Type":"ContainerDied","Data":"13109134ce52018aded3dfe07926b6b4a98944795072cbf30afb729163f4fe2e"} Jun 11 16:27:07.866872 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.866674 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a596v4" Jun 11 16:27:07.866872 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.866759 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13109134ce52018aded3dfe07926b6b4a98944795072cbf30afb729163f4fe2e" Jun 11 16:27:07.976882 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.976849 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-56659f465f-nnqjn"] Jun 11 16:27:07.977171 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.977158 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d79b0e-c628-4c71-8a98-6ad44495b66c" containerName="util" Jun 11 16:27:07.977229 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.977172 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d79b0e-c628-4c71-8a98-6ad44495b66c" containerName="util" Jun 11 16:27:07.977229 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.977184 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d79b0e-c628-4c71-8a98-6ad44495b66c" containerName="extract" Jun 11 16:27:07.977229 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.977189 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d79b0e-c628-4c71-8a98-6ad44495b66c" containerName="extract" Jun 11 16:27:07.977229 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.977200 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d79b0e-c628-4c71-8a98-6ad44495b66c" containerName="pull" Jun 11 16:27:07.977229 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.977206 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d79b0e-c628-4c71-8a98-6ad44495b66c" containerName="pull" Jun 11 16:27:07.977382 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.977257 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8d79b0e-c628-4c71-8a98-6ad44495b66c" containerName="extract" Jun 11 16:27:07.979443 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.979415 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56659f465f-nnqjn" Jun 11 16:27:07.982723 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.982698 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 16:27:07.982900 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.982698 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vm2f6\"" Jun 11 16:27:07.989829 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:07.989805 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56659f465f-nnqjn"] Jun 11 16:27:08.048356 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:08.048316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcvgj\" (UniqueName: \"kubernetes.io/projected/26f3c5f7-744e-4790-820a-f77a3d142397-kube-api-access-pcvgj\") pod \"dashboard-redirect-56659f465f-nnqjn\" (UID: \"26f3c5f7-744e-4790-820a-f77a3d142397\") " pod="opendatahub/dashboard-redirect-56659f465f-nnqjn" Jun 11 16:27:08.048747 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:08.048399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/26f3c5f7-744e-4790-820a-f77a3d142397-redirect-config\") pod \"dashboard-redirect-56659f465f-nnqjn\" (UID: \"26f3c5f7-744e-4790-820a-f77a3d142397\") " pod="opendatahub/dashboard-redirect-56659f465f-nnqjn" Jun 11 16:27:08.149645 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:08.149546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/26f3c5f7-744e-4790-820a-f77a3d142397-redirect-config\") pod \"dashboard-redirect-56659f465f-nnqjn\" (UID: \"26f3c5f7-744e-4790-820a-f77a3d142397\") " pod="opendatahub/dashboard-redirect-56659f465f-nnqjn" Jun 11 16:27:08.149823 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:08.149654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcvgj\" (UniqueName: \"kubernetes.io/projected/26f3c5f7-744e-4790-820a-f77a3d142397-kube-api-access-pcvgj\") pod \"dashboard-redirect-56659f465f-nnqjn\" (UID: \"26f3c5f7-744e-4790-820a-f77a3d142397\") " pod="opendatahub/dashboard-redirect-56659f465f-nnqjn" Jun 11 16:27:08.150231 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:08.150211 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/26f3c5f7-744e-4790-820a-f77a3d142397-redirect-config\") pod \"dashboard-redirect-56659f465f-nnqjn\" (UID: \"26f3c5f7-744e-4790-820a-f77a3d142397\") " pod="opendatahub/dashboard-redirect-56659f465f-nnqjn" Jun 11 16:27:08.166322 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:08.166296 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcvgj\" (UniqueName: \"kubernetes.io/projected/26f3c5f7-744e-4790-820a-f77a3d142397-kube-api-access-pcvgj\") pod \"dashboard-redirect-56659f465f-nnqjn\" (UID: \"26f3c5f7-744e-4790-820a-f77a3d142397\") " pod="opendatahub/dashboard-redirect-56659f465f-nnqjn" Jun 11 16:27:08.290819 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:08.290783 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56659f465f-nnqjn" Jun 11 16:27:08.420249 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:08.420221 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56659f465f-nnqjn"] Jun 11 16:27:08.421945 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:27:08.421915 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f3c5f7_744e_4790_820a_f77a3d142397.slice/crio-3a3adfb2416785b696f85b52654b5513f870e5cf5b4550d0aa20b1b375614081 WatchSource:0}: Error finding container 3a3adfb2416785b696f85b52654b5513f870e5cf5b4550d0aa20b1b375614081: Status 404 returned error can't find the container with id 3a3adfb2416785b696f85b52654b5513f870e5cf5b4550d0aa20b1b375614081 Jun 11 16:27:08.871668 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:08.871628 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56659f465f-nnqjn" event={"ID":"26f3c5f7-744e-4790-820a-f77a3d142397","Type":"ContainerStarted","Data":"3a3adfb2416785b696f85b52654b5513f870e5cf5b4550d0aa20b1b375614081"} Jun 11 16:27:13.899025 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:13.898974 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56659f465f-nnqjn" event={"ID":"26f3c5f7-744e-4790-820a-f77a3d142397","Type":"ContainerStarted","Data":"accb227f747c3bc29b4017312b78f4a12d06096d87630000aadb29f462e96c1f"} Jun 11 16:27:13.917477 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:13.917423 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-56659f465f-nnqjn" podStartSLOduration=2.436827502 podStartE2EDuration="6.917408978s" totalImagesPullingTime="4.480581476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:27:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:27:13.916764327 +0000 UTC m=+451.264872559" watchObservedRunningTime="2026-06-11 16:27:13.917408978 +0000 UTC m=+451.265517261" Jun 11 16:27:29.218045 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.217996 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q"] Jun 11 16:27:29.222439 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.222420 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.227110 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.227090 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bnfvq\"" Jun 11 16:27:29.227238 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.227093 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 16:27:29.236559 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.236534 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q"] Jun 11 16:27:29.328209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.328167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.328209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.328210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.328440 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.328274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.328440 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.328317 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.328440 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.328386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.328440 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.328423 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.328640 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.328442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn6m5\" (UniqueName: \"kubernetes.io/projected/194969eb-8b7a-4d4b-8858-bff5a5a8d739-kube-api-access-tn6m5\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.328640 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.328466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.328640 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.328497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.429322 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.429278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.429322 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.429328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.429571 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.429364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.429571 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.429398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.429571 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.429435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.429721 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.429574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.429721 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.429622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn6m5\" (UniqueName: \"kubernetes.io/projected/194969eb-8b7a-4d4b-8858-bff5a5a8d739-kube-api-access-tn6m5\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.429721 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.429656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.429721 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.429685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.429896 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.429860 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.429954 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.429912 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.430113 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.430094 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.430199 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.430128 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.430247 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.430227 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.431867 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.431843 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.432173 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.432156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.438746 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.438726 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/194969eb-8b7a-4d4b-8858-bff5a5a8d739-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.439347 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.439325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn6m5\" (UniqueName: \"kubernetes.io/projected/194969eb-8b7a-4d4b-8858-bff5a5a8d739-kube-api-access-tn6m5\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gxv4q\" (UID: \"194969eb-8b7a-4d4b-8858-bff5a5a8d739\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.532713 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.532619 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:29.674931 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.674891 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q"] Jun 11 16:27:29.676067 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:27:29.676033 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194969eb_8b7a_4d4b_8858_bff5a5a8d739.slice/crio-e11984f27b1084c8b54b5b1e39f1e32b3e373800fb6dba19815d301ba238e881 WatchSource:0}: Error finding container e11984f27b1084c8b54b5b1e39f1e32b3e373800fb6dba19815d301ba238e881: Status 404 returned error can't find the container with id e11984f27b1084c8b54b5b1e39f1e32b3e373800fb6dba19815d301ba238e881 Jun 11 16:27:29.973222 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:29.973186 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" event={"ID":"194969eb-8b7a-4d4b-8858-bff5a5a8d739","Type":"ContainerStarted","Data":"e11984f27b1084c8b54b5b1e39f1e32b3e373800fb6dba19815d301ba238e881"} Jun 11 16:27:32.069028 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:32.068975 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:27:32.069373 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:32.069086 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:27:32.069373 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:32.069137 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:27:32.993690 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:32.993637 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" event={"ID":"194969eb-8b7a-4d4b-8858-bff5a5a8d739","Type":"ContainerStarted","Data":"ecd0b7d8b42c38d54fa1a8b8426cbb7ab6388f2e311b33eb17a1dc6467eac8f6"} Jun 11 16:27:33.018764 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:33.018704 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" podStartSLOduration=1.628183361 podStartE2EDuration="4.018684325s" totalImagesPullingTime="2.390500964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:27:33.01785084 +0000 UTC m=+470.365959068" watchObservedRunningTime="2026-06-11 16:27:33.018684325 +0000 UTC m=+470.366792555" Jun 11 16:27:33.533505 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:33.533464 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:33.538068 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:33.538043 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:33.998531 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:33.998490 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:33.999580 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:33.999562 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gxv4q" Jun 11 16:27:52.213159 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.213107 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jsmfv"] Jun 11 16:27:52.235264 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.235234 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jsmfv"] Jun 11 16:27:52.235444 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.235337 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jsmfv" Jun 11 16:27:52.238255 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.238227 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 16:27:52.238385 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.238227 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 16:27:52.239313 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.239295 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-n79f7\"" Jun 11 16:27:52.432316 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.432274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj8qx\" (UniqueName: \"kubernetes.io/projected/abd88462-a46e-4bb0-9f50-581b745070a7-kube-api-access-pj8qx\") pod \"kuadrant-operator-catalog-jsmfv\" (UID: \"abd88462-a46e-4bb0-9f50-581b745070a7\") " pod="kuadrant-system/kuadrant-operator-catalog-jsmfv" Jun 11 16:27:52.532901 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.532801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj8qx\" (UniqueName: \"kubernetes.io/projected/abd88462-a46e-4bb0-9f50-581b745070a7-kube-api-access-pj8qx\") pod \"kuadrant-operator-catalog-jsmfv\" (UID: \"abd88462-a46e-4bb0-9f50-581b745070a7\") " pod="kuadrant-system/kuadrant-operator-catalog-jsmfv" Jun 11 16:27:52.543385 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.543350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj8qx\" (UniqueName: \"kubernetes.io/projected/abd88462-a46e-4bb0-9f50-581b745070a7-kube-api-access-pj8qx\") pod \"kuadrant-operator-catalog-jsmfv\" (UID: \"abd88462-a46e-4bb0-9f50-581b745070a7\") " pod="kuadrant-system/kuadrant-operator-catalog-jsmfv" Jun 11 16:27:52.545176 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.545153 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jsmfv" Jun 11 16:27:52.676097 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.676068 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jsmfv"] Jun 11 16:27:52.678061 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:27:52.678038 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd88462_a46e_4bb0_9f50_581b745070a7.slice/crio-750277d2b3c75a5889e0daabef1d63b160d7d836f10ef62a101f03d7a13dbf79 WatchSource:0}: Error finding container 750277d2b3c75a5889e0daabef1d63b160d7d836f10ef62a101f03d7a13dbf79: Status 404 returned error can't find the container with id 750277d2b3c75a5889e0daabef1d63b160d7d836f10ef62a101f03d7a13dbf79 Jun 11 16:27:52.831928 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.831891 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jsmfv"] Jun 11 16:27:52.871558 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.871526 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s72r6"] Jun 11 16:27:52.876043 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.876001 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s72r6" Jun 11 16:27:52.884292 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:52.884266 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s72r6"] Jun 11 16:27:53.036928 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:53.036894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffmxf\" (UniqueName: \"kubernetes.io/projected/a55f0b41-59df-4769-9c61-18060cde2e98-kube-api-access-ffmxf\") pod \"kuadrant-operator-catalog-s72r6\" (UID: \"a55f0b41-59df-4769-9c61-18060cde2e98\") " pod="kuadrant-system/kuadrant-operator-catalog-s72r6" Jun 11 16:27:53.089323 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:53.086704 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jsmfv" event={"ID":"abd88462-a46e-4bb0-9f50-581b745070a7","Type":"ContainerStarted","Data":"750277d2b3c75a5889e0daabef1d63b160d7d836f10ef62a101f03d7a13dbf79"} Jun 11 16:27:53.137871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:53.137840 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffmxf\" (UniqueName: \"kubernetes.io/projected/a55f0b41-59df-4769-9c61-18060cde2e98-kube-api-access-ffmxf\") pod \"kuadrant-operator-catalog-s72r6\" (UID: \"a55f0b41-59df-4769-9c61-18060cde2e98\") " pod="kuadrant-system/kuadrant-operator-catalog-s72r6" Jun 11 16:27:53.147102 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:53.147071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffmxf\" (UniqueName: \"kubernetes.io/projected/a55f0b41-59df-4769-9c61-18060cde2e98-kube-api-access-ffmxf\") pod \"kuadrant-operator-catalog-s72r6\" (UID: \"a55f0b41-59df-4769-9c61-18060cde2e98\") " pod="kuadrant-system/kuadrant-operator-catalog-s72r6" Jun 11 16:27:53.187254 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:53.187212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s72r6" Jun 11 16:27:53.331722 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:53.331634 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s72r6"] Jun 11 16:27:53.360466 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:27:53.360394 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda55f0b41_59df_4769_9c61_18060cde2e98.slice/crio-80f9f99f265a7edba1283a98fe64a0047a18b00c0abac8014433fac37795e3b7 WatchSource:0}: Error finding container 80f9f99f265a7edba1283a98fe64a0047a18b00c0abac8014433fac37795e3b7: Status 404 returned error can't find the container with id 80f9f99f265a7edba1283a98fe64a0047a18b00c0abac8014433fac37795e3b7 Jun 11 16:27:54.096986 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:54.096923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s72r6" event={"ID":"a55f0b41-59df-4769-9c61-18060cde2e98","Type":"ContainerStarted","Data":"80f9f99f265a7edba1283a98fe64a0047a18b00c0abac8014433fac37795e3b7"} Jun 11 16:27:55.103400 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:55.103359 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s72r6" event={"ID":"a55f0b41-59df-4769-9c61-18060cde2e98","Type":"ContainerStarted","Data":"f64a4e2db1142e1b351ad276affb2a73f94c6ed4733fa64fc9c4cdfd8aa2e2d1"} Jun 11 16:27:55.104897 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:55.104868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jsmfv" event={"ID":"abd88462-a46e-4bb0-9f50-581b745070a7","Type":"ContainerStarted","Data":"0f33af90f12e3dc208d46baa60b0e66c35d83cb56b1e617e913eda917a06f1ba"} Jun 11 16:27:55.105050 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:55.104921 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-jsmfv" podUID="abd88462-a46e-4bb0-9f50-581b745070a7" containerName="registry-server" containerID="cri-o://0f33af90f12e3dc208d46baa60b0e66c35d83cb56b1e617e913eda917a06f1ba" gracePeriod=2 Jun 11 16:27:55.120967 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:55.120923 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-s72r6" podStartSLOduration=1.736014792 podStartE2EDuration="3.12090619s" totalImagesPullingTime="1.384891398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:27:55.119586247 +0000 UTC m=+492.467694481" watchObservedRunningTime="2026-06-11 16:27:55.12090619 +0000 UTC m=+492.469014425" Jun 11 16:27:55.137379 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:55.137329 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jsmfv" podStartSLOduration=1.073918061 podStartE2EDuration="3.137311341s" totalImagesPullingTime="2.06339328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:27:55.136068465 +0000 UTC m=+492.484176696" watchObservedRunningTime="2026-06-11 16:27:55.137311341 +0000 UTC m=+492.485419602" Jun 11 16:27:55.350055 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:55.350026 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jsmfv" Jun 11 16:27:55.356892 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:55.356831 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj8qx\" (UniqueName: \"kubernetes.io/projected/abd88462-a46e-4bb0-9f50-581b745070a7-kube-api-access-pj8qx\") pod \"abd88462-a46e-4bb0-9f50-581b745070a7\" (UID: \"abd88462-a46e-4bb0-9f50-581b745070a7\") " Jun 11 16:27:55.358958 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:55.358937 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abd88462-a46e-4bb0-9f50-581b745070a7-kube-api-access-pj8qx" (OuterVolumeSpecName: "kube-api-access-pj8qx") pod "abd88462-a46e-4bb0-9f50-581b745070a7" (UID: "abd88462-a46e-4bb0-9f50-581b745070a7"). InnerVolumeSpecName "kube-api-access-pj8qx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:27:55.458216 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:55.458178 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj8qx\" (UniqueName: \"kubernetes.io/projected/abd88462-a46e-4bb0-9f50-581b745070a7-kube-api-access-pj8qx\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:27:56.111007 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:56.110970 2576 generic.go:356] "Generic (PLEG): container finished" podID="abd88462-a46e-4bb0-9f50-581b745070a7" containerID="0f33af90f12e3dc208d46baa60b0e66c35d83cb56b1e617e913eda917a06f1ba" exitCode=0 Jun 11 16:27:56.111440 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:56.111027 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jsmfv" Jun 11 16:27:56.111440 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:56.111055 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jsmfv" event={"ID":"abd88462-a46e-4bb0-9f50-581b745070a7","Type":"ContainerDied","Data":"0f33af90f12e3dc208d46baa60b0e66c35d83cb56b1e617e913eda917a06f1ba"} Jun 11 16:27:56.111440 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:56.111099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jsmfv" event={"ID":"abd88462-a46e-4bb0-9f50-581b745070a7","Type":"ContainerDied","Data":"750277d2b3c75a5889e0daabef1d63b160d7d836f10ef62a101f03d7a13dbf79"} Jun 11 16:27:56.111440 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:56.111118 2576 scope.go:117] "RemoveContainer" containerID="0f33af90f12e3dc208d46baa60b0e66c35d83cb56b1e617e913eda917a06f1ba" Jun 11 16:27:56.119866 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:56.119850 2576 scope.go:117] "RemoveContainer" containerID="0f33af90f12e3dc208d46baa60b0e66c35d83cb56b1e617e913eda917a06f1ba" Jun 11 16:27:56.120151 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:27:56.120133 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f33af90f12e3dc208d46baa60b0e66c35d83cb56b1e617e913eda917a06f1ba\": container with ID starting with 0f33af90f12e3dc208d46baa60b0e66c35d83cb56b1e617e913eda917a06f1ba not found: ID does not exist" containerID="0f33af90f12e3dc208d46baa60b0e66c35d83cb56b1e617e913eda917a06f1ba" Jun 11 16:27:56.120202 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:56.120160 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f33af90f12e3dc208d46baa60b0e66c35d83cb56b1e617e913eda917a06f1ba"} err="failed to get container status \"0f33af90f12e3dc208d46baa60b0e66c35d83cb56b1e617e913eda917a06f1ba\": rpc error: code = NotFound desc = could not find container \"0f33af90f12e3dc208d46baa60b0e66c35d83cb56b1e617e913eda917a06f1ba\": container with ID starting with 0f33af90f12e3dc208d46baa60b0e66c35d83cb56b1e617e913eda917a06f1ba not found: ID does not exist" Jun 11 16:27:56.132459 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:56.132435 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jsmfv"] Jun 11 16:27:56.135564 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:56.135543 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jsmfv"] Jun 11 16:27:57.101850 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:27:57.101813 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abd88462-a46e-4bb0-9f50-581b745070a7" path="/var/lib/kubelet/pods/abd88462-a46e-4bb0-9f50-581b745070a7/volumes" Jun 11 16:28:03.188121 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:03.188087 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-s72r6" Jun 11 16:28:03.188644 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:03.188359 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-s72r6" Jun 11 16:28:03.211189 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:03.211164 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-s72r6" Jun 11 16:28:04.170285 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:04.170250 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-s72r6" Jun 11 16:28:07.836440 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:07.836401 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6"] Jun 11 16:28:07.836832 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:07.836753 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abd88462-a46e-4bb0-9f50-581b745070a7" containerName="registry-server" Jun 11 16:28:07.836832 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:07.836764 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="abd88462-a46e-4bb0-9f50-581b745070a7" containerName="registry-server" Jun 11 16:28:07.836902 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:07.836834 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="abd88462-a46e-4bb0-9f50-581b745070a7" containerName="registry-server" Jun 11 16:28:07.844932 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:07.844905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" Jun 11 16:28:07.847920 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:07.847891 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8f82d\"" Jun 11 16:28:07.848823 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:07.848795 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6"] Jun 11 16:28:07.953801 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:07.953742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcmtp\" (UniqueName: \"kubernetes.io/projected/24f8a056-45b7-4f9e-8d02-97b17a8a1504-kube-api-access-tcmtp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6\" (UID: \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" Jun 11 16:28:07.953801 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:07.953797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f8a056-45b7-4f9e-8d02-97b17a8a1504-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6\" (UID: \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" Jun 11 16:28:07.954065 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:07.953955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f8a056-45b7-4f9e-8d02-97b17a8a1504-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6\" (UID: \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" Jun 11 16:28:08.054628 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.054585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f8a056-45b7-4f9e-8d02-97b17a8a1504-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6\" (UID: \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" Jun 11 16:28:08.054816 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.054633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcmtp\" (UniqueName: \"kubernetes.io/projected/24f8a056-45b7-4f9e-8d02-97b17a8a1504-kube-api-access-tcmtp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6\" (UID: \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" Jun 11 16:28:08.054816 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.054663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f8a056-45b7-4f9e-8d02-97b17a8a1504-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6\" (UID: \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" Jun 11 16:28:08.055004 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.054980 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f8a056-45b7-4f9e-8d02-97b17a8a1504-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6\" (UID: \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" Jun 11 16:28:08.055117 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.055051 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f8a056-45b7-4f9e-8d02-97b17a8a1504-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6\" (UID: \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" Jun 11 16:28:08.064303 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.064266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcmtp\" (UniqueName: \"kubernetes.io/projected/24f8a056-45b7-4f9e-8d02-97b17a8a1504-kube-api-access-tcmtp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6\" (UID: \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" Jun 11 16:28:08.155775 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.155683 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" Jun 11 16:28:08.232749 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.232713 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk"] Jun 11 16:28:08.236883 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.236859 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" Jun 11 16:28:08.247400 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.247376 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk"] Jun 11 16:28:08.257064 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.257006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk\" (UID: \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" Jun 11 16:28:08.257211 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.257067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk\" (UID: \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" Jun 11 16:28:08.257211 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.257158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsbc8\" (UniqueName: \"kubernetes.io/projected/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-kube-api-access-jsbc8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk\" (UID: \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" Jun 11 16:28:08.299527 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.299500 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6"] Jun 11 16:28:08.301083 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:28:08.301050 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f8a056_45b7_4f9e_8d02_97b17a8a1504.slice/crio-3d83166e59bec2011c177f319bcb71b26a109eef831a347d49d6e0b6dcb869f4 WatchSource:0}: Error finding container 3d83166e59bec2011c177f319bcb71b26a109eef831a347d49d6e0b6dcb869f4: Status 404 returned error can't find the container with id 3d83166e59bec2011c177f319bcb71b26a109eef831a347d49d6e0b6dcb869f4 Jun 11 16:28:08.357966 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.357938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbc8\" (UniqueName: \"kubernetes.io/projected/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-kube-api-access-jsbc8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk\" (UID: \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" Jun 11 16:28:08.358123 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.357987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk\" (UID: \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" Jun 11 16:28:08.358186 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.358123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk\" (UID: \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" Jun 11 16:28:08.358309 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.358293 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk\" (UID: \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" Jun 11 16:28:08.358485 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.358465 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk\" (UID: \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" Jun 11 16:28:08.367852 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.367825 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsbc8\" (UniqueName: \"kubernetes.io/projected/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-kube-api-access-jsbc8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk\" (UID: \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" Jun 11 16:28:08.549526 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.549488 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" Jun 11 16:28:08.632345 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.632309 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4"] Jun 11 16:28:08.636384 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.636358 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" Jun 11 16:28:08.644792 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.644684 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4"] Jun 11 16:28:08.660326 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.660246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4c28ca4-10de-43e4-8593-b4081857283f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4\" (UID: \"a4c28ca4-10de-43e4-8593-b4081857283f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" Jun 11 16:28:08.660326 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.660282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42msf\" (UniqueName: \"kubernetes.io/projected/a4c28ca4-10de-43e4-8593-b4081857283f-kube-api-access-42msf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4\" (UID: \"a4c28ca4-10de-43e4-8593-b4081857283f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" Jun 11 16:28:08.660499 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.660376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4c28ca4-10de-43e4-8593-b4081857283f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4\" (UID: \"a4c28ca4-10de-43e4-8593-b4081857283f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" Jun 11 16:28:08.689336 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.689182 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk"] Jun 11 16:28:08.692056 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:28:08.692032 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea73d3a4_8b9c_44b9_be2b_861330eabf5b.slice/crio-3a8c87c1aa8d9db728bdd613ab117bd2a90275f33075b9782c391f221d3c3847 WatchSource:0}: Error finding container 3a8c87c1aa8d9db728bdd613ab117bd2a90275f33075b9782c391f221d3c3847: Status 404 returned error can't find the container with id 3a8c87c1aa8d9db728bdd613ab117bd2a90275f33075b9782c391f221d3c3847 Jun 11 16:28:08.761609 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.761573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4c28ca4-10de-43e4-8593-b4081857283f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4\" (UID: \"a4c28ca4-10de-43e4-8593-b4081857283f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" Jun 11 16:28:08.761794 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.761627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42msf\" (UniqueName: \"kubernetes.io/projected/a4c28ca4-10de-43e4-8593-b4081857283f-kube-api-access-42msf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4\" (UID: \"a4c28ca4-10de-43e4-8593-b4081857283f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" Jun 11 16:28:08.761794 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.761714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4c28ca4-10de-43e4-8593-b4081857283f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4\" (UID: \"a4c28ca4-10de-43e4-8593-b4081857283f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" Jun 11 16:28:08.761971 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.761949 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4c28ca4-10de-43e4-8593-b4081857283f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4\" (UID: \"a4c28ca4-10de-43e4-8593-b4081857283f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" Jun 11 16:28:08.762070 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.762051 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4c28ca4-10de-43e4-8593-b4081857283f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4\" (UID: \"a4c28ca4-10de-43e4-8593-b4081857283f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" Jun 11 16:28:08.771906 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.771873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42msf\" (UniqueName: \"kubernetes.io/projected/a4c28ca4-10de-43e4-8593-b4081857283f-kube-api-access-42msf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4\" (UID: \"a4c28ca4-10de-43e4-8593-b4081857283f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" Jun 11 16:28:08.949165 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:08.949075 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" Jun 11 16:28:09.080860 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.080816 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4"] Jun 11 16:28:09.083665 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:28:09.083635 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c28ca4_10de_43e4_8593_b4081857283f.slice/crio-72d3905d923c76f8b4a98d9ff22e8950b4dc4cb5f54818e0d4b977300c2c92a9 WatchSource:0}: Error finding container 72d3905d923c76f8b4a98d9ff22e8950b4dc4cb5f54818e0d4b977300c2c92a9: Status 404 returned error can't find the container with id 72d3905d923c76f8b4a98d9ff22e8950b4dc4cb5f54818e0d4b977300c2c92a9 Jun 11 16:28:09.173731 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.173697 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" event={"ID":"a4c28ca4-10de-43e4-8593-b4081857283f","Type":"ContainerStarted","Data":"edd73fe0c3500d3645dcee070dc6e4522fd9bf6c34d2cc284208a918dfcd629a"} Jun 11 16:28:09.173913 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.173748 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" event={"ID":"a4c28ca4-10de-43e4-8593-b4081857283f","Type":"ContainerStarted","Data":"72d3905d923c76f8b4a98d9ff22e8950b4dc4cb5f54818e0d4b977300c2c92a9"} Jun 11 16:28:09.175345 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.175318 2576 generic.go:356] "Generic (PLEG): container finished" podID="24f8a056-45b7-4f9e-8d02-97b17a8a1504" containerID="812d590df6d951c1ee3097b40e461168419e9c30524636808836ecf19c054059" exitCode=0 Jun 11 16:28:09.175463 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.175409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" event={"ID":"24f8a056-45b7-4f9e-8d02-97b17a8a1504","Type":"ContainerDied","Data":"812d590df6d951c1ee3097b40e461168419e9c30524636808836ecf19c054059"} Jun 11 16:28:09.175530 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.175459 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" event={"ID":"24f8a056-45b7-4f9e-8d02-97b17a8a1504","Type":"ContainerStarted","Data":"3d83166e59bec2011c177f319bcb71b26a109eef831a347d49d6e0b6dcb869f4"} Jun 11 16:28:09.177071 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.177041 2576 generic.go:356] "Generic (PLEG): container finished" podID="ea73d3a4-8b9c-44b9-be2b-861330eabf5b" containerID="1be31c6b208e9870a8aee7870553997333561e40b3b4be39e46cf9d07e5b283e" exitCode=0 Jun 11 16:28:09.177181 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.177104 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" event={"ID":"ea73d3a4-8b9c-44b9-be2b-861330eabf5b","Type":"ContainerDied","Data":"1be31c6b208e9870a8aee7870553997333561e40b3b4be39e46cf9d07e5b283e"} Jun 11 16:28:09.177181 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.177148 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" event={"ID":"ea73d3a4-8b9c-44b9-be2b-861330eabf5b","Type":"ContainerStarted","Data":"3a8c87c1aa8d9db728bdd613ab117bd2a90275f33075b9782c391f221d3c3847"} Jun 11 16:28:09.252545 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.252512 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb"] Jun 11 16:28:09.262461 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.262424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" Jun 11 16:28:09.264672 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.264644 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb"] Jun 11 16:28:09.366988 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.366954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5135afff-fd51-4781-bde8-fd72bb4f82cc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb\" (UID: \"5135afff-fd51-4781-bde8-fd72bb4f82cc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" Jun 11 16:28:09.367174 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.367080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5135afff-fd51-4781-bde8-fd72bb4f82cc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb\" (UID: \"5135afff-fd51-4781-bde8-fd72bb4f82cc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" Jun 11 16:28:09.367174 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.367119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k926\" (UniqueName: \"kubernetes.io/projected/5135afff-fd51-4781-bde8-fd72bb4f82cc-kube-api-access-9k926\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb\" (UID: \"5135afff-fd51-4781-bde8-fd72bb4f82cc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" Jun 11 16:28:09.467870 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.467766 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5135afff-fd51-4781-bde8-fd72bb4f82cc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb\" (UID: \"5135afff-fd51-4781-bde8-fd72bb4f82cc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" Jun 11 16:28:09.467870 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.467819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k926\" (UniqueName: \"kubernetes.io/projected/5135afff-fd51-4781-bde8-fd72bb4f82cc-kube-api-access-9k926\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb\" (UID: \"5135afff-fd51-4781-bde8-fd72bb4f82cc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" Jun 11 16:28:09.467870 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.467868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5135afff-fd51-4781-bde8-fd72bb4f82cc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb\" (UID: \"5135afff-fd51-4781-bde8-fd72bb4f82cc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" Jun 11 16:28:09.468279 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.468255 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5135afff-fd51-4781-bde8-fd72bb4f82cc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb\" (UID: \"5135afff-fd51-4781-bde8-fd72bb4f82cc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" Jun 11 16:28:09.468344 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.468266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5135afff-fd51-4781-bde8-fd72bb4f82cc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb\" (UID: \"5135afff-fd51-4781-bde8-fd72bb4f82cc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" Jun 11 16:28:09.476478 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.476449 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k926\" (UniqueName: \"kubernetes.io/projected/5135afff-fd51-4781-bde8-fd72bb4f82cc-kube-api-access-9k926\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb\" (UID: \"5135afff-fd51-4781-bde8-fd72bb4f82cc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" Jun 11 16:28:09.572512 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.572475 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" Jun 11 16:28:09.706567 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:09.706540 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb"] Jun 11 16:28:09.747479 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:28:09.747406 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5135afff_fd51_4781_bde8_fd72bb4f82cc.slice/crio-40a29d2e7b67c4317043d66eb3a2d2167abb1386ce5c8663fe80607ea09db882 WatchSource:0}: Error finding container 40a29d2e7b67c4317043d66eb3a2d2167abb1386ce5c8663fe80607ea09db882: Status 404 returned error can't find the container with id 40a29d2e7b67c4317043d66eb3a2d2167abb1386ce5c8663fe80607ea09db882 Jun 11 16:28:10.183989 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:10.183957 2576 generic.go:356] "Generic (PLEG): container finished" podID="a4c28ca4-10de-43e4-8593-b4081857283f" containerID="edd73fe0c3500d3645dcee070dc6e4522fd9bf6c34d2cc284208a918dfcd629a" exitCode=0 Jun 11 16:28:10.184412 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:10.184048 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" event={"ID":"a4c28ca4-10de-43e4-8593-b4081857283f","Type":"ContainerDied","Data":"edd73fe0c3500d3645dcee070dc6e4522fd9bf6c34d2cc284208a918dfcd629a"} Jun 11 16:28:10.186043 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:10.185993 2576 generic.go:356] "Generic (PLEG): container finished" podID="24f8a056-45b7-4f9e-8d02-97b17a8a1504" containerID="a408f59b0197d3970cddfcc2180e6d9164b59da48e5bd575746b144e6dc6d29b" exitCode=0 Jun 11 16:28:10.186132 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:10.186047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" event={"ID":"24f8a056-45b7-4f9e-8d02-97b17a8a1504","Type":"ContainerDied","Data":"a408f59b0197d3970cddfcc2180e6d9164b59da48e5bd575746b144e6dc6d29b"} Jun 11 16:28:10.188053 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:10.188031 2576 generic.go:356] "Generic (PLEG): container finished" podID="ea73d3a4-8b9c-44b9-be2b-861330eabf5b" containerID="e4dacee4d415929f98c703537361003d473774aa06930489a20d26c297c81924" exitCode=0 Jun 11 16:28:10.188149 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:10.188103 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" event={"ID":"ea73d3a4-8b9c-44b9-be2b-861330eabf5b","Type":"ContainerDied","Data":"e4dacee4d415929f98c703537361003d473774aa06930489a20d26c297c81924"} Jun 11 16:28:10.189835 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:10.189814 2576 generic.go:356] "Generic (PLEG): container finished" podID="5135afff-fd51-4781-bde8-fd72bb4f82cc" containerID="841289ee3bd8f54a991335d9b5e7d1065fb70ffa8ca77efff6ea31a15cbd3846" exitCode=0 Jun 11 16:28:10.189936 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:10.189862 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" event={"ID":"5135afff-fd51-4781-bde8-fd72bb4f82cc","Type":"ContainerDied","Data":"841289ee3bd8f54a991335d9b5e7d1065fb70ffa8ca77efff6ea31a15cbd3846"} Jun 11 16:28:10.189936 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:10.189899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" event={"ID":"5135afff-fd51-4781-bde8-fd72bb4f82cc","Type":"ContainerStarted","Data":"40a29d2e7b67c4317043d66eb3a2d2167abb1386ce5c8663fe80607ea09db882"} Jun 11 16:28:11.196248 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:11.196213 2576 generic.go:356] "Generic (PLEG): container finished" podID="24f8a056-45b7-4f9e-8d02-97b17a8a1504" containerID="6e5219ee6ec9943e929f75ecbb2a464612d151444a114580400d63d7190530b1" exitCode=0 Jun 11 16:28:11.196651 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:11.196296 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" event={"ID":"24f8a056-45b7-4f9e-8d02-97b17a8a1504","Type":"ContainerDied","Data":"6e5219ee6ec9943e929f75ecbb2a464612d151444a114580400d63d7190530b1"} Jun 11 16:28:11.198317 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:11.198292 2576 generic.go:356] "Generic (PLEG): container finished" podID="ea73d3a4-8b9c-44b9-be2b-861330eabf5b" containerID="507a1ab85e3919ccecb3ffceb4c8d951316897818645aa30fb102a3c17e0e2c2" exitCode=0 Jun 11 16:28:11.198442 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:11.198376 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" event={"ID":"ea73d3a4-8b9c-44b9-be2b-861330eabf5b","Type":"ContainerDied","Data":"507a1ab85e3919ccecb3ffceb4c8d951316897818645aa30fb102a3c17e0e2c2"} Jun 11 16:28:11.199937 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:11.199914 2576 generic.go:356] "Generic (PLEG): container finished" podID="5135afff-fd51-4781-bde8-fd72bb4f82cc" containerID="21e95e1046a8125ecd396f42c1406e3bb4d4a9fcfadbc85be6d929c7d2e9709c" exitCode=0 Jun 11 16:28:11.200052 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:11.199943 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" event={"ID":"5135afff-fd51-4781-bde8-fd72bb4f82cc","Type":"ContainerDied","Data":"21e95e1046a8125ecd396f42c1406e3bb4d4a9fcfadbc85be6d929c7d2e9709c"} Jun 11 16:28:11.201837 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:11.201818 2576 generic.go:356] "Generic (PLEG): container finished" podID="a4c28ca4-10de-43e4-8593-b4081857283f" containerID="a3caf9ebab55f0bba85a80117c8611407665e5ffdaf56825d2f3960923a71a27" exitCode=0 Jun 11 16:28:11.201910 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:11.201886 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" event={"ID":"a4c28ca4-10de-43e4-8593-b4081857283f","Type":"ContainerDied","Data":"a3caf9ebab55f0bba85a80117c8611407665e5ffdaf56825d2f3960923a71a27"} Jun 11 16:28:12.209573 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.209529 2576 generic.go:356] "Generic (PLEG): container finished" podID="a4c28ca4-10de-43e4-8593-b4081857283f" containerID="1d0dee560a7ba5be1506f9d0a97715df8615ea376748df1b730825004acc286d" exitCode=0 Jun 11 16:28:12.209960 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.209567 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" event={"ID":"a4c28ca4-10de-43e4-8593-b4081857283f","Type":"ContainerDied","Data":"1d0dee560a7ba5be1506f9d0a97715df8615ea376748df1b730825004acc286d"} Jun 11 16:28:12.211982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.211956 2576 generic.go:356] "Generic (PLEG): container finished" podID="5135afff-fd51-4781-bde8-fd72bb4f82cc" containerID="7aa381561c5d983978f72eb30ca0f454fc522586bf07daf7cba83ab88b9300e7" exitCode=0 Jun 11 16:28:12.212188 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.212001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" event={"ID":"5135afff-fd51-4781-bde8-fd72bb4f82cc","Type":"ContainerDied","Data":"7aa381561c5d983978f72eb30ca0f454fc522586bf07daf7cba83ab88b9300e7"} Jun 11 16:28:12.353310 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.353286 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" Jun 11 16:28:12.381209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.381185 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" Jun 11 16:28:12.394905 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.394880 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-util\") pod \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\" (UID: \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\") " Jun 11 16:28:12.395046 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.394941 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-bundle\") pod \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\" (UID: \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\") " Jun 11 16:28:12.395046 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.394980 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsbc8\" (UniqueName: \"kubernetes.io/projected/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-kube-api-access-jsbc8\") pod \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\" (UID: \"ea73d3a4-8b9c-44b9-be2b-861330eabf5b\") " Jun 11 16:28:12.395382 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.395353 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-bundle" (OuterVolumeSpecName: "bundle") pod "ea73d3a4-8b9c-44b9-be2b-861330eabf5b" (UID: "ea73d3a4-8b9c-44b9-be2b-861330eabf5b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:28:12.397468 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.397445 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-kube-api-access-jsbc8" (OuterVolumeSpecName: "kube-api-access-jsbc8") pod "ea73d3a4-8b9c-44b9-be2b-861330eabf5b" (UID: "ea73d3a4-8b9c-44b9-be2b-861330eabf5b"). InnerVolumeSpecName "kube-api-access-jsbc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:28:12.401799 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.401770 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-util" (OuterVolumeSpecName: "util") pod "ea73d3a4-8b9c-44b9-be2b-861330eabf5b" (UID: "ea73d3a4-8b9c-44b9-be2b-861330eabf5b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:28:12.496000 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.495976 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f8a056-45b7-4f9e-8d02-97b17a8a1504-bundle\") pod \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\" (UID: \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\") " Jun 11 16:28:12.496134 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.496041 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcmtp\" (UniqueName: \"kubernetes.io/projected/24f8a056-45b7-4f9e-8d02-97b17a8a1504-kube-api-access-tcmtp\") pod \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\" (UID: \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\") " Jun 11 16:28:12.496134 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.496088 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f8a056-45b7-4f9e-8d02-97b17a8a1504-util\") pod \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\" (UID: \"24f8a056-45b7-4f9e-8d02-97b17a8a1504\") " Jun 11 16:28:12.496335 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.496317 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsbc8\" (UniqueName: \"kubernetes.io/projected/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-kube-api-access-jsbc8\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:28:12.496399 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.496339 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-util\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:28:12.496399 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.496353 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea73d3a4-8b9c-44b9-be2b-861330eabf5b-bundle\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:28:12.496569 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.496545 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f8a056-45b7-4f9e-8d02-97b17a8a1504-bundle" (OuterVolumeSpecName: "bundle") pod "24f8a056-45b7-4f9e-8d02-97b17a8a1504" (UID: "24f8a056-45b7-4f9e-8d02-97b17a8a1504"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:28:12.498062 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.498041 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f8a056-45b7-4f9e-8d02-97b17a8a1504-kube-api-access-tcmtp" (OuterVolumeSpecName: "kube-api-access-tcmtp") pod "24f8a056-45b7-4f9e-8d02-97b17a8a1504" (UID: "24f8a056-45b7-4f9e-8d02-97b17a8a1504"). InnerVolumeSpecName "kube-api-access-tcmtp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:28:12.501075 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.501054 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f8a056-45b7-4f9e-8d02-97b17a8a1504-util" (OuterVolumeSpecName: "util") pod "24f8a056-45b7-4f9e-8d02-97b17a8a1504" (UID: "24f8a056-45b7-4f9e-8d02-97b17a8a1504"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:28:12.597669 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.597603 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcmtp\" (UniqueName: \"kubernetes.io/projected/24f8a056-45b7-4f9e-8d02-97b17a8a1504-kube-api-access-tcmtp\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:28:12.597669 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.597638 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f8a056-45b7-4f9e-8d02-97b17a8a1504-util\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:28:12.597669 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:12.597648 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f8a056-45b7-4f9e-8d02-97b17a8a1504-bundle\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:28:13.218837 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.218801 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" event={"ID":"24f8a056-45b7-4f9e-8d02-97b17a8a1504","Type":"ContainerDied","Data":"3d83166e59bec2011c177f319bcb71b26a109eef831a347d49d6e0b6dcb869f4"} Jun 11 16:28:13.219256 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.218858 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d83166e59bec2011c177f319bcb71b26a109eef831a347d49d6e0b6dcb869f4" Jun 11 16:28:13.219256 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.218817 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6" Jun 11 16:28:13.221300 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.221278 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" Jun 11 16:28:13.221423 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.221297 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk" event={"ID":"ea73d3a4-8b9c-44b9-be2b-861330eabf5b","Type":"ContainerDied","Data":"3a8c87c1aa8d9db728bdd613ab117bd2a90275f33075b9782c391f221d3c3847"} Jun 11 16:28:13.221423 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.221347 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a8c87c1aa8d9db728bdd613ab117bd2a90275f33075b9782c391f221d3c3847" Jun 11 16:28:13.353575 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.353550 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" Jun 11 16:28:13.383689 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.383659 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" Jun 11 16:28:13.403715 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.403691 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5135afff-fd51-4781-bde8-fd72bb4f82cc-bundle\") pod \"5135afff-fd51-4781-bde8-fd72bb4f82cc\" (UID: \"5135afff-fd51-4781-bde8-fd72bb4f82cc\") " Jun 11 16:28:13.403856 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.403778 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k926\" (UniqueName: \"kubernetes.io/projected/5135afff-fd51-4781-bde8-fd72bb4f82cc-kube-api-access-9k926\") pod \"5135afff-fd51-4781-bde8-fd72bb4f82cc\" (UID: \"5135afff-fd51-4781-bde8-fd72bb4f82cc\") " Jun 11 16:28:13.403856 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.403816 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5135afff-fd51-4781-bde8-fd72bb4f82cc-util\") pod \"5135afff-fd51-4781-bde8-fd72bb4f82cc\" (UID: \"5135afff-fd51-4781-bde8-fd72bb4f82cc\") " Jun 11 16:28:13.404421 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.404388 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5135afff-fd51-4781-bde8-fd72bb4f82cc-bundle" (OuterVolumeSpecName: "bundle") pod "5135afff-fd51-4781-bde8-fd72bb4f82cc" (UID: "5135afff-fd51-4781-bde8-fd72bb4f82cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:28:13.406265 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.406229 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5135afff-fd51-4781-bde8-fd72bb4f82cc-kube-api-access-9k926" (OuterVolumeSpecName: "kube-api-access-9k926") pod "5135afff-fd51-4781-bde8-fd72bb4f82cc" (UID: "5135afff-fd51-4781-bde8-fd72bb4f82cc"). InnerVolumeSpecName "kube-api-access-9k926". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:28:13.411777 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.411748 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5135afff-fd51-4781-bde8-fd72bb4f82cc-util" (OuterVolumeSpecName: "util") pod "5135afff-fd51-4781-bde8-fd72bb4f82cc" (UID: "5135afff-fd51-4781-bde8-fd72bb4f82cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:28:13.504783 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.504749 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42msf\" (UniqueName: \"kubernetes.io/projected/a4c28ca4-10de-43e4-8593-b4081857283f-kube-api-access-42msf\") pod \"a4c28ca4-10de-43e4-8593-b4081857283f\" (UID: \"a4c28ca4-10de-43e4-8593-b4081857283f\") " Jun 11 16:28:13.504965 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.504803 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4c28ca4-10de-43e4-8593-b4081857283f-util\") pod \"a4c28ca4-10de-43e4-8593-b4081857283f\" (UID: \"a4c28ca4-10de-43e4-8593-b4081857283f\") " Jun 11 16:28:13.504965 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.504839 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4c28ca4-10de-43e4-8593-b4081857283f-bundle\") pod \"a4c28ca4-10de-43e4-8593-b4081857283f\" (UID: \"a4c28ca4-10de-43e4-8593-b4081857283f\") " Jun 11 16:28:13.505145 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.505127 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k926\" (UniqueName: \"kubernetes.io/projected/5135afff-fd51-4781-bde8-fd72bb4f82cc-kube-api-access-9k926\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:28:13.505187 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.505152 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5135afff-fd51-4781-bde8-fd72bb4f82cc-util\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:28:13.505187 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.505167 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5135afff-fd51-4781-bde8-fd72bb4f82cc-bundle\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:28:13.505526 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.505495 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4c28ca4-10de-43e4-8593-b4081857283f-bundle" (OuterVolumeSpecName: "bundle") pod "a4c28ca4-10de-43e4-8593-b4081857283f" (UID: "a4c28ca4-10de-43e4-8593-b4081857283f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:28:13.506832 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.506812 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4c28ca4-10de-43e4-8593-b4081857283f-kube-api-access-42msf" (OuterVolumeSpecName: "kube-api-access-42msf") pod "a4c28ca4-10de-43e4-8593-b4081857283f" (UID: "a4c28ca4-10de-43e4-8593-b4081857283f"). InnerVolumeSpecName "kube-api-access-42msf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:28:13.510215 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.510194 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4c28ca4-10de-43e4-8593-b4081857283f-util" (OuterVolumeSpecName: "util") pod "a4c28ca4-10de-43e4-8593-b4081857283f" (UID: "a4c28ca4-10de-43e4-8593-b4081857283f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:28:13.605911 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.605825 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4c28ca4-10de-43e4-8593-b4081857283f-util\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:28:13.605911 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.605854 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4c28ca4-10de-43e4-8593-b4081857283f-bundle\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:28:13.605911 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:13.605865 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42msf\" (UniqueName: \"kubernetes.io/projected/a4c28ca4-10de-43e4-8593-b4081857283f-kube-api-access-42msf\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:28:14.228754 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:14.228719 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" event={"ID":"5135afff-fd51-4781-bde8-fd72bb4f82cc","Type":"ContainerDied","Data":"40a29d2e7b67c4317043d66eb3a2d2167abb1386ce5c8663fe80607ea09db882"} Jun 11 16:28:14.229192 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:14.228773 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40a29d2e7b67c4317043d66eb3a2d2167abb1386ce5c8663fe80607ea09db882" Jun 11 16:28:14.229192 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:14.228725 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb" Jun 11 16:28:14.230805 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:14.230780 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" Jun 11 16:28:14.230949 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:14.230800 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4" event={"ID":"a4c28ca4-10de-43e4-8593-b4081857283f","Type":"ContainerDied","Data":"72d3905d923c76f8b4a98d9ff22e8950b4dc4cb5f54818e0d4b977300c2c92a9"} Jun 11 16:28:14.230949 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:14.230841 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72d3905d923c76f8b4a98d9ff22e8950b4dc4cb5f54818e0d4b977300c2c92a9" Jun 11 16:28:18.428744 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.428713 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jmjc"] Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429054 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f8a056-45b7-4f9e-8d02-97b17a8a1504" containerName="pull" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429066 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f8a056-45b7-4f9e-8d02-97b17a8a1504" containerName="pull" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429078 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5135afff-fd51-4781-bde8-fd72bb4f82cc" containerName="extract" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429083 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5135afff-fd51-4781-bde8-fd72bb4f82cc" containerName="extract" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429093 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f8a056-45b7-4f9e-8d02-97b17a8a1504" containerName="util" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429099 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f8a056-45b7-4f9e-8d02-97b17a8a1504" containerName="util" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429117 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea73d3a4-8b9c-44b9-be2b-861330eabf5b" containerName="util" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429126 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea73d3a4-8b9c-44b9-be2b-861330eabf5b" containerName="util" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429134 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f8a056-45b7-4f9e-8d02-97b17a8a1504" containerName="extract" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429141 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f8a056-45b7-4f9e-8d02-97b17a8a1504" containerName="extract" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429148 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea73d3a4-8b9c-44b9-be2b-861330eabf5b" containerName="extract" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429153 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea73d3a4-8b9c-44b9-be2b-861330eabf5b" containerName="extract" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429158 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5135afff-fd51-4781-bde8-fd72bb4f82cc" containerName="pull" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429164 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5135afff-fd51-4781-bde8-fd72bb4f82cc" containerName="pull" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429170 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c28ca4-10de-43e4-8593-b4081857283f" containerName="util" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429175 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c28ca4-10de-43e4-8593-b4081857283f" containerName="util" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429182 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c28ca4-10de-43e4-8593-b4081857283f" containerName="pull" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429186 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c28ca4-10de-43e4-8593-b4081857283f" containerName="pull" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429196 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5135afff-fd51-4781-bde8-fd72bb4f82cc" containerName="util" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429204 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5135afff-fd51-4781-bde8-fd72bb4f82cc" containerName="util" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429213 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea73d3a4-8b9c-44b9-be2b-861330eabf5b" containerName="pull" Jun 11 16:28:18.429209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429219 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea73d3a4-8b9c-44b9-be2b-861330eabf5b" containerName="pull" Jun 11 16:28:18.429850 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429224 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c28ca4-10de-43e4-8593-b4081857283f" containerName="extract" Jun 11 16:28:18.429850 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429229 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c28ca4-10de-43e4-8593-b4081857283f" containerName="extract" Jun 11 16:28:18.429850 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429276 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5135afff-fd51-4781-bde8-fd72bb4f82cc" containerName="extract" Jun 11 16:28:18.429850 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429283 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="24f8a056-45b7-4f9e-8d02-97b17a8a1504" containerName="extract" Jun 11 16:28:18.429850 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429291 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea73d3a4-8b9c-44b9-be2b-861330eabf5b" containerName="extract" Jun 11 16:28:18.429850 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.429296 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4c28ca4-10de-43e4-8593-b4081857283f" containerName="extract" Jun 11 16:28:18.433565 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.433549 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jmjc" Jun 11 16:28:18.436232 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.436211 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 16:28:18.436312 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.436211 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vn5nj\"" Jun 11 16:28:18.443883 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.443863 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jmjc"] Jun 11 16:28:18.548342 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.548307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5258\" (UniqueName: \"kubernetes.io/projected/bbbe9fb3-c742-4de8-8661-03641d3a6424-kube-api-access-t5258\") pod \"dns-operator-controller-manager-864dd78c4c-8jmjc\" (UID: \"bbbe9fb3-c742-4de8-8661-03641d3a6424\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jmjc" Jun 11 16:28:18.649763 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.649721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5258\" (UniqueName: \"kubernetes.io/projected/bbbe9fb3-c742-4de8-8661-03641d3a6424-kube-api-access-t5258\") pod \"dns-operator-controller-manager-864dd78c4c-8jmjc\" (UID: \"bbbe9fb3-c742-4de8-8661-03641d3a6424\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jmjc" Jun 11 16:28:18.663742 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.663706 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5258\" (UniqueName: \"kubernetes.io/projected/bbbe9fb3-c742-4de8-8661-03641d3a6424-kube-api-access-t5258\") pod \"dns-operator-controller-manager-864dd78c4c-8jmjc\" (UID: \"bbbe9fb3-c742-4de8-8661-03641d3a6424\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jmjc" Jun 11 16:28:18.744518 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.744422 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jmjc" Jun 11 16:28:18.880724 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:18.880697 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jmjc"] Jun 11 16:28:19.258305 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:19.258269 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jmjc" event={"ID":"bbbe9fb3-c742-4de8-8661-03641d3a6424","Type":"ContainerStarted","Data":"cd7b6da6f4fe7ac96b7514f4cd2c41b788d45de8bbd1310fb2aebc2b439cdda1"} Jun 11 16:28:21.849722 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:21.849686 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt"] Jun 11 16:28:21.853092 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:21.853075 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:21.855873 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:21.855851 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6hnl9\"" Jun 11 16:28:21.863283 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:21.863261 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt"] Jun 11 16:28:21.979396 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:21.979287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkncp\" (UniqueName: \"kubernetes.io/projected/95e13094-dfb2-4c59-9616-d20961be6512-kube-api-access-fkncp\") pod \"limitador-operator-controller-manager-859d7b78bd-scfwt\" (UID: \"95e13094-dfb2-4c59-9616-d20961be6512\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:22.080008 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:22.079968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkncp\" (UniqueName: \"kubernetes.io/projected/95e13094-dfb2-4c59-9616-d20961be6512-kube-api-access-fkncp\") pod \"limitador-operator-controller-manager-859d7b78bd-scfwt\" (UID: \"95e13094-dfb2-4c59-9616-d20961be6512\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:22.097159 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:22.097119 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkncp\" (UniqueName: \"kubernetes.io/projected/95e13094-dfb2-4c59-9616-d20961be6512-kube-api-access-fkncp\") pod \"limitador-operator-controller-manager-859d7b78bd-scfwt\" (UID: \"95e13094-dfb2-4c59-9616-d20961be6512\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:22.163935 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:22.163892 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:22.280164 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:22.279738 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jmjc" event={"ID":"bbbe9fb3-c742-4de8-8661-03641d3a6424","Type":"ContainerStarted","Data":"d7c299a795f8d82f6296e3137e22435e4d6c5f5cbbaf1779d69287c4143b1f0b"} Jun 11 16:28:22.280164 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:22.280096 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jmjc" Jun 11 16:28:22.300810 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:22.300760 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jmjc" podStartSLOduration=1.52718432 podStartE2EDuration="4.30074345s" totalImagesPullingTime="2.77355913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:28:22.299720087 +0000 UTC m=+519.647828334" watchObservedRunningTime="2026-06-11 16:28:22.30074345 +0000 UTC m=+519.648851693" Jun 11 16:28:22.315499 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:22.315478 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt"] Jun 11 16:28:22.318067 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:28:22.318039 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e13094_dfb2_4c59_9616_d20961be6512.slice/crio-2784295a2a3ec533938001827deffec9808483d527692a49f29fb4ef23d9c38d WatchSource:0}: Error finding container 2784295a2a3ec533938001827deffec9808483d527692a49f29fb4ef23d9c38d: Status 404 returned error can't find the container with id 2784295a2a3ec533938001827deffec9808483d527692a49f29fb4ef23d9c38d Jun 11 16:28:23.287773 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:23.287730 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" event={"ID":"95e13094-dfb2-4c59-9616-d20961be6512","Type":"ContainerStarted","Data":"2784295a2a3ec533938001827deffec9808483d527692a49f29fb4ef23d9c38d"} Jun 11 16:28:24.293916 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:24.293805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" event={"ID":"95e13094-dfb2-4c59-9616-d20961be6512","Type":"ContainerStarted","Data":"edef220057b79a313d71560c22941bfea70d389f381eeb4c2a94d36ed7ece727"} Jun 11 16:28:24.293916 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:24.293872 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:24.323027 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:24.322959 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" podStartSLOduration=1.7256743079999999 podStartE2EDuration="3.322942644s" totalImagesPullingTime="1.597268336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:28:24.320693363 +0000 UTC m=+521.668801594" watchObservedRunningTime="2026-06-11 16:28:24.322942644 +0000 UTC m=+521.671050885" Jun 11 16:28:25.583191 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:25.583145 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rssfj"] Jun 11 16:28:25.586731 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:25.586707 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rssfj" Jun 11 16:28:25.589671 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:25.589649 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pxqlr\"" Jun 11 16:28:25.597045 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:25.597008 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rssfj"] Jun 11 16:28:25.709098 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:25.709061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk7ld\" (UniqueName: \"kubernetes.io/projected/b92c7392-f98d-4a35-81fa-e28049a18507-kube-api-access-rk7ld\") pod \"authorino-operator-75cc8d5cb7-rssfj\" (UID: \"b92c7392-f98d-4a35-81fa-e28049a18507\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rssfj" Jun 11 16:28:25.809912 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:25.809874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk7ld\" (UniqueName: \"kubernetes.io/projected/b92c7392-f98d-4a35-81fa-e28049a18507-kube-api-access-rk7ld\") pod \"authorino-operator-75cc8d5cb7-rssfj\" (UID: \"b92c7392-f98d-4a35-81fa-e28049a18507\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rssfj" Jun 11 16:28:25.818715 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:25.818677 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk7ld\" (UniqueName: \"kubernetes.io/projected/b92c7392-f98d-4a35-81fa-e28049a18507-kube-api-access-rk7ld\") pod \"authorino-operator-75cc8d5cb7-rssfj\" (UID: \"b92c7392-f98d-4a35-81fa-e28049a18507\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rssfj" Jun 11 16:28:25.898306 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:25.898215 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rssfj" Jun 11 16:28:26.030898 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:26.030871 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rssfj"] Jun 11 16:28:26.032500 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:28:26.032475 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92c7392_f98d_4a35_81fa_e28049a18507.slice/crio-63b24b0119d760925f92acbf741a704d3323322c54075a5ad0ad673e64506b33 WatchSource:0}: Error finding container 63b24b0119d760925f92acbf741a704d3323322c54075a5ad0ad673e64506b33: Status 404 returned error can't find the container with id 63b24b0119d760925f92acbf741a704d3323322c54075a5ad0ad673e64506b33 Jun 11 16:28:26.305893 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:26.305851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rssfj" event={"ID":"b92c7392-f98d-4a35-81fa-e28049a18507","Type":"ContainerStarted","Data":"63b24b0119d760925f92acbf741a704d3323322c54075a5ad0ad673e64506b33"} Jun 11 16:28:29.323604 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:29.323562 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rssfj" event={"ID":"b92c7392-f98d-4a35-81fa-e28049a18507","Type":"ContainerStarted","Data":"521ab30186ca1db8e809897a2d6a4999d46d39b370d4126154744cd55c175237"} Jun 11 16:28:29.324130 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:29.323642 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rssfj" Jun 11 16:28:29.347575 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:29.347520 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rssfj" podStartSLOduration=1.768443961 podStartE2EDuration="4.347506034s" totalImagesPullingTime="2.579062073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:28:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:28:29.346161641 +0000 UTC m=+526.694269872" watchObservedRunningTime="2026-06-11 16:28:29.347506034 +0000 UTC m=+526.695614309" Jun 11 16:28:33.290575 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:33.290502 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jmjc" Jun 11 16:28:35.302990 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:35.302956 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:40.331508 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:40.331474 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rssfj" Jun 11 16:28:41.378589 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:41.378549 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76"] Jun 11 16:28:41.382272 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:41.382240 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" Jun 11 16:28:41.385037 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:41.384992 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 16:28:41.385037 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:41.385028 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 16:28:41.385233 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:41.385123 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8f82d\"" Jun 11 16:28:41.391917 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:41.391885 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76"] Jun 11 16:28:41.549643 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:41.549604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf6rq\" (UniqueName: \"kubernetes.io/projected/98bf0ccf-0306-40fa-9301-896a8b09b781-kube-api-access-zf6rq\") pod \"kuadrant-console-plugin-66b5774985-q7g76\" (UID: \"98bf0ccf-0306-40fa-9301-896a8b09b781\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" Jun 11 16:28:41.549819 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:41.549668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98bf0ccf-0306-40fa-9301-896a8b09b781-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-q7g76\" (UID: \"98bf0ccf-0306-40fa-9301-896a8b09b781\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" Jun 11 16:28:41.549819 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:41.549774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/98bf0ccf-0306-40fa-9301-896a8b09b781-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q7g76\" (UID: \"98bf0ccf-0306-40fa-9301-896a8b09b781\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" Jun 11 16:28:41.651106 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:41.650983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf6rq\" (UniqueName: \"kubernetes.io/projected/98bf0ccf-0306-40fa-9301-896a8b09b781-kube-api-access-zf6rq\") pod \"kuadrant-console-plugin-66b5774985-q7g76\" (UID: \"98bf0ccf-0306-40fa-9301-896a8b09b781\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" Jun 11 16:28:41.651106 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:41.651099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98bf0ccf-0306-40fa-9301-896a8b09b781-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-q7g76\" (UID: \"98bf0ccf-0306-40fa-9301-896a8b09b781\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" Jun 11 16:28:41.651291 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:41.651156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/98bf0ccf-0306-40fa-9301-896a8b09b781-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q7g76\" (UID: \"98bf0ccf-0306-40fa-9301-896a8b09b781\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" Jun 11 16:28:41.651291 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:28:41.651251 2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 16:28:41.651357 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:28:41.651319 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98bf0ccf-0306-40fa-9301-896a8b09b781-plugin-serving-cert podName:98bf0ccf-0306-40fa-9301-896a8b09b781 nodeName:}" failed. No retries permitted until 2026-06-11 16:28:42.1512998 +0000 UTC m=+539.499408015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/98bf0ccf-0306-40fa-9301-896a8b09b781-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-q7g76" (UID: "98bf0ccf-0306-40fa-9301-896a8b09b781") : secret "plugin-serving-cert" not found Jun 11 16:28:41.651779 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:41.651758 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98bf0ccf-0306-40fa-9301-896a8b09b781-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-q7g76\" (UID: \"98bf0ccf-0306-40fa-9301-896a8b09b781\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" Jun 11 16:28:41.660332 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:41.660308 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf6rq\" (UniqueName: \"kubernetes.io/projected/98bf0ccf-0306-40fa-9301-896a8b09b781-kube-api-access-zf6rq\") pod \"kuadrant-console-plugin-66b5774985-q7g76\" (UID: \"98bf0ccf-0306-40fa-9301-896a8b09b781\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" Jun 11 16:28:42.156274 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:42.156224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/98bf0ccf-0306-40fa-9301-896a8b09b781-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q7g76\" (UID: \"98bf0ccf-0306-40fa-9301-896a8b09b781\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" Jun 11 16:28:42.156467 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:28:42.156376 2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 16:28:42.156467 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:28:42.156459 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98bf0ccf-0306-40fa-9301-896a8b09b781-plugin-serving-cert podName:98bf0ccf-0306-40fa-9301-896a8b09b781 nodeName:}" failed. No retries permitted until 2026-06-11 16:28:43.156442995 +0000 UTC m=+540.504551207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/98bf0ccf-0306-40fa-9301-896a8b09b781-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-q7g76" (UID: "98bf0ccf-0306-40fa-9301-896a8b09b781") : secret "plugin-serving-cert" not found Jun 11 16:28:43.166278 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:43.165779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/98bf0ccf-0306-40fa-9301-896a8b09b781-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q7g76\" (UID: \"98bf0ccf-0306-40fa-9301-896a8b09b781\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" Jun 11 16:28:43.173061 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:43.173033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/98bf0ccf-0306-40fa-9301-896a8b09b781-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q7g76\" (UID: \"98bf0ccf-0306-40fa-9301-896a8b09b781\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" Jun 11 16:28:43.195348 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:43.195326 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8f82d\"" Jun 11 16:28:43.203522 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:43.203504 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" Jun 11 16:28:43.339631 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:43.339604 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76"] Jun 11 16:28:43.341181 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:28:43.341158 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98bf0ccf_0306_40fa_9301_896a8b09b781.slice/crio-f4c5e7b44cce2151abeb1f70bcab1efd9818e40504876e666b1dfbed5d7556f7 WatchSource:0}: Error finding container f4c5e7b44cce2151abeb1f70bcab1efd9818e40504876e666b1dfbed5d7556f7: Status 404 returned error can't find the container with id f4c5e7b44cce2151abeb1f70bcab1efd9818e40504876e666b1dfbed5d7556f7 Jun 11 16:28:43.397631 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:43.397570 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" event={"ID":"98bf0ccf-0306-40fa-9301-896a8b09b781","Type":"ContainerStarted","Data":"f4c5e7b44cce2151abeb1f70bcab1efd9818e40504876e666b1dfbed5d7556f7"} Jun 11 16:28:52.024359 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.024316 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt"] Jun 11 16:28:52.024856 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.024594 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" podUID="95e13094-dfb2-4c59-9616-d20961be6512" containerName="manager" containerID="cri-o://edef220057b79a313d71560c22941bfea70d389f381eeb4c2a94d36ed7ece727" gracePeriod=2 Jun 11 16:28:52.042136 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.041798 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt"] Jun 11 16:28:52.048428 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:28:52.048364 2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"95e13094-dfb2-4c59-9616-d20961be6512\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-scfwt\": pods \"limitador-operator-controller-manager-859d7b78bd-scfwt\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:52.051727 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.051698 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dz6rk"] Jun 11 16:28:52.052123 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.052104 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e13094-dfb2-4c59-9616-d20961be6512" containerName="manager" Jun 11 16:28:52.052123 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.052123 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e13094-dfb2-4c59-9616-d20961be6512" containerName="manager" Jun 11 16:28:52.052278 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.052194 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="95e13094-dfb2-4c59-9616-d20961be6512" containerName="manager" Jun 11 16:28:52.055579 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.055558 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dz6rk" Jun 11 16:28:52.058387 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:28:52.058353 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-scfwt\" is forbidden: User \"system:node:ip-10-0-128-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-162.ec2.internal' and this object" podUID="95e13094-dfb2-4c59-9616-d20961be6512" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:52.078610 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.078536 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dz6rk"] Jun 11 16:28:52.141804 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.141769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8s2s\" (UniqueName: \"kubernetes.io/projected/e1374c8b-219c-44d1-b549-16c3da33d61d-kube-api-access-g8s2s\") pod \"limitador-operator-controller-manager-859d7b78bd-dz6rk\" (UID: \"e1374c8b-219c-44d1-b549-16c3da33d61d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dz6rk" Jun 11 16:28:52.242847 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.242808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8s2s\" (UniqueName: \"kubernetes.io/projected/e1374c8b-219c-44d1-b549-16c3da33d61d-kube-api-access-g8s2s\") pod \"limitador-operator-controller-manager-859d7b78bd-dz6rk\" (UID: \"e1374c8b-219c-44d1-b549-16c3da33d61d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dz6rk" Jun 11 16:28:52.255095 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.255064 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8s2s\" (UniqueName: \"kubernetes.io/projected/e1374c8b-219c-44d1-b549-16c3da33d61d-kube-api-access-g8s2s\") pod \"limitador-operator-controller-manager-859d7b78bd-dz6rk\" (UID: \"e1374c8b-219c-44d1-b549-16c3da33d61d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dz6rk" Jun 11 16:28:52.281279 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.281216 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:52.283894 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:28:52.283865 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-scfwt\" is forbidden: User \"system:node:ip-10-0-128-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-162.ec2.internal' and this object" podUID="95e13094-dfb2-4c59-9616-d20961be6512" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:52.343432 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.343394 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkncp\" (UniqueName: \"kubernetes.io/projected/95e13094-dfb2-4c59-9616-d20961be6512-kube-api-access-fkncp\") pod \"95e13094-dfb2-4c59-9616-d20961be6512\" (UID: \"95e13094-dfb2-4c59-9616-d20961be6512\") " Jun 11 16:28:52.345774 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.345739 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e13094-dfb2-4c59-9616-d20961be6512-kube-api-access-fkncp" (OuterVolumeSpecName: "kube-api-access-fkncp") pod "95e13094-dfb2-4c59-9616-d20961be6512" (UID: "95e13094-dfb2-4c59-9616-d20961be6512"). InnerVolumeSpecName "kube-api-access-fkncp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:28:52.396802 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.396764 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dz6rk" Jun 11 16:28:52.444481 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.444446 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkncp\" (UniqueName: \"kubernetes.io/projected/95e13094-dfb2-4c59-9616-d20961be6512-kube-api-access-fkncp\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:28:52.453235 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.453194 2576 generic.go:356] "Generic (PLEG): container finished" podID="95e13094-dfb2-4c59-9616-d20961be6512" containerID="edef220057b79a313d71560c22941bfea70d389f381eeb4c2a94d36ed7ece727" exitCode=0 Jun 11 16:28:52.453385 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.453248 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:52.453385 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.453292 2576 scope.go:117] "RemoveContainer" containerID="edef220057b79a313d71560c22941bfea70d389f381eeb4c2a94d36ed7ece727" Jun 11 16:28:52.455817 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:28:52.455780 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-scfwt\" is forbidden: User \"system:node:ip-10-0-128-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-162.ec2.internal' and this object" podUID="95e13094-dfb2-4c59-9616-d20961be6512" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:52.468402 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.466859 2576 scope.go:117] "RemoveContainer" containerID="edef220057b79a313d71560c22941bfea70d389f381eeb4c2a94d36ed7ece727" Jun 11 16:28:52.468402 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:28:52.467244 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edef220057b79a313d71560c22941bfea70d389f381eeb4c2a94d36ed7ece727\": container with ID starting with edef220057b79a313d71560c22941bfea70d389f381eeb4c2a94d36ed7ece727 not found: ID does not exist" containerID="edef220057b79a313d71560c22941bfea70d389f381eeb4c2a94d36ed7ece727" Jun 11 16:28:52.468402 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.467280 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edef220057b79a313d71560c22941bfea70d389f381eeb4c2a94d36ed7ece727"} err="failed to get container status \"edef220057b79a313d71560c22941bfea70d389f381eeb4c2a94d36ed7ece727\": rpc error: code = NotFound desc = could not find container \"edef220057b79a313d71560c22941bfea70d389f381eeb4c2a94d36ed7ece727\": container with ID starting with edef220057b79a313d71560c22941bfea70d389f381eeb4c2a94d36ed7ece727 not found: ID does not exist" Jun 11 16:28:52.471503 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:28:52.471463 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-scfwt\" is forbidden: User \"system:node:ip-10-0-128-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-162.ec2.internal' and this object" podUID="95e13094-dfb2-4c59-9616-d20961be6512" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:52.559668 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:52.559583 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dz6rk"] Jun 11 16:28:52.562731 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:28:52.562698 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1374c8b_219c_44d1_b549_16c3da33d61d.slice/crio-fbf8987a8f48adda559bb57df2c27c67d4819ccade221fdb6376509e95263f42 WatchSource:0}: Error finding container fbf8987a8f48adda559bb57df2c27c67d4819ccade221fdb6376509e95263f42: Status 404 returned error can't find the container with id fbf8987a8f48adda559bb57df2c27c67d4819ccade221fdb6376509e95263f42 Jun 11 16:28:53.101237 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:28:53.101196 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-scfwt\" is forbidden: User \"system:node:ip-10-0-128-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-162.ec2.internal' and this object" podUID="95e13094-dfb2-4c59-9616-d20961be6512" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-scfwt" Jun 11 16:28:53.101877 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:53.101855 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95e13094-dfb2-4c59-9616-d20961be6512" path="/var/lib/kubelet/pods/95e13094-dfb2-4c59-9616-d20961be6512/volumes" Jun 11 16:28:53.460080 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:53.459965 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dz6rk" event={"ID":"e1374c8b-219c-44d1-b549-16c3da33d61d","Type":"ContainerStarted","Data":"3ceeaaefe877729a3e307e8126738e1cde5c5cee69a1e80f6f2a325d585d14f0"} Jun 11 16:28:53.460080 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:53.460049 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dz6rk" event={"ID":"e1374c8b-219c-44d1-b549-16c3da33d61d","Type":"ContainerStarted","Data":"fbf8987a8f48adda559bb57df2c27c67d4819ccade221fdb6376509e95263f42"} Jun 11 16:28:53.460282 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:53.460082 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dz6rk" Jun 11 16:28:53.479166 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:28:53.479111 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dz6rk" podStartSLOduration=1.479097117 podStartE2EDuration="1.479097117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:28:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:28:53.477172054 +0000 UTC m=+550.825280286" watchObservedRunningTime="2026-06-11 16:28:53.479097117 +0000 UTC m=+550.827205350" Jun 11 16:29:04.469356 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:04.469324 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dz6rk" Jun 11 16:29:09.556447 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:09.556404 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" event={"ID":"98bf0ccf-0306-40fa-9301-896a8b09b781","Type":"ContainerStarted","Data":"eefa749ac7f0e92bd8a118afe420ff695bea2af91351f3202f83fe991f2c5336"} Jun 11 16:29:09.582916 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:09.582862 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q7g76" podStartSLOduration=2.894596872 podStartE2EDuration="28.582845055s" totalImagesPullingTime="25.688248183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:29:09.580711017 +0000 UTC m=+566.928819261" watchObservedRunningTime="2026-06-11 16:29:09.582845055 +0000 UTC m=+566.930953290" Jun 11 16:29:24.734934 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.734893 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj"] Jun 11 16:29:24.753082 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.753052 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj"] Jun 11 16:29:24.753230 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.753184 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.755956 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.755936 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-q296t\"" Jun 11 16:29:24.848350 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.848319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0060b4a-d104-43f4-bd00-4355681ea0ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.848350 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.848360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.848571 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.848396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.848571 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.848437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.848571 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.848463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0060b4a-d104-43f4-bd00-4355681ea0ae-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.848571 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.848499 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-528p7\" (UniqueName: \"kubernetes.io/projected/d0060b4a-d104-43f4-bd00-4355681ea0ae-kube-api-access-528p7\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.848571 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.848538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0060b4a-d104-43f4-bd00-4355681ea0ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.848571 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.848569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.848759 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.848588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.949551 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.949514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.949708 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.949559 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.949708 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.949591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0060b4a-d104-43f4-bd00-4355681ea0ae-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.949708 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.949636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-528p7\" (UniqueName: \"kubernetes.io/projected/d0060b4a-d104-43f4-bd00-4355681ea0ae-kube-api-access-528p7\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.949708 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.949675 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0060b4a-d104-43f4-bd00-4355681ea0ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.949920 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.949720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.949920 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.949747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.949920 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.949777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0060b4a-d104-43f4-bd00-4355681ea0ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.949920 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.949814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.950205 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.950079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.950205 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.950108 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.950205 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.950152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.950205 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.950164 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.950623 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.950599 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0060b4a-d104-43f4-bd00-4355681ea0ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.951853 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.951831 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0060b4a-d104-43f4-bd00-4355681ea0ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.952090 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.952074 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0060b4a-d104-43f4-bd00-4355681ea0ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.958287 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.958260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0060b4a-d104-43f4-bd00-4355681ea0ae-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:24.958364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:24.958330 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-528p7\" (UniqueName: \"kubernetes.io/projected/d0060b4a-d104-43f4-bd00-4355681ea0ae-kube-api-access-528p7\") pod \"maas-default-gateway-openshift-default-687ff6996-5qscj\" (UID: \"d0060b4a-d104-43f4-bd00-4355681ea0ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:25.064229 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:25.064192 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:25.200565 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:25.200539 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj"] Jun 11 16:29:25.202731 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:29:25.202704 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0060b4a_d104_43f4_bd00_4355681ea0ae.slice/crio-0f30a6639309d4291ebb8a68823ca22cff61aa16ceff0ddcd378ac4b2caf7f94 WatchSource:0}: Error finding container 0f30a6639309d4291ebb8a68823ca22cff61aa16ceff0ddcd378ac4b2caf7f94: Status 404 returned error can't find the container with id 0f30a6639309d4291ebb8a68823ca22cff61aa16ceff0ddcd378ac4b2caf7f94 Jun 11 16:29:25.204823 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:25.204788 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:29:25.205031 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:25.204852 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:29:25.205031 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:25.204878 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:29:25.642028 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:25.641980 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" event={"ID":"d0060b4a-d104-43f4-bd00-4355681ea0ae","Type":"ContainerStarted","Data":"5a64c9bfd34f031aff1434878bc9ed374cc96a04db4d36d7dd5590a82846e645"} Jun 11 16:29:25.642209 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:25.642052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" event={"ID":"d0060b4a-d104-43f4-bd00-4355681ea0ae","Type":"ContainerStarted","Data":"0f30a6639309d4291ebb8a68823ca22cff61aa16ceff0ddcd378ac4b2caf7f94"} Jun 11 16:29:25.668272 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:25.668226 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" podStartSLOduration=1.668211265 podStartE2EDuration="1.668211265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:29:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:29:25.664990263 +0000 UTC m=+583.013098495" watchObservedRunningTime="2026-06-11 16:29:25.668211265 +0000 UTC m=+583.016319573" Jun 11 16:29:26.065092 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:26.065062 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:26.069829 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:26.069796 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:26.647477 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:26.647446 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:29:26.648564 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:29:26.648544 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:30:11.691139 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.691062 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz"] Jun 11 16:30:11.694496 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.694480 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" Jun 11 16:30:11.699244 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.699218 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:30:11.699343 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.699310 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-848q4\"" Jun 11 16:30:11.700293 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.700278 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:30:11.722104 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.722079 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz"] Jun 11 16:30:11.823533 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.823507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a060c5df-a282-4ca9-8063-e09a232d8ca1-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz\" (UID: \"a060c5df-a282-4ca9-8063-e09a232d8ca1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" Jun 11 16:30:11.823642 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.823553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a060c5df-a282-4ca9-8063-e09a232d8ca1-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz\" (UID: \"a060c5df-a282-4ca9-8063-e09a232d8ca1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" Jun 11 16:30:11.823642 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.823626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbkm6\" (UniqueName: \"kubernetes.io/projected/a060c5df-a282-4ca9-8063-e09a232d8ca1-kube-api-access-zbkm6\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz\" (UID: \"a060c5df-a282-4ca9-8063-e09a232d8ca1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" Jun 11 16:30:11.925000 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.924974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a060c5df-a282-4ca9-8063-e09a232d8ca1-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz\" (UID: \"a060c5df-a282-4ca9-8063-e09a232d8ca1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" Jun 11 16:30:11.925132 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.925056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a060c5df-a282-4ca9-8063-e09a232d8ca1-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz\" (UID: \"a060c5df-a282-4ca9-8063-e09a232d8ca1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" Jun 11 16:30:11.925132 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.925122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbkm6\" (UniqueName: \"kubernetes.io/projected/a060c5df-a282-4ca9-8063-e09a232d8ca1-kube-api-access-zbkm6\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz\" (UID: \"a060c5df-a282-4ca9-8063-e09a232d8ca1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" Jun 11 16:30:11.925435 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.925418 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a060c5df-a282-4ca9-8063-e09a232d8ca1-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz\" (UID: \"a060c5df-a282-4ca9-8063-e09a232d8ca1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" Jun 11 16:30:11.925498 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.925475 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a060c5df-a282-4ca9-8063-e09a232d8ca1-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz\" (UID: \"a060c5df-a282-4ca9-8063-e09a232d8ca1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" Jun 11 16:30:11.934343 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:11.934317 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbkm6\" (UniqueName: \"kubernetes.io/projected/a060c5df-a282-4ca9-8063-e09a232d8ca1-kube-api-access-zbkm6\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz\" (UID: \"a060c5df-a282-4ca9-8063-e09a232d8ca1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" Jun 11 16:30:12.004306 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:12.004256 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" Jun 11 16:30:12.139219 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:12.139189 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz"] Jun 11 16:30:12.139964 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:30:12.139937 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda060c5df_a282_4ca9_8063_e09a232d8ca1.slice/crio-608dd29db18eadd51e36701597eefe58d2192fec363a1d40ccaf1e559e9db9da WatchSource:0}: Error finding container 608dd29db18eadd51e36701597eefe58d2192fec363a1d40ccaf1e559e9db9da: Status 404 returned error can't find the container with id 608dd29db18eadd51e36701597eefe58d2192fec363a1d40ccaf1e559e9db9da Jun 11 16:30:12.897247 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:12.897206 2576 generic.go:356] "Generic (PLEG): container finished" podID="a060c5df-a282-4ca9-8063-e09a232d8ca1" containerID="e835245964b5c11aa8b29475ff51a349c76789a286cde1d9cb074a8ac7c0fcde" exitCode=0 Jun 11 16:30:12.897621 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:12.897291 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" event={"ID":"a060c5df-a282-4ca9-8063-e09a232d8ca1","Type":"ContainerDied","Data":"e835245964b5c11aa8b29475ff51a349c76789a286cde1d9cb074a8ac7c0fcde"} Jun 11 16:30:12.897621 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:12.897371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" event={"ID":"a060c5df-a282-4ca9-8063-e09a232d8ca1","Type":"ContainerStarted","Data":"608dd29db18eadd51e36701597eefe58d2192fec363a1d40ccaf1e559e9db9da"} Jun 11 16:30:13.903874 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:13.903840 2576 generic.go:356] "Generic (PLEG): container finished" podID="a060c5df-a282-4ca9-8063-e09a232d8ca1" containerID="d38d83b971922dac3da53f0c1312d0d560178b8899b7273c79eaaab28538b7c9" exitCode=0 Jun 11 16:30:13.904215 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:13.903877 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" event={"ID":"a060c5df-a282-4ca9-8063-e09a232d8ca1","Type":"ContainerDied","Data":"d38d83b971922dac3da53f0c1312d0d560178b8899b7273c79eaaab28538b7c9"} Jun 11 16:30:14.911504 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:14.911471 2576 generic.go:356] "Generic (PLEG): container finished" podID="a060c5df-a282-4ca9-8063-e09a232d8ca1" containerID="213f6ec1efc0ae0bad79ca3e5a9578b36ed71ab0527868cd318f659231f21713" exitCode=0 Jun 11 16:30:14.911504 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:14.911511 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" event={"ID":"a060c5df-a282-4ca9-8063-e09a232d8ca1","Type":"ContainerDied","Data":"213f6ec1efc0ae0bad79ca3e5a9578b36ed71ab0527868cd318f659231f21713"} Jun 11 16:30:16.053612 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:16.053585 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" Jun 11 16:30:16.159123 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:16.159093 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a060c5df-a282-4ca9-8063-e09a232d8ca1-util\") pod \"a060c5df-a282-4ca9-8063-e09a232d8ca1\" (UID: \"a060c5df-a282-4ca9-8063-e09a232d8ca1\") " Jun 11 16:30:16.159300 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:16.159145 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbkm6\" (UniqueName: \"kubernetes.io/projected/a060c5df-a282-4ca9-8063-e09a232d8ca1-kube-api-access-zbkm6\") pod \"a060c5df-a282-4ca9-8063-e09a232d8ca1\" (UID: \"a060c5df-a282-4ca9-8063-e09a232d8ca1\") " Jun 11 16:30:16.159300 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:16.159233 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a060c5df-a282-4ca9-8063-e09a232d8ca1-bundle\") pod \"a060c5df-a282-4ca9-8063-e09a232d8ca1\" (UID: \"a060c5df-a282-4ca9-8063-e09a232d8ca1\") " Jun 11 16:30:16.159717 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:16.159683 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a060c5df-a282-4ca9-8063-e09a232d8ca1-bundle" (OuterVolumeSpecName: "bundle") pod "a060c5df-a282-4ca9-8063-e09a232d8ca1" (UID: "a060c5df-a282-4ca9-8063-e09a232d8ca1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:30:16.161304 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:16.161282 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a060c5df-a282-4ca9-8063-e09a232d8ca1-kube-api-access-zbkm6" (OuterVolumeSpecName: "kube-api-access-zbkm6") pod "a060c5df-a282-4ca9-8063-e09a232d8ca1" (UID: "a060c5df-a282-4ca9-8063-e09a232d8ca1"). InnerVolumeSpecName "kube-api-access-zbkm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:30:16.165182 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:16.165148 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a060c5df-a282-4ca9-8063-e09a232d8ca1-util" (OuterVolumeSpecName: "util") pod "a060c5df-a282-4ca9-8063-e09a232d8ca1" (UID: "a060c5df-a282-4ca9-8063-e09a232d8ca1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:30:16.260040 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:16.259960 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a060c5df-a282-4ca9-8063-e09a232d8ca1-util\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:30:16.260040 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:16.259986 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbkm6\" (UniqueName: \"kubernetes.io/projected/a060c5df-a282-4ca9-8063-e09a232d8ca1-kube-api-access-zbkm6\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:30:16.260040 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:16.259996 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a060c5df-a282-4ca9-8063-e09a232d8ca1-bundle\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:30:16.923935 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:16.923894 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" event={"ID":"a060c5df-a282-4ca9-8063-e09a232d8ca1","Type":"ContainerDied","Data":"608dd29db18eadd51e36701597eefe58d2192fec363a1d40ccaf1e559e9db9da"} Jun 11 16:30:16.923935 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:16.923931 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xtrz" Jun 11 16:30:16.924165 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:16.923944 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="608dd29db18eadd51e36701597eefe58d2192fec363a1d40ccaf1e559e9db9da" Jun 11 16:30:37.052357 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.052327 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:30:37.052790 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.052672 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a060c5df-a282-4ca9-8063-e09a232d8ca1" containerName="extract" Jun 11 16:30:37.052790 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.052685 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a060c5df-a282-4ca9-8063-e09a232d8ca1" containerName="extract" Jun 11 16:30:37.052790 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.052700 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a060c5df-a282-4ca9-8063-e09a232d8ca1" containerName="pull" Jun 11 16:30:37.052790 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.052706 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a060c5df-a282-4ca9-8063-e09a232d8ca1" containerName="pull" Jun 11 16:30:37.052790 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.052717 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a060c5df-a282-4ca9-8063-e09a232d8ca1" containerName="util" Jun 11 16:30:37.052790 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.052723 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a060c5df-a282-4ca9-8063-e09a232d8ca1" containerName="util" Jun 11 16:30:37.052790 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.052784 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a060c5df-a282-4ca9-8063-e09a232d8ca1" containerName="extract" Jun 11 16:30:37.055802 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.055785 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:30:37.058748 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.058726 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 16:30:37.058871 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.058836 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 16:30:37.058978 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.058963 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 16:30:37.059061 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.059048 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-pn8zt\"" Jun 11 16:30:37.067077 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.067056 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:30:37.140690 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.140667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87mr6\" (UniqueName: \"kubernetes.io/projected/b8f14160-8ded-40d3-a1c4-ed9e4afbc98e-kube-api-access-87mr6\") pod \"maas-keycloak-0\" (UID: \"b8f14160-8ded-40d3-a1c4-ed9e4afbc98e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:30:37.241203 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.241180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87mr6\" (UniqueName: \"kubernetes.io/projected/b8f14160-8ded-40d3-a1c4-ed9e4afbc98e-kube-api-access-87mr6\") pod \"maas-keycloak-0\" (UID: \"b8f14160-8ded-40d3-a1c4-ed9e4afbc98e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:30:37.250706 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.250683 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87mr6\" (UniqueName: \"kubernetes.io/projected/b8f14160-8ded-40d3-a1c4-ed9e4afbc98e-kube-api-access-87mr6\") pod \"maas-keycloak-0\" (UID: \"b8f14160-8ded-40d3-a1c4-ed9e4afbc98e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:30:37.365817 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.365757 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:30:37.501720 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.501689 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:30:37.502943 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:30:37.502915 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f14160_8ded_40d3_a1c4_ed9e4afbc98e.slice/crio-78da8108cde278c48b373a17900ed197e5a55b9d80ce776c01259f5ea148b781 WatchSource:0}: Error finding container 78da8108cde278c48b373a17900ed197e5a55b9d80ce776c01259f5ea148b781: Status 404 returned error can't find the container with id 78da8108cde278c48b373a17900ed197e5a55b9d80ce776c01259f5ea148b781 Jun 11 16:30:37.504460 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:37.504436 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:30:38.043338 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:38.043299 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b8f14160-8ded-40d3-a1c4-ed9e4afbc98e","Type":"ContainerStarted","Data":"78da8108cde278c48b373a17900ed197e5a55b9d80ce776c01259f5ea148b781"} Jun 11 16:30:43.087715 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:43.087692 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 16:30:44.081649 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:44.081608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b8f14160-8ded-40d3-a1c4-ed9e4afbc98e","Type":"ContainerStarted","Data":"fef07571629291d1e7808094eb5f0633d8ad5630c94907712871b78348955b9b"} Jun 11 16:30:44.106661 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:44.106601 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.526474071 podStartE2EDuration="7.106580509s" totalImagesPullingTime="5.580106438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:30:44.103827724 +0000 UTC m=+661.451935956" watchObservedRunningTime="2026-06-11 16:30:44.106580509 +0000 UTC m=+661.454688740" Jun 11 16:30:44.366040 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:44.365921 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 16:30:44.367863 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:44.367825 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 11 16:30:45.366264 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:45.366213 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 11 16:30:46.367079 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:46.367004 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 11 16:30:47.366933 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:47.366887 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:30:47.367298 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:47.367259 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 11 16:30:48.366984 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:48.366934 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 11 16:30:49.366470 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:49.366418 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 11 16:30:50.366478 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:50.366420 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 11 16:30:51.366933 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:51.366881 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 11 16:30:52.366674 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:52.366633 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 11 16:30:53.366997 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:53.366938 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 11 16:30:54.366709 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:54.366659 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 11 16:30:55.366375 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:55.366333 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 11 16:30:56.457581 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:56.457533 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 16:30:56.473174 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:30:56.473128 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:31:06.464557 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:06.464513 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:31:47.036604 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.036517 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6d6db4864c-b966h"] Jun 11 16:31:47.040107 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.040085 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6d6db4864c-b966h" Jun 11 16:31:47.046687 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.046667 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 16:31:47.058442 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.058415 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6d6db4864c-b966h"] Jun 11 16:31:47.169375 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.169338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de7cff8f-ff15-4f44-86fa-6c5a6a61fed1-openshift-service-ca\") pod \"maas-api-6d6db4864c-b966h\" (UID: \"de7cff8f-ff15-4f44-86fa-6c5a6a61fed1\") " pod="opendatahub/maas-api-6d6db4864c-b966h" Jun 11 16:31:47.169525 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.169385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de7cff8f-ff15-4f44-86fa-6c5a6a61fed1-maas-api-tls\") pod \"maas-api-6d6db4864c-b966h\" (UID: \"de7cff8f-ff15-4f44-86fa-6c5a6a61fed1\") " pod="opendatahub/maas-api-6d6db4864c-b966h" Jun 11 16:31:47.169525 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.169410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2dq8\" (UniqueName: \"kubernetes.io/projected/de7cff8f-ff15-4f44-86fa-6c5a6a61fed1-kube-api-access-f2dq8\") pod \"maas-api-6d6db4864c-b966h\" (UID: \"de7cff8f-ff15-4f44-86fa-6c5a6a61fed1\") " pod="opendatahub/maas-api-6d6db4864c-b966h" Jun 11 16:31:47.270213 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.270185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de7cff8f-ff15-4f44-86fa-6c5a6a61fed1-openshift-service-ca\") pod \"maas-api-6d6db4864c-b966h\" (UID: \"de7cff8f-ff15-4f44-86fa-6c5a6a61fed1\") " pod="opendatahub/maas-api-6d6db4864c-b966h" Jun 11 16:31:47.270320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.270223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de7cff8f-ff15-4f44-86fa-6c5a6a61fed1-maas-api-tls\") pod \"maas-api-6d6db4864c-b966h\" (UID: \"de7cff8f-ff15-4f44-86fa-6c5a6a61fed1\") " pod="opendatahub/maas-api-6d6db4864c-b966h" Jun 11 16:31:47.270320 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.270242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2dq8\" (UniqueName: \"kubernetes.io/projected/de7cff8f-ff15-4f44-86fa-6c5a6a61fed1-kube-api-access-f2dq8\") pod \"maas-api-6d6db4864c-b966h\" (UID: \"de7cff8f-ff15-4f44-86fa-6c5a6a61fed1\") " pod="opendatahub/maas-api-6d6db4864c-b966h" Jun 11 16:31:47.270787 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.270767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de7cff8f-ff15-4f44-86fa-6c5a6a61fed1-openshift-service-ca\") pod \"maas-api-6d6db4864c-b966h\" (UID: \"de7cff8f-ff15-4f44-86fa-6c5a6a61fed1\") " pod="opendatahub/maas-api-6d6db4864c-b966h" Jun 11 16:31:47.272748 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.272729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de7cff8f-ff15-4f44-86fa-6c5a6a61fed1-maas-api-tls\") pod \"maas-api-6d6db4864c-b966h\" (UID: \"de7cff8f-ff15-4f44-86fa-6c5a6a61fed1\") " pod="opendatahub/maas-api-6d6db4864c-b966h" Jun 11 16:31:47.281758 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.281733 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2dq8\" (UniqueName: \"kubernetes.io/projected/de7cff8f-ff15-4f44-86fa-6c5a6a61fed1-kube-api-access-f2dq8\") pod \"maas-api-6d6db4864c-b966h\" (UID: \"de7cff8f-ff15-4f44-86fa-6c5a6a61fed1\") " pod="opendatahub/maas-api-6d6db4864c-b966h" Jun 11 16:31:47.349668 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.349646 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6d6db4864c-b966h" Jun 11 16:31:47.502156 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.502130 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6d6db4864c-b966h"] Jun 11 16:31:47.503676 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:31:47.503652 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7cff8f_ff15_4f44_86fa_6c5a6a61fed1.slice/crio-9e8f9d7f080beb5dbcabb0113eeccf3805d7cb5431e779bcc02e178d212cfa46 WatchSource:0}: Error finding container 9e8f9d7f080beb5dbcabb0113eeccf3805d7cb5431e779bcc02e178d212cfa46: Status 404 returned error can't find the container with id 9e8f9d7f080beb5dbcabb0113eeccf3805d7cb5431e779bcc02e178d212cfa46 Jun 11 16:31:47.714217 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.714149 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-4fkln"] Jun 11 16:31:47.718499 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.718483 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-4fkln" Jun 11 16:31:47.721522 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.721498 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 16:31:47.721661 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.721498 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pmn9x\"" Jun 11 16:31:47.734334 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.734313 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-4fkln"] Jun 11 16:31:47.877282 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.877248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xf2n\" (UniqueName: \"kubernetes.io/projected/77237469-4cd6-4def-882d-0a88cdb903ff-kube-api-access-8xf2n\") pod \"payload-pre-processing-579785bc64-4fkln\" (UID: \"77237469-4cd6-4def-882d-0a88cdb903ff\") " pod="openshift-ingress/payload-pre-processing-579785bc64-4fkln" Jun 11 16:31:47.978561 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.978471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xf2n\" (UniqueName: \"kubernetes.io/projected/77237469-4cd6-4def-882d-0a88cdb903ff-kube-api-access-8xf2n\") pod \"payload-pre-processing-579785bc64-4fkln\" (UID: \"77237469-4cd6-4def-882d-0a88cdb903ff\") " pod="openshift-ingress/payload-pre-processing-579785bc64-4fkln" Jun 11 16:31:47.988448 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:47.988415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xf2n\" (UniqueName: \"kubernetes.io/projected/77237469-4cd6-4def-882d-0a88cdb903ff-kube-api-access-8xf2n\") pod \"payload-pre-processing-579785bc64-4fkln\" (UID: \"77237469-4cd6-4def-882d-0a88cdb903ff\") " pod="openshift-ingress/payload-pre-processing-579785bc64-4fkln" Jun 11 16:31:48.028825 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:48.028796 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-4fkln" Jun 11 16:31:48.212466 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:48.212429 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-4fkln"] Jun 11 16:31:48.213614 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:31:48.213585 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77237469_4cd6_4def_882d_0a88cdb903ff.slice/crio-06decd0e519dc97f05273e9e97c4a7b7d5a919bde34db0c6101ef94d2d231006 WatchSource:0}: Error finding container 06decd0e519dc97f05273e9e97c4a7b7d5a919bde34db0c6101ef94d2d231006: Status 404 returned error can't find the container with id 06decd0e519dc97f05273e9e97c4a7b7d5a919bde34db0c6101ef94d2d231006 Jun 11 16:31:48.480528 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:48.480446 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-4fkln" event={"ID":"77237469-4cd6-4def-882d-0a88cdb903ff","Type":"ContainerStarted","Data":"06decd0e519dc97f05273e9e97c4a7b7d5a919bde34db0c6101ef94d2d231006"} Jun 11 16:31:48.482205 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:48.482166 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6d6db4864c-b966h" event={"ID":"de7cff8f-ff15-4f44-86fa-6c5a6a61fed1","Type":"ContainerStarted","Data":"9e8f9d7f080beb5dbcabb0113eeccf3805d7cb5431e779bcc02e178d212cfa46"} Jun 11 16:31:52.511161 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:52.511124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6d6db4864c-b966h" event={"ID":"de7cff8f-ff15-4f44-86fa-6c5a6a61fed1","Type":"ContainerStarted","Data":"469d24ffbf6207c58f6ee2c79ac3eaaa6aadd351a4463b47f4555749c04f636b"} Jun 11 16:31:52.511555 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:52.511286 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6d6db4864c-b966h" Jun 11 16:31:52.512728 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:52.512702 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-4fkln" event={"ID":"77237469-4cd6-4def-882d-0a88cdb903ff","Type":"ContainerStarted","Data":"51fc9bdd53343eeab1373f59ca7679b6e97e287baf8130698fafbcb3734f8f94"} Jun 11 16:31:52.512818 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:52.512753 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-4fkln" Jun 11 16:31:52.535074 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:52.535005 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6d6db4864c-b966h" podStartSLOduration=1.411187433 podStartE2EDuration="5.534987694s" totalImagesPullingTime="4.123800261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:52.531315041 +0000 UTC m=+729.879423275" watchObservedRunningTime="2026-06-11 16:31:52.534987694 +0000 UTC m=+729.883095929" Jun 11 16:31:52.548211 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:52.548150 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-4fkln" podStartSLOduration=2.0638412329999998 podStartE2EDuration="5.548132606s" totalImagesPullingTime="3.484291373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:52.547932083 +0000 UTC m=+729.896040315" watchObservedRunningTime="2026-06-11 16:31:52.548132606 +0000 UTC m=+729.896240838" Jun 11 16:31:55.530861 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:55.530799 2576 generic.go:356] "Generic (PLEG): container finished" podID="d0060b4a-d104-43f4-bd00-4355681ea0ae" containerID="5a64c9bfd34f031aff1434878bc9ed374cc96a04db4d36d7dd5590a82846e645" exitCode=0 Jun 11 16:31:55.531217 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:55.530873 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" event={"ID":"d0060b4a-d104-43f4-bd00-4355681ea0ae","Type":"ContainerDied","Data":"5a64c9bfd34f031aff1434878bc9ed374cc96a04db4d36d7dd5590a82846e645"} Jun 11 16:31:55.531266 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:55.531249 2576 scope.go:117] "RemoveContainer" containerID="5a64c9bfd34f031aff1434878bc9ed374cc96a04db4d36d7dd5590a82846e645" Jun 11 16:31:55.532141 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:55.532116 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:31:55.532212 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:55.532180 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:31:55.532250 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:55.532216 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:31:56.542554 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:56.542510 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" event={"ID":"d0060b4a-d104-43f4-bd00-4355681ea0ae","Type":"ContainerStarted","Data":"95fb5c851ad2404df167ad55340e878ca3974a0ac6885aa32d80a54833c9d0ad"} Jun 11 16:31:56.648156 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:56.648113 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:31:57.065035 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:57.064972 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:31:57.066259 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:57.066236 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-5qscj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jun 11 16:31:57.066325 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:57.066285 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" podUID="d0060b4a-d104-43f4-bd00-4355681ea0ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jun 11 16:31:58.065405 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:58.065371 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-5qscj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jun 11 16:31:58.065810 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:58.065441 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" podUID="d0060b4a-d104-43f4-bd00-4355681ea0ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jun 11 16:31:58.524502 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:58.524420 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6d6db4864c-b966h" Jun 11 16:31:59.065333 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:59.065296 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-5qscj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jun 11 16:31:59.065503 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:31:59.065353 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" podUID="d0060b4a-d104-43f4-bd00-4355681ea0ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jun 11 16:32:00.065350 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:32:00.065315 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-5qscj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jun 11 16:32:00.065526 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:32:00.065370 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" podUID="d0060b4a-d104-43f4-bd00-4355681ea0ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jun 11 16:32:01.068925 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:32:01.068895 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:32:01.069916 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:32:01.069897 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5qscj" Jun 11 16:32:03.521338 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:32:03.521311 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-4fkln" Jun 11 16:34:02.907434 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:02.907398 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:34:02.907977 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:02.907596 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" containerID="cri-o://fef07571629291d1e7808094eb5f0633d8ad5630c94907712871b78348955b9b" gracePeriod=30 Jun 11 16:34:04.960661 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:04.960639 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:34:05.109308 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.109220 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87mr6\" (UniqueName: \"kubernetes.io/projected/b8f14160-8ded-40d3-a1c4-ed9e4afbc98e-kube-api-access-87mr6\") pod \"b8f14160-8ded-40d3-a1c4-ed9e4afbc98e\" (UID: \"b8f14160-8ded-40d3-a1c4-ed9e4afbc98e\") " Jun 11 16:34:05.111271 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.111247 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8f14160-8ded-40d3-a1c4-ed9e4afbc98e-kube-api-access-87mr6" (OuterVolumeSpecName: "kube-api-access-87mr6") pod "b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" (UID: "b8f14160-8ded-40d3-a1c4-ed9e4afbc98e"). InnerVolumeSpecName "kube-api-access-87mr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:34:05.210572 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.210539 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87mr6\" (UniqueName: \"kubernetes.io/projected/b8f14160-8ded-40d3-a1c4-ed9e4afbc98e-kube-api-access-87mr6\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:34:05.261654 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.261626 2576 generic.go:356] "Generic (PLEG): container finished" podID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerID="fef07571629291d1e7808094eb5f0633d8ad5630c94907712871b78348955b9b" exitCode=143 Jun 11 16:34:05.261815 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.261669 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:34:05.261815 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.261694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b8f14160-8ded-40d3-a1c4-ed9e4afbc98e","Type":"ContainerDied","Data":"fef07571629291d1e7808094eb5f0633d8ad5630c94907712871b78348955b9b"} Jun 11 16:34:05.261815 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.261732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b8f14160-8ded-40d3-a1c4-ed9e4afbc98e","Type":"ContainerDied","Data":"78da8108cde278c48b373a17900ed197e5a55b9d80ce776c01259f5ea148b781"} Jun 11 16:34:05.261815 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.261753 2576 scope.go:117] "RemoveContainer" containerID="fef07571629291d1e7808094eb5f0633d8ad5630c94907712871b78348955b9b" Jun 11 16:34:05.271769 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.271751 2576 scope.go:117] "RemoveContainer" containerID="fef07571629291d1e7808094eb5f0633d8ad5630c94907712871b78348955b9b" Jun 11 16:34:05.272041 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:34:05.272005 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fef07571629291d1e7808094eb5f0633d8ad5630c94907712871b78348955b9b\": container with ID starting with fef07571629291d1e7808094eb5f0633d8ad5630c94907712871b78348955b9b not found: ID does not exist" containerID="fef07571629291d1e7808094eb5f0633d8ad5630c94907712871b78348955b9b" Jun 11 16:34:05.272122 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.272050 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef07571629291d1e7808094eb5f0633d8ad5630c94907712871b78348955b9b"} err="failed to get container status \"fef07571629291d1e7808094eb5f0633d8ad5630c94907712871b78348955b9b\": rpc error: code = NotFound desc = could not find container \"fef07571629291d1e7808094eb5f0633d8ad5630c94907712871b78348955b9b\": container with ID starting with fef07571629291d1e7808094eb5f0633d8ad5630c94907712871b78348955b9b not found: ID does not exist" Jun 11 16:34:05.284071 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.284045 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:34:05.286376 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.286353 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:34:05.309260 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.309237 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:34:05.309638 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.309622 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" Jun 11 16:34:05.309716 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.309642 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" Jun 11 16:34:05.309770 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.309724 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" containerName="keycloak" Jun 11 16:34:05.312316 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.312297 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:34:05.318417 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.318389 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 16:34:05.318534 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.318412 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 16:34:05.318534 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.318478 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 16:34:05.318534 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.318441 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 16:34:05.318743 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.318724 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-pn8zt\"" Jun 11 16:34:05.325838 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.325776 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:34:05.411988 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.411892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7719b60a-75c4-47b6-8b46-7426e3a72536-test-realms\") pod \"maas-keycloak-0\" (UID: \"7719b60a-75c4-47b6-8b46-7426e3a72536\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:34:05.411988 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.411944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f95vh\" (UniqueName: \"kubernetes.io/projected/7719b60a-75c4-47b6-8b46-7426e3a72536-kube-api-access-f95vh\") pod \"maas-keycloak-0\" (UID: \"7719b60a-75c4-47b6-8b46-7426e3a72536\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:34:05.512863 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.512830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7719b60a-75c4-47b6-8b46-7426e3a72536-test-realms\") pod \"maas-keycloak-0\" (UID: \"7719b60a-75c4-47b6-8b46-7426e3a72536\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:34:05.512995 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.512883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f95vh\" (UniqueName: \"kubernetes.io/projected/7719b60a-75c4-47b6-8b46-7426e3a72536-kube-api-access-f95vh\") pod \"maas-keycloak-0\" (UID: \"7719b60a-75c4-47b6-8b46-7426e3a72536\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:34:05.513552 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.513532 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7719b60a-75c4-47b6-8b46-7426e3a72536-test-realms\") pod \"maas-keycloak-0\" (UID: \"7719b60a-75c4-47b6-8b46-7426e3a72536\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:34:05.521958 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.521935 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f95vh\" (UniqueName: \"kubernetes.io/projected/7719b60a-75c4-47b6-8b46-7426e3a72536-kube-api-access-f95vh\") pod \"maas-keycloak-0\" (UID: \"7719b60a-75c4-47b6-8b46-7426e3a72536\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:34:05.629827 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.629777 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:34:05.763511 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:05.763483 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:34:05.766160 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:34:05.766123 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7719b60a_75c4_47b6_8b46_7426e3a72536.slice/crio-15d1396e4f3c9e7deb70409e3e6e489b6bdec7825a7b65decdfb872d9f64bad9 WatchSource:0}: Error finding container 15d1396e4f3c9e7deb70409e3e6e489b6bdec7825a7b65decdfb872d9f64bad9: Status 404 returned error can't find the container with id 15d1396e4f3c9e7deb70409e3e6e489b6bdec7825a7b65decdfb872d9f64bad9 Jun 11 16:34:06.268720 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:06.268681 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7719b60a-75c4-47b6-8b46-7426e3a72536","Type":"ContainerStarted","Data":"6bde254d3a9409d3c5ca97db42f9b3350c75f1289646981ea913aea0ed3e3c25"} Jun 11 16:34:06.269171 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:06.268735 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7719b60a-75c4-47b6-8b46-7426e3a72536","Type":"ContainerStarted","Data":"15d1396e4f3c9e7deb70409e3e6e489b6bdec7825a7b65decdfb872d9f64bad9"} Jun 11 16:34:06.289468 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:06.289422 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.966365206 podStartE2EDuration="1.289407262s" totalImagesPullingTime="323.042056ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:06.287143599 +0000 UTC m=+863.635251853" watchObservedRunningTime="2026-06-11 16:34:06.289407262 +0000 UTC m=+863.637515505" Jun 11 16:34:06.630191 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:06.630148 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 16:34:06.631618 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:06.631581 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7719b60a-75c4-47b6-8b46-7426e3a72536" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 11 16:34:07.105652 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:07.105607 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8f14160-8ded-40d3-a1c4-ed9e4afbc98e" path="/var/lib/kubelet/pods/b8f14160-8ded-40d3-a1c4-ed9e4afbc98e/volumes" Jun 11 16:34:07.630301 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:07.630251 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7719b60a-75c4-47b6-8b46-7426e3a72536" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 11 16:34:08.631028 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:08.630975 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7719b60a-75c4-47b6-8b46-7426e3a72536" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 11 16:34:09.630578 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:09.630527 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7719b60a-75c4-47b6-8b46-7426e3a72536" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 11 16:34:10.630523 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:10.630469 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7719b60a-75c4-47b6-8b46-7426e3a72536" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 11 16:34:11.630684 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:11.630630 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7719b60a-75c4-47b6-8b46-7426e3a72536" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 11 16:34:12.631306 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:12.631254 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7719b60a-75c4-47b6-8b46-7426e3a72536" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 11 16:34:13.630667 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:13.630614 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7719b60a-75c4-47b6-8b46-7426e3a72536" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 11 16:34:14.631055 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:14.630986 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7719b60a-75c4-47b6-8b46-7426e3a72536" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 11 16:34:15.630495 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:15.630451 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:34:15.630789 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:15.630759 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7719b60a-75c4-47b6-8b46-7426e3a72536" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 11 16:34:16.630388 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:16.630330 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7719b60a-75c4-47b6-8b46-7426e3a72536" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 11 16:34:17.630254 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:17.630213 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7719b60a-75c4-47b6-8b46-7426e3a72536" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 11 16:34:18.630397 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:18.630357 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7719b60a-75c4-47b6-8b46-7426e3a72536" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 11 16:34:19.736050 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:19.735992 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 16:34:19.754227 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:19.754183 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="7719b60a-75c4-47b6-8b46-7426e3a72536" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:34:29.743460 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:34:29.743426 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:35:06.734429 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.734400 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc"] Jun 11 16:35:06.737113 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.737092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.739957 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.739934 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 16:35:06.740087 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.740048 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 16:35:06.741213 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.741188 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 16:35:06.741326 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.741220 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lfnwp\"" Jun 11 16:35:06.755212 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.755191 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc"] Jun 11 16:35:06.864921 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.864894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7701921-07d6-47f0-9e8c-e7413120dbac-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.865068 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.864929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7701921-07d6-47f0-9e8c-e7413120dbac-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.865068 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.864976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f7701921-07d6-47f0-9e8c-e7413120dbac-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.865068 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.865035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7701921-07d6-47f0-9e8c-e7413120dbac-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.865068 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.865053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcwp4\" (UniqueName: \"kubernetes.io/projected/f7701921-07d6-47f0-9e8c-e7413120dbac-kube-api-access-gcwp4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.865213 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.865075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7701921-07d6-47f0-9e8c-e7413120dbac-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.965792 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.965757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7701921-07d6-47f0-9e8c-e7413120dbac-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.965792 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.965796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcwp4\" (UniqueName: \"kubernetes.io/projected/f7701921-07d6-47f0-9e8c-e7413120dbac-kube-api-access-gcwp4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.965980 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.965822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7701921-07d6-47f0-9e8c-e7413120dbac-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.965980 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.965874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7701921-07d6-47f0-9e8c-e7413120dbac-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.965980 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.965906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7701921-07d6-47f0-9e8c-e7413120dbac-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.965980 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.965967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f7701921-07d6-47f0-9e8c-e7413120dbac-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.966380 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.966356 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7701921-07d6-47f0-9e8c-e7413120dbac-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.966380 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.966370 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f7701921-07d6-47f0-9e8c-e7413120dbac-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.966497 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.966414 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7701921-07d6-47f0-9e8c-e7413120dbac-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.968172 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.968151 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7701921-07d6-47f0-9e8c-e7413120dbac-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.968403 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.968386 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7701921-07d6-47f0-9e8c-e7413120dbac-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:06.975481 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:06.975462 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcwp4\" (UniqueName: \"kubernetes.io/projected/f7701921-07d6-47f0-9e8c-e7413120dbac-kube-api-access-gcwp4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc\" (UID: \"f7701921-07d6-47f0-9e8c-e7413120dbac\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:07.047568 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:07.047547 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:35:07.192183 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:07.192153 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc"] Jun 11 16:35:07.192895 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:35:07.192856 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7701921_07d6_47f0_9e8c_e7413120dbac.slice/crio-23f5c2c62e2ef8015c20cc608cdabfdfcf14efec9699d5201cec035e3db00f3a WatchSource:0}: Error finding container 23f5c2c62e2ef8015c20cc608cdabfdfcf14efec9699d5201cec035e3db00f3a: Status 404 returned error can't find the container with id 23f5c2c62e2ef8015c20cc608cdabfdfcf14efec9699d5201cec035e3db00f3a Jun 11 16:35:07.663265 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:07.663231 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" event={"ID":"f7701921-07d6-47f0-9e8c-e7413120dbac","Type":"ContainerStarted","Data":"23f5c2c62e2ef8015c20cc608cdabfdfcf14efec9699d5201cec035e3db00f3a"} Jun 11 16:35:12.698346 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:12.698303 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" event={"ID":"f7701921-07d6-47f0-9e8c-e7413120dbac","Type":"ContainerStarted","Data":"144c42c41a617bcc37504b2b8c32b36d760c6059f357bbb5ba7d98ca383ae398"} Jun 11 16:35:30.001695 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.001652 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc"] Jun 11 16:35:30.006743 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.006720 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.009642 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.009622 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 16:35:30.019403 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.019380 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc"] Jun 11 16:35:30.068154 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.068119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/058f1084-2233-4201-af9e-cc7837fe48bd-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.068334 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.068178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/058f1084-2233-4201-af9e-cc7837fe48bd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.068334 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.068232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/058f1084-2233-4201-af9e-cc7837fe48bd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.068334 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.068323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/058f1084-2233-4201-af9e-cc7837fe48bd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.068448 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.068387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/058f1084-2233-4201-af9e-cc7837fe48bd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.068448 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.068417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t69n6\" (UniqueName: \"kubernetes.io/projected/058f1084-2233-4201-af9e-cc7837fe48bd-kube-api-access-t69n6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.169323 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.169277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/058f1084-2233-4201-af9e-cc7837fe48bd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.169527 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.169338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/058f1084-2233-4201-af9e-cc7837fe48bd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.169527 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.169366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/058f1084-2233-4201-af9e-cc7837fe48bd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.169527 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.169414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/058f1084-2233-4201-af9e-cc7837fe48bd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.169527 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.169457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t69n6\" (UniqueName: \"kubernetes.io/projected/058f1084-2233-4201-af9e-cc7837fe48bd-kube-api-access-t69n6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.169527 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.169518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/058f1084-2233-4201-af9e-cc7837fe48bd-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.169800 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.169739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/058f1084-2233-4201-af9e-cc7837fe48bd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.169800 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.169767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/058f1084-2233-4201-af9e-cc7837fe48bd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.169937 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.169916 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/058f1084-2233-4201-af9e-cc7837fe48bd-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.171623 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.171600 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/058f1084-2233-4201-af9e-cc7837fe48bd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.171896 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.171878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/058f1084-2233-4201-af9e-cc7837fe48bd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.178511 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.178491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t69n6\" (UniqueName: \"kubernetes.io/projected/058f1084-2233-4201-af9e-cc7837fe48bd-kube-api-access-t69n6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc\" (UID: \"058f1084-2233-4201-af9e-cc7837fe48bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.318374 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.318334 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:30.462443 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.462406 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc"] Jun 11 16:35:30.462860 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:35:30.462836 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058f1084_2233_4201_af9e_cc7837fe48bd.slice/crio-e1a86aecada2f759f3a928d9ce54f8f4c387d22f6fcecbc0ea13c2866bd93395 WatchSource:0}: Error finding container e1a86aecada2f759f3a928d9ce54f8f4c387d22f6fcecbc0ea13c2866bd93395: Status 404 returned error can't find the container with id e1a86aecada2f759f3a928d9ce54f8f4c387d22f6fcecbc0ea13c2866bd93395 Jun 11 16:35:30.799373 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.799339 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" event={"ID":"058f1084-2233-4201-af9e-cc7837fe48bd","Type":"ContainerStarted","Data":"15d18b9764e73556f37e6dfae637a865cb75a2a4f22802a592b22870d88cf1bb"} Jun 11 16:35:30.799580 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:30.799395 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" event={"ID":"058f1084-2233-4201-af9e-cc7837fe48bd","Type":"ContainerStarted","Data":"e1a86aecada2f759f3a928d9ce54f8f4c387d22f6fcecbc0ea13c2866bd93395"} Jun 11 16:35:32.812914 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:32.812871 2576 generic.go:356] "Generic (PLEG): container finished" podID="058f1084-2233-4201-af9e-cc7837fe48bd" containerID="15d18b9764e73556f37e6dfae637a865cb75a2a4f22802a592b22870d88cf1bb" exitCode=0 Jun 11 16:35:32.813395 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:32.812946 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" event={"ID":"058f1084-2233-4201-af9e-cc7837fe48bd","Type":"ContainerDied","Data":"15d18b9764e73556f37e6dfae637a865cb75a2a4f22802a592b22870d88cf1bb"} Jun 11 16:35:34.828435 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:34.828394 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" event={"ID":"058f1084-2233-4201-af9e-cc7837fe48bd","Type":"ContainerStarted","Data":"4ab5a0d96a963548bcebe4e83fa12218ecaeba5101c05007f1b8f330d163533d"} Jun 11 16:35:34.849313 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:34.849123 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" podStartSLOduration=3.393043548 podStartE2EDuration="5.849100479s" totalImagesPullingTime="1.094192054s" totalInitContainerRuntime="1.361864877s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:34.84892737 +0000 UTC m=+952.197035601" watchObservedRunningTime="2026-06-11 16:35:34.849100479 +0000 UTC m=+952.197208718" Jun 11 16:35:40.319045 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:40.318990 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:40.319482 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:40.319099 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:40.331502 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:40.331475 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:40.875889 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:40.875855 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc" Jun 11 16:35:42.202283 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.202247 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52"] Jun 11 16:35:42.207107 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.207086 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.210277 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.210255 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 16:35:42.218092 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.218070 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52"] Jun 11 16:35:42.281856 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.281828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c686192d-88a0-4db9-916f-8c26bffcf8c2-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.281856 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.281858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c686192d-88a0-4db9-916f-8c26bffcf8c2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.282069 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.281889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2gzm\" (UniqueName: \"kubernetes.io/projected/c686192d-88a0-4db9-916f-8c26bffcf8c2-kube-api-access-j2gzm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.282069 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.281917 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c686192d-88a0-4db9-916f-8c26bffcf8c2-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.282069 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.281985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c686192d-88a0-4db9-916f-8c26bffcf8c2-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.282069 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.282005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c686192d-88a0-4db9-916f-8c26bffcf8c2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.382979 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.382948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c686192d-88a0-4db9-916f-8c26bffcf8c2-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.383136 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.382986 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c686192d-88a0-4db9-916f-8c26bffcf8c2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.383136 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.383040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c686192d-88a0-4db9-916f-8c26bffcf8c2-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.383254 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.383149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c686192d-88a0-4db9-916f-8c26bffcf8c2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.383317 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.383250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2gzm\" (UniqueName: \"kubernetes.io/projected/c686192d-88a0-4db9-916f-8c26bffcf8c2-kube-api-access-j2gzm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.383317 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.383295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c686192d-88a0-4db9-916f-8c26bffcf8c2-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.383421 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.383361 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c686192d-88a0-4db9-916f-8c26bffcf8c2-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.383421 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.383399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c686192d-88a0-4db9-916f-8c26bffcf8c2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.383678 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.383656 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c686192d-88a0-4db9-916f-8c26bffcf8c2-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.385197 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.385174 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c686192d-88a0-4db9-916f-8c26bffcf8c2-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.385461 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.385443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c686192d-88a0-4db9-916f-8c26bffcf8c2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.392769 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.392743 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2gzm\" (UniqueName: \"kubernetes.io/projected/c686192d-88a0-4db9-916f-8c26bffcf8c2-kube-api-access-j2gzm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cjf52\" (UID: \"c686192d-88a0-4db9-916f-8c26bffcf8c2\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.517068 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.516972 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:42.652558 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.652528 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52"] Jun 11 16:35:42.653380 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:35:42.653353 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc686192d_88a0_4db9_916f_8c26bffcf8c2.slice/crio-7f88d708a1edd7468f0d056fe8d20baf2c438815de0d65814cee08dd33ea5141 WatchSource:0}: Error finding container 7f88d708a1edd7468f0d056fe8d20baf2c438815de0d65814cee08dd33ea5141: Status 404 returned error can't find the container with id 7f88d708a1edd7468f0d056fe8d20baf2c438815de0d65814cee08dd33ea5141 Jun 11 16:35:42.877044 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.876986 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" event={"ID":"c686192d-88a0-4db9-916f-8c26bffcf8c2","Type":"ContainerStarted","Data":"483fd70739471c3f6a94a731d9f0e02c6ee3a44a5915e532aebf67415e455b98"} Jun 11 16:35:42.877234 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:42.877057 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" event={"ID":"c686192d-88a0-4db9-916f-8c26bffcf8c2","Type":"ContainerStarted","Data":"7f88d708a1edd7468f0d056fe8d20baf2c438815de0d65814cee08dd33ea5141"} Jun 11 16:35:44.890466 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:44.890430 2576 generic.go:356] "Generic (PLEG): container finished" podID="c686192d-88a0-4db9-916f-8c26bffcf8c2" containerID="483fd70739471c3f6a94a731d9f0e02c6ee3a44a5915e532aebf67415e455b98" exitCode=0 Jun 11 16:35:44.890930 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:44.890512 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" event={"ID":"c686192d-88a0-4db9-916f-8c26bffcf8c2","Type":"ContainerDied","Data":"483fd70739471c3f6a94a731d9f0e02c6ee3a44a5915e532aebf67415e455b98"} Jun 11 16:35:44.891261 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:44.891242 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:35:45.897581 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:45.897551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" event={"ID":"c686192d-88a0-4db9-916f-8c26bffcf8c2","Type":"ContainerStarted","Data":"f353df5c80dfaa8b4d336e31ca4a769457e14941b5412679c7d4c8bde900d566"} Jun 11 16:35:45.922989 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:45.922914 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" podStartSLOduration=2.252871325 podStartE2EDuration="3.92289192s" totalImagesPullingTime="193.733785ms" totalInitContainerRuntime="1.47628681s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:45.922611815 +0000 UTC m=+963.270720046" watchObservedRunningTime="2026-06-11 16:35:45.92289192 +0000 UTC m=+963.271000156" Jun 11 16:35:52.517954 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:52.517921 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:52.518504 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:52.517981 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:52.530625 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:52.530600 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:35:52.948817 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:35:52.948793 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cjf52" Jun 11 16:36:05.009582 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:36:05.009550 2576 generic.go:356] "Generic (PLEG): container finished" podID="f7701921-07d6-47f0-9e8c-e7413120dbac" containerID="144c42c41a617bcc37504b2b8c32b36d760c6059f357bbb5ba7d98ca383ae398" exitCode=0 Jun 11 16:36:05.009991 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:36:05.009623 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" event={"ID":"f7701921-07d6-47f0-9e8c-e7413120dbac","Type":"ContainerDied","Data":"144c42c41a617bcc37504b2b8c32b36d760c6059f357bbb5ba7d98ca383ae398"} Jun 11 16:36:06.017851 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:36:06.017818 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" event={"ID":"f7701921-07d6-47f0-9e8c-e7413120dbac","Type":"ContainerStarted","Data":"594782bc8f168f2459714d8929b8015920d06138bb01396ae802f7153bdf6fe9"} Jun 11 16:36:06.054712 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:36:06.054647 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" podStartSLOduration=2.675372625 podStartE2EDuration="1m0.05462929s" totalImagesPullingTime="4.790058974s" totalInitContainerRuntime="52.589197691s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:35:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:06.051208916 +0000 UTC m=+983.399317150" watchObservedRunningTime="2026-06-11 16:36:06.05462929 +0000 UTC m=+983.402737536" Jun 11 16:36:07.047819 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:36:07.047789 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:36:07.048227 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:36:07.047881 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:36:07.060304 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:36:07.060283 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:36:08.043576 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:36:08.043548 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc" Jun 11 16:56:34.543166 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.543134 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6"] Jun 11 16:56:34.545787 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.545767 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.554261 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.554235 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-375d1095-openshift-default-dockercfg-j9hk4\"" Jun 11 16:56:34.578438 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.578414 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6"] Jun 11 16:56:34.657538 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.657511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-envoy\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.657654 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.657555 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-podinfo\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.657701 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.657646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-workload-socket\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.657741 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.657700 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istiod-ca-cert\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.657776 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.657742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ftfj\" (UniqueName: \"kubernetes.io/projected/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-kube-api-access-4ftfj\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.657811 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.657803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-credential-socket\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.657846 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.657820 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-token\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.657846 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.657839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-data\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.657933 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.657864 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-workload-certs\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.758894 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.758861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-credential-socket\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.759090 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.758901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-token\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.759090 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.758926 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-data\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.759090 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.758955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-workload-certs\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.759277 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.759137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-envoy\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.759277 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.759164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-podinfo\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.759277 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.759212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-workload-socket\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.759277 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.759262 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istiod-ca-cert\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.759488 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.759322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ftfj\" (UniqueName: \"kubernetes.io/projected/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-kube-api-access-4ftfj\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.759488 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.759359 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-credential-socket\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.759594 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.759504 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-workload-certs\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.759594 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.759552 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-data\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.759594 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.759574 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-workload-socket\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.760064 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.760037 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istiod-ca-cert\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.761417 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.761397 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-envoy\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.761791 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.761769 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-podinfo\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.780222 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.780195 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-token\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.780385 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.780366 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ftfj\" (UniqueName: \"kubernetes.io/projected/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-kube-api-access-4ftfj\") pod \"e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:34.858643 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:34.858617 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:35.029406 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:35.029355 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6"] Jun 11 16:56:35.030490 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:56:35.030464 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f60fb37_0287_4cdd_82e5_7ec2d3b566ee.slice/crio-6b460ef1e3a3e65ccb30f9ea9236c0a51eec87edde564da3b527c48d1b42dfb3 WatchSource:0}: Error finding container 6b460ef1e3a3e65ccb30f9ea9236c0a51eec87edde564da3b527c48d1b42dfb3: Status 404 returned error can't find the container with id 6b460ef1e3a3e65ccb30f9ea9236c0a51eec87edde564da3b527c48d1b42dfb3 Jun 11 16:56:35.032493 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:35.032448 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:56:35.032584 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:35.032533 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:56:35.032584 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:35.032562 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:56:35.974555 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:35.974524 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" event={"ID":"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee","Type":"ContainerStarted","Data":"bb77a1737d49f94524f36ec0f8aa6239a09abfcdd33f1c4c568ac244fb886e1d"} Jun 11 16:56:35.974929 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:35.974581 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" event={"ID":"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee","Type":"ContainerStarted","Data":"6b460ef1e3a3e65ccb30f9ea9236c0a51eec87edde564da3b527c48d1b42dfb3"} Jun 11 16:56:36.005385 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:36.005325 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" podStartSLOduration=2.005305969 podStartE2EDuration="2.005305969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:56:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:56:36.003113342 +0000 UTC m=+2213.351221575" watchObservedRunningTime="2026-06-11 16:56:36.005305969 +0000 UTC m=+2213.353414225" Jun 11 16:56:36.858933 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:36.858896 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:36.864022 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:36.863985 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:36.980653 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:36.980626 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:36.981595 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:36.981566 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:40.955322 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:40.955285 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6"] Jun 11 16:56:40.955810 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:40.955473 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" podUID="5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" containerName="istio-proxy" containerID="cri-o://bb77a1737d49f94524f36ec0f8aa6239a09abfcdd33f1c4c568ac244fb886e1d" gracePeriod=30 Jun 11 16:56:46.210375 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.210350 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:46.259976 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.259907 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-envoy\") pod \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " Jun 11 16:56:46.259976 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.259972 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istiod-ca-cert\") pod \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " Jun 11 16:56:46.260200 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.259991 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-token\") pod \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " Jun 11 16:56:46.260200 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.260086 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-workload-socket\") pod \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " Jun 11 16:56:46.260200 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.260104 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ftfj\" (UniqueName: \"kubernetes.io/projected/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-kube-api-access-4ftfj\") pod \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " Jun 11 16:56:46.260200 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.260120 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-data\") pod \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " Jun 11 16:56:46.260200 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.260142 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-podinfo\") pod \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " Jun 11 16:56:46.260200 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.260173 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-credential-socket\") pod \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " Jun 11 16:56:46.260200 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.260201 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-workload-certs\") pod \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\" (UID: \"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee\") " Jun 11 16:56:46.260570 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.260373 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" (UID: "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:56:46.260628 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.260606 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" (UID: "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:56:46.260628 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.260611 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" (UID: "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:56:46.260628 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.260377 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" (UID: "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:56:46.260763 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.260625 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" (UID: "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:56:46.260763 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.260616 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istiod-ca-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:56:46.262644 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.262610 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-kube-api-access-4ftfj" (OuterVolumeSpecName: "kube-api-access-4ftfj") pod "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" (UID: "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee"). InnerVolumeSpecName "kube-api-access-4ftfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:56:46.262762 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.262671 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" (UID: "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:56:46.262762 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.262668 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" (UID: "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 16:56:46.262762 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.262681 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" (UID: "5f60fb37-0287-4cdd-82e5-7ec2d3b566ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:56:46.361803 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.361776 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-token\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:56:46.361803 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.361801 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-workload-socket\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:56:46.361965 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.361815 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ftfj\" (UniqueName: \"kubernetes.io/projected/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-kube-api-access-4ftfj\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:56:46.361965 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.361831 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-data\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:56:46.361965 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.361844 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-podinfo\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:56:46.361965 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.361856 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-credential-socket\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:56:46.361965 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.361869 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-workload-certs\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:56:46.361965 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:46.361882 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee-istio-envoy\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:56:47.042608 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.042568 2576 generic.go:356] "Generic (PLEG): container finished" podID="5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" containerID="bb77a1737d49f94524f36ec0f8aa6239a09abfcdd33f1c4c568ac244fb886e1d" exitCode=0 Jun 11 16:56:47.042811 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.042637 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" Jun 11 16:56:47.042811 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.042647 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" event={"ID":"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee","Type":"ContainerDied","Data":"bb77a1737d49f94524f36ec0f8aa6239a09abfcdd33f1c4c568ac244fb886e1d"} Jun 11 16:56:47.042811 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.042722 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6" event={"ID":"5f60fb37-0287-4cdd-82e5-7ec2d3b566ee","Type":"ContainerDied","Data":"6b460ef1e3a3e65ccb30f9ea9236c0a51eec87edde564da3b527c48d1b42dfb3"} Jun 11 16:56:47.042811 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.042744 2576 scope.go:117] "RemoveContainer" containerID="bb77a1737d49f94524f36ec0f8aa6239a09abfcdd33f1c4c568ac244fb886e1d" Jun 11 16:56:47.057134 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.057114 2576 scope.go:117] "RemoveContainer" containerID="bb77a1737d49f94524f36ec0f8aa6239a09abfcdd33f1c4c568ac244fb886e1d" Jun 11 16:56:47.057428 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:56:47.057408 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb77a1737d49f94524f36ec0f8aa6239a09abfcdd33f1c4c568ac244fb886e1d\": container with ID starting with bb77a1737d49f94524f36ec0f8aa6239a09abfcdd33f1c4c568ac244fb886e1d not found: ID does not exist" containerID="bb77a1737d49f94524f36ec0f8aa6239a09abfcdd33f1c4c568ac244fb886e1d" Jun 11 16:56:47.057472 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.057436 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb77a1737d49f94524f36ec0f8aa6239a09abfcdd33f1c4c568ac244fb886e1d"} err="failed to get container status \"bb77a1737d49f94524f36ec0f8aa6239a09abfcdd33f1c4c568ac244fb886e1d\": rpc error: code = NotFound desc = could not find container \"bb77a1737d49f94524f36ec0f8aa6239a09abfcdd33f1c4c568ac244fb886e1d\": container with ID starting with bb77a1737d49f94524f36ec0f8aa6239a09abfcdd33f1c4c568ac244fb886e1d not found: ID does not exist" Jun 11 16:56:47.070452 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.070427 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6"] Jun 11 16:56:47.074121 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.074101 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-375d1095-openshift-default-59f68c68d6-bpgd6"] Jun 11 16:56:47.101777 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.101746 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" path="/var/lib/kubelet/pods/5f60fb37-0287-4cdd-82e5-7ec2d3b566ee/volumes" Jun 11 16:56:47.720107 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.720078 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9"] Jun 11 16:56:47.720573 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.720479 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" containerName="istio-proxy" Jun 11 16:56:47.720573 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.720495 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" containerName="istio-proxy" Jun 11 16:56:47.720573 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.720570 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f60fb37-0287-4cdd-82e5-7ec2d3b566ee" containerName="istio-proxy" Jun 11 16:56:47.723350 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.723332 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.728803 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.728780 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f120076e-openshift-default-dockercfg-rmwqc\"" Jun 11 16:56:47.737362 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.737338 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9"] Jun 11 16:56:47.776033 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.775981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-envoy\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.776187 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.776052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-workload-socket\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.776187 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.776103 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-credential-socket\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.776187 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.776127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-workload-certs\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.776187 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.776160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxcl9\" (UniqueName: \"kubernetes.io/projected/a52d77d9-b480-41ca-89d1-f9564d533d37-kube-api-access-gxcl9\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.776353 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.776198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a52d77d9-b480-41ca-89d1-f9564d533d37-istiod-ca-cert\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.776353 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.776221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-data\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.776353 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.776246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-podinfo\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.776353 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.776260 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-token\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.877837 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.877805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-envoy\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.878036 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.877860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-workload-socket\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.878036 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.877914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-credential-socket\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.878036 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.877943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-workload-certs\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.878036 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.877964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxcl9\" (UniqueName: \"kubernetes.io/projected/a52d77d9-b480-41ca-89d1-f9564d533d37-kube-api-access-gxcl9\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.878258 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.878097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a52d77d9-b480-41ca-89d1-f9564d533d37-istiod-ca-cert\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.878258 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.878143 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-data\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.878258 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.878192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-podinfo\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.878258 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.878219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-token\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.878479 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.878385 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-workload-socket\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.878479 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.878463 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-workload-certs\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.878585 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.878559 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-credential-socket\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.878645 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.878599 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-data\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.879057 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.879001 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a52d77d9-b480-41ca-89d1-f9564d533d37-istiod-ca-cert\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.880745 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.880718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-envoy\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.880878 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.880862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-podinfo\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.895833 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.895804 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxcl9\" (UniqueName: \"kubernetes.io/projected/a52d77d9-b480-41ca-89d1-f9564d533d37-kube-api-access-gxcl9\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:47.896163 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:47.896143 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-token\") pod \"e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:48.035387 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:48.035303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:48.174569 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:48.174536 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9"] Jun 11 16:56:48.176078 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:56:48.176049 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda52d77d9_b480_41ca_89d1_f9564d533d37.slice/crio-1f8e7af777459f650bcd8fa9dab1d1d7fdff1057501016163eca9049bd7e2ca0 WatchSource:0}: Error finding container 1f8e7af777459f650bcd8fa9dab1d1d7fdff1057501016163eca9049bd7e2ca0: Status 404 returned error can't find the container with id 1f8e7af777459f650bcd8fa9dab1d1d7fdff1057501016163eca9049bd7e2ca0 Jun 11 16:56:48.178165 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:48.178135 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:56:48.178245 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:48.178194 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:56:48.178245 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:48.178225 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:56:49.058071 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:49.058035 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" event={"ID":"a52d77d9-b480-41ca-89d1-f9564d533d37","Type":"ContainerStarted","Data":"b9324ce0dbee873f44b4f2747d8065c59a9b0e648caa1f07ecd1cf4a9d1c9234"} Jun 11 16:56:49.058459 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:49.058092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" event={"ID":"a52d77d9-b480-41ca-89d1-f9564d533d37","Type":"ContainerStarted","Data":"1f8e7af777459f650bcd8fa9dab1d1d7fdff1057501016163eca9049bd7e2ca0"} Jun 11 16:56:49.083551 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:49.083505 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" podStartSLOduration=2.083490799 podStartE2EDuration="2.083490799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:56:49.081258469 +0000 UTC m=+2226.429366713" watchObservedRunningTime="2026-06-11 16:56:49.083490799 +0000 UTC m=+2226.431599041" Jun 11 16:56:50.035756 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:50.035717 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:50.040954 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:50.040932 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:50.064999 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:50.064970 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:50.065653 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:50.065634 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:56:55.131760 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:55.131721 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9"] Jun 11 16:56:55.132202 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:56:55.131914 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" podUID="a52d77d9-b480-41ca-89d1-f9564d533d37" containerName="istio-proxy" containerID="cri-o://b9324ce0dbee873f44b4f2747d8065c59a9b0e648caa1f07ecd1cf4a9d1c9234" gracePeriod=30 Jun 11 16:57:00.379963 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.379937 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:57:00.489374 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489309 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-workload-socket\") pod \"a52d77d9-b480-41ca-89d1-f9564d533d37\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " Jun 11 16:57:00.489374 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489363 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-credential-socket\") pod \"a52d77d9-b480-41ca-89d1-f9564d533d37\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " Jun 11 16:57:00.489580 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489384 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-envoy\") pod \"a52d77d9-b480-41ca-89d1-f9564d533d37\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " Jun 11 16:57:00.489580 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489403 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a52d77d9-b480-41ca-89d1-f9564d533d37-istiod-ca-cert\") pod \"a52d77d9-b480-41ca-89d1-f9564d533d37\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " Jun 11 16:57:00.489580 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489442 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-podinfo\") pod \"a52d77d9-b480-41ca-89d1-f9564d533d37\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " Jun 11 16:57:00.489580 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489460 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-workload-certs\") pod \"a52d77d9-b480-41ca-89d1-f9564d533d37\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " Jun 11 16:57:00.489580 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489509 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxcl9\" (UniqueName: \"kubernetes.io/projected/a52d77d9-b480-41ca-89d1-f9564d533d37-kube-api-access-gxcl9\") pod \"a52d77d9-b480-41ca-89d1-f9564d533d37\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " Jun 11 16:57:00.489580 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489531 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-data\") pod \"a52d77d9-b480-41ca-89d1-f9564d533d37\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " Jun 11 16:57:00.489580 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489553 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-token\") pod \"a52d77d9-b480-41ca-89d1-f9564d533d37\" (UID: \"a52d77d9-b480-41ca-89d1-f9564d533d37\") " Jun 11 16:57:00.489968 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489602 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a52d77d9-b480-41ca-89d1-f9564d533d37" (UID: "a52d77d9-b480-41ca-89d1-f9564d533d37"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:57:00.489968 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489662 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a52d77d9-b480-41ca-89d1-f9564d533d37" (UID: "a52d77d9-b480-41ca-89d1-f9564d533d37"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:57:00.489968 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489816 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-data" (OuterVolumeSpecName: "istio-data") pod "a52d77d9-b480-41ca-89d1-f9564d533d37" (UID: "a52d77d9-b480-41ca-89d1-f9564d533d37"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:57:00.489968 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489908 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a52d77d9-b480-41ca-89d1-f9564d533d37-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a52d77d9-b480-41ca-89d1-f9564d533d37" (UID: "a52d77d9-b480-41ca-89d1-f9564d533d37"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:57:00.489968 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489917 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-credential-socket\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:00.489968 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489944 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-data\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:00.489968 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.489961 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-workload-socket\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:00.490298 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.490128 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a52d77d9-b480-41ca-89d1-f9564d533d37" (UID: "a52d77d9-b480-41ca-89d1-f9564d533d37"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:57:00.491538 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.491500 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a52d77d9-b480-41ca-89d1-f9564d533d37" (UID: "a52d77d9-b480-41ca-89d1-f9564d533d37"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 16:57:00.491638 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.491610 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-token" (OuterVolumeSpecName: "istio-token") pod "a52d77d9-b480-41ca-89d1-f9564d533d37" (UID: "a52d77d9-b480-41ca-89d1-f9564d533d37"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:57:00.491992 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.491965 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a52d77d9-b480-41ca-89d1-f9564d533d37" (UID: "a52d77d9-b480-41ca-89d1-f9564d533d37"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:57:00.492123 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.491964 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a52d77d9-b480-41ca-89d1-f9564d533d37-kube-api-access-gxcl9" (OuterVolumeSpecName: "kube-api-access-gxcl9") pod "a52d77d9-b480-41ca-89d1-f9564d533d37" (UID: "a52d77d9-b480-41ca-89d1-f9564d533d37"). InnerVolumeSpecName "kube-api-access-gxcl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:57:00.591176 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.591152 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxcl9\" (UniqueName: \"kubernetes.io/projected/a52d77d9-b480-41ca-89d1-f9564d533d37-kube-api-access-gxcl9\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:00.591176 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.591176 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-token\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:00.591309 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.591185 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-envoy\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:00.591309 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.591196 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a52d77d9-b480-41ca-89d1-f9564d533d37-istiod-ca-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:00.591309 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.591205 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a52d77d9-b480-41ca-89d1-f9564d533d37-istio-podinfo\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:00.591309 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:00.591212 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a52d77d9-b480-41ca-89d1-f9564d533d37-workload-certs\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:01.128563 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:01.128533 2576 generic.go:356] "Generic (PLEG): container finished" podID="a52d77d9-b480-41ca-89d1-f9564d533d37" containerID="b9324ce0dbee873f44b4f2747d8065c59a9b0e648caa1f07ecd1cf4a9d1c9234" exitCode=0 Jun 11 16:57:01.128710 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:01.128574 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" Jun 11 16:57:01.128710 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:01.128608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" event={"ID":"a52d77d9-b480-41ca-89d1-f9564d533d37","Type":"ContainerDied","Data":"b9324ce0dbee873f44b4f2747d8065c59a9b0e648caa1f07ecd1cf4a9d1c9234"} Jun 11 16:57:01.128710 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:01.128665 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9" event={"ID":"a52d77d9-b480-41ca-89d1-f9564d533d37","Type":"ContainerDied","Data":"1f8e7af777459f650bcd8fa9dab1d1d7fdff1057501016163eca9049bd7e2ca0"} Jun 11 16:57:01.128710 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:01.128687 2576 scope.go:117] "RemoveContainer" containerID="b9324ce0dbee873f44b4f2747d8065c59a9b0e648caa1f07ecd1cf4a9d1c9234" Jun 11 16:57:01.140567 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:01.140547 2576 scope.go:117] "RemoveContainer" containerID="b9324ce0dbee873f44b4f2747d8065c59a9b0e648caa1f07ecd1cf4a9d1c9234" Jun 11 16:57:01.140840 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:57:01.140817 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9324ce0dbee873f44b4f2747d8065c59a9b0e648caa1f07ecd1cf4a9d1c9234\": container with ID starting with b9324ce0dbee873f44b4f2747d8065c59a9b0e648caa1f07ecd1cf4a9d1c9234 not found: ID does not exist" containerID="b9324ce0dbee873f44b4f2747d8065c59a9b0e648caa1f07ecd1cf4a9d1c9234" Jun 11 16:57:01.140945 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:01.140845 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9324ce0dbee873f44b4f2747d8065c59a9b0e648caa1f07ecd1cf4a9d1c9234"} err="failed to get container status \"b9324ce0dbee873f44b4f2747d8065c59a9b0e648caa1f07ecd1cf4a9d1c9234\": rpc error: code = NotFound desc = could not find container \"b9324ce0dbee873f44b4f2747d8065c59a9b0e648caa1f07ecd1cf4a9d1c9234\": container with ID starting with b9324ce0dbee873f44b4f2747d8065c59a9b0e648caa1f07ecd1cf4a9d1c9234 not found: ID does not exist" Jun 11 16:57:01.152234 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:01.152210 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9"] Jun 11 16:57:01.158155 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:01.158133 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f120076e-openshift-default-9b589bfc6-dj5p9"] Jun 11 16:57:02.346059 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.346027 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt"] Jun 11 16:57:02.346517 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.346495 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a52d77d9-b480-41ca-89d1-f9564d533d37" containerName="istio-proxy" Jun 11 16:57:02.346517 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.346510 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a52d77d9-b480-41ca-89d1-f9564d533d37" containerName="istio-proxy" Jun 11 16:57:02.346592 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.346583 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a52d77d9-b480-41ca-89d1-f9564d533d37" containerName="istio-proxy" Jun 11 16:57:02.349362 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.349342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.352826 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.352806 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-invalid-582aa36b-openshift-default-dockercfg-sbknw\"" Jun 11 16:57:02.362391 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.362367 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt"] Jun 11 16:57:02.405860 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.405831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-workload-socket\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.405957 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.405867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-token\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.405957 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.405890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-podinfo\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.406062 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.405986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5d9efc2-5033-47bc-8549-18434b3a2247-istiod-ca-cert\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.406062 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.406042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-workload-certs\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.406146 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.406108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg6nh\" (UniqueName: \"kubernetes.io/projected/e5d9efc2-5033-47bc-8549-18434b3a2247-kube-api-access-pg6nh\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.406146 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.406138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-envoy\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.406225 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.406154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-data\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.406225 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.406184 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-credential-socket\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.506647 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.506583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-workload-socket\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.506647 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.506616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-token\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.506647 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.506638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-podinfo\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.506884 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.506692 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5d9efc2-5033-47bc-8549-18434b3a2247-istiod-ca-cert\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.506884 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.506726 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-workload-certs\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.506884 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.506778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg6nh\" (UniqueName: \"kubernetes.io/projected/e5d9efc2-5033-47bc-8549-18434b3a2247-kube-api-access-pg6nh\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.506884 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.506799 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-envoy\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.506884 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.506818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-data\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.506884 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.506854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-credential-socket\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.507192 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.507063 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-workload-socket\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.507192 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.507144 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-workload-certs\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.507276 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.507249 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-credential-socket\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.507331 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.507307 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-data\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.507498 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.507481 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5d9efc2-5033-47bc-8549-18434b3a2247-istiod-ca-cert\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.509089 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.509065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-envoy\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.509383 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.509365 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-podinfo\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.514648 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.514626 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-token\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.514751 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.514732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg6nh\" (UniqueName: \"kubernetes.io/projected/e5d9efc2-5033-47bc-8549-18434b3a2247-kube-api-access-pg6nh\") pod \"e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.661246 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.661172 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:02.797208 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.797178 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt"] Jun 11 16:57:02.797759 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:57:02.797734 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d9efc2_5033_47bc_8549_18434b3a2247.slice/crio-d3c669f823f1f5ee7eb063e84424edd1eae2566e9e3a99955d8d181dadbf03a9 WatchSource:0}: Error finding container d3c669f823f1f5ee7eb063e84424edd1eae2566e9e3a99955d8d181dadbf03a9: Status 404 returned error can't find the container with id d3c669f823f1f5ee7eb063e84424edd1eae2566e9e3a99955d8d181dadbf03a9 Jun 11 16:57:02.799934 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.799900 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:57:02.800036 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.799965 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:57:02.800036 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.799991 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:57:02.908167 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:02.908137 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt"] Jun 11 16:57:03.101993 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:03.101962 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a52d77d9-b480-41ca-89d1-f9564d533d37" path="/var/lib/kubelet/pods/a52d77d9-b480-41ca-89d1-f9564d533d37/volumes" Jun 11 16:57:03.143063 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:03.143037 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" event={"ID":"e5d9efc2-5033-47bc-8549-18434b3a2247","Type":"ContainerStarted","Data":"e5bef185b7fa373df7089b300018b3c9db8784f98c4a317c5dfacc8c645c84e4"} Jun 11 16:57:03.143173 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:03.143082 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" event={"ID":"e5d9efc2-5033-47bc-8549-18434b3a2247","Type":"ContainerStarted","Data":"d3c669f823f1f5ee7eb063e84424edd1eae2566e9e3a99955d8d181dadbf03a9"} Jun 11 16:57:03.143216 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:03.143176 2576 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" secret="" err="secret \"e2e-invalid-582aa36b-openshift-default-dockercfg-sbknw\" not found" Jun 11 16:57:03.168250 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:03.168211 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" podStartSLOduration=1.168199512 podStartE2EDuration="1.168199512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:57:03.165597027 +0000 UTC m=+2240.513705269" watchObservedRunningTime="2026-06-11 16:57:03.168199512 +0000 UTC m=+2240.516307754" Jun 11 16:57:03.661967 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:03.661934 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:03.663106 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:03.663083 2576 patch_prober.go:28] interesting pod/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jun 11 16:57:03.663221 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:03.663151 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" podUID="e5d9efc2-5033-47bc-8549-18434b3a2247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jun 11 16:57:04.148925 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:04.148879 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" podUID="e5d9efc2-5033-47bc-8549-18434b3a2247" containerName="istio-proxy" containerID="cri-o://e5bef185b7fa373df7089b300018b3c9db8784f98c4a317c5dfacc8c645c84e4" gracePeriod=30 Jun 11 16:57:09.405284 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.405226 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:09.477160 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477136 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-envoy\") pod \"e5d9efc2-5033-47bc-8549-18434b3a2247\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " Jun 11 16:57:09.477303 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477174 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-workload-certs\") pod \"e5d9efc2-5033-47bc-8549-18434b3a2247\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " Jun 11 16:57:09.477303 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477193 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-token\") pod \"e5d9efc2-5033-47bc-8549-18434b3a2247\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " Jun 11 16:57:09.477303 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477243 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-podinfo\") pod \"e5d9efc2-5033-47bc-8549-18434b3a2247\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " Jun 11 16:57:09.477477 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477390 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5d9efc2-5033-47bc-8549-18434b3a2247" (UID: "e5d9efc2-5033-47bc-8549-18434b3a2247"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:57:09.477477 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477408 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-workload-socket\") pod \"e5d9efc2-5033-47bc-8549-18434b3a2247\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " Jun 11 16:57:09.477477 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477452 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg6nh\" (UniqueName: \"kubernetes.io/projected/e5d9efc2-5033-47bc-8549-18434b3a2247-kube-api-access-pg6nh\") pod \"e5d9efc2-5033-47bc-8549-18434b3a2247\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " Jun 11 16:57:09.477640 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477479 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-credential-socket\") pod \"e5d9efc2-5033-47bc-8549-18434b3a2247\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " Jun 11 16:57:09.477640 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477545 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-data\") pod \"e5d9efc2-5033-47bc-8549-18434b3a2247\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " Jun 11 16:57:09.477640 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477606 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5d9efc2-5033-47bc-8549-18434b3a2247-istiod-ca-cert\") pod \"e5d9efc2-5033-47bc-8549-18434b3a2247\" (UID: \"e5d9efc2-5033-47bc-8549-18434b3a2247\") " Jun 11 16:57:09.477794 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477656 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5d9efc2-5033-47bc-8549-18434b3a2247" (UID: "e5d9efc2-5033-47bc-8549-18434b3a2247"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:57:09.477794 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477675 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5d9efc2-5033-47bc-8549-18434b3a2247" (UID: "e5d9efc2-5033-47bc-8549-18434b3a2247"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:57:09.477896 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477832 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5d9efc2-5033-47bc-8549-18434b3a2247" (UID: "e5d9efc2-5033-47bc-8549-18434b3a2247"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:57:09.477983 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477962 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-workload-socket\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:09.478065 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477989 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-credential-socket\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:09.478065 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.478004 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-data\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:09.478065 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.478042 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-workload-certs\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:09.478065 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.477960 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5d9efc2-5033-47bc-8549-18434b3a2247-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5d9efc2-5033-47bc-8549-18434b3a2247" (UID: "e5d9efc2-5033-47bc-8549-18434b3a2247"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:57:09.479378 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.479356 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5d9efc2-5033-47bc-8549-18434b3a2247" (UID: "e5d9efc2-5033-47bc-8549-18434b3a2247"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:57:09.479477 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.479399 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5d9efc2-5033-47bc-8549-18434b3a2247" (UID: "e5d9efc2-5033-47bc-8549-18434b3a2247"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 16:57:09.479764 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.479746 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5d9efc2-5033-47bc-8549-18434b3a2247-kube-api-access-pg6nh" (OuterVolumeSpecName: "kube-api-access-pg6nh") pod "e5d9efc2-5033-47bc-8549-18434b3a2247" (UID: "e5d9efc2-5033-47bc-8549-18434b3a2247"). InnerVolumeSpecName "kube-api-access-pg6nh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:57:09.479833 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.479782 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5d9efc2-5033-47bc-8549-18434b3a2247" (UID: "e5d9efc2-5033-47bc-8549-18434b3a2247"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:57:09.579081 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.579058 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-podinfo\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:09.579081 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.579079 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg6nh\" (UniqueName: \"kubernetes.io/projected/e5d9efc2-5033-47bc-8549-18434b3a2247-kube-api-access-pg6nh\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:09.579212 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.579089 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5d9efc2-5033-47bc-8549-18434b3a2247-istiod-ca-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:09.579212 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.579097 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-envoy\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:09.579212 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:09.579105 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5d9efc2-5033-47bc-8549-18434b3a2247-istio-token\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:57:10.183051 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:10.183003 2576 generic.go:356] "Generic (PLEG): container finished" podID="e5d9efc2-5033-47bc-8549-18434b3a2247" containerID="e5bef185b7fa373df7089b300018b3c9db8784f98c4a317c5dfacc8c645c84e4" exitCode=0 Jun 11 16:57:10.183051 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:10.183053 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" Jun 11 16:57:10.183300 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:10.183109 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" event={"ID":"e5d9efc2-5033-47bc-8549-18434b3a2247","Type":"ContainerDied","Data":"e5bef185b7fa373df7089b300018b3c9db8784f98c4a317c5dfacc8c645c84e4"} Jun 11 16:57:10.183300 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:10.183162 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt" event={"ID":"e5d9efc2-5033-47bc-8549-18434b3a2247","Type":"ContainerDied","Data":"d3c669f823f1f5ee7eb063e84424edd1eae2566e9e3a99955d8d181dadbf03a9"} Jun 11 16:57:10.183300 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:10.183193 2576 scope.go:117] "RemoveContainer" containerID="e5bef185b7fa373df7089b300018b3c9db8784f98c4a317c5dfacc8c645c84e4" Jun 11 16:57:10.194003 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:10.193987 2576 scope.go:117] "RemoveContainer" containerID="e5bef185b7fa373df7089b300018b3c9db8784f98c4a317c5dfacc8c645c84e4" Jun 11 16:57:10.194329 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:57:10.194310 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5bef185b7fa373df7089b300018b3c9db8784f98c4a317c5dfacc8c645c84e4\": container with ID starting with e5bef185b7fa373df7089b300018b3c9db8784f98c4a317c5dfacc8c645c84e4 not found: ID does not exist" containerID="e5bef185b7fa373df7089b300018b3c9db8784f98c4a317c5dfacc8c645c84e4" Jun 11 16:57:10.194383 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:10.194337 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5bef185b7fa373df7089b300018b3c9db8784f98c4a317c5dfacc8c645c84e4"} err="failed to get container status \"e5bef185b7fa373df7089b300018b3c9db8784f98c4a317c5dfacc8c645c84e4\": rpc error: code = NotFound desc = could not find container \"e5bef185b7fa373df7089b300018b3c9db8784f98c4a317c5dfacc8c645c84e4\": container with ID starting with e5bef185b7fa373df7089b300018b3c9db8784f98c4a317c5dfacc8c645c84e4 not found: ID does not exist" Jun 11 16:57:10.208351 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:10.208318 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt"] Jun 11 16:57:10.212754 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:10.212731 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-invalid-582aa36b-openshift-default-c58d65568-ncdpt"] Jun 11 16:57:11.102523 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:57:11.102492 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5d9efc2-5033-47bc-8549-18434b3a2247" path="/var/lib/kubelet/pods/e5d9efc2-5033-47bc-8549-18434b3a2247/volumes" Jun 11 16:58:27.056096 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.056064 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b7d7887b-kwj76"] Jun 11 16:58:27.056570 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.056466 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5d9efc2-5033-47bc-8549-18434b3a2247" containerName="istio-proxy" Jun 11 16:58:27.056570 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.056480 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d9efc2-5033-47bc-8549-18434b3a2247" containerName="istio-proxy" Jun 11 16:58:27.056570 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.056559 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5d9efc2-5033-47bc-8549-18434b3a2247" containerName="istio-proxy" Jun 11 16:58:27.059572 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.059552 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.073059 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.073033 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7d7887b-kwj76"] Jun 11 16:58:27.142029 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.141983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-oauth-serving-cert\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.142164 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.142053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nrtn\" (UniqueName: \"kubernetes.io/projected/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-kube-api-access-7nrtn\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.142164 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.142105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-console-config\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.142164 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.142123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-service-ca\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.142164 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.142140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-console-serving-cert\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.142164 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.142161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-console-oauth-config\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.142381 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.142179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-trusted-ca-bundle\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.243446 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.243413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-oauth-serving-cert\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.243584 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.243472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nrtn\" (UniqueName: \"kubernetes.io/projected/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-kube-api-access-7nrtn\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.243584 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.243516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-console-config\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.243584 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.243541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-service-ca\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.243584 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.243568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-console-serving-cert\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.243812 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.243599 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-console-oauth-config\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.243812 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.243629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-trusted-ca-bundle\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.244287 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.244262 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-oauth-serving-cert\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.244391 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.244304 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-console-config\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.244391 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.244324 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-service-ca\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.244527 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.244516 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-trusted-ca-bundle\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.246191 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.246168 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-console-serving-cert\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.246294 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.246261 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-console-oauth-config\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.251950 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.251932 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nrtn\" (UniqueName: \"kubernetes.io/projected/da9e2db2-2480-4eda-a18f-9c5ef0ae815c-kube-api-access-7nrtn\") pod \"console-7b7d7887b-kwj76\" (UID: \"da9e2db2-2480-4eda-a18f-9c5ef0ae815c\") " pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.369454 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.369392 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:27.501502 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.501472 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7d7887b-kwj76"] Jun 11 16:58:27.502440 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:58:27.502415 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda9e2db2_2480_4eda_a18f_9c5ef0ae815c.slice/crio-2c324d84c6ede511ee52915ad818c839d00be423aa609b89b23ca11e2a110946 WatchSource:0}: Error finding container 2c324d84c6ede511ee52915ad818c839d00be423aa609b89b23ca11e2a110946: Status 404 returned error can't find the container with id 2c324d84c6ede511ee52915ad818c839d00be423aa609b89b23ca11e2a110946 Jun 11 16:58:27.614860 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.614822 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7d7887b-kwj76" event={"ID":"da9e2db2-2480-4eda-a18f-9c5ef0ae815c","Type":"ContainerStarted","Data":"ce9c6992fedb358d9938a13ec19ca07de38551624c9e29c11f4ab82fec4f65d4"} Jun 11 16:58:27.614999 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.614882 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7d7887b-kwj76" event={"ID":"da9e2db2-2480-4eda-a18f-9c5ef0ae815c","Type":"ContainerStarted","Data":"2c324d84c6ede511ee52915ad818c839d00be423aa609b89b23ca11e2a110946"} Jun 11 16:58:27.638333 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:27.638246 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b7d7887b-kwj76" podStartSLOduration=0.638230703 podStartE2EDuration="638.230703ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:58:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:58:27.636190296 +0000 UTC m=+2324.984298539" watchObservedRunningTime="2026-06-11 16:58:27.638230703 +0000 UTC m=+2324.986338953" Jun 11 16:58:37.370547 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:37.370456 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:37.370547 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:37.370539 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:37.375279 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:37.375260 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:37.674539 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:37.674455 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b7d7887b-kwj76" Jun 11 16:58:37.729065 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:37.729028 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77b6b9c9fb-xd8bv"] Jun 11 16:58:49.575406 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.575377 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l"] Jun 11 16:58:49.579235 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.579212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.583364 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.583341 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-93b04232-openshift-default-dockercfg-v55m8\"" Jun 11 16:58:49.596034 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.595982 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l"] Jun 11 16:58:49.745577 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.745546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-workload-socket\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.745744 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.745589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-istio-data\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.745744 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.745629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5237c8d5-237d-4397-b17c-601f731a6e49-istio-token\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.745744 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.745658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-credential-socket\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.745744 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.745681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-istio-envoy\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.745744 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.745729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5237c8d5-237d-4397-b17c-601f731a6e49-istio-podinfo\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.745915 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.745775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5237c8d5-237d-4397-b17c-601f731a6e49-istiod-ca-cert\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.745915 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.745802 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-workload-certs\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.745982 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.745912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt4gb\" (UniqueName: \"kubernetes.io/projected/5237c8d5-237d-4397-b17c-601f731a6e49-kube-api-access-zt4gb\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.846632 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.846534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-credential-socket\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.846632 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.846580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-istio-envoy\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.846632 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.846608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5237c8d5-237d-4397-b17c-601f731a6e49-istio-podinfo\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.846916 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.846653 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5237c8d5-237d-4397-b17c-601f731a6e49-istiod-ca-cert\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.846916 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.846700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-workload-certs\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.846916 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.846767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt4gb\" (UniqueName: \"kubernetes.io/projected/5237c8d5-237d-4397-b17c-601f731a6e49-kube-api-access-zt4gb\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.846916 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.846804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-workload-socket\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.847176 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.847089 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-credential-socket\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.847176 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.847090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-istio-data\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.847176 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.847166 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-workload-certs\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.847343 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.847170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5237c8d5-237d-4397-b17c-601f731a6e49-istio-token\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.847411 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.847345 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-istio-data\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.847411 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.847386 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-workload-socket\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.847486 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.847430 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5237c8d5-237d-4397-b17c-601f731a6e49-istiod-ca-cert\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.849451 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.849424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-istio-envoy\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.849601 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.849583 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5237c8d5-237d-4397-b17c-601f731a6e49-istio-podinfo\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.860822 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.860802 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5237c8d5-237d-4397-b17c-601f731a6e49-istio-token\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.861194 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.861173 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt4gb\" (UniqueName: \"kubernetes.io/projected/5237c8d5-237d-4397-b17c-601f731a6e49-kube-api-access-zt4gb\") pod \"e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:49.890951 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:49.890931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:50.030153 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:50.030118 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l"] Jun 11 16:58:50.030823 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:58:50.030795 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5237c8d5_237d_4397_b17c_601f731a6e49.slice/crio-91fe833c6537672001955f3fc50a00a9f75b29947a3ae65a490f1ff56fb67ff6 WatchSource:0}: Error finding container 91fe833c6537672001955f3fc50a00a9f75b29947a3ae65a490f1ff56fb67ff6: Status 404 returned error can't find the container with id 91fe833c6537672001955f3fc50a00a9f75b29947a3ae65a490f1ff56fb67ff6 Jun 11 16:58:50.033062 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:50.033027 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:58:50.033143 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:50.033094 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:58:50.033143 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:50.033120 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:58:50.745991 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:50.745952 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" event={"ID":"5237c8d5-237d-4397-b17c-601f731a6e49","Type":"ContainerStarted","Data":"47fe3fa2252f76229cc31f4f9565b962bebb9dc11c9f14fa0b71cd89f59aefed"} Jun 11 16:58:50.746391 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:50.746040 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" event={"ID":"5237c8d5-237d-4397-b17c-601f731a6e49","Type":"ContainerStarted","Data":"91fe833c6537672001955f3fc50a00a9f75b29947a3ae65a490f1ff56fb67ff6"} Jun 11 16:58:50.782621 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:50.782563 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" podStartSLOduration=1.782548812 podStartE2EDuration="1.782548812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:58:50.780337501 +0000 UTC m=+2348.128445732" watchObservedRunningTime="2026-06-11 16:58:50.782548812 +0000 UTC m=+2348.130657053" Jun 11 16:58:50.891779 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:50.891752 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:51.896331 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:51.896295 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:52.758082 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:52.758048 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:58:52.758959 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:58:52.758930 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:59:02.751390 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:02.751346 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-77b6b9c9fb-xd8bv" podUID="f625ca92-2e5b-4f8d-9612-5c8fa196e9ec" containerName="console" containerID="cri-o://ec8dd35dc2c21eb11b2c2403ec17d53064c393e54d408c2b34d9ace17f09d387" gracePeriod=15 Jun 11 16:59:03.005512 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.005457 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:59:03.073287 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.073254 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-trusted-ca-bundle\") pod \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " Jun 11 16:59:03.073446 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.073300 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-oauth-config\") pod \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " Jun 11 16:59:03.073446 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.073325 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-service-ca\") pod \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " Jun 11 16:59:03.073446 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.073425 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-oauth-serving-cert\") pod \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " Jun 11 16:59:03.073631 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.073496 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-serving-cert\") pod \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " Jun 11 16:59:03.073631 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.073520 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxhlg\" (UniqueName: \"kubernetes.io/projected/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-kube-api-access-jxhlg\") pod \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " Jun 11 16:59:03.073631 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.073542 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-config\") pod \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\" (UID: \"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec\") " Jun 11 16:59:03.073783 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.073612 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f625ca92-2e5b-4f8d-9612-5c8fa196e9ec" (UID: "f625ca92-2e5b-4f8d-9612-5c8fa196e9ec"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:59:03.073783 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.073727 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-service-ca" (OuterVolumeSpecName: "service-ca") pod "f625ca92-2e5b-4f8d-9612-5c8fa196e9ec" (UID: "f625ca92-2e5b-4f8d-9612-5c8fa196e9ec"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:59:03.073900 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.073783 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f625ca92-2e5b-4f8d-9612-5c8fa196e9ec" (UID: "f625ca92-2e5b-4f8d-9612-5c8fa196e9ec"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:59:03.074050 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.074004 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-config" (OuterVolumeSpecName: "console-config") pod "f625ca92-2e5b-4f8d-9612-5c8fa196e9ec" (UID: "f625ca92-2e5b-4f8d-9612-5c8fa196e9ec"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:59:03.074139 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.074095 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-trusted-ca-bundle\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:03.074139 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.074119 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-service-ca\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:03.074139 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.074134 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-oauth-serving-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:03.075649 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.075629 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f625ca92-2e5b-4f8d-9612-5c8fa196e9ec" (UID: "f625ca92-2e5b-4f8d-9612-5c8fa196e9ec"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:59:03.075734 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.075649 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f625ca92-2e5b-4f8d-9612-5c8fa196e9ec" (UID: "f625ca92-2e5b-4f8d-9612-5c8fa196e9ec"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:59:03.075734 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.075723 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-kube-api-access-jxhlg" (OuterVolumeSpecName: "kube-api-access-jxhlg") pod "f625ca92-2e5b-4f8d-9612-5c8fa196e9ec" (UID: "f625ca92-2e5b-4f8d-9612-5c8fa196e9ec"). InnerVolumeSpecName "kube-api-access-jxhlg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:59:03.175281 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.175254 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-serving-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:03.175281 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.175279 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxhlg\" (UniqueName: \"kubernetes.io/projected/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-kube-api-access-jxhlg\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:03.175432 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.175288 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-config\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:03.175432 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.175297 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec-console-oauth-config\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:03.821396 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.821357 2576 generic.go:356] "Generic (PLEG): container finished" podID="f625ca92-2e5b-4f8d-9612-5c8fa196e9ec" containerID="ec8dd35dc2c21eb11b2c2403ec17d53064c393e54d408c2b34d9ace17f09d387" exitCode=0 Jun 11 16:59:03.821845 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.821407 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77b6b9c9fb-xd8bv" Jun 11 16:59:03.821845 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.821446 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77b6b9c9fb-xd8bv" event={"ID":"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec","Type":"ContainerDied","Data":"ec8dd35dc2c21eb11b2c2403ec17d53064c393e54d408c2b34d9ace17f09d387"} Jun 11 16:59:03.821845 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.821499 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77b6b9c9fb-xd8bv" event={"ID":"f625ca92-2e5b-4f8d-9612-5c8fa196e9ec","Type":"ContainerDied","Data":"dc113bedd49b681cea8f6e38f6af972c387783f3d8f0f6499ffd50de5c44e45c"} Jun 11 16:59:03.821845 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.821521 2576 scope.go:117] "RemoveContainer" containerID="ec8dd35dc2c21eb11b2c2403ec17d53064c393e54d408c2b34d9ace17f09d387" Jun 11 16:59:03.830645 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.830629 2576 scope.go:117] "RemoveContainer" containerID="ec8dd35dc2c21eb11b2c2403ec17d53064c393e54d408c2b34d9ace17f09d387" Jun 11 16:59:03.830892 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:59:03.830874 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec8dd35dc2c21eb11b2c2403ec17d53064c393e54d408c2b34d9ace17f09d387\": container with ID starting with ec8dd35dc2c21eb11b2c2403ec17d53064c393e54d408c2b34d9ace17f09d387 not found: ID does not exist" containerID="ec8dd35dc2c21eb11b2c2403ec17d53064c393e54d408c2b34d9ace17f09d387" Jun 11 16:59:03.830962 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.830905 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec8dd35dc2c21eb11b2c2403ec17d53064c393e54d408c2b34d9ace17f09d387"} err="failed to get container status \"ec8dd35dc2c21eb11b2c2403ec17d53064c393e54d408c2b34d9ace17f09d387\": rpc error: code = NotFound desc = could not find container \"ec8dd35dc2c21eb11b2c2403ec17d53064c393e54d408c2b34d9ace17f09d387\": container with ID starting with ec8dd35dc2c21eb11b2c2403ec17d53064c393e54d408c2b34d9ace17f09d387 not found: ID does not exist" Jun 11 16:59:03.841145 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.841122 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77b6b9c9fb-xd8bv"] Jun 11 16:59:03.844861 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:03.844836 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77b6b9c9fb-xd8bv"] Jun 11 16:59:05.102695 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:05.102658 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f625ca92-2e5b-4f8d-9612-5c8fa196e9ec" path="/var/lib/kubelet/pods/f625ca92-2e5b-4f8d-9612-5c8fa196e9ec/volumes" Jun 11 16:59:10.015738 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:10.015702 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l"] Jun 11 16:59:10.016214 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:10.015903 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" podUID="5237c8d5-237d-4397-b17c-601f731a6e49" containerName="istio-proxy" containerID="cri-o://47fe3fa2252f76229cc31f4f9565b962bebb9dc11c9f14fa0b71cd89f59aefed" gracePeriod=30 Jun 11 16:59:15.268347 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.268318 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:59:15.282929 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.282874 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt4gb\" (UniqueName: \"kubernetes.io/projected/5237c8d5-237d-4397-b17c-601f731a6e49-kube-api-access-zt4gb\") pod \"5237c8d5-237d-4397-b17c-601f731a6e49\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " Jun 11 16:59:15.282929 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.282910 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-istio-data\") pod \"5237c8d5-237d-4397-b17c-601f731a6e49\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " Jun 11 16:59:15.283088 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.282940 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5237c8d5-237d-4397-b17c-601f731a6e49-istio-token\") pod \"5237c8d5-237d-4397-b17c-601f731a6e49\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " Jun 11 16:59:15.283088 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.282972 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5237c8d5-237d-4397-b17c-601f731a6e49-istio-podinfo\") pod \"5237c8d5-237d-4397-b17c-601f731a6e49\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " Jun 11 16:59:15.283088 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.283030 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5237c8d5-237d-4397-b17c-601f731a6e49-istiod-ca-cert\") pod \"5237c8d5-237d-4397-b17c-601f731a6e49\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " Jun 11 16:59:15.283088 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.283072 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-workload-socket\") pod \"5237c8d5-237d-4397-b17c-601f731a6e49\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " Jun 11 16:59:15.283256 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.283103 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-credential-socket\") pod \"5237c8d5-237d-4397-b17c-601f731a6e49\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " Jun 11 16:59:15.283256 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.283130 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-workload-certs\") pod \"5237c8d5-237d-4397-b17c-601f731a6e49\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " Jun 11 16:59:15.283256 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.283177 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-istio-envoy\") pod \"5237c8d5-237d-4397-b17c-601f731a6e49\" (UID: \"5237c8d5-237d-4397-b17c-601f731a6e49\") " Jun 11 16:59:15.283256 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.283181 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-istio-data" (OuterVolumeSpecName: "istio-data") pod "5237c8d5-237d-4397-b17c-601f731a6e49" (UID: "5237c8d5-237d-4397-b17c-601f731a6e49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:59:15.283712 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.283550 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-istio-data\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:15.283712 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.283622 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5237c8d5-237d-4397-b17c-601f731a6e49" (UID: "5237c8d5-237d-4397-b17c-601f731a6e49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:59:15.283860 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.283747 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5237c8d5-237d-4397-b17c-601f731a6e49" (UID: "5237c8d5-237d-4397-b17c-601f731a6e49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:59:15.283860 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.283789 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5237c8d5-237d-4397-b17c-601f731a6e49-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5237c8d5-237d-4397-b17c-601f731a6e49" (UID: "5237c8d5-237d-4397-b17c-601f731a6e49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:59:15.283977 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.283843 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5237c8d5-237d-4397-b17c-601f731a6e49" (UID: "5237c8d5-237d-4397-b17c-601f731a6e49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:59:15.285304 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.285271 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5237c8d5-237d-4397-b17c-601f731a6e49-kube-api-access-zt4gb" (OuterVolumeSpecName: "kube-api-access-zt4gb") pod "5237c8d5-237d-4397-b17c-601f731a6e49" (UID: "5237c8d5-237d-4397-b17c-601f731a6e49"). InnerVolumeSpecName "kube-api-access-zt4gb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:59:15.285406 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.285314 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5237c8d5-237d-4397-b17c-601f731a6e49" (UID: "5237c8d5-237d-4397-b17c-601f731a6e49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:59:15.285483 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.285463 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5237c8d5-237d-4397-b17c-601f731a6e49-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5237c8d5-237d-4397-b17c-601f731a6e49" (UID: "5237c8d5-237d-4397-b17c-601f731a6e49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 16:59:15.285731 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.285716 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5237c8d5-237d-4397-b17c-601f731a6e49-istio-token" (OuterVolumeSpecName: "istio-token") pod "5237c8d5-237d-4397-b17c-601f731a6e49" (UID: "5237c8d5-237d-4397-b17c-601f731a6e49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:59:15.384631 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.384604 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt4gb\" (UniqueName: \"kubernetes.io/projected/5237c8d5-237d-4397-b17c-601f731a6e49-kube-api-access-zt4gb\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:15.384631 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.384630 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5237c8d5-237d-4397-b17c-601f731a6e49-istio-token\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:15.384777 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.384640 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5237c8d5-237d-4397-b17c-601f731a6e49-istio-podinfo\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:15.384777 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.384648 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5237c8d5-237d-4397-b17c-601f731a6e49-istiod-ca-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:15.384777 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.384656 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-workload-socket\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:15.384777 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.384664 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-credential-socket\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:15.384777 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.384672 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-workload-certs\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:15.384777 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.384680 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5237c8d5-237d-4397-b17c-601f731a6e49-istio-envoy\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 16:59:15.892890 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.892855 2576 generic.go:356] "Generic (PLEG): container finished" podID="5237c8d5-237d-4397-b17c-601f731a6e49" containerID="47fe3fa2252f76229cc31f4f9565b962bebb9dc11c9f14fa0b71cd89f59aefed" exitCode=0 Jun 11 16:59:15.893094 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.892902 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" Jun 11 16:59:15.893094 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.892938 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" event={"ID":"5237c8d5-237d-4397-b17c-601f731a6e49","Type":"ContainerDied","Data":"47fe3fa2252f76229cc31f4f9565b962bebb9dc11c9f14fa0b71cd89f59aefed"} Jun 11 16:59:15.893094 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.892990 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l" event={"ID":"5237c8d5-237d-4397-b17c-601f731a6e49","Type":"ContainerDied","Data":"91fe833c6537672001955f3fc50a00a9f75b29947a3ae65a490f1ff56fb67ff6"} Jun 11 16:59:15.893094 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.893035 2576 scope.go:117] "RemoveContainer" containerID="47fe3fa2252f76229cc31f4f9565b962bebb9dc11c9f14fa0b71cd89f59aefed" Jun 11 16:59:15.903657 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.903638 2576 scope.go:117] "RemoveContainer" containerID="47fe3fa2252f76229cc31f4f9565b962bebb9dc11c9f14fa0b71cd89f59aefed" Jun 11 16:59:15.903943 ip-10-0-128-162 kubenswrapper[2576]: E0611 16:59:15.903920 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47fe3fa2252f76229cc31f4f9565b962bebb9dc11c9f14fa0b71cd89f59aefed\": container with ID starting with 47fe3fa2252f76229cc31f4f9565b962bebb9dc11c9f14fa0b71cd89f59aefed not found: ID does not exist" containerID="47fe3fa2252f76229cc31f4f9565b962bebb9dc11c9f14fa0b71cd89f59aefed" Jun 11 16:59:15.904005 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.903952 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47fe3fa2252f76229cc31f4f9565b962bebb9dc11c9f14fa0b71cd89f59aefed"} err="failed to get container status \"47fe3fa2252f76229cc31f4f9565b962bebb9dc11c9f14fa0b71cd89f59aefed\": rpc error: code = NotFound desc = could not find container \"47fe3fa2252f76229cc31f4f9565b962bebb9dc11c9f14fa0b71cd89f59aefed\": container with ID starting with 47fe3fa2252f76229cc31f4f9565b962bebb9dc11c9f14fa0b71cd89f59aefed not found: ID does not exist" Jun 11 16:59:15.917575 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.917546 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l"] Jun 11 16:59:15.920882 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:15.920858 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-93b04232-openshift-default-7cf88bdcf4-bb28l"] Jun 11 16:59:17.102957 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:17.102919 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5237c8d5-237d-4397-b17c-601f731a6e49" path="/var/lib/kubelet/pods/5237c8d5-237d-4397-b17c-601f731a6e49/volumes" Jun 11 16:59:33.432932 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.432899 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv"] Jun 11 16:59:33.433516 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.433498 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5237c8d5-237d-4397-b17c-601f731a6e49" containerName="istio-proxy" Jun 11 16:59:33.433590 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.433519 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5237c8d5-237d-4397-b17c-601f731a6e49" containerName="istio-proxy" Jun 11 16:59:33.433590 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.433554 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f625ca92-2e5b-4f8d-9612-5c8fa196e9ec" containerName="console" Jun 11 16:59:33.433590 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.433565 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f625ca92-2e5b-4f8d-9612-5c8fa196e9ec" containerName="console" Jun 11 16:59:33.433723 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.433663 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5237c8d5-237d-4397-b17c-601f731a6e49" containerName="istio-proxy" Jun 11 16:59:33.433723 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.433677 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f625ca92-2e5b-4f8d-9612-5c8fa196e9ec" containerName="console" Jun 11 16:59:33.437487 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.437466 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.445289 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.445254 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-66b31aca-openshift-default-dockercfg-qtljd\"" Jun 11 16:59:33.449543 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.449521 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv"] Jun 11 16:59:33.553221 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.553189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-workload-socket\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.553356 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.553234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-workload-certs\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.553356 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.553298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-token\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.553356 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.553316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istiod-ca-cert\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.553356 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.553336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-podinfo\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.553356 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.553352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44wv9\" (UniqueName: \"kubernetes.io/projected/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-kube-api-access-44wv9\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.553552 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.553438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-envoy\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.553552 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.553487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-credential-socket\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.553552 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.553505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-data\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.654024 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.653988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-token\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.654125 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.654053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istiod-ca-cert\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.654125 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.654086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-podinfo\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.654125 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.654110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44wv9\" (UniqueName: \"kubernetes.io/projected/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-kube-api-access-44wv9\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.654247 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.654165 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-envoy\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.654247 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.654214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-credential-socket\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.654388 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.654365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-data\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.654466 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.654417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-workload-socket\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.654529 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.654470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-workload-certs\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.654771 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.654734 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-data\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.654856 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.654815 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-workload-certs\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.654903 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.654855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-credential-socket\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.654903 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.654856 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-workload-socket\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.655054 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.655025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istiod-ca-cert\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.656617 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.656597 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-envoy\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.656826 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.656808 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-podinfo\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.662073 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.662051 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-token\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.662386 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.662370 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44wv9\" (UniqueName: \"kubernetes.io/projected/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-kube-api-access-44wv9\") pod \"e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.749535 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.749480 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:33.889448 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.889419 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv"] Jun 11 16:59:33.891121 ip-10-0-128-162 kubenswrapper[2576]: W0611 16:59:33.891095 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e87ff3_ece1_40bb_861b_fc018c3b3a2d.slice/crio-677a7395373993b724aa8a6551ef290ca5c97e19dc439e86149a18bffcc30995 WatchSource:0}: Error finding container 677a7395373993b724aa8a6551ef290ca5c97e19dc439e86149a18bffcc30995: Status 404 returned error can't find the container with id 677a7395373993b724aa8a6551ef290ca5c97e19dc439e86149a18bffcc30995 Jun 11 16:59:33.893611 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.893574 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:59:33.893683 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.893642 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:59:33.893725 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:33.893682 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 16:59:34.007190 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:34.007101 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" event={"ID":"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d","Type":"ContainerStarted","Data":"ce249f512bb441872bbfa7353126fb106b352fce89b3b6357251c97ecab26d76"} Jun 11 16:59:34.007190 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:34.007149 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" event={"ID":"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d","Type":"ContainerStarted","Data":"677a7395373993b724aa8a6551ef290ca5c97e19dc439e86149a18bffcc30995"} Jun 11 16:59:34.049255 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:34.049206 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" podStartSLOduration=1.04919027 podStartE2EDuration="1.04919027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:34.047361145 +0000 UTC m=+2391.395469376" watchObservedRunningTime="2026-06-11 16:59:34.04919027 +0000 UTC m=+2391.397298512" Jun 11 16:59:34.750244 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:34.750207 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:34.755136 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:34.755111 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:35.013815 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:35.013732 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 16:59:35.014756 ip-10-0-128-162 kubenswrapper[2576]: I0611 16:59:35.014735 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 17:01:50.333497 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:50.333460 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv"] Jun 11 17:01:50.336142 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:50.333645 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" podUID="e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" containerName="istio-proxy" containerID="cri-o://ce249f512bb441872bbfa7353126fb106b352fce89b3b6357251c97ecab26d76" gracePeriod=30 Jun 11 17:01:55.591676 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.591615 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 17:01:55.695354 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.695325 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44wv9\" (UniqueName: \"kubernetes.io/projected/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-kube-api-access-44wv9\") pod \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " Jun 11 17:01:55.695490 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.695371 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istiod-ca-cert\") pod \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " Jun 11 17:01:55.695490 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.695427 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-envoy\") pod \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " Jun 11 17:01:55.695490 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.695476 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-token\") pod \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " Jun 11 17:01:55.695652 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.695510 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-credential-socket\") pod \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " Jun 11 17:01:55.695652 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.695552 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-podinfo\") pod \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " Jun 11 17:01:55.695652 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.695613 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-workload-socket\") pod \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " Jun 11 17:01:55.695652 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.695641 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-workload-certs\") pod \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " Jun 11 17:01:55.695847 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.695668 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-data\") pod \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\" (UID: \"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d\") " Jun 11 17:01:55.695847 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.695784 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" (UID: "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:01:55.695962 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.695888 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" (UID: "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:01:55.695962 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.695906 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" (UID: "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:01:55.696134 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.696104 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" (UID: "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:01:55.696282 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.696129 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istiod-ca-cert\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 17:01:55.696417 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.696295 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-workload-socket\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 17:01:55.696417 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.696314 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-workload-certs\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 17:01:55.696417 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.696235 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" (UID: "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:01:55.697636 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.697604 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-kube-api-access-44wv9" (OuterVolumeSpecName: "kube-api-access-44wv9") pod "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" (UID: "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d"). InnerVolumeSpecName "kube-api-access-44wv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:01:55.697844 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.697818 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" (UID: "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:01:55.698206 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.698185 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" (UID: "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:01:55.698273 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.698202 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" (UID: "e5e87ff3-ece1-40bb-861b-fc018c3b3a2d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 17:01:55.796860 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.796841 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-envoy\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 17:01:55.796860 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.796860 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-token\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 17:01:55.796984 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.796869 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-credential-socket\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 17:01:55.796984 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.796878 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-podinfo\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 17:01:55.796984 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.796888 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-istio-data\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 17:01:55.796984 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.796896 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44wv9\" (UniqueName: \"kubernetes.io/projected/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d-kube-api-access-44wv9\") on node \"ip-10-0-128-162.ec2.internal\" DevicePath \"\"" Jun 11 17:01:55.808025 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.807982 2576 generic.go:356] "Generic (PLEG): container finished" podID="e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" containerID="ce249f512bb441872bbfa7353126fb106b352fce89b3b6357251c97ecab26d76" exitCode=0 Jun 11 17:01:55.808125 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.808048 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" Jun 11 17:01:55.808125 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.808065 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" event={"ID":"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d","Type":"ContainerDied","Data":"ce249f512bb441872bbfa7353126fb106b352fce89b3b6357251c97ecab26d76"} Jun 11 17:01:55.808125 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.808116 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv" event={"ID":"e5e87ff3-ece1-40bb-861b-fc018c3b3a2d","Type":"ContainerDied","Data":"677a7395373993b724aa8a6551ef290ca5c97e19dc439e86149a18bffcc30995"} Jun 11 17:01:55.808283 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.808130 2576 scope.go:117] "RemoveContainer" containerID="ce249f512bb441872bbfa7353126fb106b352fce89b3b6357251c97ecab26d76" Jun 11 17:01:55.818709 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.818689 2576 scope.go:117] "RemoveContainer" containerID="ce249f512bb441872bbfa7353126fb106b352fce89b3b6357251c97ecab26d76" Jun 11 17:01:55.818955 ip-10-0-128-162 kubenswrapper[2576]: E0611 17:01:55.818937 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce249f512bb441872bbfa7353126fb106b352fce89b3b6357251c97ecab26d76\": container with ID starting with ce249f512bb441872bbfa7353126fb106b352fce89b3b6357251c97ecab26d76 not found: ID does not exist" containerID="ce249f512bb441872bbfa7353126fb106b352fce89b3b6357251c97ecab26d76" Jun 11 17:01:55.819021 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.818963 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce249f512bb441872bbfa7353126fb106b352fce89b3b6357251c97ecab26d76"} err="failed to get container status \"ce249f512bb441872bbfa7353126fb106b352fce89b3b6357251c97ecab26d76\": rpc error: code = NotFound desc = could not find container \"ce249f512bb441872bbfa7353126fb106b352fce89b3b6357251c97ecab26d76\": container with ID starting with ce249f512bb441872bbfa7353126fb106b352fce89b3b6357251c97ecab26d76 not found: ID does not exist" Jun 11 17:01:55.834730 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.834710 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv"] Jun 11 17:01:55.845413 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:55.845361 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-66b31aca-openshift-default-57c6d54554-2klgv"] Jun 11 17:01:57.108779 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:01:57.108744 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" path="/var/lib/kubelet/pods/e5e87ff3-ece1-40bb-861b-fc018c3b3a2d/volumes" Jun 11 17:06:34.562503 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:34.562434 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56659f465f-nnqjn_26f3c5f7-744e-4790-820a-f77a3d142397/nginx/0.log" Jun 11 17:06:34.924440 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:34.924359 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6d6db4864c-b966h_de7cff8f-ff15-4f44-86fa-6c5a6a61fed1/maas-api/0.log" Jun 11 17:06:35.857493 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:35.857463 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc59bf699-qr5xs_0817c373-b9b9-440d-a5b2-18a11197c3eb/copy-manifests/0.log" Jun 11 17:06:35.870462 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:35.870433 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc59bf699-qr5xs_0817c373-b9b9-440d-a5b2-18a11197c3eb/manager/0.log" Jun 11 17:06:36.855769 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:36.855738 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk_ea73d3a4-8b9c-44b9-be2b-861330eabf5b/util/0.log" Jun 11 17:06:36.867188 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:36.867164 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk_ea73d3a4-8b9c-44b9-be2b-861330eabf5b/pull/0.log" Jun 11 17:06:36.886127 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:36.886107 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk_ea73d3a4-8b9c-44b9-be2b-861330eabf5b/extract/0.log" Jun 11 17:06:36.996483 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:36.996450 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6_24f8a056-45b7-4f9e-8d02-97b17a8a1504/util/0.log" Jun 11 17:06:37.003491 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:37.003467 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6_24f8a056-45b7-4f9e-8d02-97b17a8a1504/pull/0.log" Jun 11 17:06:37.010279 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:37.010256 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6_24f8a056-45b7-4f9e-8d02-97b17a8a1504/extract/0.log" Jun 11 17:06:37.119175 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:37.119102 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4_a4c28ca4-10de-43e4-8593-b4081857283f/util/0.log" Jun 11 17:06:37.129322 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:37.129301 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4_a4c28ca4-10de-43e4-8593-b4081857283f/pull/0.log" Jun 11 17:06:37.136885 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:37.136865 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4_a4c28ca4-10de-43e4-8593-b4081857283f/extract/0.log" Jun 11 17:06:37.250149 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:37.250123 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb_5135afff-fd51-4781-bde8-fd72bb4f82cc/util/0.log" Jun 11 17:06:37.256668 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:37.256646 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb_5135afff-fd51-4781-bde8-fd72bb4f82cc/pull/0.log" Jun 11 17:06:37.263074 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:37.263054 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb_5135afff-fd51-4781-bde8-fd72bb4f82cc/extract/0.log" Jun 11 17:06:37.497318 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:37.497242 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rssfj_b92c7392-f98d-4a35-81fa-e28049a18507/manager/0.log" Jun 11 17:06:37.614309 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:37.614280 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8jmjc_bbbe9fb3-c742-4de8-8661-03641d3a6424/manager/0.log" Jun 11 17:06:37.721694 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:37.721670 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-q7g76_98bf0ccf-0306-40fa-9301-896a8b09b781/kuadrant-console-plugin/0.log" Jun 11 17:06:37.836452 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:37.836421 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-s72r6_a55f0b41-59df-4769-9c61-18060cde2e98/registry-server/0.log" Jun 11 17:06:38.207770 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:38.207690 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dz6rk_e1374c8b-219c-44d1-b549-16c3da33d61d/manager/0.log" Jun 11 17:06:38.546558 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:38.546531 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gxv4q_194969eb-8b7a-4d4b-8858-bff5a5a8d739/istio-proxy/0.log" Jun 11 17:06:39.034573 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:39.034496 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5qscj_d0060b4a-d104-43f4-bd00-4355681ea0ae/istio-proxy/1.log" Jun 11 17:06:39.168320 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:39.168293 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-4fkln_77237469-4cd6-4def-882d-0a88cdb903ff/payload-pre-processing/0.log" Jun 11 17:06:39.416382 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:39.416354 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc6777d5f-vtflb_945f23b6-8d4c-4437-acf0-1905759b39d6/router/0.log" Jun 11 17:06:39.759847 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:39.759751 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc_f7701921-07d6-47f0-9e8c-e7413120dbac/storage-initializer/0.log" Jun 11 17:06:39.767536 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:39.767503 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-85lfc_f7701921-07d6-47f0-9e8c-e7413120dbac/main/0.log" Jun 11 17:06:40.154280 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:40.154250 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc_058f1084-2233-4201-af9e-cc7837fe48bd/storage-initializer/0.log" Jun 11 17:06:40.162237 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:40.162217 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn7fvc_058f1084-2233-4201-af9e-cc7837fe48bd/main/0.log" Jun 11 17:06:40.420640 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:40.420562 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-cjf52_c686192d-88a0-4db9-916f-8c26bffcf8c2/storage-initializer/0.log" Jun 11 17:06:40.435902 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:40.435877 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-cjf52_c686192d-88a0-4db9-916f-8c26bffcf8c2/main/0.log" Jun 11 17:06:48.405175 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:48.405142 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-97nhl_e803ad6b-ecb9-49c8-856f-a83161cd17ba/global-pull-secret-syncer/0.log" Jun 11 17:06:48.589871 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:48.589839 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-97sxp_dd8665d4-17a7-45de-a631-96cd8f57a51d/konnectivity-agent/0.log" Jun 11 17:06:48.699497 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:48.699402 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-162.ec2.internal_6cb48f7aa513b56b107622689ce0f5ee/haproxy/0.log" Jun 11 17:06:52.880363 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:52.880337 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk_ea73d3a4-8b9c-44b9-be2b-861330eabf5b/extract/0.log" Jun 11 17:06:53.074288 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:53.074257 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk_ea73d3a4-8b9c-44b9-be2b-861330eabf5b/util/0.log" Jun 11 17:06:53.381126 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:53.381097 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpcqk_ea73d3a4-8b9c-44b9-be2b-861330eabf5b/pull/0.log" Jun 11 17:06:53.506110 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:53.506077 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6_24f8a056-45b7-4f9e-8d02-97b17a8a1504/extract/0.log" Jun 11 17:06:53.617000 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:53.616970 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6_24f8a056-45b7-4f9e-8d02-97b17a8a1504/util/0.log" Jun 11 17:06:53.677659 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:53.677582 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdcd6_24f8a056-45b7-4f9e-8d02-97b17a8a1504/pull/0.log" Jun 11 17:06:53.785465 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:53.785438 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4_a4c28ca4-10de-43e4-8593-b4081857283f/extract/0.log" Jun 11 17:06:53.845323 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:53.845290 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4_a4c28ca4-10de-43e4-8593-b4081857283f/util/0.log" Jun 11 17:06:53.921502 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:53.921476 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xz9f4_a4c28ca4-10de-43e4-8593-b4081857283f/pull/0.log" Jun 11 17:06:53.993052 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:53.992964 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb_5135afff-fd51-4781-bde8-fd72bb4f82cc/extract/0.log" Jun 11 17:06:54.046132 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:54.046105 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb_5135afff-fd51-4781-bde8-fd72bb4f82cc/util/0.log" Jun 11 17:06:54.115632 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:54.115605 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nm8xb_5135afff-fd51-4781-bde8-fd72bb4f82cc/pull/0.log" Jun 11 17:06:54.552829 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:54.552803 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rssfj_b92c7392-f98d-4a35-81fa-e28049a18507/manager/0.log" Jun 11 17:06:54.610162 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:54.610137 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8jmjc_bbbe9fb3-c742-4de8-8661-03641d3a6424/manager/0.log" Jun 11 17:06:54.676674 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:54.676655 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-q7g76_98bf0ccf-0306-40fa-9301-896a8b09b781/kuadrant-console-plugin/0.log" Jun 11 17:06:54.753991 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:54.753959 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-s72r6_a55f0b41-59df-4769-9c61-18060cde2e98/registry-server/0.log" Jun 11 17:06:55.082492 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:55.082467 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dz6rk_e1374c8b-219c-44d1-b549-16c3da33d61d/manager/0.log" Jun 11 17:06:57.279384 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:57.279353 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-pwgds_c7913000-84b9-494b-9d88-dbf8359d90ef/kube-state-metrics/0.log" Jun 11 17:06:57.313743 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:57.313722 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-pwgds_c7913000-84b9-494b-9d88-dbf8359d90ef/kube-rbac-proxy-main/0.log" Jun 11 17:06:57.344950 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:57.344929 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-pwgds_c7913000-84b9-494b-9d88-dbf8359d90ef/kube-rbac-proxy-self/0.log" Jun 11 17:06:57.420212 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:57.420189 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-cmzgt_147c6a4c-6693-4389-a659-aac4727b6653/monitoring-plugin/0.log" Jun 11 17:06:57.455116 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:57.455095 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d9f9n_ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9/node-exporter/0.log" Jun 11 17:06:57.484724 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:57.484705 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d9f9n_ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9/kube-rbac-proxy/0.log" Jun 11 17:06:57.519151 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:57.519132 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d9f9n_ad956a33-5ca7-4d5b-a538-8ef0d2dc85f9/init-textfile/0.log" Jun 11 17:06:57.852638 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:57.852609 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wtphf_8163d10f-bc9b-49b7-99b5-af031d049845/kube-rbac-proxy-main/0.log" Jun 11 17:06:57.891670 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:57.891640 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wtphf_8163d10f-bc9b-49b7-99b5-af031d049845/kube-rbac-proxy-self/0.log" Jun 11 17:06:57.921934 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:57.921907 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wtphf_8163d10f-bc9b-49b7-99b5-af031d049845/openshift-state-metrics/0.log" Jun 11 17:06:58.252337 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:58.252258 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-m8fj5_923c0e61-c047-4c6a-a25a-5c35d59055c4/prometheus-operator/0.log" Jun 11 17:06:58.301029 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:58.300992 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-m8fj5_923c0e61-c047-4c6a-a25a-5c35d59055c4/kube-rbac-proxy/0.log" Jun 11 17:06:58.434472 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:58.434444 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85b6dc9799-qgrfn_c1ae5714-5bd1-46c7-b782-6eeddf373554/telemeter-client/0.log" Jun 11 17:06:58.499591 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:58.499567 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85b6dc9799-qgrfn_c1ae5714-5bd1-46c7-b782-6eeddf373554/reload/0.log" Jun 11 17:06:58.553911 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:58.553893 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85b6dc9799-qgrfn_c1ae5714-5bd1-46c7-b782-6eeddf373554/kube-rbac-proxy/0.log" Jun 11 17:06:59.497116 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.497087 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8"] Jun 11 17:06:59.497511 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.497456 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" containerName="istio-proxy" Jun 11 17:06:59.497511 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.497469 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" containerName="istio-proxy" Jun 11 17:06:59.497594 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.497545 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5e87ff3-ece1-40bb-861b-fc018c3b3a2d" containerName="istio-proxy" Jun 11 17:06:59.500612 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.500592 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.506533 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.506509 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47zhp\"/\"kube-root-ca.crt\"" Jun 11 17:06:59.506533 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.506522 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47zhp\"/\"openshift-service-ca.crt\"" Jun 11 17:06:59.507572 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.507549 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-47zhp\"/\"default-dockercfg-mbxvh\"" Jun 11 17:06:59.518781 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.518748 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8"] Jun 11 17:06:59.607389 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.607349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-825k8\" (UniqueName: \"kubernetes.io/projected/0980a328-4f13-4643-994f-b96aa514878c-kube-api-access-825k8\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.607560 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.607402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0980a328-4f13-4643-994f-b96aa514878c-podres\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.607560 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.607505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0980a328-4f13-4643-994f-b96aa514878c-lib-modules\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.607560 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.607544 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0980a328-4f13-4643-994f-b96aa514878c-sys\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.607671 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.607595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0980a328-4f13-4643-994f-b96aa514878c-proc\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.708430 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.708391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0980a328-4f13-4643-994f-b96aa514878c-proc\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.708592 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.708451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-825k8\" (UniqueName: \"kubernetes.io/projected/0980a328-4f13-4643-994f-b96aa514878c-kube-api-access-825k8\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.708592 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.708496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0980a328-4f13-4643-994f-b96aa514878c-podres\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.708592 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.708523 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0980a328-4f13-4643-994f-b96aa514878c-proc\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.708592 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.708528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0980a328-4f13-4643-994f-b96aa514878c-lib-modules\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.708592 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.708573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0980a328-4f13-4643-994f-b96aa514878c-sys\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.708756 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.708626 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0980a328-4f13-4643-994f-b96aa514878c-sys\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.708756 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.708636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0980a328-4f13-4643-994f-b96aa514878c-lib-modules\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.708756 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.708636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0980a328-4f13-4643-994f-b96aa514878c-podres\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.721719 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.721687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-825k8\" (UniqueName: \"kubernetes.io/projected/0980a328-4f13-4643-994f-b96aa514878c-kube-api-access-825k8\") pod \"perf-node-gather-daemonset-dwpr8\" (UID: \"0980a328-4f13-4643-994f-b96aa514878c\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.810953 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.810923 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:06:59.956673 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:06:59.956645 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8"] Jun 11 17:06:59.958603 ip-10-0-128-162 kubenswrapper[2576]: W0611 17:06:59.958578 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0980a328_4f13_4643_994f_b96aa514878c.slice/crio-5c07f8a2cb669f64d6773cb74ff3da15ad6e5c6ac252af97a834f079888d24ce WatchSource:0}: Error finding container 5c07f8a2cb669f64d6773cb74ff3da15ad6e5c6ac252af97a834f079888d24ce: Status 404 returned error can't find the container with id 5c07f8a2cb669f64d6773cb74ff3da15ad6e5c6ac252af97a834f079888d24ce Jun 11 17:07:00.529734 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:00.529700 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" event={"ID":"0980a328-4f13-4643-994f-b96aa514878c","Type":"ContainerStarted","Data":"1d8e15e2341ad06d79b8dbee1c4b3c372162410225875fa5021cf82685d342d9"} Jun 11 17:07:00.530149 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:00.529757 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" event={"ID":"0980a328-4f13-4643-994f-b96aa514878c","Type":"ContainerStarted","Data":"5c07f8a2cb669f64d6773cb74ff3da15ad6e5c6ac252af97a834f079888d24ce"} Jun 11 17:07:00.530149 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:00.529788 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:07:00.568973 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:00.568927 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" podStartSLOduration=1.56891222 podStartE2EDuration="1.56891222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:06:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:07:00.567488081 +0000 UTC m=+2837.915596315" watchObservedRunningTime="2026-06-11 17:07:00.56891222 +0000 UTC m=+2837.917020462" Jun 11 17:07:01.607142 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:01.607111 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b7d7887b-kwj76_da9e2db2-2480-4eda-a18f-9c5ef0ae815c/console/0.log" Jun 11 17:07:01.650986 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:01.650962 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-tbwkm_90c74d1b-a21e-495d-9e2c-1c521a9985e4/download-server/0.log" Jun 11 17:07:03.718893 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:03.718864 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6mlxp_6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31/dns/0.log" Jun 11 17:07:03.760678 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:03.760652 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6mlxp_6b4f8ff7-1fe0-4b85-8fd3-8abd8cdc6f31/kube-rbac-proxy/0.log" Jun 11 17:07:04.118992 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:04.118968 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bjzqb_afd82990-4b39-4fcb-8f26-39d82a8c9185/dns-node-resolver/0.log" Jun 11 17:07:04.923502 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:04.923472 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-75qf9_db0c1e0d-ef22-4054-8329-66ae378c4ce1/node-ca/0.log" Jun 11 17:07:06.198391 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:06.198350 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gxv4q_194969eb-8b7a-4d4b-8858-bff5a5a8d739/istio-proxy/0.log" Jun 11 17:07:06.545893 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:06.545808 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-dwpr8" Jun 11 17:07:06.688822 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:06.688793 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5qscj_d0060b4a-d104-43f4-bd00-4355681ea0ae/istio-proxy/0.log" Jun 11 17:07:06.719190 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:06.719166 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5qscj_d0060b4a-d104-43f4-bd00-4355681ea0ae/istio-proxy/1.log" Jun 11 17:07:06.785597 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:06.785571 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-4fkln_77237469-4cd6-4def-882d-0a88cdb903ff/payload-pre-processing/0.log" Jun 11 17:07:06.973556 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:06.973484 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc6777d5f-vtflb_945f23b6-8d4c-4437-acf0-1905759b39d6/router/0.log" Jun 11 17:07:07.797509 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:07.797479 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5qf6f_a134d59e-6da0-4275-9c4f-ad16541f41b1/serve-healthcheck-canary/0.log" Jun 11 17:07:08.629246 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:08.629222 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27k99_29f0d1bb-009d-451d-b890-4df05dae2e69/kube-rbac-proxy/0.log" Jun 11 17:07:08.665558 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:08.665535 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27k99_29f0d1bb-009d-451d-b890-4df05dae2e69/exporter/0.log" Jun 11 17:07:08.695523 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:08.695499 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27k99_29f0d1bb-009d-451d-b890-4df05dae2e69/extractor/0.log" Jun 11 17:07:11.820233 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:11.820210 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56659f465f-nnqjn_26f3c5f7-744e-4790-820a-f77a3d142397/nginx/0.log" Jun 11 17:07:12.238192 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:12.238105 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6d6db4864c-b966h_de7cff8f-ff15-4f44-86fa-6c5a6a61fed1/maas-api/0.log" Jun 11 17:07:12.590210 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:12.590183 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gxv4q_194969eb-8b7a-4d4b-8858-bff5a5a8d739/istio-proxy/0.log" Jun 11 17:07:13.077995 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:13.077969 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5qscj_d0060b4a-d104-43f4-bd00-4355681ea0ae/istio-proxy/0.log" Jun 11 17:07:13.116671 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:13.116641 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5qscj_d0060b4a-d104-43f4-bd00-4355681ea0ae/istio-proxy/1.log" Jun 11 17:07:13.192905 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:13.192880 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-4fkln_77237469-4cd6-4def-882d-0a88cdb903ff/payload-pre-processing/0.log" Jun 11 17:07:13.398850 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:13.398790 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc6777d5f-vtflb_945f23b6-8d4c-4437-acf0-1905759b39d6/router/0.log" Jun 11 17:07:13.529334 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:13.529307 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc59bf699-qr5xs_0817c373-b9b9-440d-a5b2-18a11197c3eb/manager/0.log" Jun 11 17:07:13.624413 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:13.624389 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc59bf699-qr5xs_0817c373-b9b9-440d-a5b2-18a11197c3eb/copy-manifests/0.log" Jun 11 17:07:14.727953 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:14.727924 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gxv4q_194969eb-8b7a-4d4b-8858-bff5a5a8d739/istio-proxy/0.log" Jun 11 17:07:15.237223 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:15.237192 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5qscj_d0060b4a-d104-43f4-bd00-4355681ea0ae/istio-proxy/0.log" Jun 11 17:07:15.267998 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:15.267969 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5qscj_d0060b4a-d104-43f4-bd00-4355681ea0ae/istio-proxy/1.log" Jun 11 17:07:15.302425 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:15.302402 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-4fkln_77237469-4cd6-4def-882d-0a88cdb903ff/payload-pre-processing/0.log" Jun 11 17:07:15.550902 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:15.550880 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc6777d5f-vtflb_945f23b6-8d4c-4437-acf0-1905759b39d6/router/0.log" Jun 11 17:07:15.566470 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:15.566450 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-595bc765c4-c7hjr_5e163fa8-fa4b-475d-832b-78ce153fdb3f/manager/0.log" Jun 11 17:07:15.770675 ip-10-0-128-162 kubenswrapper[2576]: I0611 17:07:15.770647 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4fzvm_2b0e0269-4ed2-4745-9810-f9d735af2813/openshift-lws-operator/0.log"