Jun 14 14:37:14.155840 ip-10-0-135-57 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 14 14:37:14.155851 ip-10-0-135-57 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 14 14:37:14.155859 ip-10-0-135-57 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 14 14:37:14.156101 ip-10-0-135-57 systemd[1]: Failed to start Kubernetes Kubelet. Jun 14 14:37:24.338350 ip-10-0-135-57 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 14 14:37:24.338365 ip-10-0-135-57 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ed69510324a1437999f4036530bbc614 -- Jun 14 14:39:27.013849 ip-10-0-135-57 systemd[1]: Starting Kubernetes Kubelet... Jun 14 14:39:27.405648 ip-10-0-135-57 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:39:27.405648 ip-10-0-135-57 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 14:39:27.405648 ip-10-0-135-57 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:39:27.405648 ip-10-0-135-57 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 14:39:27.406716 ip-10-0-135-57 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:39:27.407598 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.407505 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 14:39:27.412258 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412230 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:27.412258 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412250 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:27.412258 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412254 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:27.412258 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412257 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:27.412258 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412261 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:27.412258 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412264 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:27.412258 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412267 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:27.412258 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412269 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412272 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412275 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412278 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412280 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412283 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412285 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412288 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412291 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412293 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412296 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412299 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412302 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412304 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412307 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412309 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412312 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412316 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412321 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412324 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:27.412566 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412326 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412332 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412335 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412338 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412340 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412343 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412345 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412348 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412350 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412353 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412355 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412357 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412360 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412363 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412366 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412368 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412371 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412374 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412377 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:27.413041 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412379 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412382 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412385 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412387 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412390 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412393 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412395 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412398 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412400 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412403 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412405 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412408 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412410 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412413 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412417 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412421 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412424 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412426 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412429 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412432 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:27.413533 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412435 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412437 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412440 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412442 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412445 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412450 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412453 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412455 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412458 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412461 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412464 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412467 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412469 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412472 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412474 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412477 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412479 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412482 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412486 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412490 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:27.414031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412492 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412495 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412498 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412500 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412503 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412505 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412508 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412510 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412513 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412515 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412518 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412521 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.412523 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413238 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413244 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413247 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413250 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413253 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413256 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:27.414512 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413259 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413262 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413264 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413267 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413270 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413272 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413275 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413278 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413281 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413285 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413289 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413292 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413295 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413298 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413301 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413304 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413307 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413309 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413312 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:27.414980 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413315 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413317 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413320 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413322 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413325 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413328 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413330 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413333 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413336 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413338 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413341 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413344 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413348 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413351 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413354 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413356 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413359 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413361 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413364 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413367 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:27.415454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413370 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413372 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413375 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413377 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413380 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413383 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413385 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413388 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413391 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413393 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413396 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413399 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413401 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413404 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413406 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413409 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413412 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413414 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413417 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413421 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:27.415993 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413424 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413427 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413430 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413433 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413436 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413438 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413442 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413444 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413447 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413450 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413452 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413455 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413457 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413460 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413463 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413465 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413468 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413471 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413474 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:27.416484 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413477 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413480 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413484 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413487 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413490 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413492 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413495 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413497 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413500 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413503 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413506 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413509 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413511 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413514 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413516 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413885 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413891 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413894 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413897 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413900 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:27.416969 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413902 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413905 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413909 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413914 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413917 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413919 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413922 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413924 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413927 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413930 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413932 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413936 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413938 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413941 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413944 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413946 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413949 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413951 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413954 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:27.417454 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413956 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413959 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413962 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413964 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413967 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413969 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413972 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413974 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413977 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413984 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413986 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413989 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413992 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413994 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413997 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.413999 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414002 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414005 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414007 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414010 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:27.417934 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414013 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414015 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414018 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414020 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414023 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414027 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414029 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414034 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414037 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414041 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414044 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414046 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414049 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414053 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414056 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414059 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414061 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414064 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414067 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:27.418418 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414070 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414073 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414077 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414080 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414083 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414086 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414089 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414091 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414094 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414097 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414100 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414103 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414105 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414108 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414110 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414113 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414118 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414122 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414125 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:27.418893 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414128 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414131 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414134 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414136 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414139 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414142 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414144 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414147 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414149 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414152 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414155 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414157 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414160 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414162 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414164 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414169 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414171 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414246 2566 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414254 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414264 2566 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414270 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 14:39:27.419366 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414275 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414280 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414286 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414292 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414296 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414299 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414303 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414306 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414309 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414312 2566 flags.go:64] FLAG: --cgroup-root="" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414315 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414318 2566 flags.go:64] FLAG: --client-ca-file="" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414322 2566 flags.go:64] FLAG: --cloud-provider="external" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414325 2566 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414329 2566 flags.go:64] FLAG: --cluster-domain="" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414332 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414335 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414338 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414341 2566 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414346 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414349 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414352 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414355 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414358 2566 flags.go:64] FLAG: --contention-profiling="false" Jun 14 14:39:27.419883 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414360 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414365 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414370 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414372 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414376 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414379 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414382 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414385 2566 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414388 2566 flags.go:64] FLAG: --enable-server="true" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414390 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414395 2566 flags.go:64] FLAG: --event-burst="100" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414398 2566 flags.go:64] FLAG: --event-qps="50" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414401 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414404 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414407 2566 flags.go:64] FLAG: --eviction-hard="" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414411 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414414 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414416 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414419 2566 flags.go:64] FLAG: --eviction-soft="" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414422 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414425 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414429 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414431 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414434 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414437 2566 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 14:39:27.420458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414440 2566 flags.go:64] FLAG: --feature-gates="" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414444 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414447 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414450 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414452 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414456 2566 flags.go:64] FLAG: --healthz-port="10248" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414458 2566 flags.go:64] FLAG: --help="false" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414461 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414467 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414472 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414475 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414478 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414482 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414484 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414487 2566 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414490 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414493 2566 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414496 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414499 2566 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414503 2566 flags.go:64] FLAG: --kube-reserved="" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414506 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414508 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414511 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414515 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 14:39:27.421137 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414518 2566 flags.go:64] FLAG: --lock-file="" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414521 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414524 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414527 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414533 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414548 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414551 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414554 2566 flags.go:64] FLAG: --logging-format="text" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414557 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414560 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414563 2566 flags.go:64] FLAG: --manifest-url="" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414566 2566 flags.go:64] FLAG: --manifest-url-header="" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414570 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414573 2566 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414577 2566 flags.go:64] FLAG: --max-pods="110" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414580 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414585 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414588 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414592 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414594 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414597 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414600 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414607 2566 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414610 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414613 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 14:39:27.421721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414616 2566 flags.go:64] FLAG: --pod-cidr="" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414619 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414624 2566 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414627 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414630 2566 flags.go:64] FLAG: --pods-per-core="0" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414632 2566 flags.go:64] FLAG: --port="10250" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414635 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414638 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ecd3af36c318012e" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414642 2566 flags.go:64] FLAG: --qos-reserved="" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414645 2566 flags.go:64] FLAG: --read-only-port="10255" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414648 2566 flags.go:64] FLAG: --register-node="true" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414651 2566 flags.go:64] FLAG: --register-with-taints="" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414654 2566 flags.go:64] FLAG: --registry-burst="10" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414658 2566 flags.go:64] FLAG: --registry-qps="5" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414661 2566 flags.go:64] FLAG: --reserved-cpus="" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414664 2566 flags.go:64] FLAG: --reserved-memory="" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414668 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414670 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414673 2566 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414676 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414679 2566 flags.go:64] FLAG: --runonce="false" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414681 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414684 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414688 2566 flags.go:64] FLAG: --seccomp-default="false" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414691 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 14:39:27.422359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414695 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414698 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414701 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414704 2566 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414707 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414710 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414713 2566 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414716 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414719 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414721 2566 flags.go:64] FLAG: --system-cgroups="" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414724 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414729 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414732 2566 flags.go:64] FLAG: --tls-cert-file="" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414735 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414738 2566 flags.go:64] FLAG: --tls-min-version="" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414741 2566 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414744 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414747 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414750 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414752 2566 flags.go:64] FLAG: --v="2" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414756 2566 flags.go:64] FLAG: --version="false" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414761 2566 flags.go:64] FLAG: --vmodule="" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414765 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.414768 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414883 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:27.422984 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414887 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414890 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414893 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414896 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414899 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414904 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414906 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414909 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414912 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414914 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414917 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414919 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414922 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414925 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414927 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414931 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414935 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414938 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414940 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:27.423611 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414943 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414946 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414948 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414951 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414954 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414956 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414959 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414962 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414964 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414967 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414970 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414973 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414975 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414978 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414981 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414983 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414986 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414989 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414993 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414996 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:27.424057 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.414999 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415001 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415004 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415006 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415009 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415011 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415014 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415017 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415019 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415022 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415024 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415027 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415029 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415032 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415034 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415037 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415040 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415043 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415045 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415048 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:27.424588 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415050 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415053 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415056 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415059 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415061 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415064 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415066 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415069 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415071 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415074 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415079 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415082 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415085 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415087 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415090 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415092 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415095 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415098 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415100 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415103 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:27.425078 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415105 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415108 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415110 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415113 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415116 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415119 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415123 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415126 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415129 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415132 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415134 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415137 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415147 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415150 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415153 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415156 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415160 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415163 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:27.425592 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.415167 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:27.426035 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.415775 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:39:27.426035 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.422381 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 14:39:27.426035 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.422396 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 14:39:27.426035 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.423554 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 14:39:27.426035 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.423564 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 14:39:27.426035 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423636 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:27.426035 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423641 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:27.426035 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423645 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:27.426035 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423648 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:27.426035 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423651 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:27.426035 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423654 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:27.426035 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423656 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:27.426035 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423659 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:27.426035 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423662 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423666 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423670 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423673 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423676 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423679 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423682 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423685 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423688 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423692 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423694 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423697 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423701 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423704 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423707 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423710 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423713 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423716 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423719 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:27.426392 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423722 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423725 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423728 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423731 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423734 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423736 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423739 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423742 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423744 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423747 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423750 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423752 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423755 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423757 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423760 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423763 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423766 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423768 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423771 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423773 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:27.426871 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423776 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423778 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423781 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423783 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423786 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423788 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423791 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423794 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423796 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423799 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423802 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423804 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423807 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423810 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423814 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423816 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423819 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423822 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423824 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:27.427377 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423827 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423830 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423832 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423835 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423837 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423840 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423842 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423845 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423848 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423852 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423855 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423858 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423861 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423867 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423870 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423873 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423876 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423879 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423882 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:27.427843 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423885 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423887 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423890 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423893 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423896 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423899 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423901 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423904 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423908 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423910 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423913 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423916 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423918 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.423921 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.423926 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:39:27.428363 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424042 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424046 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424049 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424052 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424054 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424057 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424059 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424062 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424065 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424068 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424070 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424073 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424076 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424078 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424082 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424086 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424088 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424091 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424093 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424096 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:27.428867 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424099 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424102 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424104 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424107 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424110 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424112 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424115 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424117 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424120 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424122 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424125 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424127 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424130 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424132 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424135 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424137 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424140 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424143 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424145 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424148 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:27.429356 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424150 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424154 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424157 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424160 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424163 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424166 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424169 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424171 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424174 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424176 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424179 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424181 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424184 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424187 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424189 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424192 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424195 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424198 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424201 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:27.429938 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424203 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424205 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424208 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424212 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424215 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424218 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424221 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424224 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424226 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424229 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424232 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424235 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424237 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424240 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424242 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424245 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424247 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424250 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424253 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:27.430417 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424255 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424258 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424260 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424262 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424265 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424267 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424270 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424272 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424275 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424277 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424280 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424283 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424286 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424288 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424291 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424293 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424296 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424298 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424301 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424303 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:27.431122 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:27.424306 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:27.431858 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.424311 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:39:27.431858 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.424410 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 14:39:27.431858 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.426390 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 14:39:27.431858 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.427823 2566 server.go:1019] "Starting client certificate rotation" Jun 14 14:39:27.431858 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.427945 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 14:39:27.431858 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.428735 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 14:39:27.431858 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.430677 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 14:39:27.432583 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.432563 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 14:39:27.441610 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.441586 2566 log.go:25] "Validated CRI v1 runtime API" Jun 14 14:39:27.446863 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.446847 2566 log.go:25] "Validated CRI v1 image API" Jun 14 14:39:27.447643 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.447628 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 14:39:27.449974 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.449956 2566 fs.go:135] Filesystem UUIDs: map[0401c928-e960-4510-82ac-bdce9c6ae907:/dev/nvme0n1p3 32d64446-2e9f-4faf-95bf-0a32f920d553:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 14 14:39:27.450027 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.449974 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 14:39:27.455115 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.455099 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 14:39:27.455818 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.455721 2566 manager.go:216] Machine: {Timestamp:2026-06-14 14:39:27.454372687 +0000 UTC m=+0.325305991 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099647 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec205bfa6c64de1c5d493a55e80270d4 SystemUUID:ec205bfa-6c64-de1c-5d49-3a55e80270d4 BootID:ed695103-24a1-4379-99f4-036530bbc614 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ea:08:3d:12:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ea:08:3d:12:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:76:b3:b7:e5:15 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 14:39:27.455818 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.455817 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 14:39:27.455915 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.455888 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 14:39:27.459604 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.459583 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 14:39:27.459730 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.459607 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 14:39:27.460312 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.460302 2566 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 14:39:27.460344 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.460314 2566 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 14:39:27.460344 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.460321 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 14:39:27.461214 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.461204 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 14:39:27.462616 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.462603 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 14:39:27.465512 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.465500 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 14 14:39:27.465643 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.465633 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 14:39:27.465675 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.465664 2566 kubelet.go:486] "Attempting to sync node with API server" Jun 14 14:39:27.465701 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.465678 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 14:39:27.465728 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.465701 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 14:39:27.465728 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.465714 2566 kubelet.go:398] "Adding apiserver pod source" Jun 14 14:39:27.465728 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.465725 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 14:39:27.466040 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.466029 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 14:39:27.466083 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.466048 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 14:39:27.468155 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.468132 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 14:39:27.469380 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.469367 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 14:39:27.469436 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.469396 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 14:39:27.469535 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.469526 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 14:39:27.469581 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.469554 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 14:39:27.469581 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.469561 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 14:39:27.469581 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.469566 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 14:39:27.469581 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.469574 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 14:39:27.469581 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.469579 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 14:39:27.470124 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.470114 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 14:39:27.470124 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.470124 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 14:39:27.470183 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.470132 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 14:39:27.470183 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.470137 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 14:39:27.470183 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.470150 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 14:39:27.470183 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.470158 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 14:39:27.471838 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.471826 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 14:39:27.471892 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.471840 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 14:39:27.475026 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.475008 2566 server.go:1268] "Started kubelet" Jun 14 14:39:27.475509 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.475487 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 14:39:27.475807 ip-10-0-135-57 systemd[1]: Started Kubernetes Kubelet. Jun 14 14:39:27.479158 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.479113 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 14:39:27.479244 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.479194 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 14:39:27.479374 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.479350 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-spqnh" Jun 14 14:39:27.480698 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.480681 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 14:39:27.482076 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.482035 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 14:39:27.482076 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.482072 2566 server.go:310] "Adding debug handlers to kubelet server" Jun 14 14:39:27.482507 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:27.482485 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 14:39:27.482783 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:27.482758 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 14:39:27.482916 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.482889 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-spqnh" Jun 14 14:39:27.486419 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.486396 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 14:39:27.486419 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.486406 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 14:39:27.486567 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:27.486467 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-57.ec2.internal\" not found" Jun 14 14:39:27.487160 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.486988 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 14:39:27.487160 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.487135 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 14:39:27.487160 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.487152 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 14:39:27.487557 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.487292 2566 reconstruct.go:97] "Volume reconstruction finished" Jun 14 14:39:27.487557 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.487300 2566 reconciler.go:29] "Reconciler: start to sync state" Jun 14 14:39:27.487676 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.487616 2566 factory.go:55] Registering systemd factory Jun 14 14:39:27.487676 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.487630 2566 factory.go:223] Registration of the systemd container factory successfully Jun 14 14:39:27.487840 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.487823 2566 factory.go:153] Registering CRI-O factory Jun 14 14:39:27.487840 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.487841 2566 factory.go:223] Registration of the crio container factory successfully Jun 14 14:39:27.487945 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.487889 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 14:39:27.487945 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.487911 2566 factory.go:103] Registering Raw factory Jun 14 14:39:27.487945 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.487925 2566 manager.go:1196] Started watching for new ooms in manager Jun 14 14:39:27.488303 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.488289 2566 manager.go:349] Starting recovery of all containers Jun 14 14:39:27.491446 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.491421 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:27.492845 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.492825 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:27.494512 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:27.494348 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-57.ec2.internal\" not found" node="ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.499787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.499772 2566 manager.go:354] Recovery completed Jun 14 14:39:27.504316 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.504303 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:27.506194 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.506174 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-57.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:27.506256 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.506209 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:27.506256 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.506223 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-57.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:27.506688 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.506675 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 14:39:27.506741 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.506693 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:27.506741 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.506690 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 14:39:27.506741 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.506717 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 14 14:39:27.507360 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.507346 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-57.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:27.507398 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.507366 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:27.507398 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.507375 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-57.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:27.507817 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.507805 2566 policy_none.go:49] "None policy: Start" Jun 14 14:39:27.507855 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.507821 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 14:39:27.507855 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.507831 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 14:39:27.508815 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.508805 2566 policy_none.go:47] "Start" Jun 14 14:39:27.549271 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.549254 2566 manager.go:337] "Starting Device Plugin manager" Jun 14 14:39:27.559856 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:27.549291 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 14:39:27.559856 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.549304 2566 server.go:87] "Starting device plugin registration server" Jun 14 14:39:27.559856 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.549613 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 14:39:27.559856 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.549627 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 14:39:27.559856 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.549704 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 14:39:27.559856 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.549790 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 14:39:27.559856 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.549798 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 14:39:27.559856 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:27.550322 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 14:39:27.559856 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:27.550362 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-57.ec2.internal\" not found" Jun 14 14:39:27.559856 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.556943 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 14:39:27.559856 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.558073 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 14:39:27.559856 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.558121 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 14:39:27.559856 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.558142 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 14:39:27.559856 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:27.558174 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 14:39:27.560261 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.560188 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:27.650573 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.650525 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:27.651475 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.651461 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-57.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:27.651533 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.651488 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:27.651533 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.651499 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-57.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:27.651533 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.651519 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.658908 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.658892 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-57.ec2.internal"] Jun 14 14:39:27.658966 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.658947 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:27.660185 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.660173 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-57.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:27.660252 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.660198 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:27.660252 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.660209 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-57.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:27.660598 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.660584 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.661510 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.661495 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.662381 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.662366 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.687240 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.687218 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.687440 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.687426 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9f359032b5ba6a1a599342de8ccda48-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal\" (UID: \"e9f359032b5ba6a1a599342de8ccda48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.687490 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.687450 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9f359032b5ba6a1a599342de8ccda48-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal\" (UID: \"e9f359032b5ba6a1a599342de8ccda48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.687490 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.687473 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73d13947db166b6a6edbf8d9dacc9ada-config\") pod \"kube-apiserver-proxy-ip-10-0-135-57.ec2.internal\" (UID: \"73d13947db166b6a6edbf8d9dacc9ada\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.693148 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.693134 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.697398 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.697386 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.697903 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.697890 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 14:39:27.698959 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.698947 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.705707 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.705695 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 14:39:27.709470 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.709458 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 14:39:27.709506 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:27.709491 2566 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-57.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.712374 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.712362 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 14:39:27.712421 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:27.712390 2566 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.788059 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.788038 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73d13947db166b6a6edbf8d9dacc9ada-config\") pod \"kube-apiserver-proxy-ip-10-0-135-57.ec2.internal\" (UID: \"73d13947db166b6a6edbf8d9dacc9ada\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.788148 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.788071 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9f359032b5ba6a1a599342de8ccda48-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal\" (UID: \"e9f359032b5ba6a1a599342de8ccda48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.788148 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.788089 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9f359032b5ba6a1a599342de8ccda48-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal\" (UID: \"e9f359032b5ba6a1a599342de8ccda48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.788148 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.788125 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9f359032b5ba6a1a599342de8ccda48-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal\" (UID: \"e9f359032b5ba6a1a599342de8ccda48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.788148 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.788145 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9f359032b5ba6a1a599342de8ccda48-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal\" (UID: \"e9f359032b5ba6a1a599342de8ccda48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" Jun 14 14:39:27.788286 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:27.788150 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73d13947db166b6a6edbf8d9dacc9ada-config\") pod \"kube-apiserver-proxy-ip-10-0-135-57.ec2.internal\" (UID: \"73d13947db166b6a6edbf8d9dacc9ada\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-57.ec2.internal" Jun 14 14:39:28.007700 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.007635 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" Jun 14 14:39:28.012436 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.012419 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-57.ec2.internal" Jun 14 14:39:28.427960 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.427934 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 14:39:28.428658 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.428128 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 14:39:28.428658 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.428132 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 14:39:28.464604 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:28.464565 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d13947db166b6a6edbf8d9dacc9ada.slice/crio-0ebb1b4e6d7aa1753308eccaaad05f4c33b3a6a62d0c0c499c42b5c302067fbb WatchSource:0}: Error finding container 0ebb1b4e6d7aa1753308eccaaad05f4c33b3a6a62d0c0c499c42b5c302067fbb: Status 404 returned error can't find the container with id 0ebb1b4e6d7aa1753308eccaaad05f4c33b3a6a62d0c0c499c42b5c302067fbb Jun 14 14:39:28.464947 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:28.464927 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f359032b5ba6a1a599342de8ccda48.slice/crio-6cea1ca5c8ee19f58c876bb2a4825e40c1669fc2df0632e1ddbdb2a6042e83ee WatchSource:0}: Error finding container 6cea1ca5c8ee19f58c876bb2a4825e40c1669fc2df0632e1ddbdb2a6042e83ee: Status 404 returned error can't find the container with id 6cea1ca5c8ee19f58c876bb2a4825e40c1669fc2df0632e1ddbdb2a6042e83ee Jun 14 14:39:28.466045 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.466031 2566 apiserver.go:52] "Watching apiserver" Jun 14 14:39:28.470621 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.470600 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 14:39:28.472197 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.472177 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 14:39:28.474135 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.474104 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh","openshift-cluster-node-tuning-operator/tuned-bs88w","openshift-multus/multus-additional-cni-plugins-lvnnn","openshift-multus/multus-kxl4d","openshift-network-diagnostics/network-check-target-sqfcj","openshift-dns/node-resolver-24l22","openshift-image-registry/node-ca-mtw64","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal","openshift-multus/network-metrics-daemon-sshnr","openshift-network-operator/iptables-alerter-g4l9b","openshift-ovn-kubernetes/ovnkube-node-2mmbs","kube-system/global-pull-secret-syncer-hcw6x","kube-system/konnectivity-agent-j5x6f","kube-system/kube-apiserver-proxy-ip-10-0-135-57.ec2.internal"] Jun 14 14:39:28.476358 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.476332 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.477638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.477614 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.478089 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.478070 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 14:39:28.478254 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.478237 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 14:39:28.478482 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.478468 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jzk65\"" Jun 14 14:39:28.478559 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.478467 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 14:39:28.478699 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.478671 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.479200 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.479150 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:39:28.479497 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.479480 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vn789\"" Jun 14 14:39:28.479596 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.479527 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 14:39:28.479661 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.479626 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.480342 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.480318 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bssvr\"" Jun 14 14:39:28.480460 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.480444 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 14:39:28.480582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.480569 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 14:39:28.480647 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.480634 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 14:39:28.480783 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.480768 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 14:39:28.480875 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.480855 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:28.480957 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:28.480936 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:28.481095 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.481081 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 14:39:28.481164 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.481121 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 14:39:28.481232 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.481214 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6r9ck\"" Jun 14 14:39:28.481991 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.481972 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-24l22" Jun 14 14:39:28.483011 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.482993 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mtw64" Jun 14 14:39:28.483642 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.483626 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 14:39:28.483741 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.483638 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h96q6\"" Jun 14 14:39:28.483921 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.483902 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 14:39:28.484379 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.484205 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:28.484379 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:28.484347 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:28.484635 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.484616 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 14:39:28.484740 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.484726 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 14:39:28.484785 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.484728 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 14:39:28.484837 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.484823 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f9xbs\"" Jun 14 14:39:28.485682 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.485657 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g4l9b" Jun 14 14:39:28.486888 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.486849 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 14:39:28.486888 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.486860 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 14:34:27 +0000 UTC" deadline="2027-11-26 14:02:57.743564641 +0000 UTC" Jun 14 14:39:28.487077 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.486899 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12719h23m29.256669878s" Jun 14 14:39:28.487077 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.486914 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.487321 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.487263 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 14:39:28.487321 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.487321 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:39:28.487774 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.487645 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 14:39:28.487774 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.487671 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l2qhr\"" Jun 14 14:39:28.488390 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.488374 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:28.488496 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:28.488470 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:28.488743 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.488732 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 14:39:28.488986 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.488966 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zb7w9\"" Jun 14 14:39:28.489071 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.489013 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 14:39:28.489071 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.489029 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 14:39:28.489275 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.489261 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 14:39:28.489366 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.489325 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 14:39:28.489526 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.489511 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 14:39:28.489652 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.489638 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j5x6f" Jun 14 14:39:28.492153 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.491757 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 14:39:28.492153 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.491879 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-88nbh\"" Jun 14 14:39:28.492153 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.492061 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/853c09c4-64cc-443b-be20-c50c89c658b9-serviceca\") pod \"node-ca-mtw64\" (UID: \"853c09c4-64cc-443b-be20-c50c89c658b9\") " pod="openshift-image-registry/node-ca-mtw64" Jun 14 14:39:28.492153 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.492085 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 14:39:28.492153 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.492095 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be70807c-2293-4cd1-b20f-fcd454645178-host-slash\") pod \"iptables-alerter-g4l9b\" (UID: \"be70807c-2293-4cd1-b20f-fcd454645178\") " pod="openshift-network-operator/iptables-alerter-g4l9b" Jun 14 14:39:28.492153 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.492130 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-run-netns\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.492594 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.492166 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-run-ovn-kubernetes\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.492594 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.492204 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-etc-selinux\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.492806 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.492786 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d5a5116-e745-4723-b65d-ba4deb03b9a6-os-release\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.492868 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.492837 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-run-netns\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.492920 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.492878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-multus-conf-dir\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.492973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.492918 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sldjf\" (UniqueName: \"kubernetes.io/projected/26e41ccc-f684-4956-8587-6fde095a627c-kube-api-access-sldjf\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.492973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.492955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-sysctl-d\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.493106 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.492997 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-systemd\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.493361 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.493325 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-lib-modules\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.493466 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.493366 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d5a5116-e745-4723-b65d-ba4deb03b9a6-cnibin\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.493615 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.493477 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be70807c-2293-4cd1-b20f-fcd454645178-iptables-alerter-script\") pod \"iptables-alerter-g4l9b\" (UID: \"be70807c-2293-4cd1-b20f-fcd454645178\") " pod="openshift-network-operator/iptables-alerter-g4l9b" Jun 14 14:39:28.493615 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.493511 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-run-openvswitch\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.493615 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.493567 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-var-lib-kubelet\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.493881 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.493760 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-run-ovn\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.493994 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.493889 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/96baa92a-c1c7-4ca2-8d22-75c0621d5482-ovnkube-script-lib\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.493994 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.493958 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-etc-kubernetes\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.494103 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494062 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-multus-cni-dir\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.494787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494142 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-run-k8s-cni-cncf-io\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.494787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494190 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-sys\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.494787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494252 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-cnibin\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.494787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494370 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmgpw\" (UniqueName: \"kubernetes.io/projected/31d1b293-a88c-41f1-9f0b-e3abddee92e8-kube-api-access-rmgpw\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.494787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494456 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs6md\" (UniqueName: \"kubernetes.io/projected/853c09c4-64cc-443b-be20-c50c89c658b9-kube-api-access-rs6md\") pod \"node-ca-mtw64\" (UID: \"853c09c4-64cc-443b-be20-c50c89c658b9\") " pod="openshift-image-registry/node-ca-mtw64" Jun 14 14:39:28.494787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494528 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-log-socket\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.494787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494576 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-cni-bin\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.494787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494613 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/96baa92a-c1c7-4ca2-8d22-75c0621d5482-env-overrides\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.494787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494646 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-registration-dir\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.494787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494680 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-sys-fs\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.494787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494722 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-kubelet\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.494787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494778 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/96baa92a-c1c7-4ca2-8d22-75c0621d5482-ovnkube-config\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.495429 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494818 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/96baa92a-c1c7-4ca2-8d22-75c0621d5482-ovn-node-metrics-cert\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.495429 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494851 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b-hosts-file\") pod \"node-resolver-24l22\" (UID: \"b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b\") " pod="openshift-dns/node-resolver-24l22" Jun 14 14:39:28.495429 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494893 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44d32134-7e4e-4026-9157-bcb08b28a558-kubelet-config\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:28.495429 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.494947 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-system-cni-dir\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.495429 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495020 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqzw2\" (UniqueName: \"kubernetes.io/projected/81fade08-631d-4392-b10c-7df855c0be42-kube-api-access-bqzw2\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.495429 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495074 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/31d1b293-a88c-41f1-9f0b-e3abddee92e8-multus-daemon-config\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.495429 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495155 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mpn2\" (UniqueName: \"kubernetes.io/projected/6d5a5116-e745-4723-b65d-ba4deb03b9a6-kube-api-access-9mpn2\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.495429 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495216 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/853c09c4-64cc-443b-be20-c50c89c658b9-host\") pod \"node-ca-mtw64\" (UID: \"853c09c4-64cc-443b-be20-c50c89c658b9\") " pod="openshift-image-registry/node-ca-mtw64" Jun 14 14:39:28.495429 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495243 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-host\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.495429 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495276 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d5a5116-e745-4723-b65d-ba4deb03b9a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.495429 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495300 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-systemd-units\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.495429 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495344 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-run-systemd\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.495429 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495380 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-node-log\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495441 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495487 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-sysctl-conf\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495527 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-run\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495585 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81fade08-631d-4392-b10c-7df855c0be42-etc-tuned\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495606 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31d1b293-a88c-41f1-9f0b-e3abddee92e8-cni-binary-copy\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495633 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-kubernetes\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495673 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-var-lib-kubelet\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495698 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-hostroot\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495748 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-etc-openvswitch\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495787 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495814 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-socket-dir\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495840 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-device-dir\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495881 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-sysconfig\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495903 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gn42\" (UniqueName: \"kubernetes.io/projected/b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b-kube-api-access-7gn42\") pod \"node-resolver-24l22\" (UID: \"b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b\") " pod="openshift-dns/node-resolver-24l22" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495944 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggp2l\" (UniqueName: \"kubernetes.io/projected/be70807c-2293-4cd1-b20f-fcd454645178-kube-api-access-ggp2l\") pod \"iptables-alerter-g4l9b\" (UID: \"be70807c-2293-4cd1-b20f-fcd454645178\") " pod="openshift-network-operator/iptables-alerter-g4l9b" Jun 14 14:39:28.496044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.495970 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-cni-netd\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.496747 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.496034 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d5a5116-e745-4723-b65d-ba4deb03b9a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.496747 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.496096 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-multus-socket-dir-parent\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.496747 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.496232 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-var-lib-cni-multus\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.496747 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.496418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:28.496747 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.496493 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-os-release\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.496747 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.496556 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv679\" (UniqueName: \"kubernetes.io/projected/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-kube-api-access-wv679\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:28.496747 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.496593 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b-tmp-dir\") pod \"node-resolver-24l22\" (UID: \"b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b\") " pod="openshift-dns/node-resolver-24l22" Jun 14 14:39:28.496747 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.496624 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d5a5116-e745-4723-b65d-ba4deb03b9a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.496747 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.496712 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d5a5116-e745-4723-b65d-ba4deb03b9a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.497038 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.496765 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-run-multus-certs\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.497038 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.496804 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:28.497200 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.497182 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-slash\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.497257 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.497215 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44d32134-7e4e-4026-9157-bcb08b28a558-dbus\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:28.497257 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.497235 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h6dj\" (UniqueName: \"kubernetes.io/projected/96baa92a-c1c7-4ca2-8d22-75c0621d5482-kube-api-access-7h6dj\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.497355 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.497280 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-modprobe-d\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.497355 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.497306 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81fade08-631d-4392-b10c-7df855c0be42-tmp\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.497355 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.497337 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vx5v\" (UniqueName: \"kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v\") pod \"network-check-target-sqfcj\" (UID: \"04442159-4235-4fda-aec1-49808474e1ce\") " pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:28.497491 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.497362 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-var-lib-openvswitch\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.497491 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.497387 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d5a5116-e745-4723-b65d-ba4deb03b9a6-system-cni-dir\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.497491 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.497408 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-var-lib-cni-bin\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.500551 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.500520 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 14:39:28.521013 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.520993 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vmg5g" Jun 14 14:39:28.527991 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.527976 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vmg5g" Jun 14 14:39:28.561082 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.561031 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-57.ec2.internal" event={"ID":"73d13947db166b6a6edbf8d9dacc9ada","Type":"ContainerStarted","Data":"0ebb1b4e6d7aa1753308eccaaad05f4c33b3a6a62d0c0c499c42b5c302067fbb"} Jun 14 14:39:28.562097 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.562071 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" event={"ID":"e9f359032b5ba6a1a599342de8ccda48","Type":"ContainerStarted","Data":"6cea1ca5c8ee19f58c876bb2a4825e40c1669fc2df0632e1ddbdb2a6042e83ee"} Jun 14 14:39:28.582721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.582692 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:28.587611 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.587591 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 14:39:28.597644 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.597621 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d5a5116-e745-4723-b65d-ba4deb03b9a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.597753 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.597654 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-systemd-units\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.597753 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.597691 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-run-systemd\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.597753 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.597714 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-node-log\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.597878 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.597750 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-systemd-units\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.597878 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.597766 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-run-systemd\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.597878 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.597751 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.597878 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.597791 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.597878 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.597807 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-node-log\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.597878 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.597822 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-sysctl-conf\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.597878 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.597854 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-run\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.598177 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.597988 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81fade08-631d-4392-b10c-7df855c0be42-etc-tuned\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.598177 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598016 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31d1b293-a88c-41f1-9f0b-e3abddee92e8-cni-binary-copy\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.598177 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598022 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-run\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.598177 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598038 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-kubernetes\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.598177 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598036 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-sysctl-conf\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.598177 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598064 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-var-lib-kubelet\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.598177 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598091 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-hostroot\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.598177 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598122 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-etc-openvswitch\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.598177 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598146 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.598177 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598154 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-var-lib-kubelet\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598182 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-hostroot\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598178 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-socket-dir\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598208 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-etc-openvswitch\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598270 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598317 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-device-dir\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598334 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-socket-dir\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598362 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-sysconfig\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598397 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598416 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-device-dir\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598416 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gn42\" (UniqueName: \"kubernetes.io/projected/b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b-kube-api-access-7gn42\") pod \"node-resolver-24l22\" (UID: \"b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b\") " pod="openshift-dns/node-resolver-24l22" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598447 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-sysconfig\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598465 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggp2l\" (UniqueName: \"kubernetes.io/projected/be70807c-2293-4cd1-b20f-fcd454645178-kube-api-access-ggp2l\") pod \"iptables-alerter-g4l9b\" (UID: \"be70807c-2293-4cd1-b20f-fcd454645178\") " pod="openshift-network-operator/iptables-alerter-g4l9b" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598495 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-cni-netd\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598511 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d5a5116-e745-4723-b65d-ba4deb03b9a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598524 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d5a5116-e745-4723-b65d-ba4deb03b9a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598588 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-multus-socket-dir-parent\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.598638 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598617 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-var-lib-cni-multus\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598647 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598654 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-cni-netd\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598672 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-os-release\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598701 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv679\" (UniqueName: \"kubernetes.io/projected/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-kube-api-access-wv679\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598715 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-kubernetes\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598754 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-multus-socket-dir-parent\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598750 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b-tmp-dir\") pod \"node-resolver-24l22\" (UID: \"b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b\") " pod="openshift-dns/node-resolver-24l22" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:28.598804 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598873 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-os-release\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:28.598879 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret podName:44d32134-7e4e-4026-9157-bcb08b28a558 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:29.098846678 +0000 UTC m=+1.969779971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret") pod "global-pull-secret-syncer-hcw6x" (UID: "44d32134-7e4e-4026-9157-bcb08b28a558") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598805 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d5a5116-e745-4723-b65d-ba4deb03b9a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598933 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d5a5116-e745-4723-b65d-ba4deb03b9a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598960 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-run-multus-certs\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.598989 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599000 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d5a5116-e745-4723-b65d-ba4deb03b9a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599011 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-slash\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.599318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599038 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44d32134-7e4e-4026-9157-bcb08b28a558-dbus\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599064 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h6dj\" (UniqueName: \"kubernetes.io/projected/96baa92a-c1c7-4ca2-8d22-75c0621d5482-kube-api-access-7h6dj\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599088 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b-tmp-dir\") pod \"node-resolver-24l22\" (UID: \"b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b\") " pod="openshift-dns/node-resolver-24l22" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599092 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-var-lib-cni-multus\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599137 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-slash\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599090 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-modprobe-d\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599252 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-modprobe-d\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599237 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81fade08-631d-4392-b10c-7df855c0be42-tmp\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599280 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44d32134-7e4e-4026-9157-bcb08b28a558-dbus\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599310 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vx5v\" (UniqueName: \"kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v\") pod \"network-check-target-sqfcj\" (UID: \"04442159-4235-4fda-aec1-49808474e1ce\") " pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599352 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-var-lib-openvswitch\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599416 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4-agent-certs\") pod \"konnectivity-agent-j5x6f\" (UID: \"6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4\") " pod="kube-system/konnectivity-agent-j5x6f" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4-konnectivity-ca\") pod \"konnectivity-agent-j5x6f\" (UID: \"6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4\") " pod="kube-system/konnectivity-agent-j5x6f" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599573 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-var-lib-openvswitch\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599590 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d5a5116-e745-4723-b65d-ba4deb03b9a6-system-cni-dir\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599622 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-var-lib-cni-bin\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599605 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31d1b293-a88c-41f1-9f0b-e3abddee92e8-cni-binary-copy\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.600168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599670 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/853c09c4-64cc-443b-be20-c50c89c658b9-serviceca\") pod \"node-ca-mtw64\" (UID: \"853c09c4-64cc-443b-be20-c50c89c658b9\") " pod="openshift-image-registry/node-ca-mtw64" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599696 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be70807c-2293-4cd1-b20f-fcd454645178-host-slash\") pod \"iptables-alerter-g4l9b\" (UID: \"be70807c-2293-4cd1-b20f-fcd454645178\") " pod="openshift-network-operator/iptables-alerter-g4l9b" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599717 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-var-lib-cni-bin\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599750 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-run-netns\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599729 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d5a5116-e745-4723-b65d-ba4deb03b9a6-system-cni-dir\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599782 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-run-ovn-kubernetes\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599826 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be70807c-2293-4cd1-b20f-fcd454645178-host-slash\") pod \"iptables-alerter-g4l9b\" (UID: \"be70807c-2293-4cd1-b20f-fcd454645178\") " pod="openshift-network-operator/iptables-alerter-g4l9b" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599851 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-etc-selinux\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599876 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-run-netns\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599899 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d5a5116-e745-4723-b65d-ba4deb03b9a6-os-release\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600306 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-run-netns\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600333 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-multus-conf-dir\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599933 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-run-ovn-kubernetes\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600018 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-etc-selinux\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600114 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d5a5116-e745-4723-b65d-ba4deb03b9a6-os-release\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599984 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-run-multus-certs\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:28.600129 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.599876 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d5a5116-e745-4723-b65d-ba4deb03b9a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.600973 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600227 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d5a5116-e745-4723-b65d-ba4deb03b9a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600361 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sldjf\" (UniqueName: \"kubernetes.io/projected/26e41ccc-f684-4956-8587-6fde095a627c-kube-api-access-sldjf\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600233 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/853c09c4-64cc-443b-be20-c50c89c658b9-serviceca\") pod \"node-ca-mtw64\" (UID: \"853c09c4-64cc-443b-be20-c50c89c658b9\") " pod="openshift-image-registry/node-ca-mtw64" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:28.600423 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs podName:1ad0defa-5fcf-4913-a2f5-1db88760d8fe nodeName:}" failed. No retries permitted until 2026-06-14 14:39:29.100408818 +0000 UTC m=+1.971342109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs") pod "network-metrics-daemon-sshnr" (UID: "1ad0defa-5fcf-4913-a2f5-1db88760d8fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600450 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-sysctl-d\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600500 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-run-netns\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600496 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-multus-conf-dir\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600579 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-systemd\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600602 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-lib-modules\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600647 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-sysctl-d\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600675 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-etc-systemd\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600714 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d5a5116-e745-4723-b65d-ba4deb03b9a6-cnibin\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600735 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-lib-modules\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600740 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be70807c-2293-4cd1-b20f-fcd454645178-iptables-alerter-script\") pod \"iptables-alerter-g4l9b\" (UID: \"be70807c-2293-4cd1-b20f-fcd454645178\") " pod="openshift-network-operator/iptables-alerter-g4l9b" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600759 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d5a5116-e745-4723-b65d-ba4deb03b9a6-cnibin\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600766 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-run-openvswitch\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600792 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-var-lib-kubelet\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.601801 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600816 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-run-ovn\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600824 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-run-openvswitch\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600841 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/96baa92a-c1c7-4ca2-8d22-75c0621d5482-ovnkube-script-lib\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600880 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-etc-kubernetes\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600898 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-run-ovn\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600907 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-multus-cni-dir\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600898 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-var-lib-kubelet\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600944 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-run-k8s-cni-cncf-io\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600970 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-sys\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600976 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-etc-kubernetes\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.600998 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-cnibin\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601027 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmgpw\" (UniqueName: \"kubernetes.io/projected/31d1b293-a88c-41f1-9f0b-e3abddee92e8-kube-api-access-rmgpw\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601027 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-host-run-k8s-cni-cncf-io\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601097 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-multus-cni-dir\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601104 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-sys\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601130 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs6md\" (UniqueName: \"kubernetes.io/projected/853c09c4-64cc-443b-be20-c50c89c658b9-kube-api-access-rs6md\") pod \"node-ca-mtw64\" (UID: \"853c09c4-64cc-443b-be20-c50c89c658b9\") " pod="openshift-image-registry/node-ca-mtw64" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601164 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-cnibin\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601169 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-log-socket\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.602582 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601202 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-cni-bin\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601226 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-log-socket\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601233 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/96baa92a-c1c7-4ca2-8d22-75c0621d5482-env-overrides\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601267 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be70807c-2293-4cd1-b20f-fcd454645178-iptables-alerter-script\") pod \"iptables-alerter-g4l9b\" (UID: \"be70807c-2293-4cd1-b20f-fcd454645178\") " pod="openshift-network-operator/iptables-alerter-g4l9b" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601298 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-registration-dir\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601328 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-sys-fs\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601353 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-kubelet\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601424 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-kubelet\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601493 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-registration-dir\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601558 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96baa92a-c1c7-4ca2-8d22-75c0621d5482-host-cni-bin\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601555 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/96baa92a-c1c7-4ca2-8d22-75c0621d5482-ovnkube-script-lib\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601588 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/96baa92a-c1c7-4ca2-8d22-75c0621d5482-ovnkube-config\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601615 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/96baa92a-c1c7-4ca2-8d22-75c0621d5482-ovn-node-metrics-cert\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601564 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26e41ccc-f684-4956-8587-6fde095a627c-sys-fs\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601646 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b-hosts-file\") pod \"node-resolver-24l22\" (UID: \"b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b\") " pod="openshift-dns/node-resolver-24l22" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601686 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44d32134-7e4e-4026-9157-bcb08b28a558-kubelet-config\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601714 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-system-cni-dir\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.603346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601783 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/96baa92a-c1c7-4ca2-8d22-75c0621d5482-env-overrides\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.604134 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601794 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzw2\" (UniqueName: \"kubernetes.io/projected/81fade08-631d-4392-b10c-7df855c0be42-kube-api-access-bqzw2\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.604134 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601849 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b-hosts-file\") pod \"node-resolver-24l22\" (UID: \"b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b\") " pod="openshift-dns/node-resolver-24l22" Jun 14 14:39:28.604134 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601881 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44d32134-7e4e-4026-9157-bcb08b28a558-kubelet-config\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:28.604134 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/31d1b293-a88c-41f1-9f0b-e3abddee92e8-multus-daemon-config\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.604134 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.601941 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31d1b293-a88c-41f1-9f0b-e3abddee92e8-system-cni-dir\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.604134 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.602452 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81fade08-631d-4392-b10c-7df855c0be42-tmp\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.604134 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.602508 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81fade08-631d-4392-b10c-7df855c0be42-etc-tuned\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.604134 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.602652 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mpn2\" (UniqueName: \"kubernetes.io/projected/6d5a5116-e745-4723-b65d-ba4deb03b9a6-kube-api-access-9mpn2\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.604134 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.602719 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/853c09c4-64cc-443b-be20-c50c89c658b9-host\") pod \"node-ca-mtw64\" (UID: \"853c09c4-64cc-443b-be20-c50c89c658b9\") " pod="openshift-image-registry/node-ca-mtw64" Jun 14 14:39:28.604134 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.602842 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/96baa92a-c1c7-4ca2-8d22-75c0621d5482-ovnkube-config\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.604134 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.602983 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-host\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.604134 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.603194 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/853c09c4-64cc-443b-be20-c50c89c658b9-host\") pod \"node-ca-mtw64\" (UID: \"853c09c4-64cc-443b-be20-c50c89c658b9\") " pod="openshift-image-registry/node-ca-mtw64" Jun 14 14:39:28.604134 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.603267 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81fade08-631d-4392-b10c-7df855c0be42-host\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.604134 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.603912 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/31d1b293-a88c-41f1-9f0b-e3abddee92e8-multus-daemon-config\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.604795 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.604755 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/96baa92a-c1c7-4ca2-8d22-75c0621d5482-ovn-node-metrics-cert\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.605678 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:28.605659 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:28.605764 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:28.605686 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:28.605764 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:28.605700 2566 projected.go:196] Error preparing data for projected volume kube-api-access-6vx5v for pod openshift-network-diagnostics/network-check-target-sqfcj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:28.605764 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:28.605759 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v podName:04442159-4235-4fda-aec1-49808474e1ce nodeName:}" failed. No retries permitted until 2026-06-14 14:39:29.105743744 +0000 UTC m=+1.976677040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6vx5v" (UniqueName: "kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v") pod "network-check-target-sqfcj" (UID: "04442159-4235-4fda-aec1-49808474e1ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:28.607903 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.607872 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggp2l\" (UniqueName: \"kubernetes.io/projected/be70807c-2293-4cd1-b20f-fcd454645178-kube-api-access-ggp2l\") pod \"iptables-alerter-g4l9b\" (UID: \"be70807c-2293-4cd1-b20f-fcd454645178\") " pod="openshift-network-operator/iptables-alerter-g4l9b" Jun 14 14:39:28.608005 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.607921 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv679\" (UniqueName: \"kubernetes.io/projected/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-kube-api-access-wv679\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:28.608005 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.607928 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sldjf\" (UniqueName: \"kubernetes.io/projected/26e41ccc-f684-4956-8587-6fde095a627c-kube-api-access-sldjf\") pod \"aws-ebs-csi-driver-node-224dh\" (UID: \"26e41ccc-f684-4956-8587-6fde095a627c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.608299 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.608279 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h6dj\" (UniqueName: \"kubernetes.io/projected/96baa92a-c1c7-4ca2-8d22-75c0621d5482-kube-api-access-7h6dj\") pod \"ovnkube-node-2mmbs\" (UID: \"96baa92a-c1c7-4ca2-8d22-75c0621d5482\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.608694 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.608677 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gn42\" (UniqueName: \"kubernetes.io/projected/b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b-kube-api-access-7gn42\") pod \"node-resolver-24l22\" (UID: \"b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b\") " pod="openshift-dns/node-resolver-24l22" Jun 14 14:39:28.613046 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.613022 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs6md\" (UniqueName: \"kubernetes.io/projected/853c09c4-64cc-443b-be20-c50c89c658b9-kube-api-access-rs6md\") pod \"node-ca-mtw64\" (UID: \"853c09c4-64cc-443b-be20-c50c89c658b9\") " pod="openshift-image-registry/node-ca-mtw64" Jun 14 14:39:28.613320 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.613294 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmgpw\" (UniqueName: \"kubernetes.io/projected/31d1b293-a88c-41f1-9f0b-e3abddee92e8-kube-api-access-rmgpw\") pod \"multus-kxl4d\" (UID: \"31d1b293-a88c-41f1-9f0b-e3abddee92e8\") " pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.613614 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.613599 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqzw2\" (UniqueName: \"kubernetes.io/projected/81fade08-631d-4392-b10c-7df855c0be42-kube-api-access-bqzw2\") pod \"tuned-bs88w\" (UID: \"81fade08-631d-4392-b10c-7df855c0be42\") " pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.613990 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.613973 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mpn2\" (UniqueName: \"kubernetes.io/projected/6d5a5116-e745-4723-b65d-ba4deb03b9a6-kube-api-access-9mpn2\") pod \"multus-additional-cni-plugins-lvnnn\" (UID: \"6d5a5116-e745-4723-b65d-ba4deb03b9a6\") " pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.704111 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.704028 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4-agent-certs\") pod \"konnectivity-agent-j5x6f\" (UID: \"6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4\") " pod="kube-system/konnectivity-agent-j5x6f" Jun 14 14:39:28.704111 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.704056 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4-konnectivity-ca\") pod \"konnectivity-agent-j5x6f\" (UID: \"6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4\") " pod="kube-system/konnectivity-agent-j5x6f" Jun 14 14:39:28.704492 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.704477 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4-konnectivity-ca\") pod \"konnectivity-agent-j5x6f\" (UID: \"6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4\") " pod="kube-system/konnectivity-agent-j5x6f" Jun 14 14:39:28.706244 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.706222 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4-agent-certs\") pod \"konnectivity-agent-j5x6f\" (UID: \"6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4\") " pod="kube-system/konnectivity-agent-j5x6f" Jun 14 14:39:28.788242 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.788207 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" Jun 14 14:39:28.795617 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.795531 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bs88w" Jun 14 14:39:28.797562 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:28.797525 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e41ccc_f684_4956_8587_6fde095a627c.slice/crio-7a81aee5df3056d48334958ee4633d507eb15fb56bbbc358172c86229e06a25a WatchSource:0}: Error finding container 7a81aee5df3056d48334958ee4633d507eb15fb56bbbc358172c86229e06a25a: Status 404 returned error can't find the container with id 7a81aee5df3056d48334958ee4633d507eb15fb56bbbc358172c86229e06a25a Jun 14 14:39:28.801442 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.801421 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lvnnn" Jun 14 14:39:28.805779 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:28.805740 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81fade08_631d_4392_b10c_7df855c0be42.slice/crio-3321ba886da854dab571a881efe9eafc98db8de804ca100c88ddbd6f8b0b031d WatchSource:0}: Error finding container 3321ba886da854dab571a881efe9eafc98db8de804ca100c88ddbd6f8b0b031d: Status 404 returned error can't find the container with id 3321ba886da854dab571a881efe9eafc98db8de804ca100c88ddbd6f8b0b031d Jun 14 14:39:28.807242 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.806740 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kxl4d" Jun 14 14:39:28.811680 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:28.811415 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d5a5116_e745_4723_b65d_ba4deb03b9a6.slice/crio-5188483c2977dd4233599603ef0ebf0054d02661ac35cbf238add5078c7ebb94 WatchSource:0}: Error finding container 5188483c2977dd4233599603ef0ebf0054d02661ac35cbf238add5078c7ebb94: Status 404 returned error can't find the container with id 5188483c2977dd4233599603ef0ebf0054d02661ac35cbf238add5078c7ebb94 Jun 14 14:39:28.811680 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.811485 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-24l22" Jun 14 14:39:28.816729 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:28.816703 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31d1b293_a88c_41f1_9f0b_e3abddee92e8.slice/crio-d3e3f91c3daee2045500bb8da65070ec0939105c79e4a7b0851b124ee80b7ebd WatchSource:0}: Error finding container d3e3f91c3daee2045500bb8da65070ec0939105c79e4a7b0851b124ee80b7ebd: Status 404 returned error can't find the container with id d3e3f91c3daee2045500bb8da65070ec0939105c79e4a7b0851b124ee80b7ebd Jun 14 14:39:28.817092 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.817044 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mtw64" Jun 14 14:39:28.824591 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:28.824311 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77fe2f8_fd37_40f0_ac13_6cbf4e850c9b.slice/crio-5b7cb662ca875cf3887de423730c3ba873f21d488ba443dff0eda403c9bd48c7 WatchSource:0}: Error finding container 5b7cb662ca875cf3887de423730c3ba873f21d488ba443dff0eda403c9bd48c7: Status 404 returned error can't find the container with id 5b7cb662ca875cf3887de423730c3ba873f21d488ba443dff0eda403c9bd48c7 Jun 14 14:39:28.824591 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.824404 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g4l9b" Jun 14 14:39:28.829351 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.829327 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:28.829958 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:28.829935 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853c09c4_64cc_443b_be20_c50c89c658b9.slice/crio-96e7ac5711aba99c36f3e5fb16956c161a7e5503903102557a3a5f9301caf212 WatchSource:0}: Error finding container 96e7ac5711aba99c36f3e5fb16956c161a7e5503903102557a3a5f9301caf212: Status 404 returned error can't find the container with id 96e7ac5711aba99c36f3e5fb16956c161a7e5503903102557a3a5f9301caf212 Jun 14 14:39:28.834340 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:28.834318 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j5x6f" Jun 14 14:39:28.836696 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:28.836656 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe70807c_2293_4cd1_b20f_fcd454645178.slice/crio-3cb14404f5d86bb250b5ec78c843b2d7db8a06d1a2604a214bc219bccb9aa352 WatchSource:0}: Error finding container 3cb14404f5d86bb250b5ec78c843b2d7db8a06d1a2604a214bc219bccb9aa352: Status 404 returned error can't find the container with id 3cb14404f5d86bb250b5ec78c843b2d7db8a06d1a2604a214bc219bccb9aa352 Jun 14 14:39:28.845552 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:28.845504 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96baa92a_c1c7_4ca2_8d22_75c0621d5482.slice/crio-adf977f933ddfacb6219dc810b55f8fda6317c2b97bd61b1ce60f3e5527ed41e WatchSource:0}: Error finding container adf977f933ddfacb6219dc810b55f8fda6317c2b97bd61b1ce60f3e5527ed41e: Status 404 returned error can't find the container with id adf977f933ddfacb6219dc810b55f8fda6317c2b97bd61b1ce60f3e5527ed41e Jun 14 14:39:28.850250 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:39:28.850220 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc2a5a3_7cd8_40d7_afd9_2620e07d1ad4.slice/crio-1bf7162367a0835a4cf5c5e027a369652895966f693d3ed1b961f7931628bd8d WatchSource:0}: Error finding container 1bf7162367a0835a4cf5c5e027a369652895966f693d3ed1b961f7931628bd8d: Status 404 returned error can't find the container with id 1bf7162367a0835a4cf5c5e027a369652895966f693d3ed1b961f7931628bd8d Jun 14 14:39:29.107842 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.107752 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:29.107842 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.107798 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:29.107842 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.107824 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vx5v\" (UniqueName: \"kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v\") pod \"network-check-target-sqfcj\" (UID: \"04442159-4235-4fda-aec1-49808474e1ce\") " pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:29.108106 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:29.107992 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:29.108106 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:29.108009 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:29.108106 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:29.108021 2566 projected.go:196] Error preparing data for projected volume kube-api-access-6vx5v for pod openshift-network-diagnostics/network-check-target-sqfcj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:29.108106 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:29.108072 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v podName:04442159-4235-4fda-aec1-49808474e1ce nodeName:}" failed. No retries permitted until 2026-06-14 14:39:30.108057702 +0000 UTC m=+2.978990993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vx5v" (UniqueName: "kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v") pod "network-check-target-sqfcj" (UID: "04442159-4235-4fda-aec1-49808474e1ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:29.108423 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:29.108405 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:29.108423 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:29.108412 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:29.108532 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:29.108473 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret podName:44d32134-7e4e-4026-9157-bcb08b28a558 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:30.108458261 +0000 UTC m=+2.979391565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret") pod "global-pull-secret-syncer-hcw6x" (UID: "44d32134-7e4e-4026-9157-bcb08b28a558") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:29.108532 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:29.108488 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs podName:1ad0defa-5fcf-4913-a2f5-1db88760d8fe nodeName:}" failed. No retries permitted until 2026-06-14 14:39:30.108482192 +0000 UTC m=+2.979415483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs") pod "network-metrics-daemon-sshnr" (UID: "1ad0defa-5fcf-4913-a2f5-1db88760d8fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:29.368448 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.368201 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:29.529958 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.529896 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 14:34:28 +0000 UTC" deadline="2028-02-12 18:36:32.566448214 +0000 UTC" Jun 14 14:39:29.529958 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.529935 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14595h57m3.03651773s" Jun 14 14:39:29.589117 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.589016 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvnnn" event={"ID":"6d5a5116-e745-4723-b65d-ba4deb03b9a6","Type":"ContainerStarted","Data":"5188483c2977dd4233599603ef0ebf0054d02661ac35cbf238add5078c7ebb94"} Jun 14 14:39:29.602579 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.602447 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mtw64" event={"ID":"853c09c4-64cc-443b-be20-c50c89c658b9","Type":"ContainerStarted","Data":"96e7ac5711aba99c36f3e5fb16956c161a7e5503903102557a3a5f9301caf212"} Jun 14 14:39:29.615179 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.615144 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kxl4d" event={"ID":"31d1b293-a88c-41f1-9f0b-e3abddee92e8","Type":"ContainerStarted","Data":"d3e3f91c3daee2045500bb8da65070ec0939105c79e4a7b0851b124ee80b7ebd"} Jun 14 14:39:29.633914 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.633831 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bs88w" event={"ID":"81fade08-631d-4392-b10c-7df855c0be42","Type":"ContainerStarted","Data":"3321ba886da854dab571a881efe9eafc98db8de804ca100c88ddbd6f8b0b031d"} Jun 14 14:39:29.647352 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.647316 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" event={"ID":"26e41ccc-f684-4956-8587-6fde095a627c","Type":"ContainerStarted","Data":"7a81aee5df3056d48334958ee4633d507eb15fb56bbbc358172c86229e06a25a"} Jun 14 14:39:29.661886 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.661846 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j5x6f" event={"ID":"6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4","Type":"ContainerStarted","Data":"1bf7162367a0835a4cf5c5e027a369652895966f693d3ed1b961f7931628bd8d"} Jun 14 14:39:29.663904 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.663706 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:29.675616 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.675470 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" event={"ID":"96baa92a-c1c7-4ca2-8d22-75c0621d5482","Type":"ContainerStarted","Data":"adf977f933ddfacb6219dc810b55f8fda6317c2b97bd61b1ce60f3e5527ed41e"} Jun 14 14:39:29.691277 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.691115 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g4l9b" event={"ID":"be70807c-2293-4cd1-b20f-fcd454645178","Type":"ContainerStarted","Data":"3cb14404f5d86bb250b5ec78c843b2d7db8a06d1a2604a214bc219bccb9aa352"} Jun 14 14:39:29.694401 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:29.694319 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-24l22" event={"ID":"b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b","Type":"ContainerStarted","Data":"5b7cb662ca875cf3887de423730c3ba873f21d488ba443dff0eda403c9bd48c7"} Jun 14 14:39:30.116569 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:30.116469 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:30.116569 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:30.116528 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vx5v\" (UniqueName: \"kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v\") pod \"network-check-target-sqfcj\" (UID: \"04442159-4235-4fda-aec1-49808474e1ce\") " pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:30.116843 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:30.116618 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:30.116843 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:30.116751 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:30.116843 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:30.116811 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret podName:44d32134-7e4e-4026-9157-bcb08b28a558 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:32.116793598 +0000 UTC m=+4.987726912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret") pod "global-pull-secret-syncer-hcw6x" (UID: "44d32134-7e4e-4026-9157-bcb08b28a558") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:30.117449 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:30.117208 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:30.117449 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:30.117260 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs podName:1ad0defa-5fcf-4913-a2f5-1db88760d8fe nodeName:}" failed. No retries permitted until 2026-06-14 14:39:32.117245126 +0000 UTC m=+4.988178420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs") pod "network-metrics-daemon-sshnr" (UID: "1ad0defa-5fcf-4913-a2f5-1db88760d8fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:30.117449 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:30.117334 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:30.117449 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:30.117348 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:30.117449 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:30.117359 2566 projected.go:196] Error preparing data for projected volume kube-api-access-6vx5v for pod openshift-network-diagnostics/network-check-target-sqfcj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:30.117449 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:30.117394 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v podName:04442159-4235-4fda-aec1-49808474e1ce nodeName:}" failed. No retries permitted until 2026-06-14 14:39:32.117383284 +0000 UTC m=+4.988316578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vx5v" (UniqueName: "kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v") pod "network-check-target-sqfcj" (UID: "04442159-4235-4fda-aec1-49808474e1ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:30.530508 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:30.530363 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 14:34:28 +0000 UTC" deadline="2027-12-27 18:14:46.570442995 +0000 UTC" Jun 14 14:39:30.530508 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:30.530422 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13467h35m16.040025072s" Jun 14 14:39:30.558951 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:30.558919 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:30.559119 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:30.559056 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:30.559523 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:30.559500 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:30.559965 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:30.559940 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:30.560062 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:30.560016 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:30.560123 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:30.560101 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:32.135220 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:32.135115 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vx5v\" (UniqueName: \"kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v\") pod \"network-check-target-sqfcj\" (UID: \"04442159-4235-4fda-aec1-49808474e1ce\") " pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:32.135220 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:32.135177 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:32.135704 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:32.135303 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:32.135704 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:32.135331 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:32.135704 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:32.135358 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:32.135704 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:32.135371 2566 projected.go:196] Error preparing data for projected volume kube-api-access-6vx5v for pod openshift-network-diagnostics/network-check-target-sqfcj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:32.135704 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:32.135402 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:32.135704 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:32.135434 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v podName:04442159-4235-4fda-aec1-49808474e1ce nodeName:}" failed. No retries permitted until 2026-06-14 14:39:36.135412146 +0000 UTC m=+9.006345461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vx5v" (UniqueName: "kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v") pod "network-check-target-sqfcj" (UID: "04442159-4235-4fda-aec1-49808474e1ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:32.135704 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:32.135454 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs podName:1ad0defa-5fcf-4913-a2f5-1db88760d8fe nodeName:}" failed. No retries permitted until 2026-06-14 14:39:36.135443446 +0000 UTC m=+9.006376756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs") pod "network-metrics-daemon-sshnr" (UID: "1ad0defa-5fcf-4913-a2f5-1db88760d8fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:32.135704 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:32.135465 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:32.135704 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:32.135504 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret podName:44d32134-7e4e-4026-9157-bcb08b28a558 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:36.135487361 +0000 UTC m=+9.006420669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret") pod "global-pull-secret-syncer-hcw6x" (UID: "44d32134-7e4e-4026-9157-bcb08b28a558") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:32.558569 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:32.558476 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:32.558750 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:32.558662 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:32.559042 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:32.558838 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:32.559042 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:32.558838 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:32.559042 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:32.558963 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:32.559042 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:32.559017 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:34.559107 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:34.558848 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:34.559643 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:34.558923 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:34.559643 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:34.558950 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:34.559643 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:34.559221 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:34.559643 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:34.559291 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:34.559643 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:34.559372 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:36.168926 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:36.168896 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:36.169347 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:36.168942 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:36.169347 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:36.168973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vx5v\" (UniqueName: \"kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v\") pod \"network-check-target-sqfcj\" (UID: \"04442159-4235-4fda-aec1-49808474e1ce\") " pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:36.169347 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:36.169085 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:36.169347 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:36.169093 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:36.169347 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:36.169118 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:36.169347 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:36.169134 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:36.169347 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:36.169146 2566 projected.go:196] Error preparing data for projected volume kube-api-access-6vx5v for pod openshift-network-diagnostics/network-check-target-sqfcj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:36.169347 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:36.169161 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs podName:1ad0defa-5fcf-4913-a2f5-1db88760d8fe nodeName:}" failed. No retries permitted until 2026-06-14 14:39:44.169139772 +0000 UTC m=+17.040073068 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs") pod "network-metrics-daemon-sshnr" (UID: "1ad0defa-5fcf-4913-a2f5-1db88760d8fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:36.169347 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:36.169180 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret podName:44d32134-7e4e-4026-9157-bcb08b28a558 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:44.169171423 +0000 UTC m=+17.040104719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret") pod "global-pull-secret-syncer-hcw6x" (UID: "44d32134-7e4e-4026-9157-bcb08b28a558") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:36.169347 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:36.169196 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v podName:04442159-4235-4fda-aec1-49808474e1ce nodeName:}" failed. No retries permitted until 2026-06-14 14:39:44.16918793 +0000 UTC m=+17.040121226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vx5v" (UniqueName: "kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v") pod "network-check-target-sqfcj" (UID: "04442159-4235-4fda-aec1-49808474e1ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:36.559459 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:36.558925 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:36.559459 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:36.558942 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:36.559459 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:36.559055 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:36.559459 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:36.559125 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:36.559459 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:36.559180 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:36.559459 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:36.559276 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:38.558840 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:38.558802 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:38.558840 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:38.558832 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:38.559294 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:38.558846 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:38.559294 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:38.558927 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:38.559294 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:38.559052 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:38.559294 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:38.559143 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:40.558679 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:40.558648 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:40.559136 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:40.558645 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:40.559136 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:40.558768 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:40.559136 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:40.558785 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:40.559136 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:40.558881 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:40.559136 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:40.558969 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:42.558386 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:42.558350 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:42.558800 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:42.558475 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:42.558800 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:42.558482 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:42.558800 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:42.558527 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:42.558800 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:42.558620 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:42.558800 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:42.558723 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:44.232916 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:44.232861 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:44.232916 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:44.232921 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:44.233468 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:44.232954 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vx5v\" (UniqueName: \"kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v\") pod \"network-check-target-sqfcj\" (UID: \"04442159-4235-4fda-aec1-49808474e1ce\") " pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:44.233468 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:44.232989 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:44.233468 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:44.233067 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret podName:44d32134-7e4e-4026-9157-bcb08b28a558 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:00.233049206 +0000 UTC m=+33.103982498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret") pod "global-pull-secret-syncer-hcw6x" (UID: "44d32134-7e4e-4026-9157-bcb08b28a558") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:44.233468 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:44.233069 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:44.233468 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:44.233085 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:44.233468 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:44.233101 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:44.233468 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:44.233113 2566 projected.go:196] Error preparing data for projected volume kube-api-access-6vx5v for pod openshift-network-diagnostics/network-check-target-sqfcj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:44.233468 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:44.233129 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs podName:1ad0defa-5fcf-4913-a2f5-1db88760d8fe nodeName:}" failed. No retries permitted until 2026-06-14 14:40:00.233112555 +0000 UTC m=+33.104045868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs") pod "network-metrics-daemon-sshnr" (UID: "1ad0defa-5fcf-4913-a2f5-1db88760d8fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:44.233468 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:44.233158 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v podName:04442159-4235-4fda-aec1-49808474e1ce nodeName:}" failed. No retries permitted until 2026-06-14 14:40:00.233143785 +0000 UTC m=+33.104077092 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vx5v" (UniqueName: "kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v") pod "network-check-target-sqfcj" (UID: "04442159-4235-4fda-aec1-49808474e1ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:44.558967 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:44.558884 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:44.558967 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:44.558916 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:44.559195 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:44.559066 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:44.559195 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:44.559075 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:44.559294 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:44.559179 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:44.559357 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:44.559289 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:46.558705 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:46.558666 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:46.559139 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:46.558776 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:46.559139 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:46.558787 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:46.559139 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:46.558782 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:46.559139 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:46.558895 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:46.559139 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:46.558985 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:48.559293 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:48.559266 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:48.559293 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:48.559283 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:48.559760 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:48.559278 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:48.559760 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:48.559363 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:48.559849 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:48.559815 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:48.560107 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:48.560043 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:49.744672 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.744224 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-24l22" event={"ID":"b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b","Type":"ContainerStarted","Data":"8b8485c88072792db644f4254745d1b15fb01e3da591662c4e9f7ea2857e1488"} Jun 14 14:39:49.745800 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.745776 2566 generic.go:356] "Generic (PLEG): container finished" podID="6d5a5116-e745-4723-b65d-ba4deb03b9a6" containerID="406222f2e491db2769d0d0c6ccecce66de6fceb757ff0295c6f89acd86ff23c7" exitCode=0 Jun 14 14:39:49.745907 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.745856 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvnnn" event={"ID":"6d5a5116-e745-4723-b65d-ba4deb03b9a6","Type":"ContainerDied","Data":"406222f2e491db2769d0d0c6ccecce66de6fceb757ff0295c6f89acd86ff23c7"} Jun 14 14:39:49.747379 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.747358 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mtw64" event={"ID":"853c09c4-64cc-443b-be20-c50c89c658b9","Type":"ContainerStarted","Data":"51e618f93a426eb863ab7b234eece052771f594e87f79fccfc658cded763010c"} Jun 14 14:39:49.750577 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.750533 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kxl4d" event={"ID":"31d1b293-a88c-41f1-9f0b-e3abddee92e8","Type":"ContainerStarted","Data":"c2d683d58ecdf35ec06760a33905159293fba234da8b51e57077c2738397653e"} Jun 14 14:39:49.752106 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.752085 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bs88w" event={"ID":"81fade08-631d-4392-b10c-7df855c0be42","Type":"ContainerStarted","Data":"f65261d6d77095a1a634652ebaabf0247930b04239a8a90f117abfb91d314aa9"} Jun 14 14:39:49.753386 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.753360 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" event={"ID":"26e41ccc-f684-4956-8587-6fde095a627c","Type":"ContainerStarted","Data":"c68f4fd619d1f2202a9e4e32e925eeca7fb385a48a0445c816dd2e9a9300fdb5"} Jun 14 14:39:49.754777 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.754757 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-57.ec2.internal" event={"ID":"73d13947db166b6a6edbf8d9dacc9ada","Type":"ContainerStarted","Data":"9faaae87108ce069a43890bb95bdcc3c4678fef0badb2ca3953b7a91c1559abd"} Jun 14 14:39:49.756028 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.756007 2566 generic.go:356] "Generic (PLEG): container finished" podID="e9f359032b5ba6a1a599342de8ccda48" containerID="f7c9609c5f961f3ddae7893bcd50e4480d37357dc84fb2b6ac27cfd3dab25696" exitCode=0 Jun 14 14:39:49.756135 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.756066 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" event={"ID":"e9f359032b5ba6a1a599342de8ccda48","Type":"ContainerDied","Data":"f7c9609c5f961f3ddae7893bcd50e4480d37357dc84fb2b6ac27cfd3dab25696"} Jun 14 14:39:49.757465 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.757443 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j5x6f" event={"ID":"6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4","Type":"ContainerStarted","Data":"d58f84122c7659f7a3a7fbf96aa08728a9674b0ac3dbee3d5d19d55a6fd8ef4d"} Jun 14 14:39:49.757958 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.757908 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-24l22" podStartSLOduration=2.952876394 podStartE2EDuration="22.757890682s" totalImagesPullingTime="19.805014288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:49.757120522 +0000 UTC m=+22.628053837" watchObservedRunningTime="2026-06-14 14:39:49.757890682 +0000 UTC m=+22.628824002" Jun 14 14:39:49.760143 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.760126 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 14:39:49.760439 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.760424 2566 generic.go:356] "Generic (PLEG): container finished" podID="96baa92a-c1c7-4ca2-8d22-75c0621d5482" containerID="d40a9fa91b1868cdb0805cc7d765f260b980e5198cc28846e176581fd45a7285" exitCode=1 Jun 14 14:39:49.760511 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.760451 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" event={"ID":"96baa92a-c1c7-4ca2-8d22-75c0621d5482","Type":"ContainerStarted","Data":"0d9d9d697824fa4cb5ea1de9d8f945b12e9ee6633e52df9d7583300c829d4642"} Jun 14 14:39:49.760511 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.760499 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" event={"ID":"96baa92a-c1c7-4ca2-8d22-75c0621d5482","Type":"ContainerStarted","Data":"f6c4d59118ba011b08a3f3e6a5370e37df7d20605c5b9510d8ef6947b5f702eb"} Jun 14 14:39:49.760603 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.760530 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" event={"ID":"96baa92a-c1c7-4ca2-8d22-75c0621d5482","Type":"ContainerStarted","Data":"bc32566a4332edd8ddb9466f0b899e539fa84a147b7d5da2ad7c9ab7ee836613"} Jun 14 14:39:49.760603 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.760574 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" event={"ID":"96baa92a-c1c7-4ca2-8d22-75c0621d5482","Type":"ContainerStarted","Data":"4975f9bc86ab9c77f0568197f98cf9c8ede7e5a2af4c606724d9073ed32422d3"} Jun 14 14:39:49.760603 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.760601 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" event={"ID":"96baa92a-c1c7-4ca2-8d22-75c0621d5482","Type":"ContainerDied","Data":"d40a9fa91b1868cdb0805cc7d765f260b980e5198cc28846e176581fd45a7285"} Jun 14 14:39:49.760691 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.760628 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" event={"ID":"96baa92a-c1c7-4ca2-8d22-75c0621d5482","Type":"ContainerStarted","Data":"3ca1326ba8072465b9d8d45e7d6bdbd156e982a021a086fef8298f58f7569386"} Jun 14 14:39:49.770710 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.770680 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bs88w" podStartSLOduration=2.946592161 podStartE2EDuration="22.770669957s" totalImagesPullingTime="19.824077796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:49.770609875 +0000 UTC m=+22.641543188" watchObservedRunningTime="2026-06-14 14:39:49.770669957 +0000 UTC m=+22.641603290" Jun 14 14:39:49.784912 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.784867 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kxl4d" podStartSLOduration=2.613191168 podStartE2EDuration="22.78485611s" totalImagesPullingTime="20.171664942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:49.784556034 +0000 UTC m=+22.655489346" watchObservedRunningTime="2026-06-14 14:39:49.78485611 +0000 UTC m=+22.655789422" Jun 14 14:39:49.795984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.795952 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mtw64" podStartSLOduration=3.019677612 podStartE2EDuration="22.795941966s" totalImagesPullingTime="19.776264354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:49.795764128 +0000 UTC m=+22.666697441" watchObservedRunningTime="2026-06-14 14:39:49.795941966 +0000 UTC m=+22.666875279" Jun 14 14:39:49.843455 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.843420 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-57.ec2.internal" podStartSLOduration=22.843408614 podStartE2EDuration="22.843408614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:49.843186751 +0000 UTC m=+22.714120057" watchObservedRunningTime="2026-06-14 14:39:49.843408614 +0000 UTC m=+22.714341927" Jun 14 14:39:49.856337 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:49.856307 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j5x6f" podStartSLOduration=3.079318914 podStartE2EDuration="22.856296384s" totalImagesPullingTime="19.77697747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:49.85605187 +0000 UTC m=+22.726985208" watchObservedRunningTime="2026-06-14 14:39:49.856296384 +0000 UTC m=+22.727229696" Jun 14 14:39:50.559366 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:50.559333 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:50.559366 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:50.559350 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:50.559590 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:50.559450 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:50.559590 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:50.559499 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:50.559659 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:50.559596 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:50.559691 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:50.559659 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:50.764644 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:50.764612 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g4l9b" event={"ID":"be70807c-2293-4cd1-b20f-fcd454645178","Type":"ContainerStarted","Data":"a1dceed9ebe89fd01fcf9ec051483f006f299a4134b1bf39b0e76fb5cefc0609"} Jun 14 14:39:50.766844 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:50.766788 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" event={"ID":"e9f359032b5ba6a1a599342de8ccda48","Type":"ContainerStarted","Data":"0dfb387f14bbf13d763b08f5151fa1c47f6eb9f778e054095102d4eea07da8de"} Jun 14 14:39:50.778219 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:50.778173 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g4l9b" podStartSLOduration=3.989111724 podStartE2EDuration="23.77815766s" totalImagesPullingTime="19.789045936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:50.778086835 +0000 UTC m=+23.649020147" watchObservedRunningTime="2026-06-14 14:39:50.77815766 +0000 UTC m=+23.649090974" Jun 14 14:39:50.789707 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:50.789667 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-57.ec2.internal" podStartSLOduration=23.789652729 podStartE2EDuration="23.789652729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:50.789473823 +0000 UTC m=+23.660407137" watchObservedRunningTime="2026-06-14 14:39:50.789652729 +0000 UTC m=+23.660586042" Jun 14 14:39:50.808348 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:50.808326 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 14:39:51.563572 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:51.563455 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T14:39:50.808344708Z","UUID":"8d0b44d8-7e0f-4c8e-8907-006c4ed6a5ba","Handler":null,"Name":"","Endpoint":""} Jun 14 14:39:51.565033 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:51.565014 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 14:39:51.565160 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:51.565054 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 14:39:51.774911 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:51.774846 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 14:39:51.775531 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:51.775425 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" event={"ID":"96baa92a-c1c7-4ca2-8d22-75c0621d5482","Type":"ContainerStarted","Data":"6de04aa83bcb40ba4f02617f4159a5687b3d4a630bb4de60bed7db055136e544"} Jun 14 14:39:51.777430 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:51.777404 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" event={"ID":"26e41ccc-f684-4956-8587-6fde095a627c","Type":"ContainerStarted","Data":"fb86cc85ee14ec573dfd4f96c60569beedb4b7d03859c4ba5b0c2f29a1e71683"} Jun 14 14:39:52.558756 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:52.558720 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:52.558756 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:52.558756 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:52.558977 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:52.558763 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:52.558977 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:52.558865 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:52.558977 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:52.558924 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:52.559116 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:52.559012 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:52.782153 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:52.782055 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" event={"ID":"26e41ccc-f684-4956-8587-6fde095a627c","Type":"ContainerStarted","Data":"d3199d66d4e25be1e90586aa5d2eddcdcbbccc8abbdee72caaadde1a92f02d81"} Jun 14 14:39:52.798329 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:52.798278 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-224dh" podStartSLOduration=3.574042266 podStartE2EDuration="25.798262095s" totalImagesPullingTime="22.224219829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:52.797830175 +0000 UTC m=+25.668763491" watchObservedRunningTime="2026-06-14 14:39:52.798262095 +0000 UTC m=+25.669195406" Jun 14 14:39:54.475867 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:54.475670 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j5x6f" Jun 14 14:39:54.476529 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:54.476181 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j5x6f" Jun 14 14:39:54.558759 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:54.558737 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:54.558871 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:54.558744 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:54.558871 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:54.558822 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:54.558947 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:54.558891 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:54.558982 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:54.558950 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:54.559060 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:54.559041 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:54.789360 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:54.789149 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 14:39:54.789714 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:54.789686 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" event={"ID":"96baa92a-c1c7-4ca2-8d22-75c0621d5482","Type":"ContainerStarted","Data":"5ee84fc9187e360946ab31346a8adc4a638819457c21153b226cf066bf68627e"} Jun 14 14:39:54.790003 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:54.789987 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:54.790160 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:54.790143 2566 scope.go:117] "RemoveContainer" containerID="d40a9fa91b1868cdb0805cc7d765f260b980e5198cc28846e176581fd45a7285" Jun 14 14:39:54.791639 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:54.791605 2566 generic.go:356] "Generic (PLEG): container finished" podID="6d5a5116-e745-4723-b65d-ba4deb03b9a6" containerID="55ee37af5699bd8233ac058e18e3c596867a68292f27be529f8e72364a368c9b" exitCode=0 Jun 14 14:39:54.791726 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:54.791656 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvnnn" event={"ID":"6d5a5116-e745-4723-b65d-ba4deb03b9a6","Type":"ContainerDied","Data":"55ee37af5699bd8233ac058e18e3c596867a68292f27be529f8e72364a368c9b"} Jun 14 14:39:54.791952 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:54.791937 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j5x6f" Jun 14 14:39:54.792629 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:54.792457 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j5x6f" Jun 14 14:39:54.807081 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:54.807066 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:55.797410 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:55.797389 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 14:39:55.797836 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:55.797761 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" event={"ID":"96baa92a-c1c7-4ca2-8d22-75c0621d5482","Type":"ContainerStarted","Data":"819b7672fb0ae070af782f31683d29e38a30d6007b708317a7fbc9e4ba502caf"} Jun 14 14:39:55.798055 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:55.798033 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:55.798171 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:55.798126 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:55.799960 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:55.799934 2566 generic.go:356] "Generic (PLEG): container finished" podID="6d5a5116-e745-4723-b65d-ba4deb03b9a6" containerID="4f4c2899124c49f7113c2767b6af6aca286204fb9b6823e538249e5d8b1bf702" exitCode=0 Jun 14 14:39:55.800071 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:55.799963 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvnnn" event={"ID":"6d5a5116-e745-4723-b65d-ba4deb03b9a6","Type":"ContainerDied","Data":"4f4c2899124c49f7113c2767b6af6aca286204fb9b6823e538249e5d8b1bf702"} Jun 14 14:39:55.813007 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:55.812965 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:39:55.821138 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:55.821101 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" podStartSLOduration=8.996094736 podStartE2EDuration="28.8210897s" totalImagesPullingTime="19.824994964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:55.820157446 +0000 UTC m=+28.691090758" watchObservedRunningTime="2026-06-14 14:39:55.8210897 +0000 UTC m=+28.692023029" Jun 14 14:39:55.899514 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:55.899455 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sqfcj"] Jun 14 14:39:55.899642 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:55.899584 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:55.899706 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:55.899652 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:55.902290 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:55.902270 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hcw6x"] Jun 14 14:39:55.902375 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:55.902347 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:55.902431 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:55.902413 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:55.911648 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:55.911627 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sshnr"] Jun 14 14:39:55.911723 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:55.911716 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:55.911801 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:55.911787 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:57.559528 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:57.559500 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:57.559923 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:57.559624 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:39:57.559923 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:57.559663 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:57.559923 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:57.559702 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:57.559923 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:57.559725 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:57.559923 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:57.559775 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:57.807489 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:57.807452 2566 generic.go:356] "Generic (PLEG): container finished" podID="6d5a5116-e745-4723-b65d-ba4deb03b9a6" containerID="46a45f8684d18d8c46a3a394e6a42c7ce119b6e4409b020f58ab1bce14a116b5" exitCode=0 Jun 14 14:39:57.807651 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:57.807532 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvnnn" event={"ID":"6d5a5116-e745-4723-b65d-ba4deb03b9a6","Type":"ContainerDied","Data":"46a45f8684d18d8c46a3a394e6a42c7ce119b6e4409b020f58ab1bce14a116b5"} Jun 14 14:39:59.559054 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:59.558813 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:39:59.559501 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:59.558812 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:39:59.559501 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:59.559175 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:39:59.559501 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:39:59.558876 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:39:59.559501 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:59.559222 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:39:59.559501 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:39:59.559283 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:40:00.253815 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:00.253784 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:40:00.254047 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:00.253844 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:40:00.254047 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:00.253876 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vx5v\" (UniqueName: \"kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v\") pod \"network-check-target-sqfcj\" (UID: \"04442159-4235-4fda-aec1-49808474e1ce\") " pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:40:00.254047 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:00.253965 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:40:00.254047 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:00.254034 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret podName:44d32134-7e4e-4026-9157-bcb08b28a558 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:32.254014769 +0000 UTC m=+65.124948076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret") pod "global-pull-secret-syncer-hcw6x" (UID: "44d32134-7e4e-4026-9157-bcb08b28a558") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:40:00.254047 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:00.254047 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:40:00.254428 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:00.254065 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:40:00.254428 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:00.254077 2566 projected.go:196] Error preparing data for projected volume kube-api-access-6vx5v for pod openshift-network-diagnostics/network-check-target-sqfcj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:40:00.254428 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:00.254128 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v podName:04442159-4235-4fda-aec1-49808474e1ce nodeName:}" failed. No retries permitted until 2026-06-14 14:40:32.254111753 +0000 UTC m=+65.125045094 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vx5v" (UniqueName: "kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v") pod "network-check-target-sqfcj" (UID: "04442159-4235-4fda-aec1-49808474e1ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:40:00.254428 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:00.254374 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:40:00.254428 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:00.254431 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs podName:1ad0defa-5fcf-4913-a2f5-1db88760d8fe nodeName:}" failed. No retries permitted until 2026-06-14 14:40:32.254416335 +0000 UTC m=+65.125349632 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs") pod "network-metrics-daemon-sshnr" (UID: "1ad0defa-5fcf-4913-a2f5-1db88760d8fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:40:01.562708 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:01.562675 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:40:01.563262 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:01.562685 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:40:01.563262 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:01.562792 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqfcj" podUID="04442159-4235-4fda-aec1-49808474e1ce" Jun 14 14:40:01.563262 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:01.562803 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:40:01.563262 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:01.562889 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcw6x" podUID="44d32134-7e4e-4026-9157-bcb08b28a558" Jun 14 14:40:01.563262 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:01.562990 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:40:01.962465 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:01.962442 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-57.ec2.internal" event="NodeReady" Jun 14 14:40:01.962610 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:01.962599 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 14:40:01.999804 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:01.999743 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f7d7x"] Jun 14 14:40:02.002601 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.002583 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:02.003637 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.003613 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kcjq8"] Jun 14 14:40:02.004491 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.004466 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 14:40:02.004620 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.004467 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 14:40:02.004765 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.004749 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jwvk2\"" Jun 14 14:40:02.006168 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.006148 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kcjq8" Jun 14 14:40:02.007671 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.007655 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 14:40:02.007859 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.007843 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 14:40:02.007906 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.007894 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 14:40:02.007962 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.007947 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4f8bs\"" Jun 14 14:40:02.011905 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.011882 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f7d7x"] Jun 14 14:40:02.014178 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.014154 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kcjq8"] Jun 14 14:40:02.168743 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.168706 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-tmp-dir\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:02.168743 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.168742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/143f5e39-8acd-4190-94b3-ca136a6a90c2-cert\") pod \"ingress-canary-kcjq8\" (UID: \"143f5e39-8acd-4190-94b3-ca136a6a90c2\") " pod="openshift-ingress-canary/ingress-canary-kcjq8" Jun 14 14:40:02.168926 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.168824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8d9h\" (UniqueName: \"kubernetes.io/projected/143f5e39-8acd-4190-94b3-ca136a6a90c2-kube-api-access-l8d9h\") pod \"ingress-canary-kcjq8\" (UID: \"143f5e39-8acd-4190-94b3-ca136a6a90c2\") " pod="openshift-ingress-canary/ingress-canary-kcjq8" Jun 14 14:40:02.168926 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.168862 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-config-volume\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:02.168926 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.168894 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:02.168926 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.168916 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbspf\" (UniqueName: \"kubernetes.io/projected/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-kube-api-access-fbspf\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:02.270079 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.270009 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8d9h\" (UniqueName: \"kubernetes.io/projected/143f5e39-8acd-4190-94b3-ca136a6a90c2-kube-api-access-l8d9h\") pod \"ingress-canary-kcjq8\" (UID: \"143f5e39-8acd-4190-94b3-ca136a6a90c2\") " pod="openshift-ingress-canary/ingress-canary-kcjq8" Jun 14 14:40:02.270079 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.270038 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-config-volume\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:02.270079 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.270061 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:02.270079 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.270077 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbspf\" (UniqueName: \"kubernetes.io/projected/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-kube-api-access-fbspf\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:02.270349 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.270108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-tmp-dir\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:02.270349 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.270131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/143f5e39-8acd-4190-94b3-ca136a6a90c2-cert\") pod \"ingress-canary-kcjq8\" (UID: \"143f5e39-8acd-4190-94b3-ca136a6a90c2\") " pod="openshift-ingress-canary/ingress-canary-kcjq8" Jun 14 14:40:02.270349 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:02.270183 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:02.270349 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:02.270255 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls podName:08ce8c7c-2214-40f7-93ea-b44b51b75e1f nodeName:}" failed. No retries permitted until 2026-06-14 14:40:02.770235192 +0000 UTC m=+35.641168506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls") pod "dns-default-f7d7x" (UID: "08ce8c7c-2214-40f7-93ea-b44b51b75e1f") : secret "dns-default-metrics-tls" not found Jun 14 14:40:02.270500 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.270436 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-tmp-dir\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:02.270615 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.270596 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-config-volume\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:02.274396 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.274369 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/143f5e39-8acd-4190-94b3-ca136a6a90c2-cert\") pod \"ingress-canary-kcjq8\" (UID: \"143f5e39-8acd-4190-94b3-ca136a6a90c2\") " pod="openshift-ingress-canary/ingress-canary-kcjq8" Jun 14 14:40:02.277639 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.277603 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8d9h\" (UniqueName: \"kubernetes.io/projected/143f5e39-8acd-4190-94b3-ca136a6a90c2-kube-api-access-l8d9h\") pod \"ingress-canary-kcjq8\" (UID: \"143f5e39-8acd-4190-94b3-ca136a6a90c2\") " pod="openshift-ingress-canary/ingress-canary-kcjq8" Jun 14 14:40:02.277639 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.277615 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbspf\" (UniqueName: \"kubernetes.io/projected/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-kube-api-access-fbspf\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:02.318604 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.318583 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kcjq8" Jun 14 14:40:02.443797 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.443639 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kcjq8"] Jun 14 14:40:02.447460 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:40:02.447434 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143f5e39_8acd_4190_94b3_ca136a6a90c2.slice/crio-7802213d7571dddd9acab3eff1140cb5a84a3e1e1b2120b48ee136e87fbb21a2 WatchSource:0}: Error finding container 7802213d7571dddd9acab3eff1140cb5a84a3e1e1b2120b48ee136e87fbb21a2: Status 404 returned error can't find the container with id 7802213d7571dddd9acab3eff1140cb5a84a3e1e1b2120b48ee136e87fbb21a2 Jun 14 14:40:02.775345 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.775284 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:02.775920 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:02.775436 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:02.775920 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:02.775495 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls podName:08ce8c7c-2214-40f7-93ea-b44b51b75e1f nodeName:}" failed. No retries permitted until 2026-06-14 14:40:03.775478411 +0000 UTC m=+36.646411702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls") pod "dns-default-f7d7x" (UID: "08ce8c7c-2214-40f7-93ea-b44b51b75e1f") : secret "dns-default-metrics-tls" not found Jun 14 14:40:02.822508 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.822475 2566 generic.go:356] "Generic (PLEG): container finished" podID="6d5a5116-e745-4723-b65d-ba4deb03b9a6" containerID="0e27676756e0596b435b6f6330c2099cebafb95d21e5022bbe0748ac8a9324d3" exitCode=0 Jun 14 14:40:02.822680 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.822579 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvnnn" event={"ID":"6d5a5116-e745-4723-b65d-ba4deb03b9a6","Type":"ContainerDied","Data":"0e27676756e0596b435b6f6330c2099cebafb95d21e5022bbe0748ac8a9324d3"} Jun 14 14:40:02.824047 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:02.824025 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kcjq8" event={"ID":"143f5e39-8acd-4190-94b3-ca136a6a90c2","Type":"ContainerStarted","Data":"7802213d7571dddd9acab3eff1140cb5a84a3e1e1b2120b48ee136e87fbb21a2"} Jun 14 14:40:03.559407 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:03.559372 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:40:03.559604 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:03.559372 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:40:03.559604 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:03.559383 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:40:03.564450 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:03.563011 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 14:40:03.564450 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:03.563050 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 14:40:03.564450 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:03.563127 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 14:40:03.564450 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:03.563285 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 14:40:03.564450 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:03.563499 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k8smd\"" Jun 14 14:40:03.564450 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:03.563832 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2pmmn\"" Jun 14 14:40:03.784143 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:03.784111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:03.784571 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:03.784217 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:03.784571 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:03.784288 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls podName:08ce8c7c-2214-40f7-93ea-b44b51b75e1f nodeName:}" failed. No retries permitted until 2026-06-14 14:40:05.784268257 +0000 UTC m=+38.655201614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls") pod "dns-default-f7d7x" (UID: "08ce8c7c-2214-40f7-93ea-b44b51b75e1f") : secret "dns-default-metrics-tls" not found Jun 14 14:40:03.830419 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:03.830327 2566 generic.go:356] "Generic (PLEG): container finished" podID="6d5a5116-e745-4723-b65d-ba4deb03b9a6" containerID="02ddb5244193e6f8258d84900cdd400f8965daf0ead6e234c126e22abddb76db" exitCode=0 Jun 14 14:40:03.830419 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:03.830391 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvnnn" event={"ID":"6d5a5116-e745-4723-b65d-ba4deb03b9a6","Type":"ContainerDied","Data":"02ddb5244193e6f8258d84900cdd400f8965daf0ead6e234c126e22abddb76db"} Jun 14 14:40:04.833575 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:04.833523 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kcjq8" event={"ID":"143f5e39-8acd-4190-94b3-ca136a6a90c2","Type":"ContainerStarted","Data":"f617fb15bc6184d29db5804ad7eb5a5dd023df2ebc673b4d5f7eec2226ad3929"} Jun 14 14:40:04.837020 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:04.836997 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvnnn" event={"ID":"6d5a5116-e745-4723-b65d-ba4deb03b9a6","Type":"ContainerStarted","Data":"35bae9b47397c7e35285228e37edfabfa9338c08eb3a04903971d02d857909b9"} Jun 14 14:40:04.848528 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:04.848475 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kcjq8" podStartSLOduration=2.311554959 podStartE2EDuration="3.848454575s" totalImagesPullingTime="1.536899616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:40:04.846832479 +0000 UTC m=+37.717765792" watchObservedRunningTime="2026-06-14 14:40:04.848454575 +0000 UTC m=+37.719387890" Jun 14 14:40:04.864823 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:04.864784 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lvnnn" podStartSLOduration=8.050606495 podStartE2EDuration="37.864769904s" totalImagesPullingTime="29.814163409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:40:04.864037668 +0000 UTC m=+37.734970980" watchObservedRunningTime="2026-06-14 14:40:04.864769904 +0000 UTC m=+37.735703216" Jun 14 14:40:05.799058 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:05.798813 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:05.799058 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:05.798958 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:05.799332 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:05.799081 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls podName:08ce8c7c-2214-40f7-93ea-b44b51b75e1f nodeName:}" failed. No retries permitted until 2026-06-14 14:40:09.799066292 +0000 UTC m=+42.669999583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls") pod "dns-default-f7d7x" (UID: "08ce8c7c-2214-40f7-93ea-b44b51b75e1f") : secret "dns-default-metrics-tls" not found Jun 14 14:40:09.825321 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:09.825286 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:09.825727 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:09.825410 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:09.825727 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:09.825459 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls podName:08ce8c7c-2214-40f7-93ea-b44b51b75e1f nodeName:}" failed. No retries permitted until 2026-06-14 14:40:17.825446323 +0000 UTC m=+50.696379613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls") pod "dns-default-f7d7x" (UID: "08ce8c7c-2214-40f7-93ea-b44b51b75e1f") : secret "dns-default-metrics-tls" not found Jun 14 14:40:17.875828 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:17.875797 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:17.876279 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:17.875908 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:17.876279 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:17.875964 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls podName:08ce8c7c-2214-40f7-93ea-b44b51b75e1f nodeName:}" failed. No retries permitted until 2026-06-14 14:40:33.875946103 +0000 UTC m=+66.746879395 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls") pod "dns-default-f7d7x" (UID: "08ce8c7c-2214-40f7-93ea-b44b51b75e1f") : secret "dns-default-metrics-tls" not found Jun 14 14:40:27.817626 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:27.817600 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mmbs" Jun 14 14:40:32.275612 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.275563 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vx5v\" (UniqueName: \"kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v\") pod \"network-check-target-sqfcj\" (UID: \"04442159-4235-4fda-aec1-49808474e1ce\") " pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:40:32.276123 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.275640 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:40:32.276123 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.275661 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:40:32.278238 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.278217 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 14:40:32.278292 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.278243 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 14:40:32.278292 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.278285 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 14:40:32.286632 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:32.286610 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 14:40:32.286714 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:32.286679 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs podName:1ad0defa-5fcf-4913-a2f5-1db88760d8fe nodeName:}" failed. No retries permitted until 2026-06-14 14:41:36.286657275 +0000 UTC m=+129.157590566 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs") pod "network-metrics-daemon-sshnr" (UID: "1ad0defa-5fcf-4913-a2f5-1db88760d8fe") : secret "metrics-daemon-secret" not found Jun 14 14:40:32.288393 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.288375 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 14:40:32.290291 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.290271 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44d32134-7e4e-4026-9157-bcb08b28a558-original-pull-secret\") pod \"global-pull-secret-syncer-hcw6x\" (UID: \"44d32134-7e4e-4026-9157-bcb08b28a558\") " pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:40:32.299128 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.299108 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vx5v\" (UniqueName: \"kubernetes.io/projected/04442159-4235-4fda-aec1-49808474e1ce-kube-api-access-6vx5v\") pod \"network-check-target-sqfcj\" (UID: \"04442159-4235-4fda-aec1-49808474e1ce\") " pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:40:32.372253 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.372230 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcw6x" Jun 14 14:40:32.387024 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.387000 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k8smd\"" Jun 14 14:40:32.395633 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.395613 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:40:32.500474 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.500446 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hcw6x"] Jun 14 14:40:32.503688 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:40:32.503662 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44d32134_7e4e_4026_9157_bcb08b28a558.slice/crio-b89828069898280d01cb68b727c3adfa81fd1129e217d0df95c39a17f84a2482 WatchSource:0}: Error finding container b89828069898280d01cb68b727c3adfa81fd1129e217d0df95c39a17f84a2482: Status 404 returned error can't find the container with id b89828069898280d01cb68b727c3adfa81fd1129e217d0df95c39a17f84a2482 Jun 14 14:40:32.512840 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.512816 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sqfcj"] Jun 14 14:40:32.517094 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:40:32.517072 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04442159_4235_4fda_aec1_49808474e1ce.slice/crio-04de271abfcfd4f817d75ecfc14c4e6cb6494ae79d401561ff5251d001fa0a85 WatchSource:0}: Error finding container 04de271abfcfd4f817d75ecfc14c4e6cb6494ae79d401561ff5251d001fa0a85: Status 404 returned error can't find the container with id 04de271abfcfd4f817d75ecfc14c4e6cb6494ae79d401561ff5251d001fa0a85 Jun 14 14:40:32.900627 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.900569 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hcw6x" event={"ID":"44d32134-7e4e-4026-9157-bcb08b28a558","Type":"ContainerStarted","Data":"b89828069898280d01cb68b727c3adfa81fd1129e217d0df95c39a17f84a2482"} Jun 14 14:40:32.901796 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:32.901768 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sqfcj" event={"ID":"04442159-4235-4fda-aec1-49808474e1ce","Type":"ContainerStarted","Data":"04de271abfcfd4f817d75ecfc14c4e6cb6494ae79d401561ff5251d001fa0a85"} Jun 14 14:40:33.885924 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:33.885884 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:40:33.886347 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:33.886072 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:33.886347 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:40:33.886147 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls podName:08ce8c7c-2214-40f7-93ea-b44b51b75e1f nodeName:}" failed. No retries permitted until 2026-06-14 14:41:05.886119606 +0000 UTC m=+98.757052899 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls") pod "dns-default-f7d7x" (UID: "08ce8c7c-2214-40f7-93ea-b44b51b75e1f") : secret "dns-default-metrics-tls" not found Jun 14 14:40:37.915111 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:37.915076 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sqfcj" event={"ID":"04442159-4235-4fda-aec1-49808474e1ce","Type":"ContainerStarted","Data":"d14fd21eea90f4f9eacc150df555a0a67ac5d13ca1e5ba1c5fcc2fd04edc36d2"} Jun 14 14:40:37.915662 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:37.915208 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:40:37.916686 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:37.916663 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hcw6x" event={"ID":"44d32134-7e4e-4026-9157-bcb08b28a558","Type":"ContainerStarted","Data":"5b8dcc6795925ae44f50c9f9f72282231c059e51dd5157c65bc00d2d3478fd41"} Jun 14 14:40:37.930325 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:37.930277 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sqfcj" podStartSLOduration=66.566806361 podStartE2EDuration="1m10.930263797s" totalImagesPullingTime="4.363457436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:40:37.929726123 +0000 UTC m=+70.800659436" watchObservedRunningTime="2026-06-14 14:40:37.930263797 +0000 UTC m=+70.801197111" Jun 14 14:40:37.942228 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:37.942190 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hcw6x" podStartSLOduration=66.562236169 podStartE2EDuration="1m10.942178899s" totalImagesPullingTime="4.37994273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:40:37.941822531 +0000 UTC m=+70.812755846" watchObservedRunningTime="2026-06-14 14:40:37.942178899 +0000 UTC m=+70.813112212" Jun 14 14:40:54.567520 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.567384 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59"] Jun 14 14:40:54.571524 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.571504 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59" Jun 14 14:40:54.573664 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.573639 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 14 14:40:54.574318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.574296 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 14 14:40:54.574414 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.574331 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 14 14:40:54.574414 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.574332 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cwl6s\"" Jun 14 14:40:54.574527 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.574315 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 14 14:40:54.577931 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.577767 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59"] Jun 14 14:40:54.614008 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.613988 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9dfa03fa-daf8-4337-9b4a-c4c3c6059efe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d46d445cb-p7w59\" (UID: \"9dfa03fa-daf8-4337-9b4a-c4c3c6059efe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59" Jun 14 14:40:54.614111 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.614015 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwqvr\" (UniqueName: \"kubernetes.io/projected/9dfa03fa-daf8-4337-9b4a-c4c3c6059efe-kube-api-access-dwqvr\") pod \"managed-serviceaccount-addon-agent-7d46d445cb-p7w59\" (UID: \"9dfa03fa-daf8-4337-9b4a-c4c3c6059efe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59" Jun 14 14:40:54.714766 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.714733 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9dfa03fa-daf8-4337-9b4a-c4c3c6059efe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d46d445cb-p7w59\" (UID: \"9dfa03fa-daf8-4337-9b4a-c4c3c6059efe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59" Jun 14 14:40:54.714766 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.714766 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwqvr\" (UniqueName: \"kubernetes.io/projected/9dfa03fa-daf8-4337-9b4a-c4c3c6059efe-kube-api-access-dwqvr\") pod \"managed-serviceaccount-addon-agent-7d46d445cb-p7w59\" (UID: \"9dfa03fa-daf8-4337-9b4a-c4c3c6059efe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59" Jun 14 14:40:54.717236 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.717217 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9dfa03fa-daf8-4337-9b4a-c4c3c6059efe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d46d445cb-p7w59\" (UID: \"9dfa03fa-daf8-4337-9b4a-c4c3c6059efe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59" Jun 14 14:40:54.722754 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.722728 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwqvr\" (UniqueName: \"kubernetes.io/projected/9dfa03fa-daf8-4337-9b4a-c4c3c6059efe-kube-api-access-dwqvr\") pod \"managed-serviceaccount-addon-agent-7d46d445cb-p7w59\" (UID: \"9dfa03fa-daf8-4337-9b4a-c4c3c6059efe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59" Jun 14 14:40:54.893964 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:54.893884 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59" Jun 14 14:40:55.016049 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:55.016022 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59"] Jun 14 14:40:55.018978 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:40:55.018950 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dfa03fa_daf8_4337_9b4a_c4c3c6059efe.slice/crio-d69d2f31c41f3be36015f0e9b35975e787c4f953f6c81059ae9cbc353cd2d297 WatchSource:0}: Error finding container d69d2f31c41f3be36015f0e9b35975e787c4f953f6c81059ae9cbc353cd2d297: Status 404 returned error can't find the container with id d69d2f31c41f3be36015f0e9b35975e787c4f953f6c81059ae9cbc353cd2d297 Jun 14 14:40:55.965077 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:55.965031 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59" event={"ID":"9dfa03fa-daf8-4337-9b4a-c4c3c6059efe","Type":"ContainerStarted","Data":"d69d2f31c41f3be36015f0e9b35975e787c4f953f6c81059ae9cbc353cd2d297"} Jun 14 14:40:57.971158 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:57.971117 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59" event={"ID":"9dfa03fa-daf8-4337-9b4a-c4c3c6059efe","Type":"ContainerStarted","Data":"5e4b77928a285f38c32d0e4d031e560a5594f20913b2420b75ff89a6bf7ef185"} Jun 14 14:40:57.985139 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:40:57.985090 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59" podStartSLOduration=1.539168484 podStartE2EDuration="3.985075437s" totalImagesPullingTime="2.445906953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:40:57.98430738 +0000 UTC m=+90.855240696" watchObservedRunningTime="2026-06-14 14:40:57.985075437 +0000 UTC m=+90.856008750" Jun 14 14:41:05.888101 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:41:05.888004 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:41:05.888501 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:41:05.888123 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:41:05.888501 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:41:05.888174 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls podName:08ce8c7c-2214-40f7-93ea-b44b51b75e1f nodeName:}" failed. No retries permitted until 2026-06-14 14:42:09.888161534 +0000 UTC m=+162.759094825 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls") pod "dns-default-f7d7x" (UID: "08ce8c7c-2214-40f7-93ea-b44b51b75e1f") : secret "dns-default-metrics-tls" not found Jun 14 14:41:08.921293 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:41:08.921262 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sqfcj" Jun 14 14:41:36.293039 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:41:36.292992 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:41:36.293519 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:41:36.293150 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 14:41:36.293519 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:41:36.293224 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs podName:1ad0defa-5fcf-4913-a2f5-1db88760d8fe nodeName:}" failed. No retries permitted until 2026-06-14 14:43:38.29320937 +0000 UTC m=+251.164142661 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs") pod "network-metrics-daemon-sshnr" (UID: "1ad0defa-5fcf-4913-a2f5-1db88760d8fe") : secret "metrics-daemon-secret" not found Jun 14 14:42:05.013409 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:42:05.013347 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f7d7x" podUID="08ce8c7c-2214-40f7-93ea-b44b51b75e1f" Jun 14 14:42:05.130119 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:42:05.130091 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f7d7x" Jun 14 14:42:06.579561 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:42:06.579470 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sshnr" podUID="1ad0defa-5fcf-4913-a2f5-1db88760d8fe" Jun 14 14:42:09.910590 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:42:09.910531 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:42:09.911012 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:42:09.910683 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:42:09.911012 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:42:09.910757 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls podName:08ce8c7c-2214-40f7-93ea-b44b51b75e1f nodeName:}" failed. No retries permitted until 2026-06-14 14:44:11.910741436 +0000 UTC m=+284.781674727 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls") pod "dns-default-f7d7x" (UID: "08ce8c7c-2214-40f7-93ea-b44b51b75e1f") : secret "dns-default-metrics-tls" not found Jun 14 14:42:18.558591 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:42:18.558503 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:42:58.256009 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:42:58.255973 2566 generic.go:356] "Generic (PLEG): container finished" podID="9dfa03fa-daf8-4337-9b4a-c4c3c6059efe" containerID="5e4b77928a285f38c32d0e4d031e560a5594f20913b2420b75ff89a6bf7ef185" exitCode=255 Jun 14 14:42:58.256411 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:42:58.256017 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59" event={"ID":"9dfa03fa-daf8-4337-9b4a-c4c3c6059efe","Type":"ContainerDied","Data":"5e4b77928a285f38c32d0e4d031e560a5594f20913b2420b75ff89a6bf7ef185"} Jun 14 14:42:58.261373 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:42:58.261358 2566 scope.go:117] "RemoveContainer" containerID="5e4b77928a285f38c32d0e4d031e560a5594f20913b2420b75ff89a6bf7ef185" Jun 14 14:42:59.260326 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:42:59.260294 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d46d445cb-p7w59" event={"ID":"9dfa03fa-daf8-4337-9b4a-c4c3c6059efe","Type":"ContainerStarted","Data":"a003124e376f970e0703a346e67142a2e3274f7d24520f698af11d32780d7d34"} Jun 14 14:43:04.028155 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.028122 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56cf984db-s2v7k"] Jun 14 14:43:04.031041 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.031025 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.033286 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.033264 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 14:43:04.033419 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.033273 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 14:43:04.033619 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.033604 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 14:43:04.033796 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.033781 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ns8zb\"" Jun 14 14:43:04.039825 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.039801 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 14:43:04.043166 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.043146 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56cf984db-s2v7k"] Jun 14 14:43:04.048430 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.048409 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/581dca68-aa80-428b-a78d-07a2ac6d60ef-ca-trust-extracted\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.048508 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.048437 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/581dca68-aa80-428b-a78d-07a2ac6d60ef-trusted-ca\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.048508 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.048474 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/581dca68-aa80-428b-a78d-07a2ac6d60ef-image-registry-private-configuration\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.048508 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.048498 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.048634 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.048532 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/581dca68-aa80-428b-a78d-07a2ac6d60ef-installation-pull-secrets\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.048667 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.048636 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6lb7\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-kube-api-access-j6lb7\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.048667 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.048660 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-certificates\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.048726 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.048679 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-bound-sa-token\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.115677 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.115645 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf"] Jun 14 14:43:04.118521 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.118504 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" Jun 14 14:43:04.120491 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.120471 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 14 14:43:04.120986 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.120968 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hvc4s\"" Jun 14 14:43:04.121316 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.121295 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 14 14:43:04.121398 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.121297 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 14 14:43:04.121398 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.121317 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:43:04.122892 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.122873 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-mp7dh"] Jun 14 14:43:04.125459 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.125437 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-mgjpl"] Jun 14 14:43:04.125578 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.125563 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-mp7dh" Jun 14 14:43:04.127362 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.127344 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 14 14:43:04.127926 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.127906 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:43:04.128145 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.128129 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:04.128985 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.128966 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xjxnf\"" Jun 14 14:43:04.129745 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.129725 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf"] Jun 14 14:43:04.130185 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.130166 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:43:04.130351 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.130334 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 14 14:43:04.130703 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.130679 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 14 14:43:04.130780 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.130746 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 14 14:43:04.131088 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.131075 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-t7jmz\"" Jun 14 14:43:04.136787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.136766 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 14 14:43:04.137718 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.137698 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-mp7dh"] Jun 14 14:43:04.138651 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.138633 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-mgjpl"] Jun 14 14:43:04.149231 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149213 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xbvn\" (UniqueName: \"kubernetes.io/projected/1590e269-f5bf-4167-8aa6-245d3c99b8b0-kube-api-access-9xbvn\") pod \"volume-data-source-validator-bd4ccd799-mp7dh\" (UID: \"1590e269-f5bf-4167-8aa6-245d3c99b8b0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-mp7dh" Jun 14 14:43:04.149331 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149237 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81661230-a191-4baa-8589-510a9c0082ff-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-mfcxf\" (UID: \"81661230-a191-4baa-8589-510a9c0082ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" Jun 14 14:43:04.149331 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149255 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8jds\" (UniqueName: \"kubernetes.io/projected/81661230-a191-4baa-8589-510a9c0082ff-kube-api-access-w8jds\") pod \"kube-storage-version-migrator-operator-7c578b78fc-mfcxf\" (UID: \"81661230-a191-4baa-8589-510a9c0082ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" Jun 14 14:43:04.149331 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149271 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11cceb40-aca4-4ff0-b0f9-352cca8e5a79-serving-cert\") pod \"console-operator-5dbbb5d744-mgjpl\" (UID: \"11cceb40-aca4-4ff0-b0f9-352cca8e5a79\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:04.149331 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149321 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81661230-a191-4baa-8589-510a9c0082ff-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-mfcxf\" (UID: \"81661230-a191-4baa-8589-510a9c0082ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" Jun 14 14:43:04.149557 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149378 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p24t\" (UniqueName: \"kubernetes.io/projected/11cceb40-aca4-4ff0-b0f9-352cca8e5a79-kube-api-access-5p24t\") pod \"console-operator-5dbbb5d744-mgjpl\" (UID: \"11cceb40-aca4-4ff0-b0f9-352cca8e5a79\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:04.149557 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149424 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/581dca68-aa80-428b-a78d-07a2ac6d60ef-ca-trust-extracted\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.149557 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149453 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/581dca68-aa80-428b-a78d-07a2ac6d60ef-trusted-ca\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.149557 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149530 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/581dca68-aa80-428b-a78d-07a2ac6d60ef-image-registry-private-configuration\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.149755 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149573 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.149755 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/581dca68-aa80-428b-a78d-07a2ac6d60ef-installation-pull-secrets\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.149755 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149629 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11cceb40-aca4-4ff0-b0f9-352cca8e5a79-config\") pod \"console-operator-5dbbb5d744-mgjpl\" (UID: \"11cceb40-aca4-4ff0-b0f9-352cca8e5a79\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:04.149755 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149695 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6lb7\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-kube-api-access-j6lb7\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.149755 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:04.149708 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:43:04.149755 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:04.149724 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56cf984db-s2v7k: secret "image-registry-tls" not found Jun 14 14:43:04.150007 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:04.149790 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls podName:581dca68-aa80-428b-a78d-07a2ac6d60ef nodeName:}" failed. No retries permitted until 2026-06-14 14:43:04.649773843 +0000 UTC m=+217.520707134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls") pod "image-registry-56cf984db-s2v7k" (UID: "581dca68-aa80-428b-a78d-07a2ac6d60ef") : secret "image-registry-tls" not found Jun 14 14:43:04.150007 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149801 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/581dca68-aa80-428b-a78d-07a2ac6d60ef-ca-trust-extracted\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.150007 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149720 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11cceb40-aca4-4ff0-b0f9-352cca8e5a79-trusted-ca\") pod \"console-operator-5dbbb5d744-mgjpl\" (UID: \"11cceb40-aca4-4ff0-b0f9-352cca8e5a79\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:04.150007 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149860 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-certificates\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.150007 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.149885 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-bound-sa-token\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.150418 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.150401 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-certificates\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.150478 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.150440 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/581dca68-aa80-428b-a78d-07a2ac6d60ef-trusted-ca\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.151970 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.151952 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/581dca68-aa80-428b-a78d-07a2ac6d60ef-installation-pull-secrets\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.152047 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.152000 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/581dca68-aa80-428b-a78d-07a2ac6d60ef-image-registry-private-configuration\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.158069 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.158049 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-bound-sa-token\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.158506 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.158487 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6lb7\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-kube-api-access-j6lb7\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.219208 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.219181 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-k6khp"] Jun 14 14:43:04.223018 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.223002 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.224941 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.224922 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 14 14:43:04.225037 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.224961 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hnz6d\"" Jun 14 14:43:04.225037 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.224995 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 14:43:04.225328 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.225310 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 14 14:43:04.225392 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.225352 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 14:43:04.231074 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.231053 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-k6khp"] Jun 14 14:43:04.235840 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.235764 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 14 14:43:04.250699 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.250675 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wndhc\" (UniqueName: \"kubernetes.io/projected/1566f1d4-22a5-4d5b-9d58-58a93760eff1-kube-api-access-wndhc\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.250789 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.250733 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xbvn\" (UniqueName: \"kubernetes.io/projected/1590e269-f5bf-4167-8aa6-245d3c99b8b0-kube-api-access-9xbvn\") pod \"volume-data-source-validator-bd4ccd799-mp7dh\" (UID: \"1590e269-f5bf-4167-8aa6-245d3c99b8b0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-mp7dh" Jun 14 14:43:04.250789 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.250774 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1566f1d4-22a5-4d5b-9d58-58a93760eff1-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.250854 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.250805 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1566f1d4-22a5-4d5b-9d58-58a93760eff1-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.250854 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.250830 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8jds\" (UniqueName: \"kubernetes.io/projected/81661230-a191-4baa-8589-510a9c0082ff-kube-api-access-w8jds\") pod \"kube-storage-version-migrator-operator-7c578b78fc-mfcxf\" (UID: \"81661230-a191-4baa-8589-510a9c0082ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" Jun 14 14:43:04.250854 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.250848 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81661230-a191-4baa-8589-510a9c0082ff-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-mfcxf\" (UID: \"81661230-a191-4baa-8589-510a9c0082ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" Jun 14 14:43:04.250999 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.250883 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11cceb40-aca4-4ff0-b0f9-352cca8e5a79-serving-cert\") pod \"console-operator-5dbbb5d744-mgjpl\" (UID: \"11cceb40-aca4-4ff0-b0f9-352cca8e5a79\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:04.251114 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.251016 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11cceb40-aca4-4ff0-b0f9-352cca8e5a79-config\") pod \"console-operator-5dbbb5d744-mgjpl\" (UID: \"11cceb40-aca4-4ff0-b0f9-352cca8e5a79\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:04.251114 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.251060 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1566f1d4-22a5-4d5b-9d58-58a93760eff1-tmp\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.251114 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.251084 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11cceb40-aca4-4ff0-b0f9-352cca8e5a79-trusted-ca\") pod \"console-operator-5dbbb5d744-mgjpl\" (UID: \"11cceb40-aca4-4ff0-b0f9-352cca8e5a79\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:04.251114 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.251100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1566f1d4-22a5-4d5b-9d58-58a93760eff1-serving-cert\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.251380 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.251125 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81661230-a191-4baa-8589-510a9c0082ff-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-mfcxf\" (UID: \"81661230-a191-4baa-8589-510a9c0082ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" Jun 14 14:43:04.251380 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.251166 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p24t\" (UniqueName: \"kubernetes.io/projected/11cceb40-aca4-4ff0-b0f9-352cca8e5a79-kube-api-access-5p24t\") pod \"console-operator-5dbbb5d744-mgjpl\" (UID: \"11cceb40-aca4-4ff0-b0f9-352cca8e5a79\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:04.251380 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.251191 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1566f1d4-22a5-4d5b-9d58-58a93760eff1-snapshots\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.251660 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.251641 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81661230-a191-4baa-8589-510a9c0082ff-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-mfcxf\" (UID: \"81661230-a191-4baa-8589-510a9c0082ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" Jun 14 14:43:04.251733 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.251681 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11cceb40-aca4-4ff0-b0f9-352cca8e5a79-config\") pod \"console-operator-5dbbb5d744-mgjpl\" (UID: \"11cceb40-aca4-4ff0-b0f9-352cca8e5a79\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:04.252091 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.252067 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11cceb40-aca4-4ff0-b0f9-352cca8e5a79-trusted-ca\") pod \"console-operator-5dbbb5d744-mgjpl\" (UID: \"11cceb40-aca4-4ff0-b0f9-352cca8e5a79\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:04.253096 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.253076 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81661230-a191-4baa-8589-510a9c0082ff-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-mfcxf\" (UID: \"81661230-a191-4baa-8589-510a9c0082ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" Jun 14 14:43:04.253264 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.253249 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11cceb40-aca4-4ff0-b0f9-352cca8e5a79-serving-cert\") pod \"console-operator-5dbbb5d744-mgjpl\" (UID: \"11cceb40-aca4-4ff0-b0f9-352cca8e5a79\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:04.258087 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.258065 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p24t\" (UniqueName: \"kubernetes.io/projected/11cceb40-aca4-4ff0-b0f9-352cca8e5a79-kube-api-access-5p24t\") pod \"console-operator-5dbbb5d744-mgjpl\" (UID: \"11cceb40-aca4-4ff0-b0f9-352cca8e5a79\") " pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:04.258251 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.258234 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8jds\" (UniqueName: \"kubernetes.io/projected/81661230-a191-4baa-8589-510a9c0082ff-kube-api-access-w8jds\") pod \"kube-storage-version-migrator-operator-7c578b78fc-mfcxf\" (UID: \"81661230-a191-4baa-8589-510a9c0082ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" Jun 14 14:43:04.258739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.258722 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xbvn\" (UniqueName: \"kubernetes.io/projected/1590e269-f5bf-4167-8aa6-245d3c99b8b0-kube-api-access-9xbvn\") pod \"volume-data-source-validator-bd4ccd799-mp7dh\" (UID: \"1590e269-f5bf-4167-8aa6-245d3c99b8b0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-mp7dh" Jun 14 14:43:04.351463 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.351399 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1566f1d4-22a5-4d5b-9d58-58a93760eff1-serving-cert\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.351463 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.351440 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1566f1d4-22a5-4d5b-9d58-58a93760eff1-snapshots\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.351648 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.351469 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wndhc\" (UniqueName: \"kubernetes.io/projected/1566f1d4-22a5-4d5b-9d58-58a93760eff1-kube-api-access-wndhc\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.351648 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.351556 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1566f1d4-22a5-4d5b-9d58-58a93760eff1-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.351648 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.351584 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1566f1d4-22a5-4d5b-9d58-58a93760eff1-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.351648 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.351640 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1566f1d4-22a5-4d5b-9d58-58a93760eff1-tmp\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.352065 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.352043 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1566f1d4-22a5-4d5b-9d58-58a93760eff1-tmp\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.352150 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.352131 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1566f1d4-22a5-4d5b-9d58-58a93760eff1-snapshots\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.352189 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.352156 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1566f1d4-22a5-4d5b-9d58-58a93760eff1-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.352462 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.352444 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1566f1d4-22a5-4d5b-9d58-58a93760eff1-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.353338 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.353322 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1566f1d4-22a5-4d5b-9d58-58a93760eff1-serving-cert\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.361681 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.361665 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wndhc\" (UniqueName: \"kubernetes.io/projected/1566f1d4-22a5-4d5b-9d58-58a93760eff1-kube-api-access-wndhc\") pod \"insights-operator-5bbd86d6bd-k6khp\" (UID: \"1566f1d4-22a5-4d5b-9d58-58a93760eff1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.428124 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.428104 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" Jun 14 14:43:04.438108 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.438093 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-mp7dh" Jun 14 14:43:04.444157 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.443849 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:04.535782 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.535742 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" Jun 14 14:43:04.564135 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.564111 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf"] Jun 14 14:43:04.567955 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:43:04.567908 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81661230_a191_4baa_8589_510a9c0082ff.slice/crio-dcf066ce502a0f751915cc5095d86ed6d9753aac945c6153757a1de8ae70194f WatchSource:0}: Error finding container dcf066ce502a0f751915cc5095d86ed6d9753aac945c6153757a1de8ae70194f: Status 404 returned error can't find the container with id dcf066ce502a0f751915cc5095d86ed6d9753aac945c6153757a1de8ae70194f Jun 14 14:43:04.579722 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.579697 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-mp7dh"] Jun 14 14:43:04.584374 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:43:04.584350 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1590e269_f5bf_4167_8aa6_245d3c99b8b0.slice/crio-30704d02313a535e6bc5cdf4a866a504333972f9e02efba9a0baa97c52e942dd WatchSource:0}: Error finding container 30704d02313a535e6bc5cdf4a866a504333972f9e02efba9a0baa97c52e942dd: Status 404 returned error can't find the container with id 30704d02313a535e6bc5cdf4a866a504333972f9e02efba9a0baa97c52e942dd Jun 14 14:43:04.596347 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.596255 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-mgjpl"] Jun 14 14:43:04.598791 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:43:04.598763 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11cceb40_aca4_4ff0_b0f9_352cca8e5a79.slice/crio-a5bc2f502699724eab4180e8e6aead9349c4b8eb08c7afb7eb9a1ec35e719e81 WatchSource:0}: Error finding container a5bc2f502699724eab4180e8e6aead9349c4b8eb08c7afb7eb9a1ec35e719e81: Status 404 returned error can't find the container with id a5bc2f502699724eab4180e8e6aead9349c4b8eb08c7afb7eb9a1ec35e719e81 Jun 14 14:43:04.653216 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.653188 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:04.653341 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:04.653327 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:43:04.653341 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:04.653340 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56cf984db-s2v7k: secret "image-registry-tls" not found Jun 14 14:43:04.653415 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:04.653392 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls podName:581dca68-aa80-428b-a78d-07a2ac6d60ef nodeName:}" failed. No retries permitted until 2026-06-14 14:43:05.653377078 +0000 UTC m=+218.524310374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls") pod "image-registry-56cf984db-s2v7k" (UID: "581dca68-aa80-428b-a78d-07a2ac6d60ef") : secret "image-registry-tls" not found Jun 14 14:43:04.666779 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:04.666752 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-k6khp"] Jun 14 14:43:04.670031 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:43:04.669997 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1566f1d4_22a5_4d5b_9d58_58a93760eff1.slice/crio-c6782ac3dd9292321d606454223709075caf31d25b8400eb91a98296f99ec0e6 WatchSource:0}: Error finding container c6782ac3dd9292321d606454223709075caf31d25b8400eb91a98296f99ec0e6: Status 404 returned error can't find the container with id c6782ac3dd9292321d606454223709075caf31d25b8400eb91a98296f99ec0e6 Jun 14 14:43:05.281627 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:05.281473 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" event={"ID":"11cceb40-aca4-4ff0-b0f9-352cca8e5a79","Type":"ContainerStarted","Data":"a5bc2f502699724eab4180e8e6aead9349c4b8eb08c7afb7eb9a1ec35e719e81"} Jun 14 14:43:05.283658 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:05.283552 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-mp7dh" event={"ID":"1590e269-f5bf-4167-8aa6-245d3c99b8b0","Type":"ContainerStarted","Data":"30704d02313a535e6bc5cdf4a866a504333972f9e02efba9a0baa97c52e942dd"} Jun 14 14:43:05.286007 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:05.285952 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" event={"ID":"1566f1d4-22a5-4d5b-9d58-58a93760eff1","Type":"ContainerStarted","Data":"c6782ac3dd9292321d606454223709075caf31d25b8400eb91a98296f99ec0e6"} Jun 14 14:43:05.287602 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:05.287533 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" event={"ID":"81661230-a191-4baa-8589-510a9c0082ff","Type":"ContainerStarted","Data":"dcf066ce502a0f751915cc5095d86ed6d9753aac945c6153757a1de8ae70194f"} Jun 14 14:43:05.661800 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:05.661729 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:05.661951 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:05.661895 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:43:05.661951 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:05.661917 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56cf984db-s2v7k: secret "image-registry-tls" not found Jun 14 14:43:05.662060 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:05.661986 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls podName:581dca68-aa80-428b-a78d-07a2ac6d60ef nodeName:}" failed. No retries permitted until 2026-06-14 14:43:07.66196599 +0000 UTC m=+220.532899304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls") pod "image-registry-56cf984db-s2v7k" (UID: "581dca68-aa80-428b-a78d-07a2ac6d60ef") : secret "image-registry-tls" not found Jun 14 14:43:06.294273 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:06.294176 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-mp7dh" event={"ID":"1590e269-f5bf-4167-8aa6-245d3c99b8b0","Type":"ContainerStarted","Data":"6e9be4abc54bf43538e21ae58f975591236e2845a94d3f9eb8a2befb52955b0c"} Jun 14 14:43:06.308765 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:06.308555 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-mp7dh" podStartSLOduration=0.879129592 podStartE2EDuration="2.308517744s" totalImagesPullingTime="1.429388152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:06.307938834 +0000 UTC m=+219.178872151" watchObservedRunningTime="2026-06-14 14:43:06.308517744 +0000 UTC m=+219.179451058" Jun 14 14:43:07.678036 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:07.678011 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:07.678388 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:07.678225 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:43:07.678388 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:07.678246 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56cf984db-s2v7k: secret "image-registry-tls" not found Jun 14 14:43:07.678388 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:07.678347 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls podName:581dca68-aa80-428b-a78d-07a2ac6d60ef nodeName:}" failed. No retries permitted until 2026-06-14 14:43:11.678327062 +0000 UTC m=+224.549260353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls") pod "image-registry-56cf984db-s2v7k" (UID: "581dca68-aa80-428b-a78d-07a2ac6d60ef") : secret "image-registry-tls" not found Jun 14 14:43:08.303977 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:08.303947 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/0.log" Jun 14 14:43:08.304159 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:08.303986 2566 generic.go:356] "Generic (PLEG): container finished" podID="11cceb40-aca4-4ff0-b0f9-352cca8e5a79" containerID="93d54e8ad229adf7672a00b0375bd4dbeb7c1a085c743d5be05b4534bca2f5c9" exitCode=255 Jun 14 14:43:08.304159 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:08.304020 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" event={"ID":"11cceb40-aca4-4ff0-b0f9-352cca8e5a79","Type":"ContainerDied","Data":"93d54e8ad229adf7672a00b0375bd4dbeb7c1a085c743d5be05b4534bca2f5c9"} Jun 14 14:43:08.304334 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:08.304308 2566 scope.go:117] "RemoveContainer" containerID="93d54e8ad229adf7672a00b0375bd4dbeb7c1a085c743d5be05b4534bca2f5c9" Jun 14 14:43:08.305711 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:08.305690 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" event={"ID":"1566f1d4-22a5-4d5b-9d58-58a93760eff1","Type":"ContainerStarted","Data":"827e50f507174b38352ab65279227e7758b3d726869f6ab269c9a25cf2c16637"} Jun 14 14:43:08.307230 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:08.307199 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" event={"ID":"81661230-a191-4baa-8589-510a9c0082ff","Type":"ContainerStarted","Data":"a4baed4b44b54e5cc61c7dee3622cef0ebd8aa76e7fe851c8f3a2db8923e3635"} Jun 14 14:43:08.345360 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:08.345313 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" podStartSLOduration=1.371125585 podStartE2EDuration="4.345296168s" totalImagesPullingTime="2.974170583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:08.332721451 +0000 UTC m=+221.203654765" watchObservedRunningTime="2026-06-14 14:43:08.345296168 +0000 UTC m=+221.216229485" Jun 14 14:43:08.346125 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:08.346074 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" podStartSLOduration=1.276163228 podStartE2EDuration="4.346056928s" totalImagesPullingTime="3.0698937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:08.344706641 +0000 UTC m=+221.215639955" watchObservedRunningTime="2026-06-14 14:43:08.346056928 +0000 UTC m=+221.216990243" Jun 14 14:43:09.312317 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.312291 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 14:43:09.312841 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.312712 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/0.log" Jun 14 14:43:09.312841 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.312756 2566 generic.go:356] "Generic (PLEG): container finished" podID="11cceb40-aca4-4ff0-b0f9-352cca8e5a79" containerID="f62baa1fa2a509b0fc919b0651c52a980f5a77065ef901f58a51d5de77fc9671" exitCode=255 Jun 14 14:43:09.312956 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.312835 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" event={"ID":"11cceb40-aca4-4ff0-b0f9-352cca8e5a79","Type":"ContainerDied","Data":"f62baa1fa2a509b0fc919b0651c52a980f5a77065ef901f58a51d5de77fc9671"} Jun 14 14:43:09.312956 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.312900 2566 scope.go:117] "RemoveContainer" containerID="93d54e8ad229adf7672a00b0375bd4dbeb7c1a085c743d5be05b4534bca2f5c9" Jun 14 14:43:09.313089 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.313065 2566 scope.go:117] "RemoveContainer" containerID="f62baa1fa2a509b0fc919b0651c52a980f5a77065ef901f58a51d5de77fc9671" Jun 14 14:43:09.313270 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:09.313247 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-mgjpl_openshift-console-operator(11cceb40-aca4-4ff0-b0f9-352cca8e5a79)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" podUID="11cceb40-aca4-4ff0-b0f9-352cca8e5a79" Jun 14 14:43:09.777067 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.777018 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wvqfq"] Jun 14 14:43:09.781742 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.781715 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:09.784399 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.784367 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 14:43:09.784399 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.784387 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wt54v\"" Jun 14 14:43:09.785990 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.785956 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 14:43:09.795807 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.795785 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wvqfq"] Jun 14 14:43:09.894634 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.894601 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trsq9\" (UniqueName: \"kubernetes.io/projected/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-api-access-trsq9\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:09.894780 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.894685 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-crio-socket\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:09.894780 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.894709 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:09.894780 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.894726 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-data-volume\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:09.894780 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.894741 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:09.995300 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.995266 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trsq9\" (UniqueName: \"kubernetes.io/projected/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-api-access-trsq9\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:09.995458 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.995437 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-crio-socket\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:09.995566 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.995488 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:09.995566 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.995515 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-data-volume\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:09.995566 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.995561 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:09.995660 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.995563 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-crio-socket\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:09.995660 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:09.995635 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:09.995725 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:09.995661 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:09.995725 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:09.995715 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm podName:f4ec8dc3-7b6c-4988-8481-b4f5447392a7 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:10.495697436 +0000 UTC m=+223.366630749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wvqfq" (UID: "f4ec8dc3-7b6c-4988-8481-b4f5447392a7") : configmap "kube-rbac-proxy" not found Jun 14 14:43:09.995792 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:09.995729 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls podName:f4ec8dc3-7b6c-4988-8481-b4f5447392a7 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:10.495723107 +0000 UTC m=+223.366656398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wvqfq" (UID: "f4ec8dc3-7b6c-4988-8481-b4f5447392a7") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:09.995877 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:09.995860 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-data-volume\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:10.005067 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.005048 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trsq9\" (UniqueName: \"kubernetes.io/projected/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-api-access-trsq9\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:10.258078 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.258048 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-vwc8m"] Jun 14 14:43:10.261070 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.261056 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-vwc8m" Jun 14 14:43:10.263018 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.262998 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 14 14:43:10.263138 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.263025 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 14 14:43:10.263138 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.263027 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wzhjm\"" Jun 14 14:43:10.263293 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.263278 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 14 14:43:10.263293 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.263285 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 14 14:43:10.268030 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.268000 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-vwc8m"] Jun 14 14:43:10.298606 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.298584 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb-signing-key\") pod \"service-ca-7b994bc59-vwc8m\" (UID: \"68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb\") " pod="openshift-service-ca/service-ca-7b994bc59-vwc8m" Jun 14 14:43:10.298699 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.298656 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb-signing-cabundle\") pod \"service-ca-7b994bc59-vwc8m\" (UID: \"68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb\") " pod="openshift-service-ca/service-ca-7b994bc59-vwc8m" Jun 14 14:43:10.298752 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.298710 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4kkn\" (UniqueName: \"kubernetes.io/projected/68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb-kube-api-access-f4kkn\") pod \"service-ca-7b994bc59-vwc8m\" (UID: \"68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb\") " pod="openshift-service-ca/service-ca-7b994bc59-vwc8m" Jun 14 14:43:10.317364 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.317346 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 14:43:10.317684 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.317671 2566 scope.go:117] "RemoveContainer" containerID="f62baa1fa2a509b0fc919b0651c52a980f5a77065ef901f58a51d5de77fc9671" Jun 14 14:43:10.317831 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:10.317811 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-mgjpl_openshift-console-operator(11cceb40-aca4-4ff0-b0f9-352cca8e5a79)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" podUID="11cceb40-aca4-4ff0-b0f9-352cca8e5a79" Jun 14 14:43:10.399303 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.399282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb-signing-cabundle\") pod \"service-ca-7b994bc59-vwc8m\" (UID: \"68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb\") " pod="openshift-service-ca/service-ca-7b994bc59-vwc8m" Jun 14 14:43:10.399393 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.399359 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4kkn\" (UniqueName: \"kubernetes.io/projected/68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb-kube-api-access-f4kkn\") pod \"service-ca-7b994bc59-vwc8m\" (UID: \"68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb\") " pod="openshift-service-ca/service-ca-7b994bc59-vwc8m" Jun 14 14:43:10.399432 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.399409 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb-signing-key\") pod \"service-ca-7b994bc59-vwc8m\" (UID: \"68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb\") " pod="openshift-service-ca/service-ca-7b994bc59-vwc8m" Jun 14 14:43:10.400051 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.400033 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb-signing-cabundle\") pod \"service-ca-7b994bc59-vwc8m\" (UID: \"68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb\") " pod="openshift-service-ca/service-ca-7b994bc59-vwc8m" Jun 14 14:43:10.401965 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.401944 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb-signing-key\") pod \"service-ca-7b994bc59-vwc8m\" (UID: \"68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb\") " pod="openshift-service-ca/service-ca-7b994bc59-vwc8m" Jun 14 14:43:10.406286 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.406269 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4kkn\" (UniqueName: \"kubernetes.io/projected/68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb-kube-api-access-f4kkn\") pod \"service-ca-7b994bc59-vwc8m\" (UID: \"68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb\") " pod="openshift-service-ca/service-ca-7b994bc59-vwc8m" Jun 14 14:43:10.500793 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.500767 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:10.500877 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.500803 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:10.500877 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:10.500860 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:10.500945 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:10.500899 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:10.500945 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:10.500910 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm podName:f4ec8dc3-7b6c-4988-8481-b4f5447392a7 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:11.500895461 +0000 UTC m=+224.371828766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wvqfq" (UID: "f4ec8dc3-7b6c-4988-8481-b4f5447392a7") : configmap "kube-rbac-proxy" not found Jun 14 14:43:10.501015 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:10.500945 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls podName:f4ec8dc3-7b6c-4988-8481-b4f5447392a7 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:11.500933592 +0000 UTC m=+224.371866882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wvqfq" (UID: "f4ec8dc3-7b6c-4988-8481-b4f5447392a7") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:10.570140 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.570095 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-vwc8m" Jun 14 14:43:10.687478 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:10.687451 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-vwc8m"] Jun 14 14:43:10.690019 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:43:10.689994 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a6d2fa_1f17_4096_bcb5_ba4db67eb8bb.slice/crio-7e030c8a995a7dc482b296b9048078272081d23b754db943b9dd308134e1c0d1 WatchSource:0}: Error finding container 7e030c8a995a7dc482b296b9048078272081d23b754db943b9dd308134e1c0d1: Status 404 returned error can't find the container with id 7e030c8a995a7dc482b296b9048078272081d23b754db943b9dd308134e1c0d1 Jun 14 14:43:11.323634 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:11.323598 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-vwc8m" event={"ID":"68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb","Type":"ContainerStarted","Data":"7e030c8a995a7dc482b296b9048078272081d23b754db943b9dd308134e1c0d1"} Jun 14 14:43:11.508441 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:11.508408 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:11.508643 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:11.508449 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:11.508643 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:11.508589 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:11.508643 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:11.508616 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:11.508782 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:11.508678 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls podName:f4ec8dc3-7b6c-4988-8481-b4f5447392a7 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:13.50865808 +0000 UTC m=+226.379591385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wvqfq" (UID: "f4ec8dc3-7b6c-4988-8481-b4f5447392a7") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:11.508782 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:11.508701 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm podName:f4ec8dc3-7b6c-4988-8481-b4f5447392a7 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:13.508690218 +0000 UTC m=+226.379623511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wvqfq" (UID: "f4ec8dc3-7b6c-4988-8481-b4f5447392a7") : configmap "kube-rbac-proxy" not found Jun 14 14:43:11.711153 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:11.711123 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:11.711304 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:11.711223 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:43:11.711304 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:11.711235 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56cf984db-s2v7k: secret "image-registry-tls" not found Jun 14 14:43:11.711304 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:11.711282 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls podName:581dca68-aa80-428b-a78d-07a2ac6d60ef nodeName:}" failed. No retries permitted until 2026-06-14 14:43:19.711268844 +0000 UTC m=+232.582202134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls") pod "image-registry-56cf984db-s2v7k" (UID: "581dca68-aa80-428b-a78d-07a2ac6d60ef") : secret "image-registry-tls" not found Jun 14 14:43:12.360359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:12.360323 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-24l22_b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b/dns-node-resolver/0.log" Jun 14 14:43:13.331525 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:13.331489 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-vwc8m" event={"ID":"68a6d2fa-1f17-4096-bcb5-ba4db67eb8bb","Type":"ContainerStarted","Data":"7003d723da6fc53adcd921b1f49572dc5140fab77d6978e4320e63a927a8bd38"} Jun 14 14:43:13.346107 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:13.346062 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-vwc8m" podStartSLOduration=1.4301812520000001 podStartE2EDuration="3.346047952s" totalImagesPullingTime="1.9158667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:13.34502741 +0000 UTC m=+226.215960723" watchObservedRunningTime="2026-06-14 14:43:13.346047952 +0000 UTC m=+226.216981299" Jun 14 14:43:13.526609 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:13.526575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:13.526963 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:13.526673 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:13.526963 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:13.526688 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:13.526963 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:13.526751 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm podName:f4ec8dc3-7b6c-4988-8481-b4f5447392a7 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:17.52673256 +0000 UTC m=+230.397665865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wvqfq" (UID: "f4ec8dc3-7b6c-4988-8481-b4f5447392a7") : configmap "kube-rbac-proxy" not found Jun 14 14:43:13.526963 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:13.526765 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:13.526963 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:13.526813 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls podName:f4ec8dc3-7b6c-4988-8481-b4f5447392a7 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:17.526802114 +0000 UTC m=+230.397735405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wvqfq" (UID: "f4ec8dc3-7b6c-4988-8481-b4f5447392a7") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:13.761313 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:13.761289 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mtw64_853c09c4-64cc-443b-be20-c50c89c658b9/node-ca/0.log" Jun 14 14:43:14.361088 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:14.361015 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kcjq8_143f5e39-8acd-4190-94b3-ca136a6a90c2/serve-healthcheck-canary/0.log" Jun 14 14:43:14.444149 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:14.444124 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:14.444306 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:14.444166 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:14.444449 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:14.444437 2566 scope.go:117] "RemoveContainer" containerID="f62baa1fa2a509b0fc919b0651c52a980f5a77065ef901f58a51d5de77fc9671" Jun 14 14:43:14.444607 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:14.444590 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-mgjpl_openshift-console-operator(11cceb40-aca4-4ff0-b0f9-352cca8e5a79)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" podUID="11cceb40-aca4-4ff0-b0f9-352cca8e5a79" Jun 14 14:43:15.161484 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:15.161426 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-mfcxf_81661230-a191-4baa-8589-510a9c0082ff/kube-storage-version-migrator-operator/0.log" Jun 14 14:43:17.556666 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:17.556629 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:17.556666 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:17.556669 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:17.557121 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:17.556768 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:17.557121 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:17.556812 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:17.557121 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:17.556829 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls podName:f4ec8dc3-7b6c-4988-8481-b4f5447392a7 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:25.556813208 +0000 UTC m=+238.427746499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wvqfq" (UID: "f4ec8dc3-7b6c-4988-8481-b4f5447392a7") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:17.557121 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:17.556863 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm podName:f4ec8dc3-7b6c-4988-8481-b4f5447392a7 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:25.556848919 +0000 UTC m=+238.427782210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wvqfq" (UID: "f4ec8dc3-7b6c-4988-8481-b4f5447392a7") : configmap "kube-rbac-proxy" not found Jun 14 14:43:19.772869 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:19.772833 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:19.775242 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:19.775222 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls\") pod \"image-registry-56cf984db-s2v7k\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:19.940158 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:19.940127 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:20.065605 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:20.065576 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56cf984db-s2v7k"] Jun 14 14:43:20.067903 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:43:20.067875 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581dca68_aa80_428b_a78d_07a2ac6d60ef.slice/crio-48a59ad1bc246474a4424bc55f64690426485ebbd5991f4becc1ea29a76fcdff WatchSource:0}: Error finding container 48a59ad1bc246474a4424bc55f64690426485ebbd5991f4becc1ea29a76fcdff: Status 404 returned error can't find the container with id 48a59ad1bc246474a4424bc55f64690426485ebbd5991f4becc1ea29a76fcdff Jun 14 14:43:20.356437 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:20.356355 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56cf984db-s2v7k" event={"ID":"581dca68-aa80-428b-a78d-07a2ac6d60ef","Type":"ContainerStarted","Data":"6f544cbeaeff461c11fc8c5fd6ae9bfa9ff013b6e68147fccbb6427d865167fc"} Jun 14 14:43:20.356437 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:20.356400 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56cf984db-s2v7k" event={"ID":"581dca68-aa80-428b-a78d-07a2ac6d60ef","Type":"ContainerStarted","Data":"48a59ad1bc246474a4424bc55f64690426485ebbd5991f4becc1ea29a76fcdff"} Jun 14 14:43:20.356739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:20.356491 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:20.374734 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:20.374679 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56cf984db-s2v7k" podStartSLOduration=16.374659738 podStartE2EDuration="16.374659738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:20.372944415 +0000 UTC m=+233.243877730" watchObservedRunningTime="2026-06-14 14:43:20.374659738 +0000 UTC m=+233.245593055" Jun 14 14:43:25.619719 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:25.619677 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:25.619719 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:25.619730 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:25.620355 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:25.620332 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:25.621891 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:25.621870 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ec8dc3-7b6c-4988-8481-b4f5447392a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wvqfq\" (UID: \"f4ec8dc3-7b6c-4988-8481-b4f5447392a7\") " pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:25.692269 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:25.692241 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wvqfq" Jun 14 14:43:25.815621 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:25.815436 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wvqfq"] Jun 14 14:43:25.817947 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:43:25.817918 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ec8dc3_7b6c_4988_8481_b4f5447392a7.slice/crio-7c559efae3bf9912029cf9bb38d85e30795302048a6e9b6cc37869beb4870dd2 WatchSource:0}: Error finding container 7c559efae3bf9912029cf9bb38d85e30795302048a6e9b6cc37869beb4870dd2: Status 404 returned error can't find the container with id 7c559efae3bf9912029cf9bb38d85e30795302048a6e9b6cc37869beb4870dd2 Jun 14 14:43:26.378803 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:26.378766 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wvqfq" event={"ID":"f4ec8dc3-7b6c-4988-8481-b4f5447392a7","Type":"ContainerStarted","Data":"7c559efae3bf9912029cf9bb38d85e30795302048a6e9b6cc37869beb4870dd2"} Jun 14 14:43:27.561128 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:27.561095 2566 scope.go:117] "RemoveContainer" containerID="f62baa1fa2a509b0fc919b0651c52a980f5a77065ef901f58a51d5de77fc9671" Jun 14 14:43:29.390443 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:29.390406 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wvqfq" event={"ID":"f4ec8dc3-7b6c-4988-8481-b4f5447392a7","Type":"ContainerStarted","Data":"544c98db6aa55149ac631e26feedae028591f624050c13d2e5062cf56602e7ff"} Jun 14 14:43:29.392161 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:29.392142 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 14:43:29.392253 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:29.392192 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" event={"ID":"11cceb40-aca4-4ff0-b0f9-352cca8e5a79","Type":"ContainerStarted","Data":"57220f80c351a1e9852c61d29091e54e1a3551d27d997c462116526980a40be0"} Jun 14 14:43:29.392465 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:29.392440 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:29.407202 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:29.407162 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" podStartSLOduration=22.366296612 podStartE2EDuration="25.407124866s" totalImagesPullingTime="3.040828254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:29.406610868 +0000 UTC m=+242.277544181" watchObservedRunningTime="2026-06-14 14:43:29.407124866 +0000 UTC m=+242.278058189" Jun 14 14:43:29.917628 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:29.917598 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-mgjpl" Jun 14 14:43:30.836318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.836286 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56cf984db-s2v7k"] Jun 14 14:43:30.841765 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.841743 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-j6v2f"] Jun 14 14:43:30.858656 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.858604 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-j6v2f"] Jun 14 14:43:30.858804 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.858705 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-j6v2f" Jun 14 14:43:30.860685 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.860662 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cgs9b\"" Jun 14 14:43:30.860894 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.860723 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 14:43:30.861095 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.861067 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 14:43:30.867125 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.867104 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-759cfff566-d2t4v"] Jun 14 14:43:30.892874 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.892853 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-759cfff566-d2t4v"] Jun 14 14:43:30.892980 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.892938 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:30.962513 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.962478 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71881136-77ed-43fa-9e91-7dd04bc273ae-installation-pull-secrets\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:30.962689 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.962593 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71881136-77ed-43fa-9e91-7dd04bc273ae-image-registry-private-configuration\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:30.962689 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.962623 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxznn\" (UniqueName: \"kubernetes.io/projected/e655f23a-203b-4b6f-aa19-ec3111a93f8d-kube-api-access-hxznn\") pod \"downloads-694c955b9-j6v2f\" (UID: \"e655f23a-203b-4b6f-aa19-ec3111a93f8d\") " pod="openshift-console/downloads-694c955b9-j6v2f" Jun 14 14:43:30.962689 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.962660 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71881136-77ed-43fa-9e91-7dd04bc273ae-ca-trust-extracted\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:30.962689 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.962688 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71881136-77ed-43fa-9e91-7dd04bc273ae-registry-certificates\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:30.962924 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.962738 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71881136-77ed-43fa-9e91-7dd04bc273ae-trusted-ca\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:30.962924 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.962791 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71881136-77ed-43fa-9e91-7dd04bc273ae-bound-sa-token\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:30.962924 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.962819 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71881136-77ed-43fa-9e91-7dd04bc273ae-registry-tls\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:30.962924 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:30.962841 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw5w7\" (UniqueName: \"kubernetes.io/projected/71881136-77ed-43fa-9e91-7dd04bc273ae-kube-api-access-dw5w7\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.063727 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.063699 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71881136-77ed-43fa-9e91-7dd04bc273ae-image-registry-private-configuration\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.063905 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.063734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxznn\" (UniqueName: \"kubernetes.io/projected/e655f23a-203b-4b6f-aa19-ec3111a93f8d-kube-api-access-hxznn\") pod \"downloads-694c955b9-j6v2f\" (UID: \"e655f23a-203b-4b6f-aa19-ec3111a93f8d\") " pod="openshift-console/downloads-694c955b9-j6v2f" Jun 14 14:43:31.063905 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.063866 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71881136-77ed-43fa-9e91-7dd04bc273ae-ca-trust-extracted\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.064034 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.063906 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71881136-77ed-43fa-9e91-7dd04bc273ae-registry-certificates\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.064034 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.063938 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71881136-77ed-43fa-9e91-7dd04bc273ae-trusted-ca\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.064034 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.063978 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71881136-77ed-43fa-9e91-7dd04bc273ae-bound-sa-token\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.064034 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.064013 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71881136-77ed-43fa-9e91-7dd04bc273ae-registry-tls\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.064225 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.064037 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw5w7\" (UniqueName: \"kubernetes.io/projected/71881136-77ed-43fa-9e91-7dd04bc273ae-kube-api-access-dw5w7\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.064225 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.064104 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71881136-77ed-43fa-9e91-7dd04bc273ae-installation-pull-secrets\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.064322 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.064273 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71881136-77ed-43fa-9e91-7dd04bc273ae-ca-trust-extracted\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.065204 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.065151 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71881136-77ed-43fa-9e91-7dd04bc273ae-trusted-ca\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.065328 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.065214 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71881136-77ed-43fa-9e91-7dd04bc273ae-registry-certificates\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.066880 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.066859 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71881136-77ed-43fa-9e91-7dd04bc273ae-registry-tls\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.066992 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.066972 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71881136-77ed-43fa-9e91-7dd04bc273ae-image-registry-private-configuration\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.067069 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.067041 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71881136-77ed-43fa-9e91-7dd04bc273ae-installation-pull-secrets\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.071177 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.071146 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71881136-77ed-43fa-9e91-7dd04bc273ae-bound-sa-token\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.072496 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.072456 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw5w7\" (UniqueName: \"kubernetes.io/projected/71881136-77ed-43fa-9e91-7dd04bc273ae-kube-api-access-dw5w7\") pod \"image-registry-759cfff566-d2t4v\" (UID: \"71881136-77ed-43fa-9e91-7dd04bc273ae\") " pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.072897 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.072874 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxznn\" (UniqueName: \"kubernetes.io/projected/e655f23a-203b-4b6f-aa19-ec3111a93f8d-kube-api-access-hxznn\") pod \"downloads-694c955b9-j6v2f\" (UID: \"e655f23a-203b-4b6f-aa19-ec3111a93f8d\") " pod="openshift-console/downloads-694c955b9-j6v2f" Jun 14 14:43:31.169123 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.169052 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-j6v2f" Jun 14 14:43:31.200788 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.200766 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:31.371342 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.371312 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-j6v2f"] Jun 14 14:43:31.373217 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:43:31.373188 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode655f23a_203b_4b6f_aa19_ec3111a93f8d.slice/crio-9ffe8ef5890623f004191058deb8ea0163cd818257caccf74b86e46e4ead5589 WatchSource:0}: Error finding container 9ffe8ef5890623f004191058deb8ea0163cd818257caccf74b86e46e4ead5589: Status 404 returned error can't find the container with id 9ffe8ef5890623f004191058deb8ea0163cd818257caccf74b86e46e4ead5589 Jun 14 14:43:31.390602 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.390511 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-759cfff566-d2t4v"] Jun 14 14:43:31.393529 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:43:31.393506 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71881136_77ed_43fa_9e91_7dd04bc273ae.slice/crio-0f695786adabc114ac60be0a543bdf8506df175dc20b7f813c900d8ea223d479 WatchSource:0}: Error finding container 0f695786adabc114ac60be0a543bdf8506df175dc20b7f813c900d8ea223d479: Status 404 returned error can't find the container with id 0f695786adabc114ac60be0a543bdf8506df175dc20b7f813c900d8ea223d479 Jun 14 14:43:31.401745 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.401715 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wvqfq" event={"ID":"f4ec8dc3-7b6c-4988-8481-b4f5447392a7","Type":"ContainerStarted","Data":"2ca9a9e594e3d0fff6a71b9e7477abb0307ef53559372a86c335e392a48588b7"} Jun 14 14:43:31.403110 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.403077 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" event={"ID":"71881136-77ed-43fa-9e91-7dd04bc273ae","Type":"ContainerStarted","Data":"0f695786adabc114ac60be0a543bdf8506df175dc20b7f813c900d8ea223d479"} Jun 14 14:43:31.404417 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:31.404391 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-j6v2f" event={"ID":"e655f23a-203b-4b6f-aa19-ec3111a93f8d","Type":"ContainerStarted","Data":"9ffe8ef5890623f004191058deb8ea0163cd818257caccf74b86e46e4ead5589"} Jun 14 14:43:32.410986 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:32.410900 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wvqfq" event={"ID":"f4ec8dc3-7b6c-4988-8481-b4f5447392a7","Type":"ContainerStarted","Data":"992271add2de5d26bbc005240bca8666f0317febcb8a7e300e2f916900b4e105"} Jun 14 14:43:32.412759 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:32.412721 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" event={"ID":"71881136-77ed-43fa-9e91-7dd04bc273ae","Type":"ContainerStarted","Data":"45fc7aa3ef5fd9600d87af7b691aad2719a42ead486a24e0f234ee1807c52388"} Jun 14 14:43:32.412884 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:32.412862 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:43:32.426377 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:32.426337 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wvqfq" podStartSLOduration=17.183732623 podStartE2EDuration="23.426325665s" totalImagesPullingTime="6.242593042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:43:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:32.425716484 +0000 UTC m=+245.296649794" watchObservedRunningTime="2026-06-14 14:43:32.426325665 +0000 UTC m=+245.297258978" Jun 14 14:43:32.445433 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:32.445381 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" podStartSLOduration=2.44536406 podStartE2EDuration="2.44536406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:32.444793384 +0000 UTC m=+245.315726697" watchObservedRunningTime="2026-06-14 14:43:32.44536406 +0000 UTC m=+245.316297374" Jun 14 14:43:38.323370 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:38.323330 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:43:38.325920 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:38.325887 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad0defa-5fcf-4913-a2f5-1db88760d8fe-metrics-certs\") pod \"network-metrics-daemon-sshnr\" (UID: \"1ad0defa-5fcf-4913-a2f5-1db88760d8fe\") " pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:43:38.361653 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:38.361623 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2pmmn\"" Jun 14 14:43:38.370207 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:38.370180 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sshnr" Jun 14 14:43:38.514534 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:38.514504 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sshnr"] Jun 14 14:43:38.517746 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:43:38.517717 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad0defa_5fcf_4913_a2f5_1db88760d8fe.slice/crio-9eb43f4a5ad9c4b8e59a1662727f592a40f9d81b05b8e4c987f54c7517318e0e WatchSource:0}: Error finding container 9eb43f4a5ad9c4b8e59a1662727f592a40f9d81b05b8e4c987f54c7517318e0e: Status 404 returned error can't find the container with id 9eb43f4a5ad9c4b8e59a1662727f592a40f9d81b05b8e4c987f54c7517318e0e Jun 14 14:43:39.443372 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:39.443348 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sshnr" event={"ID":"1ad0defa-5fcf-4913-a2f5-1db88760d8fe","Type":"ContainerStarted","Data":"4857235d5c9ea30349029592858179479c2e42dd967f03fc915183dd55839801"} Jun 14 14:43:39.443699 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:39.443409 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sshnr" event={"ID":"1ad0defa-5fcf-4913-a2f5-1db88760d8fe","Type":"ContainerStarted","Data":"9eb43f4a5ad9c4b8e59a1662727f592a40f9d81b05b8e4c987f54c7517318e0e"} Jun 14 14:43:40.450257 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:40.450215 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sshnr" event={"ID":"1ad0defa-5fcf-4913-a2f5-1db88760d8fe","Type":"ContainerStarted","Data":"0b4c1d28a56d75e2c4e3b0703451b9e01190794a30a83a3b939b3a35635a1348"} Jun 14 14:43:40.464519 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:40.464465 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sshnr" podStartSLOduration=252.647222152 podStartE2EDuration="4m13.46444977s" totalImagesPullingTime="817.227618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:40.464295071 +0000 UTC m=+253.335228385" watchObservedRunningTime="2026-06-14 14:43:40.46444977 +0000 UTC m=+253.335383132" Jun 14 14:43:40.842435 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:40.842346 2566 patch_prober.go:28] interesting pod/image-registry-56cf984db-s2v7k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:43:40.842435 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:40.842408 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56cf984db-s2v7k" podUID="581dca68-aa80-428b-a78d-07a2ac6d60ef" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:43:46.042824 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.042789 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8"] Jun 14 14:43:46.047954 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.047708 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.050839 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.050522 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vgxht\"" Jun 14 14:43:46.050839 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.050603 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 14:43:46.050839 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.050617 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 14 14:43:46.050839 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.050692 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 14:43:46.050839 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.050602 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 14 14:43:46.050839 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.050521 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 14 14:43:46.052184 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.050922 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 14:43:46.059863 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.059803 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8"] Jun 14 14:43:46.062763 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.062740 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sgttw"] Jun 14 14:43:46.066251 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.066232 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.068243 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.068225 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 14:43:46.068572 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.068531 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 14:43:46.069061 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.068731 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-glx62\"" Jun 14 14:43:46.069061 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.068936 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 14:43:46.189143 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189111 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtcmc\" (UniqueName: \"kubernetes.io/projected/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-api-access-vtcmc\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.189143 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189155 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-textfile\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.189375 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189179 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba6eac9c-55fb-4931-9904-bb567c23eb6d-metrics-client-ca\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.189375 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189208 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba6eac9c-55fb-4931-9904-bb567c23eb6d-root\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.189375 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189244 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.189375 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189269 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.189375 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189298 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1b5a475-5cc2-4696-8597-4c13691f155d-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.189375 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189336 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-tls\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.189375 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189360 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.189748 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189388 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.189748 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189419 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba6eac9c-55fb-4931-9904-bb567c23eb6d-sys\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.189748 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189469 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-wtmp\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.189748 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189499 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfcfn\" (UniqueName: \"kubernetes.io/projected/ba6eac9c-55fb-4931-9904-bb567c23eb6d-kube-api-access-cfcfn\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.189748 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189555 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a1b5a475-5cc2-4696-8597-4c13691f155d-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.189748 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.189583 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.289993 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.289960 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1b5a475-5cc2-4696-8597-4c13691f155d-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.290161 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290015 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-tls\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.290161 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290049 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.290161 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290078 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.290320 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:46.290175 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 14 14:43:46.290320 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:46.290262 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-tls podName:ba6eac9c-55fb-4931-9904-bb567c23eb6d nodeName:}" failed. No retries permitted until 2026-06-14 14:43:46.790237715 +0000 UTC m=+259.661171027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-tls") pod "node-exporter-sgttw" (UID: "ba6eac9c-55fb-4931-9904-bb567c23eb6d") : secret "node-exporter-tls" not found Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290517 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba6eac9c-55fb-4931-9904-bb567c23eb6d-sys\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290620 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-wtmp\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290658 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfcfn\" (UniqueName: \"kubernetes.io/projected/ba6eac9c-55fb-4931-9904-bb567c23eb6d-kube-api-access-cfcfn\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290701 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a1b5a475-5cc2-4696-8597-4c13691f155d-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290759 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba6eac9c-55fb-4931-9904-bb567c23eb6d-sys\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290793 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1b5a475-5cc2-4696-8597-4c13691f155d-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290801 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290843 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtcmc\" (UniqueName: \"kubernetes.io/projected/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-api-access-vtcmc\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290848 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-wtmp\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-textfile\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290902 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba6eac9c-55fb-4931-9904-bb567c23eb6d-metrics-client-ca\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290935 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba6eac9c-55fb-4931-9904-bb567c23eb6d-root\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.290980 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.291006 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.291230 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.291566 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba6eac9c-55fb-4931-9904-bb567c23eb6d-root\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.291739 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:46.291647 2566 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 14 14:43:46.292680 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:46.291695 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-tls podName:a1b5a475-5cc2-4696-8597-4c13691f155d nodeName:}" failed. No retries permitted until 2026-06-14 14:43:46.7916785 +0000 UTC m=+259.662611792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-lvfv8" (UID: "a1b5a475-5cc2-4696-8597-4c13691f155d") : secret "kube-state-metrics-tls" not found Jun 14 14:43:46.292680 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.291641 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-textfile\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.292680 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.291704 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba6eac9c-55fb-4931-9904-bb567c23eb6d-metrics-client-ca\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.292680 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.291812 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a1b5a475-5cc2-4696-8597-4c13691f155d-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.292680 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.291877 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.295767 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.295447 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.296865 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.296810 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.298679 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.298658 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfcfn\" (UniqueName: \"kubernetes.io/projected/ba6eac9c-55fb-4931-9904-bb567c23eb6d-kube-api-access-cfcfn\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.299968 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.299948 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtcmc\" (UniqueName: \"kubernetes.io/projected/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-api-access-vtcmc\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.796950 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.796916 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-tls\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.797236 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.797142 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:46.797339 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:46.797276 2566 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 14 14:43:46.797396 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:46.797346 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-tls podName:a1b5a475-5cc2-4696-8597-4c13691f155d nodeName:}" failed. No retries permitted until 2026-06-14 14:43:47.797327914 +0000 UTC m=+260.668261211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-lvfv8" (UID: "a1b5a475-5cc2-4696-8597-4c13691f155d") : secret "kube-state-metrics-tls" not found Jun 14 14:43:46.799880 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.799853 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba6eac9c-55fb-4931-9904-bb567c23eb6d-node-exporter-tls\") pod \"node-exporter-sgttw\" (UID: \"ba6eac9c-55fb-4931-9904-bb567c23eb6d\") " pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:46.978976 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:46.978727 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sgttw" Jun 14 14:43:47.107760 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.107671 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 14:43:47.111371 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.111349 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.113296 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.113275 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 14:43:47.113448 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.113427 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 14:43:47.113514 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.113432 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 14:43:47.113593 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.113552 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 14:43:47.113680 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.113662 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 14:43:47.113761 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.113681 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 14:43:47.113816 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.113764 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 14:43:47.113816 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.113797 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 14:43:47.113907 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.113889 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 14:43:47.114088 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.114060 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2sjhx\"" Jun 14 14:43:47.124451 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.124428 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 14:43:47.200375 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.200306 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-web-config\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.200375 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.200361 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-config-out\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.200630 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.200423 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.200630 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.200476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.200630 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.200511 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.200630 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.200554 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.200630 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.200581 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmflq\" (UniqueName: \"kubernetes.io/projected/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-kube-api-access-lmflq\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.200881 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.200659 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.200881 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.200708 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.200881 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.200752 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.200881 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.200840 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-config-volume\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.201054 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.200883 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.201054 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.200940 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.302335 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.302299 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.302511 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.302349 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmflq\" (UniqueName: \"kubernetes.io/projected/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-kube-api-access-lmflq\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.302511 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.302391 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.302511 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.302417 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.302511 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.302460 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.302769 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.302513 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-config-volume\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.302769 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.302568 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.302994 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.302966 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.303083 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.303023 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-web-config\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.303083 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.303076 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-config-out\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.303201 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.303104 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.303201 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.303135 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.303201 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.303167 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.303369 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.303318 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.303369 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.302977 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.303938 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.303894 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.306023 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.305868 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-config-volume\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.306023 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.305983 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.306170 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.306074 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.306349 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.306324 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.306481 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.306459 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.306720 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.306697 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.306871 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.306850 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.307615 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.307592 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-web-config\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.307703 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.307682 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-config-out\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.310359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.310336 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmflq\" (UniqueName: \"kubernetes.io/projected/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-kube-api-access-lmflq\") pod \"alertmanager-main-0\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.423757 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.423684 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:43:47.605689 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:43:47.605660 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba6eac9c_55fb_4931_9904_bb567c23eb6d.slice/crio-79d57d6ce28cf1571696467815dba8467fd708f2245af91d3c36113c482cff69 WatchSource:0}: Error finding container 79d57d6ce28cf1571696467815dba8467fd708f2245af91d3c36113c482cff69: Status 404 returned error can't find the container with id 79d57d6ce28cf1571696467815dba8467fd708f2245af91d3c36113c482cff69 Jun 14 14:43:47.725291 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.725261 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 14:43:47.727623 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:43:47.727596 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9a677b_8196_4b63_956b_d3f6d1b51b8b.slice/crio-4531ddbe85a06ae90231192b6b39c1a7f3546d8bfe2b08f864ff7b80b2fa7baf WatchSource:0}: Error finding container 4531ddbe85a06ae90231192b6b39c1a7f3546d8bfe2b08f864ff7b80b2fa7baf: Status 404 returned error can't find the container with id 4531ddbe85a06ae90231192b6b39c1a7f3546d8bfe2b08f864ff7b80b2fa7baf Jun 14 14:43:47.808951 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.808917 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:47.810959 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.810933 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b5a475-5cc2-4696-8597-4c13691f155d-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-lvfv8\" (UID: \"a1b5a475-5cc2-4696-8597-4c13691f155d\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:47.862018 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:47.861996 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" Jun 14 14:43:48.030569 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:48.029722 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8"] Jun 14 14:43:48.032610 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:43:48.032576 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b5a475_5cc2_4696_8597_4c13691f155d.slice/crio-59708671ff01406e4dcbf9604499cdd286464ebb84902bf30328258e9145c10d WatchSource:0}: Error finding container 59708671ff01406e4dcbf9604499cdd286464ebb84902bf30328258e9145c10d: Status 404 returned error can't find the container with id 59708671ff01406e4dcbf9604499cdd286464ebb84902bf30328258e9145c10d Jun 14 14:43:48.489608 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:48.489230 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-j6v2f" event={"ID":"e655f23a-203b-4b6f-aa19-ec3111a93f8d","Type":"ContainerStarted","Data":"6f787422401b9b0985f0598f2e6f4fbf3c0fda155bda13cb9b08944533041bc4"} Jun 14 14:43:48.490384 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:48.490329 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-j6v2f" Jun 14 14:43:48.492431 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:48.492368 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" event={"ID":"a1b5a475-5cc2-4696-8597-4c13691f155d","Type":"ContainerStarted","Data":"59708671ff01406e4dcbf9604499cdd286464ebb84902bf30328258e9145c10d"} Jun 14 14:43:48.494526 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:48.494498 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgttw" event={"ID":"ba6eac9c-55fb-4931-9904-bb567c23eb6d","Type":"ContainerStarted","Data":"79d57d6ce28cf1571696467815dba8467fd708f2245af91d3c36113c482cff69"} Jun 14 14:43:48.496505 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:48.496430 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerStarted","Data":"4531ddbe85a06ae90231192b6b39c1a7f3546d8bfe2b08f864ff7b80b2fa7baf"} Jun 14 14:43:48.500304 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:48.500253 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-j6v2f" Jun 14 14:43:48.507862 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:48.507810 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-j6v2f" podStartSLOduration=2.19310899 podStartE2EDuration="18.507792818s" totalImagesPullingTime="16.314683828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:48.506290928 +0000 UTC m=+261.377224242" watchObservedRunningTime="2026-06-14 14:43:48.507792818 +0000 UTC m=+261.378726131" Jun 14 14:43:49.019368 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.019334 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-677bcfc67f-gsct6"] Jun 14 14:43:49.025793 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.025768 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.028098 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.027984 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 14 14:43:49.028617 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.028472 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-f2bjq\"" Jun 14 14:43:49.029409 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.028788 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 14 14:43:49.029409 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.028994 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 14 14:43:49.029409 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.029118 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 14 14:43:49.029409 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.029243 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9kq7lbb119csu\"" Jun 14 14:43:49.029409 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.029369 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 14 14:43:49.035263 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.034081 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-677bcfc67f-gsct6"] Jun 14 14:43:49.125287 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.125148 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.125287 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.125201 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-grpc-tls\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.125287 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.125233 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-tls\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.125287 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.125261 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-metrics-client-ca\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.125640 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.125298 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.125640 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.125332 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.125640 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.125365 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.125640 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.125443 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vmwd\" (UniqueName: \"kubernetes.io/projected/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-kube-api-access-5vmwd\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.226797 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.226131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-grpc-tls\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.226797 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.226178 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-tls\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.226797 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.226215 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-metrics-client-ca\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.226797 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.226254 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.226797 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.226292 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.226797 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.226325 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.226797 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.226402 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vmwd\" (UniqueName: \"kubernetes.io/projected/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-kube-api-access-5vmwd\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.226797 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.226442 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.229605 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.229528 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-metrics-client-ca\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.230453 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.230341 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.233649 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.232574 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.233649 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.233608 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-grpc-tls\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.235141 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.234216 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.235141 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.235081 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.238049 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.237080 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-secret-thanos-querier-tls\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.238049 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.237874 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vmwd\" (UniqueName: \"kubernetes.io/projected/4f8bb0b3-ab88-4fd0-b983-1ad47efd1347-kube-api-access-5vmwd\") pod \"thanos-querier-677bcfc67f-gsct6\" (UID: \"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347\") " pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.346653 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.346423 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:49.514495 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.512702 2566 generic.go:356] "Generic (PLEG): container finished" podID="ba6eac9c-55fb-4931-9904-bb567c23eb6d" containerID="d58848fb1bb6ac1a222f243e06ea7ad71484c4081dfad4581439361e2f38fa62" exitCode=0 Jun 14 14:43:49.514495 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.512800 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgttw" event={"ID":"ba6eac9c-55fb-4931-9904-bb567c23eb6d","Type":"ContainerDied","Data":"d58848fb1bb6ac1a222f243e06ea7ad71484c4081dfad4581439361e2f38fa62"} Jun 14 14:43:49.518975 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.518490 2566 generic.go:356] "Generic (PLEG): container finished" podID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerID="a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f" exitCode=0 Jun 14 14:43:49.519611 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.519508 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerDied","Data":"a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f"} Jun 14 14:43:49.566267 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:49.566240 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-677bcfc67f-gsct6"] Jun 14 14:43:49.569631 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:43:49.569101 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8bb0b3_ab88_4fd0_b983_1ad47efd1347.slice/crio-79db2a9a1ca5a34a290e742e07da025c10f53d6766b7b43b4bb99168d95bf607 WatchSource:0}: Error finding container 79db2a9a1ca5a34a290e742e07da025c10f53d6766b7b43b4bb99168d95bf607: Status 404 returned error can't find the container with id 79db2a9a1ca5a34a290e742e07da025c10f53d6766b7b43b4bb99168d95bf607 Jun 14 14:43:50.339792 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.339758 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-57d4998bbb-thjqc"] Jun 14 14:43:50.357853 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.357818 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57d4998bbb-thjqc"] Jun 14 14:43:50.358037 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.357945 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.360008 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.359987 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 14 14:43:50.360228 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.360203 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 14 14:43:50.360325 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.360269 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kv7dm\"" Jun 14 14:43:50.360325 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.360020 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-eoudnhtu5lkeo\"" Jun 14 14:43:50.360450 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.360204 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 14 14:43:50.360450 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.360025 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 14 14:43:50.525449 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.525419 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" event={"ID":"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347","Type":"ContainerStarted","Data":"79db2a9a1ca5a34a290e742e07da025c10f53d6766b7b43b4bb99168d95bf607"} Jun 14 14:43:50.528384 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.528358 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgttw" event={"ID":"ba6eac9c-55fb-4931-9904-bb567c23eb6d","Type":"ContainerStarted","Data":"81a6076b546295eb76a2b16c7922aeaa98b3c66f9b771f52983de2ff11c5b7ed"} Jun 14 14:43:50.528489 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.528410 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgttw" event={"ID":"ba6eac9c-55fb-4931-9904-bb567c23eb6d","Type":"ContainerStarted","Data":"2618b99bb4f2e297b01738f5bd7d4994ff2a5c0ea760ef63fadb6ffce61c1c1d"} Jun 14 14:43:50.539512 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.539303 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/965c489f-96c2-4d00-ad1e-f18421844e40-audit-log\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.539512 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.539355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/965c489f-96c2-4d00-ad1e-f18421844e40-secret-metrics-server-tls\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.539512 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.539385 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/965c489f-96c2-4d00-ad1e-f18421844e40-metrics-server-audit-profiles\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.539512 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.539429 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4nkl\" (UniqueName: \"kubernetes.io/projected/965c489f-96c2-4d00-ad1e-f18421844e40-kube-api-access-v4nkl\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.539512 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.539455 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/965c489f-96c2-4d00-ad1e-f18421844e40-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.539821 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.539600 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/965c489f-96c2-4d00-ad1e-f18421844e40-secret-metrics-server-client-certs\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.539821 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.539653 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/965c489f-96c2-4d00-ad1e-f18421844e40-client-ca-bundle\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.551017 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.550688 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sgttw" podStartSLOduration=3.458117976 podStartE2EDuration="4.550669274s" totalImagesPullingTime="1.007269177s" totalInitContainerRuntime="85.282121ms" isStatefulPod=true podCreationTimestamp="2026-06-14 14:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:50.549897132 +0000 UTC m=+263.420830447" watchObservedRunningTime="2026-06-14 14:43:50.550669274 +0000 UTC m=+263.421602589" Jun 14 14:43:50.641028 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.640998 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/965c489f-96c2-4d00-ad1e-f18421844e40-secret-metrics-server-client-certs\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.641393 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.641308 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/965c489f-96c2-4d00-ad1e-f18421844e40-client-ca-bundle\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.641393 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.641386 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/965c489f-96c2-4d00-ad1e-f18421844e40-audit-log\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.643115 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.641632 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/965c489f-96c2-4d00-ad1e-f18421844e40-secret-metrics-server-tls\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.643115 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.641671 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/965c489f-96c2-4d00-ad1e-f18421844e40-metrics-server-audit-profiles\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.643115 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.641733 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4nkl\" (UniqueName: \"kubernetes.io/projected/965c489f-96c2-4d00-ad1e-f18421844e40-kube-api-access-v4nkl\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.643115 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.641755 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/965c489f-96c2-4d00-ad1e-f18421844e40-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.643115 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.642691 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/965c489f-96c2-4d00-ad1e-f18421844e40-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.643115 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.642819 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/965c489f-96c2-4d00-ad1e-f18421844e40-audit-log\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.643853 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.643803 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/965c489f-96c2-4d00-ad1e-f18421844e40-metrics-server-audit-profiles\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.644893 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.644868 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/965c489f-96c2-4d00-ad1e-f18421844e40-secret-metrics-server-client-certs\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.649071 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.648208 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/965c489f-96c2-4d00-ad1e-f18421844e40-secret-metrics-server-tls\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.649071 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.648637 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/965c489f-96c2-4d00-ad1e-f18421844e40-client-ca-bundle\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.652796 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.652746 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4nkl\" (UniqueName: \"kubernetes.io/projected/965c489f-96c2-4d00-ad1e-f18421844e40-kube-api-access-v4nkl\") pod \"metrics-server-57d4998bbb-thjqc\" (UID: \"965c489f-96c2-4d00-ad1e-f18421844e40\") " pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.669595 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.669573 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:43:50.846623 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.845704 2566 patch_prober.go:28] interesting pod/image-registry-56cf984db-s2v7k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:43:50.846623 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.845765 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56cf984db-s2v7k" podUID="581dca68-aa80-428b-a78d-07a2ac6d60ef" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:43:50.923245 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:50.921983 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57d4998bbb-thjqc"] Jun 14 14:43:51.207229 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:51.207184 2566 patch_prober.go:28] interesting pod/image-registry-759cfff566-d2t4v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:43:51.207448 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:51.207245 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" podUID="71881136-77ed-43fa-9e91-7dd04bc273ae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:43:51.537224 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:51.537136 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" event={"ID":"a1b5a475-5cc2-4696-8597-4c13691f155d","Type":"ContainerStarted","Data":"78022af55161abd73f6207257370686a6732dcd24853ad0d69ac9ac57d9e2f53"} Jun 14 14:43:51.537224 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:51.537210 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" event={"ID":"a1b5a475-5cc2-4696-8597-4c13691f155d","Type":"ContainerStarted","Data":"1f94cedab8893c0b40c023e445d8675e4fd3b974de16772f6880f53ce78ae8c8"} Jun 14 14:43:51.537832 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:51.537236 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" event={"ID":"a1b5a475-5cc2-4696-8597-4c13691f155d","Type":"ContainerStarted","Data":"7757ffe14d5b698398fb7dcc03c19d42570418085484a4e885059e8e83d90efe"} Jun 14 14:43:51.539758 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:51.539703 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" event={"ID":"965c489f-96c2-4d00-ad1e-f18421844e40","Type":"ContainerStarted","Data":"59150746afd78965207ce7f12a0854f7a23bc1d7dced15f1c72fda10ee068ec6"} Jun 14 14:43:51.552156 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:51.552107 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-lvfv8" podStartSLOduration=3.08268179 podStartE2EDuration="5.552090979s" totalImagesPullingTime="2.469409189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:51.551865903 +0000 UTC m=+264.422799217" watchObservedRunningTime="2026-06-14 14:43:51.552090979 +0000 UTC m=+264.423024287" Jun 14 14:43:53.422836 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:53.422788 2566 patch_prober.go:28] interesting pod/image-registry-759cfff566-d2t4v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:43:53.423392 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:53.422850 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" podUID="71881136-77ed-43fa-9e91-7dd04bc273ae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:43:54.558205 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:54.557987 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" event={"ID":"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347","Type":"ContainerStarted","Data":"b4fcda85d93422a1f3d0745d8f642b4864b691dcd2659476d18c971602bb0973"} Jun 14 14:43:54.558205 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:54.558092 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" event={"ID":"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347","Type":"ContainerStarted","Data":"b3f04a0aaabfde23e880b67b28d2cc8fc86158366515e7b244af39be235ed1ff"} Jun 14 14:43:54.558205 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:54.558137 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" event={"ID":"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347","Type":"ContainerStarted","Data":"362e5ca541e6530d0483836c597d3de788d665a2f33826b10166c5da259feb09"} Jun 14 14:43:54.561037 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:54.561010 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerStarted","Data":"bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126"} Jun 14 14:43:54.561136 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:54.561082 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerStarted","Data":"60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4"} Jun 14 14:43:54.564398 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:54.564373 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" event={"ID":"965c489f-96c2-4d00-ad1e-f18421844e40","Type":"ContainerStarted","Data":"3c90248043253f6302672093e1eef4d73789110d8d5f72ff09e85df612bf8286"} Jun 14 14:43:54.580818 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:54.580678 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" podStartSLOduration=1.3678996190000001 podStartE2EDuration="4.580660423s" totalImagesPullingTime="3.212760804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:54.580168137 +0000 UTC m=+267.451101462" watchObservedRunningTime="2026-06-14 14:43:54.580660423 +0000 UTC m=+267.451593738" Jun 14 14:43:55.579952 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:55.579914 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerStarted","Data":"4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c"} Jun 14 14:43:55.580364 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:55.580053 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerStarted","Data":"f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74"} Jun 14 14:43:55.580364 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:55.580098 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerStarted","Data":"26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc"} Jun 14 14:43:55.857209 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:55.857075 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56cf984db-s2v7k" podUID="581dca68-aa80-428b-a78d-07a2ac6d60ef" containerName="registry" containerID="cri-o://6f544cbeaeff461c11fc8c5fd6ae9bfa9ff013b6e68147fccbb6427d865167fc" gracePeriod=30 Jun 14 14:43:56.210465 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.210438 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:56.302864 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.302844 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-bound-sa-token\") pod \"581dca68-aa80-428b-a78d-07a2ac6d60ef\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " Jun 14 14:43:56.302968 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.302899 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/581dca68-aa80-428b-a78d-07a2ac6d60ef-trusted-ca\") pod \"581dca68-aa80-428b-a78d-07a2ac6d60ef\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " Jun 14 14:43:56.302968 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.302938 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6lb7\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-kube-api-access-j6lb7\") pod \"581dca68-aa80-428b-a78d-07a2ac6d60ef\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " Jun 14 14:43:56.303088 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.303005 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/581dca68-aa80-428b-a78d-07a2ac6d60ef-image-registry-private-configuration\") pod \"581dca68-aa80-428b-a78d-07a2ac6d60ef\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " Jun 14 14:43:56.303088 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.303054 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-certificates\") pod \"581dca68-aa80-428b-a78d-07a2ac6d60ef\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " Jun 14 14:43:56.303182 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.303102 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/581dca68-aa80-428b-a78d-07a2ac6d60ef-ca-trust-extracted\") pod \"581dca68-aa80-428b-a78d-07a2ac6d60ef\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " Jun 14 14:43:56.303182 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.303145 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls\") pod \"581dca68-aa80-428b-a78d-07a2ac6d60ef\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " Jun 14 14:43:56.303182 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.303169 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/581dca68-aa80-428b-a78d-07a2ac6d60ef-installation-pull-secrets\") pod \"581dca68-aa80-428b-a78d-07a2ac6d60ef\" (UID: \"581dca68-aa80-428b-a78d-07a2ac6d60ef\") " Jun 14 14:43:56.303418 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.303386 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581dca68-aa80-428b-a78d-07a2ac6d60ef-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "581dca68-aa80-428b-a78d-07a2ac6d60ef" (UID: "581dca68-aa80-428b-a78d-07a2ac6d60ef"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:43:56.303701 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.303654 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "581dca68-aa80-428b-a78d-07a2ac6d60ef" (UID: "581dca68-aa80-428b-a78d-07a2ac6d60ef"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:43:56.305511 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.305478 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581dca68-aa80-428b-a78d-07a2ac6d60ef-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "581dca68-aa80-428b-a78d-07a2ac6d60ef" (UID: "581dca68-aa80-428b-a78d-07a2ac6d60ef"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:43:56.305632 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.305575 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-kube-api-access-j6lb7" (OuterVolumeSpecName: "kube-api-access-j6lb7") pod "581dca68-aa80-428b-a78d-07a2ac6d60ef" (UID: "581dca68-aa80-428b-a78d-07a2ac6d60ef"). InnerVolumeSpecName "kube-api-access-j6lb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:43:56.305832 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.305806 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "581dca68-aa80-428b-a78d-07a2ac6d60ef" (UID: "581dca68-aa80-428b-a78d-07a2ac6d60ef"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:43:56.305915 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.305849 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581dca68-aa80-428b-a78d-07a2ac6d60ef-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "581dca68-aa80-428b-a78d-07a2ac6d60ef" (UID: "581dca68-aa80-428b-a78d-07a2ac6d60ef"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:43:56.305915 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.305889 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "581dca68-aa80-428b-a78d-07a2ac6d60ef" (UID: "581dca68-aa80-428b-a78d-07a2ac6d60ef"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:43:56.311722 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.311695 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/581dca68-aa80-428b-a78d-07a2ac6d60ef-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "581dca68-aa80-428b-a78d-07a2ac6d60ef" (UID: "581dca68-aa80-428b-a78d-07a2ac6d60ef"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:43:56.404029 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.404008 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/581dca68-aa80-428b-a78d-07a2ac6d60ef-trusted-ca\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:43:56.404029 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.404030 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6lb7\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-kube-api-access-j6lb7\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:43:56.404158 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.404041 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/581dca68-aa80-428b-a78d-07a2ac6d60ef-image-registry-private-configuration\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:43:56.404158 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.404051 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-certificates\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:43:56.404158 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.404060 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/581dca68-aa80-428b-a78d-07a2ac6d60ef-ca-trust-extracted\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:43:56.404158 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.404073 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-registry-tls\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:43:56.404158 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.404082 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/581dca68-aa80-428b-a78d-07a2ac6d60ef-installation-pull-secrets\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:43:56.404158 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.404089 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/581dca68-aa80-428b-a78d-07a2ac6d60ef-bound-sa-token\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:43:56.584466 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.584435 2566 generic.go:356] "Generic (PLEG): container finished" podID="581dca68-aa80-428b-a78d-07a2ac6d60ef" containerID="6f544cbeaeff461c11fc8c5fd6ae9bfa9ff013b6e68147fccbb6427d865167fc" exitCode=0 Jun 14 14:43:56.584897 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.584476 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56cf984db-s2v7k" Jun 14 14:43:56.584897 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.584524 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56cf984db-s2v7k" event={"ID":"581dca68-aa80-428b-a78d-07a2ac6d60ef","Type":"ContainerDied","Data":"6f544cbeaeff461c11fc8c5fd6ae9bfa9ff013b6e68147fccbb6427d865167fc"} Jun 14 14:43:56.584897 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.584588 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56cf984db-s2v7k" event={"ID":"581dca68-aa80-428b-a78d-07a2ac6d60ef","Type":"ContainerDied","Data":"48a59ad1bc246474a4424bc55f64690426485ebbd5991f4becc1ea29a76fcdff"} Jun 14 14:43:56.584897 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.584610 2566 scope.go:117] "RemoveContainer" containerID="6f544cbeaeff461c11fc8c5fd6ae9bfa9ff013b6e68147fccbb6427d865167fc" Jun 14 14:43:56.587931 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.587905 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" event={"ID":"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347","Type":"ContainerStarted","Data":"7587502039dd6584994689971c968ac20980ed20935dd3f6db12e64045e6e8db"} Jun 14 14:43:56.588052 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.587962 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" event={"ID":"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347","Type":"ContainerStarted","Data":"ee013a334fe09f2bf9e2c63afc286ed09df263c7782bdac170027a3e5c20d7ed"} Jun 14 14:43:56.588052 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.588003 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" event={"ID":"4f8bb0b3-ab88-4fd0-b983-1ad47efd1347","Type":"ContainerStarted","Data":"1c29e1b6d4428226dd10769975c67dd9b65bc0fba87971d645e6d0684e9033e8"} Jun 14 14:43:56.588178 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.588158 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:43:56.591439 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.591417 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerStarted","Data":"be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413"} Jun 14 14:43:56.593791 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.593775 2566 scope.go:117] "RemoveContainer" containerID="6f544cbeaeff461c11fc8c5fd6ae9bfa9ff013b6e68147fccbb6427d865167fc" Jun 14 14:43:56.594042 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:43:56.594025 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f544cbeaeff461c11fc8c5fd6ae9bfa9ff013b6e68147fccbb6427d865167fc\": container with ID starting with 6f544cbeaeff461c11fc8c5fd6ae9bfa9ff013b6e68147fccbb6427d865167fc not found: ID does not exist" containerID="6f544cbeaeff461c11fc8c5fd6ae9bfa9ff013b6e68147fccbb6427d865167fc" Jun 14 14:43:56.594108 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.594052 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f544cbeaeff461c11fc8c5fd6ae9bfa9ff013b6e68147fccbb6427d865167fc"} err="failed to get container status \"6f544cbeaeff461c11fc8c5fd6ae9bfa9ff013b6e68147fccbb6427d865167fc\": rpc error: code = NotFound desc = could not find container \"6f544cbeaeff461c11fc8c5fd6ae9bfa9ff013b6e68147fccbb6427d865167fc\": container with ID starting with 6f544cbeaeff461c11fc8c5fd6ae9bfa9ff013b6e68147fccbb6427d865167fc not found: ID does not exist" Jun 14 14:43:56.607185 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.607146 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" podStartSLOduration=2.568213838 podStartE2EDuration="8.607134032s" totalImagesPullingTime="6.038920194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:56.605952758 +0000 UTC m=+269.476886071" watchObservedRunningTime="2026-06-14 14:43:56.607134032 +0000 UTC m=+269.478067346" Jun 14 14:43:56.620496 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.620472 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56cf984db-s2v7k"] Jun 14 14:43:56.624764 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.624747 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56cf984db-s2v7k"] Jun 14 14:43:56.646910 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:56.646869 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.219296695 podStartE2EDuration="9.646854148s" totalImagesPullingTime="7.390524549s" totalInitContainerRuntime="37.032904ms" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:56.644807796 +0000 UTC m=+269.515741110" watchObservedRunningTime="2026-06-14 14:43:56.646854148 +0000 UTC m=+269.517787460" Jun 14 14:43:57.565826 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:43:57.565793 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="581dca68-aa80-428b-a78d-07a2ac6d60ef" path="/var/lib/kubelet/pods/581dca68-aa80-428b-a78d-07a2ac6d60ef/volumes" Jun 14 14:44:01.205273 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:01.205241 2566 patch_prober.go:28] interesting pod/image-registry-759cfff566-d2t4v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:44:01.205743 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:01.205291 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" podUID="71881136-77ed-43fa-9e91-7dd04bc273ae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:44:02.602038 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:02.602013 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-677bcfc67f-gsct6" Jun 14 14:44:03.421646 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:03.421615 2566 patch_prober.go:28] interesting pod/image-registry-759cfff566-d2t4v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:44:03.421811 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:03.421665 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" podUID="71881136-77ed-43fa-9e91-7dd04bc273ae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:44:08.130756 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:44:08.130716 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f7d7x" podUID="08ce8c7c-2214-40f7-93ea-b44b51b75e1f" Jun 14 14:44:08.637246 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:08.637217 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f7d7x" Jun 14 14:44:10.670531 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:10.670499 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:44:10.670922 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:10.670572 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:44:11.204746 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:11.204711 2566 patch_prober.go:28] interesting pod/image-registry-759cfff566-d2t4v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:44:11.204907 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:11.204759 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" podUID="71881136-77ed-43fa-9e91-7dd04bc273ae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:44:11.204907 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:11.204793 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:44:11.205273 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:11.205251 2566 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"45fc7aa3ef5fd9600d87af7b691aad2719a42ead486a24e0f234ee1807c52388"} pod="openshift-image-registry/image-registry-759cfff566-d2t4v" containerMessage="Container registry failed liveness probe, will be restarted" Jun 14 14:44:11.208671 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:11.208646 2566 patch_prober.go:28] interesting pod/image-registry-759cfff566-d2t4v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:44:11.208794 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:11.208697 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" podUID="71881136-77ed-43fa-9e91-7dd04bc273ae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:44:11.936495 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:11.936464 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:44:11.938828 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:11.938805 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08ce8c7c-2214-40f7-93ea-b44b51b75e1f-metrics-tls\") pod \"dns-default-f7d7x\" (UID: \"08ce8c7c-2214-40f7-93ea-b44b51b75e1f\") " pod="openshift-dns/dns-default-f7d7x" Jun 14 14:44:12.239898 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:12.239870 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jwvk2\"" Jun 14 14:44:12.248481 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:12.248460 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f7d7x" Jun 14 14:44:12.385596 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:12.385573 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f7d7x"] Jun 14 14:44:12.387923 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:44:12.387888 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08ce8c7c_2214_40f7_93ea_b44b51b75e1f.slice/crio-383fdd57470efd98b0e4413a9fbfc2b77768691307c1980a1e713ac84e8fc2c8 WatchSource:0}: Error finding container 383fdd57470efd98b0e4413a9fbfc2b77768691307c1980a1e713ac84e8fc2c8: Status 404 returned error can't find the container with id 383fdd57470efd98b0e4413a9fbfc2b77768691307c1980a1e713ac84e8fc2c8 Jun 14 14:44:12.653971 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:12.653896 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7d7x" event={"ID":"08ce8c7c-2214-40f7-93ea-b44b51b75e1f","Type":"ContainerStarted","Data":"383fdd57470efd98b0e4413a9fbfc2b77768691307c1980a1e713ac84e8fc2c8"} Jun 14 14:44:14.664383 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:14.664341 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7d7x" event={"ID":"08ce8c7c-2214-40f7-93ea-b44b51b75e1f","Type":"ContainerStarted","Data":"fc216a5934f8720d12b2f4d24c663c4f29bf16585b5e1a944c4d9b4e60757bab"} Jun 14 14:44:14.664829 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:14.664439 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7d7x" event={"ID":"08ce8c7c-2214-40f7-93ea-b44b51b75e1f","Type":"ContainerStarted","Data":"739f4ac819ccaf272d18375a8dc9fb5001f570349cf99713029b3d5167576e98"} Jun 14 14:44:14.664829 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:14.664559 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f7d7x" Jun 14 14:44:14.679649 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:14.679599 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f7d7x" podStartSLOduration=252.281393318 podStartE2EDuration="4m13.679584312s" totalImagesPullingTime="1.398190994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:44:14.677977346 +0000 UTC m=+287.548910672" watchObservedRunningTime="2026-06-14 14:44:14.679584312 +0000 UTC m=+287.550517626" Jun 14 14:44:18.680211 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:18.680185 2566 generic.go:356] "Generic (PLEG): container finished" podID="81661230-a191-4baa-8589-510a9c0082ff" containerID="a4baed4b44b54e5cc61c7dee3622cef0ebd8aa76e7fe851c8f3a2db8923e3635" exitCode=0 Jun 14 14:44:18.680645 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:18.680238 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" event={"ID":"81661230-a191-4baa-8589-510a9c0082ff","Type":"ContainerDied","Data":"a4baed4b44b54e5cc61c7dee3622cef0ebd8aa76e7fe851c8f3a2db8923e3635"} Jun 14 14:44:18.680718 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:18.680684 2566 scope.go:117] "RemoveContainer" containerID="a4baed4b44b54e5cc61c7dee3622cef0ebd8aa76e7fe851c8f3a2db8923e3635" Jun 14 14:44:19.686210 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:19.686178 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-mfcxf" event={"ID":"81661230-a191-4baa-8589-510a9c0082ff","Type":"ContainerStarted","Data":"e68a95ebf0d763918fbd53a82f3f730311bd275b5e26f36885ba74efce75e681"} Jun 14 14:44:21.209283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:21.209246 2566 patch_prober.go:28] interesting pod/image-registry-759cfff566-d2t4v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:44:21.209676 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:21.209299 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" podUID="71881136-77ed-43fa-9e91-7dd04bc273ae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:44:24.669797 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:24.669769 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f7d7x" Jun 14 14:44:27.498594 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:27.498534 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 14:44:27.503636 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:27.503613 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 14:44:27.504331 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:27.504305 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 14:44:27.509269 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:27.509255 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 14:44:27.511802 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:27.511786 2566 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 14:44:30.675975 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:30.675946 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:44:30.695343 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:30.679879 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-57d4998bbb-thjqc" Jun 14 14:44:31.209787 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:31.209760 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:44:36.224365 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:36.224321 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" podUID="71881136-77ed-43fa-9e91-7dd04bc273ae" containerName="registry" containerID="cri-o://45fc7aa3ef5fd9600d87af7b691aad2719a42ead486a24e0f234ee1807c52388" gracePeriod=30 Jun 14 14:44:37.756145 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:37.756112 2566 generic.go:356] "Generic (PLEG): container finished" podID="71881136-77ed-43fa-9e91-7dd04bc273ae" containerID="45fc7aa3ef5fd9600d87af7b691aad2719a42ead486a24e0f234ee1807c52388" exitCode=0 Jun 14 14:44:37.756516 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:37.756152 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" event={"ID":"71881136-77ed-43fa-9e91-7dd04bc273ae","Type":"ContainerDied","Data":"45fc7aa3ef5fd9600d87af7b691aad2719a42ead486a24e0f234ee1807c52388"} Jun 14 14:44:37.756516 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:37.756198 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" event={"ID":"71881136-77ed-43fa-9e91-7dd04bc273ae","Type":"ContainerStarted","Data":"1f8d37a30d795e49bddb6efb361d61123d23f26e49f9f7056db94ff7a67ad555"} Jun 14 14:44:37.756516 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:37.756228 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:44:39.764580 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:39.764529 2566 generic.go:356] "Generic (PLEG): container finished" podID="1566f1d4-22a5-4d5b-9d58-58a93760eff1" containerID="827e50f507174b38352ab65279227e7758b3d726869f6ab269c9a25cf2c16637" exitCode=0 Jun 14 14:44:39.764948 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:39.764605 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" event={"ID":"1566f1d4-22a5-4d5b-9d58-58a93760eff1","Type":"ContainerDied","Data":"827e50f507174b38352ab65279227e7758b3d726869f6ab269c9a25cf2c16637"} Jun 14 14:44:39.764994 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:39.764950 2566 scope.go:117] "RemoveContainer" containerID="827e50f507174b38352ab65279227e7758b3d726869f6ab269c9a25cf2c16637" Jun 14 14:44:40.571359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:40.571319 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-759cfff566-d2t4v_71881136-77ed-43fa-9e91-7dd04bc273ae/registry/0.log" Jun 14 14:44:40.576669 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:40.576641 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-759cfff566-d2t4v_71881136-77ed-43fa-9e91-7dd04bc273ae/registry/1.log" Jun 14 14:44:40.770612 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:40.770575 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-k6khp" event={"ID":"1566f1d4-22a5-4d5b-9d58-58a93760eff1","Type":"ContainerStarted","Data":"858e8cee074a57724f10666776fe3d199bec2de21d146d534eb8dabdf3762a9d"} Jun 14 14:44:41.172744 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:41.172714 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mtw64_853c09c4-64cc-443b-be20-c50c89c658b9/node-ca/0.log" Jun 14 14:44:41.772737 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:41.772709 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kcjq8_143f5e39-8acd-4190-94b3-ca136a6a90c2/serve-healthcheck-canary/0.log" Jun 14 14:44:58.764507 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:44:58.764480 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-759cfff566-d2t4v" Jun 14 14:45:06.373431 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.373393 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 14:45:06.373887 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.373713 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="alertmanager" containerID="cri-o://60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4" gracePeriod=120 Jun 14 14:45:06.373887 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.373801 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="prom-label-proxy" containerID="cri-o://be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413" gracePeriod=120 Jun 14 14:45:06.373887 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.373788 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="kube-rbac-proxy-metric" containerID="cri-o://4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c" gracePeriod=120 Jun 14 14:45:06.373887 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.373830 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="kube-rbac-proxy-web" containerID="cri-o://26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc" gracePeriod=120 Jun 14 14:45:06.373887 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.373853 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="kube-rbac-proxy" containerID="cri-o://f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74" gracePeriod=120 Jun 14 14:45:06.374119 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.373855 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="config-reloader" containerID="cri-o://bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126" gracePeriod=120 Jun 14 14:45:06.879633 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.879600 2566 generic.go:356] "Generic (PLEG): container finished" podID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerID="be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413" exitCode=0 Jun 14 14:45:06.879633 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.879626 2566 generic.go:356] "Generic (PLEG): container finished" podID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerID="f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74" exitCode=0 Jun 14 14:45:06.879633 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.879632 2566 generic.go:356] "Generic (PLEG): container finished" podID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerID="bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126" exitCode=0 Jun 14 14:45:06.879633 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.879637 2566 generic.go:356] "Generic (PLEG): container finished" podID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerID="60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4" exitCode=0 Jun 14 14:45:06.879895 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.879660 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerDied","Data":"be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413"} Jun 14 14:45:06.879895 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.879734 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerDied","Data":"f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74"} Jun 14 14:45:06.879895 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.879759 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerDied","Data":"bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126"} Jun 14 14:45:06.879895 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:06.879784 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerDied","Data":"60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4"} Jun 14 14:45:07.611554 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.611512 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.678417 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.678386 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy-web\") pod \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " Jun 14 14:45:07.678620 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.678433 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-tls-assets\") pod \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " Jun 14 14:45:07.678620 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.678450 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmflq\" (UniqueName: \"kubernetes.io/projected/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-kube-api-access-lmflq\") pod \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " Jun 14 14:45:07.678620 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.678475 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-config-volume\") pod \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " Jun 14 14:45:07.678620 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.678502 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-config-out\") pod \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " Jun 14 14:45:07.678620 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.678519 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-alertmanager-trusted-ca-bundle\") pod \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " Jun 14 14:45:07.678620 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.678555 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-cluster-tls-config\") pod \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " Jun 14 14:45:07.678620 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.678602 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " Jun 14 14:45:07.678984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.678626 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy\") pod \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " Jun 14 14:45:07.678984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.678659 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-metrics-client-ca\") pod \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " Jun 14 14:45:07.678984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.678699 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-web-config\") pod \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " Jun 14 14:45:07.678984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.678724 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-alertmanager-main-db\") pod \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " Jun 14 14:45:07.678984 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.678757 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-main-tls\") pod \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\" (UID: \"3c9a677b-8196-4b63-956b-d3f6d1b51b8b\") " Jun 14 14:45:07.679465 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.679242 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3c9a677b-8196-4b63-956b-d3f6d1b51b8b" (UID: "3c9a677b-8196-4b63-956b-d3f6d1b51b8b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:45:07.679809 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.679778 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3c9a677b-8196-4b63-956b-d3f6d1b51b8b" (UID: "3c9a677b-8196-4b63-956b-d3f6d1b51b8b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:45:07.680013 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.679987 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3c9a677b-8196-4b63-956b-d3f6d1b51b8b" (UID: "3c9a677b-8196-4b63-956b-d3f6d1b51b8b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:45:07.682147 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.681876 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-config-volume" (OuterVolumeSpecName: "config-volume") pod "3c9a677b-8196-4b63-956b-d3f6d1b51b8b" (UID: "3c9a677b-8196-4b63-956b-d3f6d1b51b8b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:07.682147 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.682014 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-kube-api-access-lmflq" (OuterVolumeSpecName: "kube-api-access-lmflq") pod "3c9a677b-8196-4b63-956b-d3f6d1b51b8b" (UID: "3c9a677b-8196-4b63-956b-d3f6d1b51b8b"). InnerVolumeSpecName "kube-api-access-lmflq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:45:07.682601 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.682574 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3c9a677b-8196-4b63-956b-d3f6d1b51b8b" (UID: "3c9a677b-8196-4b63-956b-d3f6d1b51b8b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:07.682679 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.682629 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3c9a677b-8196-4b63-956b-d3f6d1b51b8b" (UID: "3c9a677b-8196-4b63-956b-d3f6d1b51b8b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:07.682962 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.682938 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3c9a677b-8196-4b63-956b-d3f6d1b51b8b" (UID: "3c9a677b-8196-4b63-956b-d3f6d1b51b8b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:45:07.683300 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.683275 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3c9a677b-8196-4b63-956b-d3f6d1b51b8b" (UID: "3c9a677b-8196-4b63-956b-d3f6d1b51b8b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:07.683988 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.683962 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-config-out" (OuterVolumeSpecName: "config-out") pod "3c9a677b-8196-4b63-956b-d3f6d1b51b8b" (UID: "3c9a677b-8196-4b63-956b-d3f6d1b51b8b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:45:07.684130 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.684054 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3c9a677b-8196-4b63-956b-d3f6d1b51b8b" (UID: "3c9a677b-8196-4b63-956b-d3f6d1b51b8b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:07.687708 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.687682 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3c9a677b-8196-4b63-956b-d3f6d1b51b8b" (UID: "3c9a677b-8196-4b63-956b-d3f6d1b51b8b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:07.693312 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.693292 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-web-config" (OuterVolumeSpecName: "web-config") pod "3c9a677b-8196-4b63-956b-d3f6d1b51b8b" (UID: "3c9a677b-8196-4b63-956b-d3f6d1b51b8b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:07.780122 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.780065 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:45:07.780122 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.780088 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-tls-assets\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:45:07.780122 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.780099 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmflq\" (UniqueName: \"kubernetes.io/projected/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-kube-api-access-lmflq\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:45:07.780122 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.780108 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-config-volume\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:45:07.780122 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.780116 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-config-out\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:45:07.780122 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.780124 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:45:07.780348 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.780132 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-cluster-tls-config\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:45:07.780348 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.780142 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:45:07.780348 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.780152 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:45:07.780348 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.780161 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-metrics-client-ca\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:45:07.780348 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.780170 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-web-config\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:45:07.780348 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.780178 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-alertmanager-main-db\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:45:07.780348 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.780186 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c9a677b-8196-4b63-956b-d3f6d1b51b8b-secret-alertmanager-main-tls\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:45:07.888120 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.888094 2566 generic.go:356] "Generic (PLEG): container finished" podID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerID="4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c" exitCode=0 Jun 14 14:45:07.888120 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.888115 2566 generic.go:356] "Generic (PLEG): container finished" podID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerID="26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc" exitCode=0 Jun 14 14:45:07.888281 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.888149 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerDied","Data":"4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c"} Jun 14 14:45:07.888281 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.888169 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.888281 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.888213 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerDied","Data":"26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc"} Jun 14 14:45:07.888281 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.888241 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c9a677b-8196-4b63-956b-d3f6d1b51b8b","Type":"ContainerDied","Data":"4531ddbe85a06ae90231192b6b39c1a7f3546d8bfe2b08f864ff7b80b2fa7baf"} Jun 14 14:45:07.888281 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.888274 2566 scope.go:117] "RemoveContainer" containerID="be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413" Jun 14 14:45:07.895836 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.895800 2566 scope.go:117] "RemoveContainer" containerID="4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c" Jun 14 14:45:07.903035 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.903018 2566 scope.go:117] "RemoveContainer" containerID="f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74" Jun 14 14:45:07.910033 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.909953 2566 scope.go:117] "RemoveContainer" containerID="26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc" Jun 14 14:45:07.911432 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.911413 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 14:45:07.915179 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.915161 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 14:45:07.917714 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.917696 2566 scope.go:117] "RemoveContainer" containerID="bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126" Jun 14 14:45:07.924296 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.924282 2566 scope.go:117] "RemoveContainer" containerID="60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4" Jun 14 14:45:07.931290 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.931275 2566 scope.go:117] "RemoveContainer" containerID="a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f" Jun 14 14:45:07.938100 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.938078 2566 scope.go:117] "RemoveContainer" containerID="be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413" Jun 14 14:45:07.938361 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:45:07.938342 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413\": container with ID starting with be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413 not found: ID does not exist" containerID="be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413" Jun 14 14:45:07.938416 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.938370 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413"} err="failed to get container status \"be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413\": rpc error: code = NotFound desc = could not find container \"be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413\": container with ID starting with be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413 not found: ID does not exist" Jun 14 14:45:07.938416 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.938390 2566 scope.go:117] "RemoveContainer" containerID="4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c" Jun 14 14:45:07.938677 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.938658 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 14:45:07.938677 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:45:07.938664 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c\": container with ID starting with 4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c not found: ID does not exist" containerID="4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c" Jun 14 14:45:07.938791 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.938690 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c"} err="failed to get container status \"4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c\": rpc error: code = NotFound desc = could not find container \"4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c\": container with ID starting with 4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c not found: ID does not exist" Jun 14 14:45:07.938791 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.938707 2566 scope.go:117] "RemoveContainer" containerID="f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74" Jun 14 14:45:07.938973 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:45:07.938932 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74\": container with ID starting with f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74 not found: ID does not exist" containerID="f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74" Jun 14 14:45:07.939013 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.938984 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74"} err="failed to get container status \"f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74\": rpc error: code = NotFound desc = could not find container \"f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74\": container with ID starting with f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74 not found: ID does not exist" Jun 14 14:45:07.939013 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939000 2566 scope.go:117] "RemoveContainer" containerID="26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc" Jun 14 14:45:07.939088 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.938962 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="kube-rbac-proxy-metric" Jun 14 14:45:07.939088 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939053 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="kube-rbac-proxy-metric" Jun 14 14:45:07.939088 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939066 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="config-reloader" Jun 14 14:45:07.939088 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939072 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="config-reloader" Jun 14 14:45:07.939088 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939079 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="prom-label-proxy" Jun 14 14:45:07.939088 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939084 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="prom-label-proxy" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939099 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="kube-rbac-proxy-web" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939109 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="kube-rbac-proxy-web" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939124 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="kube-rbac-proxy" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939137 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="kube-rbac-proxy" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939144 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="alertmanager" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939149 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="alertmanager" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939158 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581dca68-aa80-428b-a78d-07a2ac6d60ef" containerName="registry" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939164 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="581dca68-aa80-428b-a78d-07a2ac6d60ef" containerName="registry" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939169 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="init-config-reloader" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939174 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="init-config-reloader" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:45:07.939203 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc\": container with ID starting with 26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc not found: ID does not exist" containerID="26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939219 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc"} err="failed to get container status \"26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc\": rpc error: code = NotFound desc = could not find container \"26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc\": container with ID starting with 26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc not found: ID does not exist" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939230 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="config-reloader" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939243 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="581dca68-aa80-428b-a78d-07a2ac6d60ef" containerName="registry" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939249 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="prom-label-proxy" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939255 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="kube-rbac-proxy-metric" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939260 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="kube-rbac-proxy" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939265 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="alertmanager" Jun 14 14:45:07.939283 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939271 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" containerName="kube-rbac-proxy-web" Jun 14 14:45:07.939953 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939230 2566 scope.go:117] "RemoveContainer" containerID="bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126" Jun 14 14:45:07.939953 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:45:07.939502 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126\": container with ID starting with bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126 not found: ID does not exist" containerID="bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126" Jun 14 14:45:07.939953 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939528 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126"} err="failed to get container status \"bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126\": rpc error: code = NotFound desc = could not find container \"bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126\": container with ID starting with bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126 not found: ID does not exist" Jun 14 14:45:07.939953 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939573 2566 scope.go:117] "RemoveContainer" containerID="60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4" Jun 14 14:45:07.939953 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:45:07.939801 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4\": container with ID starting with 60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4 not found: ID does not exist" containerID="60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4" Jun 14 14:45:07.939953 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939821 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4"} err="failed to get container status \"60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4\": rpc error: code = NotFound desc = could not find container \"60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4\": container with ID starting with 60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4 not found: ID does not exist" Jun 14 14:45:07.939953 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.939837 2566 scope.go:117] "RemoveContainer" containerID="a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f" Jun 14 14:45:07.940208 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:45:07.940108 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f\": container with ID starting with a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f not found: ID does not exist" containerID="a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f" Jun 14 14:45:07.940208 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.940127 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f"} err="failed to get container status \"a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f\": rpc error: code = NotFound desc = could not find container \"a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f\": container with ID starting with a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f not found: ID does not exist" Jun 14 14:45:07.940208 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.940157 2566 scope.go:117] "RemoveContainer" containerID="be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413" Jun 14 14:45:07.940470 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.940451 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413"} err="failed to get container status \"be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413\": rpc error: code = NotFound desc = could not find container \"be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413\": container with ID starting with be9cd978eaf32bb518cedd91ee8c2948f0a68c2ae57f26b78ff68e001819c413 not found: ID does not exist" Jun 14 14:45:07.940520 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.940470 2566 scope.go:117] "RemoveContainer" containerID="4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c" Jun 14 14:45:07.940760 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.940738 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c"} err="failed to get container status \"4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c\": rpc error: code = NotFound desc = could not find container \"4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c\": container with ID starting with 4f3bf997d77a4770fb0650bf7cc4c21c1b68d873c6744f83e7c632d1f28fdd9c not found: ID does not exist" Jun 14 14:45:07.940760 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.940758 2566 scope.go:117] "RemoveContainer" containerID="f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74" Jun 14 14:45:07.940962 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.940945 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74"} err="failed to get container status \"f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74\": rpc error: code = NotFound desc = could not find container \"f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74\": container with ID starting with f62047cc63f2f55c4ed7258c011c8af12c240c7cd630e6b839c3bf6561a8dd74 not found: ID does not exist" Jun 14 14:45:07.941008 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.940963 2566 scope.go:117] "RemoveContainer" containerID="26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc" Jun 14 14:45:07.941152 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.941137 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc"} err="failed to get container status \"26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc\": rpc error: code = NotFound desc = could not find container \"26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc\": container with ID starting with 26483bbda9dca37294d43ebf10e7eab35ef0bb54f6205904e82c9826d5eff4fc not found: ID does not exist" Jun 14 14:45:07.941206 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.941152 2566 scope.go:117] "RemoveContainer" containerID="bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126" Jun 14 14:45:07.941366 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.941352 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126"} err="failed to get container status \"bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126\": rpc error: code = NotFound desc = could not find container \"bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126\": container with ID starting with bb726526a630dcf051ea2119c5256384ecd95f52a53f56d3bba4d37d8fd72126 not found: ID does not exist" Jun 14 14:45:07.941366 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.941365 2566 scope.go:117] "RemoveContainer" containerID="60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4" Jun 14 14:45:07.941619 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.941601 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4"} err="failed to get container status \"60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4\": rpc error: code = NotFound desc = could not find container \"60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4\": container with ID starting with 60a6813916a9f30861c2c3ea227a7b702a93c952c19089be166083e835226ee4 not found: ID does not exist" Jun 14 14:45:07.941673 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.941620 2566 scope.go:117] "RemoveContainer" containerID="a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f" Jun 14 14:45:07.941855 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.941827 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f"} err="failed to get container status \"a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f\": rpc error: code = NotFound desc = could not find container \"a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f\": container with ID starting with a66f06de77f2153969c2777d853f47782a92a02d639f4d28c9d79bceb075474f not found: ID does not exist" Jun 14 14:45:07.943026 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.943013 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.944791 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.944760 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 14:45:07.944909 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.944880 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 14:45:07.945176 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.945160 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 14:45:07.945357 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.945264 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 14:45:07.945455 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.945402 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 14:45:07.945598 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.945576 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 14:45:07.945598 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.945591 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 14:45:07.945745 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.945698 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 14:45:07.945745 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.945721 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2sjhx\"" Jun 14 14:45:07.949897 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.949862 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 14:45:07.956578 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.956560 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 14:45:07.981128 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.981104 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3af41db9-a200-4ca0-9dcb-f36c621d57cf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.981206 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.981141 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.981206 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.981166 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.981206 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.981182 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3af41db9-a200-4ca0-9dcb-f36c621d57cf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.981206 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.981201 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.981335 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.981289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-config-volume\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.981335 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.981314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3af41db9-a200-4ca0-9dcb-f36c621d57cf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.981335 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.981330 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtwn5\" (UniqueName: \"kubernetes.io/projected/3af41db9-a200-4ca0-9dcb-f36c621d57cf-kube-api-access-vtwn5\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.981423 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.981355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.981423 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.981385 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3af41db9-a200-4ca0-9dcb-f36c621d57cf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.981423 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.981406 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3af41db9-a200-4ca0-9dcb-f36c621d57cf-config-out\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.981510 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.981424 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:07.981510 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:07.981484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-web-config\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.082070 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.081997 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3af41db9-a200-4ca0-9dcb-f36c621d57cf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.082070 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.082029 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.082070 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.082047 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.082070 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.082066 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3af41db9-a200-4ca0-9dcb-f36c621d57cf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.082335 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.082280 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.082388 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.082373 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-config-volume\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.082437 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.082403 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3af41db9-a200-4ca0-9dcb-f36c621d57cf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.082437 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.082428 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtwn5\" (UniqueName: \"kubernetes.io/projected/3af41db9-a200-4ca0-9dcb-f36c621d57cf-kube-api-access-vtwn5\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.082570 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.082466 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.082570 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.082493 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3af41db9-a200-4ca0-9dcb-f36c621d57cf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.082570 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.082527 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3af41db9-a200-4ca0-9dcb-f36c621d57cf-config-out\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.082723 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.082580 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.082723 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.082624 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-web-config\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.082838 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.082451 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3af41db9-a200-4ca0-9dcb-f36c621d57cf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.083749 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.082994 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3af41db9-a200-4ca0-9dcb-f36c621d57cf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.083749 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.083680 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3af41db9-a200-4ca0-9dcb-f36c621d57cf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.085222 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.085196 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.085417 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.085390 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-config-volume\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.085533 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.085461 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.085533 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.085491 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-web-config\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.085533 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.085527 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3af41db9-a200-4ca0-9dcb-f36c621d57cf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.085731 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.085621 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.085932 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.085913 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.086325 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.086306 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3af41db9-a200-4ca0-9dcb-f36c621d57cf-config-out\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.086660 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.086646 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3af41db9-a200-4ca0-9dcb-f36c621d57cf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.089997 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.089979 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtwn5\" (UniqueName: \"kubernetes.io/projected/3af41db9-a200-4ca0-9dcb-f36c621d57cf-kube-api-access-vtwn5\") pod \"alertmanager-main-0\" (UID: \"3af41db9-a200-4ca0-9dcb-f36c621d57cf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.252643 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.252607 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:45:08.386721 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.386699 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 14:45:08.389170 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:45:08.389137 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3af41db9_a200_4ca0_9dcb_f36c621d57cf.slice/crio-07cf0e3d90d5686fa6aab904a02e01979a71212dbf9977fdbe98670c3bf8ac4f WatchSource:0}: Error finding container 07cf0e3d90d5686fa6aab904a02e01979a71212dbf9977fdbe98670c3bf8ac4f: Status 404 returned error can't find the container with id 07cf0e3d90d5686fa6aab904a02e01979a71212dbf9977fdbe98670c3bf8ac4f Jun 14 14:45:08.899394 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.899358 2566 generic.go:356] "Generic (PLEG): container finished" podID="3af41db9-a200-4ca0-9dcb-f36c621d57cf" containerID="d755f6ed089827395f66b789a21aa9d4147e9dc2d6508d125e93ede90202590c" exitCode=0 Jun 14 14:45:08.899790 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.899414 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3af41db9-a200-4ca0-9dcb-f36c621d57cf","Type":"ContainerDied","Data":"d755f6ed089827395f66b789a21aa9d4147e9dc2d6508d125e93ede90202590c"} Jun 14 14:45:08.899790 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:08.899489 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3af41db9-a200-4ca0-9dcb-f36c621d57cf","Type":"ContainerStarted","Data":"07cf0e3d90d5686fa6aab904a02e01979a71212dbf9977fdbe98670c3bf8ac4f"} Jun 14 14:45:09.564092 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:09.564054 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c9a677b-8196-4b63-956b-d3f6d1b51b8b" path="/var/lib/kubelet/pods/3c9a677b-8196-4b63-956b-d3f6d1b51b8b/volumes" Jun 14 14:45:09.906461 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:09.906367 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3af41db9-a200-4ca0-9dcb-f36c621d57cf","Type":"ContainerStarted","Data":"2d2916e87573356ca93a1b3679edab2ec260ccca32ec16d5dfa05d8430ff7b7e"} Jun 14 14:45:09.906461 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:09.906445 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3af41db9-a200-4ca0-9dcb-f36c621d57cf","Type":"ContainerStarted","Data":"b9942e0afb4c38481f9caea7deac55b90dd616cc974a19828f2c15d686ab0ef2"} Jun 14 14:45:09.907019 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:09.906491 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3af41db9-a200-4ca0-9dcb-f36c621d57cf","Type":"ContainerStarted","Data":"3ec0b86cb28a095ff167860de3f33197a97a2a5c59f37a38e9d2c3fdeef23c06"} Jun 14 14:45:09.907019 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:09.906528 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3af41db9-a200-4ca0-9dcb-f36c621d57cf","Type":"ContainerStarted","Data":"76b1d15d163878b741d8a2e5dc3e10b3091c435e7d0d7206b69d46f73b7093ee"} Jun 14 14:45:09.907019 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:09.906611 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3af41db9-a200-4ca0-9dcb-f36c621d57cf","Type":"ContainerStarted","Data":"1c013708e558ee1045f79662822415fdcd720665df580b7c4288016c03c7367d"} Jun 14 14:45:09.907019 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:09.906651 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3af41db9-a200-4ca0-9dcb-f36c621d57cf","Type":"ContainerStarted","Data":"f07dedcef5c70cfca15b03c4711b99d6e5df8e7150709cafddcdf276add11cf9"} Jun 14 14:45:09.930156 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:45:09.930104 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.914601237 podStartE2EDuration="2.930088001s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.486764ms" isStatefulPod=false podCreationTimestamp="2026-06-14 14:45:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:45:09.927266645 +0000 UTC m=+342.798199957" watchObservedRunningTime="2026-06-14 14:45:09.930088001 +0000 UTC m=+342.801021669" Jun 14 14:46:40.727138 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:40.727105 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8vmpt"] Jun 14 14:46:40.730363 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:40.730348 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8vmpt" Jun 14 14:46:40.732092 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:40.732071 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 14 14:46:40.732527 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:40.732514 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ntjnt\"" Jun 14 14:46:40.732596 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:40.732560 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 14 14:46:40.738664 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:40.738644 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8vmpt"] Jun 14 14:46:40.819750 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:40.819723 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8536063f-12d4-4a4a-ac34-3a74e516685b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8vmpt\" (UID: \"8536063f-12d4-4a4a-ac34-3a74e516685b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8vmpt" Jun 14 14:46:40.819856 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:40.819762 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-592g7\" (UniqueName: \"kubernetes.io/projected/8536063f-12d4-4a4a-ac34-3a74e516685b-kube-api-access-592g7\") pod \"cert-manager-cainjector-5d99449ffd-8vmpt\" (UID: \"8536063f-12d4-4a4a-ac34-3a74e516685b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8vmpt" Jun 14 14:46:40.920524 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:40.920495 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8536063f-12d4-4a4a-ac34-3a74e516685b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8vmpt\" (UID: \"8536063f-12d4-4a4a-ac34-3a74e516685b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8vmpt" Jun 14 14:46:40.920682 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:40.920533 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-592g7\" (UniqueName: \"kubernetes.io/projected/8536063f-12d4-4a4a-ac34-3a74e516685b-kube-api-access-592g7\") pod \"cert-manager-cainjector-5d99449ffd-8vmpt\" (UID: \"8536063f-12d4-4a4a-ac34-3a74e516685b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8vmpt" Jun 14 14:46:40.927842 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:40.927818 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-592g7\" (UniqueName: \"kubernetes.io/projected/8536063f-12d4-4a4a-ac34-3a74e516685b-kube-api-access-592g7\") pod \"cert-manager-cainjector-5d99449ffd-8vmpt\" (UID: \"8536063f-12d4-4a4a-ac34-3a74e516685b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8vmpt" Jun 14 14:46:40.931879 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:40.931856 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8536063f-12d4-4a4a-ac34-3a74e516685b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8vmpt\" (UID: \"8536063f-12d4-4a4a-ac34-3a74e516685b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8vmpt" Jun 14 14:46:41.040152 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:41.040090 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8vmpt" Jun 14 14:46:41.161705 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:41.161656 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8vmpt"] Jun 14 14:46:41.164263 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:46:41.164228 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8536063f_12d4_4a4a_ac34_3a74e516685b.slice/crio-8b196b2284567a93276562d6b81a87ee3f2d63c60699d7f130f45721081cd108 WatchSource:0}: Error finding container 8b196b2284567a93276562d6b81a87ee3f2d63c60699d7f130f45721081cd108: Status 404 returned error can't find the container with id 8b196b2284567a93276562d6b81a87ee3f2d63c60699d7f130f45721081cd108 Jun 14 14:46:41.166192 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:41.166175 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 14:46:41.260488 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:41.260461 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8vmpt" event={"ID":"8536063f-12d4-4a4a-ac34-3a74e516685b","Type":"ContainerStarted","Data":"8b196b2284567a93276562d6b81a87ee3f2d63c60699d7f130f45721081cd108"} Jun 14 14:46:44.276839 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:44.276802 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8vmpt" event={"ID":"8536063f-12d4-4a4a-ac34-3a74e516685b","Type":"ContainerStarted","Data":"933e7081246f732dfedea9f8a36a4083a71796f81a270d5ab424dd365e349bae"} Jun 14 14:46:44.294733 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:44.294689 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8vmpt" podStartSLOduration=1.522393334 podStartE2EDuration="4.294673069s" totalImagesPullingTime="2.772279735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:46:44.293354721 +0000 UTC m=+437.164288031" watchObservedRunningTime="2026-06-14 14:46:44.294673069 +0000 UTC m=+437.165606382" Jun 14 14:46:46.388661 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:46.388629 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84v7l"] Jun 14 14:46:46.391862 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:46.391843 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84v7l" Jun 14 14:46:46.394022 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:46.394002 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:46:46.394560 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:46.394526 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rr9mk\"" Jun 14 14:46:46.394560 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:46.394551 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 14:46:46.398782 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:46.398751 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84v7l"] Jun 14 14:46:46.566484 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:46.566454 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7c8c03c-0b79-42d7-a052-1b4223431618-tmp\") pod \"openshift-lws-operator-fd8ccff4c-84v7l\" (UID: \"d7c8c03c-0b79-42d7-a052-1b4223431618\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84v7l" Jun 14 14:46:46.566711 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:46.566492 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6nvr\" (UniqueName: \"kubernetes.io/projected/d7c8c03c-0b79-42d7-a052-1b4223431618-kube-api-access-b6nvr\") pod \"openshift-lws-operator-fd8ccff4c-84v7l\" (UID: \"d7c8c03c-0b79-42d7-a052-1b4223431618\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84v7l" Jun 14 14:46:46.668001 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:46.667917 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7c8c03c-0b79-42d7-a052-1b4223431618-tmp\") pod \"openshift-lws-operator-fd8ccff4c-84v7l\" (UID: \"d7c8c03c-0b79-42d7-a052-1b4223431618\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84v7l" Jun 14 14:46:46.668001 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:46.667965 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6nvr\" (UniqueName: \"kubernetes.io/projected/d7c8c03c-0b79-42d7-a052-1b4223431618-kube-api-access-b6nvr\") pod \"openshift-lws-operator-fd8ccff4c-84v7l\" (UID: \"d7c8c03c-0b79-42d7-a052-1b4223431618\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84v7l" Jun 14 14:46:46.668528 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:46.668506 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7c8c03c-0b79-42d7-a052-1b4223431618-tmp\") pod \"openshift-lws-operator-fd8ccff4c-84v7l\" (UID: \"d7c8c03c-0b79-42d7-a052-1b4223431618\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84v7l" Jun 14 14:46:46.674954 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:46.674926 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6nvr\" (UniqueName: \"kubernetes.io/projected/d7c8c03c-0b79-42d7-a052-1b4223431618-kube-api-access-b6nvr\") pod \"openshift-lws-operator-fd8ccff4c-84v7l\" (UID: \"d7c8c03c-0b79-42d7-a052-1b4223431618\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84v7l" Jun 14 14:46:46.701799 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:46.701774 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84v7l" Jun 14 14:46:46.823713 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:46.823683 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84v7l"] Jun 14 14:46:46.827178 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:46:46.827137 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7c8c03c_0b79_42d7_a052_1b4223431618.slice/crio-b5464bc4b40197cfe39b00adcd5c284edb5ea9ad40565331b568b21648982cd4 WatchSource:0}: Error finding container b5464bc4b40197cfe39b00adcd5c284edb5ea9ad40565331b568b21648982cd4: Status 404 returned error can't find the container with id b5464bc4b40197cfe39b00adcd5c284edb5ea9ad40565331b568b21648982cd4 Jun 14 14:46:47.290102 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:47.290024 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84v7l" event={"ID":"d7c8c03c-0b79-42d7-a052-1b4223431618","Type":"ContainerStarted","Data":"b5464bc4b40197cfe39b00adcd5c284edb5ea9ad40565331b568b21648982cd4"} Jun 14 14:46:50.306876 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:50.306844 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84v7l" event={"ID":"d7c8c03c-0b79-42d7-a052-1b4223431618","Type":"ContainerStarted","Data":"130fc040b4a7c8b8b6f3e7c8dc21e286b15850bcdf9f14b716ff4cc877da4550"} Jun 14 14:46:50.322118 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:46:50.322076 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84v7l" podStartSLOduration=1.67687058 podStartE2EDuration="4.322061534s" totalImagesPullingTime="2.645190954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:46:50.320248082 +0000 UTC m=+443.191181395" watchObservedRunningTime="2026-06-14 14:46:50.322061534 +0000 UTC m=+443.192994846" Jun 14 14:47:06.502623 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.502592 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk"] Jun 14 14:47:06.506127 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.506108 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.509194 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.509169 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f6x9g\"" Jun 14 14:47:06.509370 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.509345 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 14:47:06.509492 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.509450 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 14:47:06.509492 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.509455 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 14:47:06.509641 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.509601 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 14:47:06.526757 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.526729 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk"] Jun 14 14:47:06.529594 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.529558 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv2pr\" (UniqueName: \"kubernetes.io/projected/3b00c660-4a69-4af7-a1e0-d8ada3a15493-kube-api-access-bv2pr\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.529742 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.529640 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b00c660-4a69-4af7-a1e0-d8ada3a15493-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.529742 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.529681 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b00c660-4a69-4af7-a1e0-d8ada3a15493-manifests\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.529742 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.529702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b00c660-4a69-4af7-a1e0-d8ada3a15493-tmp\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.529880 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.529755 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b00c660-4a69-4af7-a1e0-d8ada3a15493-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.631062 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.631032 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b00c660-4a69-4af7-a1e0-d8ada3a15493-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.631280 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.631156 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv2pr\" (UniqueName: \"kubernetes.io/projected/3b00c660-4a69-4af7-a1e0-d8ada3a15493-kube-api-access-bv2pr\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.631280 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.631254 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b00c660-4a69-4af7-a1e0-d8ada3a15493-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.631391 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.631327 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b00c660-4a69-4af7-a1e0-d8ada3a15493-manifests\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.631391 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.631373 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b00c660-4a69-4af7-a1e0-d8ada3a15493-tmp\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.631790 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.631766 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b00c660-4a69-4af7-a1e0-d8ada3a15493-manifests\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.633744 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.633714 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b00c660-4a69-4af7-a1e0-d8ada3a15493-tmp\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.633854 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.633725 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b00c660-4a69-4af7-a1e0-d8ada3a15493-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.633937 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.633922 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b00c660-4a69-4af7-a1e0-d8ada3a15493-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.639209 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.639184 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv2pr\" (UniqueName: \"kubernetes.io/projected/3b00c660-4a69-4af7-a1e0-d8ada3a15493-kube-api-access-bv2pr\") pod \"opendatahub-operator-controller-manager-bc868665f-v9lvk\" (UID: \"3b00c660-4a69-4af7-a1e0-d8ada3a15493\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.817173 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.817069 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:06.952140 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:06.952118 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk"] Jun 14 14:47:06.954915 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:47:06.954887 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b00c660_4a69_4af7_a1e0_d8ada3a15493.slice/crio-e1021450994fb265ca06d82a5c36b3427cbcdcc5b860483e92289d67590d3d08 WatchSource:0}: Error finding container e1021450994fb265ca06d82a5c36b3427cbcdcc5b860483e92289d67590d3d08: Status 404 returned error can't find the container with id e1021450994fb265ca06d82a5c36b3427cbcdcc5b860483e92289d67590d3d08 Jun 14 14:47:07.378966 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:07.378925 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" event={"ID":"3b00c660-4a69-4af7-a1e0-d8ada3a15493","Type":"ContainerStarted","Data":"e1021450994fb265ca06d82a5c36b3427cbcdcc5b860483e92289d67590d3d08"} Jun 14 14:47:10.395746 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:10.395710 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" event={"ID":"3b00c660-4a69-4af7-a1e0-d8ada3a15493","Type":"ContainerStarted","Data":"04ea43cfe866bae2c6bf4073e88124a118d2e15384a5e803925b4171fc2b5969"} Jun 14 14:47:11.403511 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:11.403475 2566 generic.go:356] "Generic (PLEG): container finished" podID="3b00c660-4a69-4af7-a1e0-d8ada3a15493" containerID="04ea43cfe866bae2c6bf4073e88124a118d2e15384a5e803925b4171fc2b5969" exitCode=0 Jun 14 14:47:11.403511 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:11.403512 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" event={"ID":"3b00c660-4a69-4af7-a1e0-d8ada3a15493","Type":"ContainerDied","Data":"04ea43cfe866bae2c6bf4073e88124a118d2e15384a5e803925b4171fc2b5969"} Jun 14 14:47:12.409512 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:12.409476 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" event={"ID":"3b00c660-4a69-4af7-a1e0-d8ada3a15493","Type":"ContainerStarted","Data":"f56257385f81cda95e01b19b274e07c6c606d60ec5a436c262a915878206192f"} Jun 14 14:47:12.409917 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:12.409591 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:12.431325 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:12.431281 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" podStartSLOduration=2.29599064 podStartE2EDuration="6.431266381s" totalImagesPullingTime="3.231186248s" totalInitContainerRuntime="904.089493ms" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:12.428974767 +0000 UTC m=+465.299908091" watchObservedRunningTime="2026-06-14 14:47:12.431266381 +0000 UTC m=+465.302199757" Jun 14 14:47:23.416933 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:23.416900 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-v9lvk" Jun 14 14:47:25.889837 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:25.889791 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r"] Jun 14 14:47:25.894779 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:25.894753 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" Jun 14 14:47:25.897370 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:25.897344 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 14:47:25.897524 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:25.897377 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 14:47:25.897619 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:25.897421 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 14:47:25.897619 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:25.897423 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tkjx6\"" Jun 14 14:47:25.897734 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:25.897427 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 14:47:25.905378 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:25.905356 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r"] Jun 14 14:47:26.005588 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.005528 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9672735f-f4a8-4df9-b022-2dc5d18837dc-tmp\") pod \"kube-auth-proxy-798fd884dc-6lt7r\" (UID: \"9672735f-f4a8-4df9-b022-2dc5d18837dc\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" Jun 14 14:47:26.005777 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.005604 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9672735f-f4a8-4df9-b022-2dc5d18837dc-tls-certs\") pod \"kube-auth-proxy-798fd884dc-6lt7r\" (UID: \"9672735f-f4a8-4df9-b022-2dc5d18837dc\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" Jun 14 14:47:26.005777 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.005648 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqmvb\" (UniqueName: \"kubernetes.io/projected/9672735f-f4a8-4df9-b022-2dc5d18837dc-kube-api-access-dqmvb\") pod \"kube-auth-proxy-798fd884dc-6lt7r\" (UID: \"9672735f-f4a8-4df9-b022-2dc5d18837dc\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" Jun 14 14:47:26.106344 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.106313 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqmvb\" (UniqueName: \"kubernetes.io/projected/9672735f-f4a8-4df9-b022-2dc5d18837dc-kube-api-access-dqmvb\") pod \"kube-auth-proxy-798fd884dc-6lt7r\" (UID: \"9672735f-f4a8-4df9-b022-2dc5d18837dc\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" Jun 14 14:47:26.106495 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.106412 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9672735f-f4a8-4df9-b022-2dc5d18837dc-tmp\") pod \"kube-auth-proxy-798fd884dc-6lt7r\" (UID: \"9672735f-f4a8-4df9-b022-2dc5d18837dc\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" Jun 14 14:47:26.106495 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.106448 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9672735f-f4a8-4df9-b022-2dc5d18837dc-tls-certs\") pod \"kube-auth-proxy-798fd884dc-6lt7r\" (UID: \"9672735f-f4a8-4df9-b022-2dc5d18837dc\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" Jun 14 14:47:26.106633 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:47:26.106616 2566 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 14 14:47:26.106712 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:47:26.106693 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9672735f-f4a8-4df9-b022-2dc5d18837dc-tls-certs podName:9672735f-f4a8-4df9-b022-2dc5d18837dc nodeName:}" failed. No retries permitted until 2026-06-14 14:47:26.606675287 +0000 UTC m=+479.477608592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9672735f-f4a8-4df9-b022-2dc5d18837dc-tls-certs") pod "kube-auth-proxy-798fd884dc-6lt7r" (UID: "9672735f-f4a8-4df9-b022-2dc5d18837dc") : secret "kube-auth-proxy-tls" not found Jun 14 14:47:26.108800 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.108776 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9672735f-f4a8-4df9-b022-2dc5d18837dc-tmp\") pod \"kube-auth-proxy-798fd884dc-6lt7r\" (UID: \"9672735f-f4a8-4df9-b022-2dc5d18837dc\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" Jun 14 14:47:26.120917 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.120892 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqmvb\" (UniqueName: \"kubernetes.io/projected/9672735f-f4a8-4df9-b022-2dc5d18837dc-kube-api-access-dqmvb\") pod \"kube-auth-proxy-798fd884dc-6lt7r\" (UID: \"9672735f-f4a8-4df9-b022-2dc5d18837dc\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" Jun 14 14:47:26.610348 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.610315 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9672735f-f4a8-4df9-b022-2dc5d18837dc-tls-certs\") pod \"kube-auth-proxy-798fd884dc-6lt7r\" (UID: \"9672735f-f4a8-4df9-b022-2dc5d18837dc\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" Jun 14 14:47:26.612749 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.612730 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9672735f-f4a8-4df9-b022-2dc5d18837dc-tls-certs\") pod \"kube-auth-proxy-798fd884dc-6lt7r\" (UID: \"9672735f-f4a8-4df9-b022-2dc5d18837dc\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" Jun 14 14:47:26.805986 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.805954 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" Jun 14 14:47:26.959044 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.959002 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r"] Jun 14 14:47:26.960416 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.960391 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6z9s2"] Jun 14 14:47:26.961352 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:47:26.961329 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9672735f_f4a8_4df9_b022_2dc5d18837dc.slice/crio-e0f6d38f6e7709996f6e33a1ef7f6ccfc2cae86d2592e0b5cfc2070b25b48f29 WatchSource:0}: Error finding container e0f6d38f6e7709996f6e33a1ef7f6ccfc2cae86d2592e0b5cfc2070b25b48f29: Status 404 returned error can't find the container with id e0f6d38f6e7709996f6e33a1ef7f6ccfc2cae86d2592e0b5cfc2070b25b48f29 Jun 14 14:47:26.963754 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.963736 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-6z9s2" Jun 14 14:47:26.965782 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.965755 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wspn8\"" Jun 14 14:47:26.965907 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.965891 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 14 14:47:26.970399 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:26.970382 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6z9s2"] Jun 14 14:47:27.115420 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:27.115302 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccb50b80-e763-43c4-a92f-c79f450b31fe-tls-certs\") pod \"model-serving-api-5dd488fc48-6z9s2\" (UID: \"ccb50b80-e763-43c4-a92f-c79f450b31fe\") " pod="opendatahub/model-serving-api-5dd488fc48-6z9s2" Jun 14 14:47:27.115420 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:27.115378 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdmmt\" (UniqueName: \"kubernetes.io/projected/ccb50b80-e763-43c4-a92f-c79f450b31fe-kube-api-access-gdmmt\") pod \"model-serving-api-5dd488fc48-6z9s2\" (UID: \"ccb50b80-e763-43c4-a92f-c79f450b31fe\") " pod="opendatahub/model-serving-api-5dd488fc48-6z9s2" Jun 14 14:47:27.216775 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:27.216742 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccb50b80-e763-43c4-a92f-c79f450b31fe-tls-certs\") pod \"model-serving-api-5dd488fc48-6z9s2\" (UID: \"ccb50b80-e763-43c4-a92f-c79f450b31fe\") " pod="opendatahub/model-serving-api-5dd488fc48-6z9s2" Jun 14 14:47:27.216971 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:27.216798 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdmmt\" (UniqueName: \"kubernetes.io/projected/ccb50b80-e763-43c4-a92f-c79f450b31fe-kube-api-access-gdmmt\") pod \"model-serving-api-5dd488fc48-6z9s2\" (UID: \"ccb50b80-e763-43c4-a92f-c79f450b31fe\") " pod="opendatahub/model-serving-api-5dd488fc48-6z9s2" Jun 14 14:47:27.216971 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:47:27.216901 2566 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 14 14:47:27.217064 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:47:27.216978 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb50b80-e763-43c4-a92f-c79f450b31fe-tls-certs podName:ccb50b80-e763-43c4-a92f-c79f450b31fe nodeName:}" failed. No retries permitted until 2026-06-14 14:47:27.716960906 +0000 UTC m=+480.587894197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ccb50b80-e763-43c4-a92f-c79f450b31fe-tls-certs") pod "model-serving-api-5dd488fc48-6z9s2" (UID: "ccb50b80-e763-43c4-a92f-c79f450b31fe") : secret "model-serving-api-tls" not found Jun 14 14:47:27.224656 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:27.224630 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdmmt\" (UniqueName: \"kubernetes.io/projected/ccb50b80-e763-43c4-a92f-c79f450b31fe-kube-api-access-gdmmt\") pod \"model-serving-api-5dd488fc48-6z9s2\" (UID: \"ccb50b80-e763-43c4-a92f-c79f450b31fe\") " pod="opendatahub/model-serving-api-5dd488fc48-6z9s2" Jun 14 14:47:27.475002 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:27.474974 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" event={"ID":"9672735f-f4a8-4df9-b022-2dc5d18837dc","Type":"ContainerStarted","Data":"e0f6d38f6e7709996f6e33a1ef7f6ccfc2cae86d2592e0b5cfc2070b25b48f29"} Jun 14 14:47:27.721569 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:27.721517 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccb50b80-e763-43c4-a92f-c79f450b31fe-tls-certs\") pod \"model-serving-api-5dd488fc48-6z9s2\" (UID: \"ccb50b80-e763-43c4-a92f-c79f450b31fe\") " pod="opendatahub/model-serving-api-5dd488fc48-6z9s2" Jun 14 14:47:27.724484 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:27.724455 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccb50b80-e763-43c4-a92f-c79f450b31fe-tls-certs\") pod \"model-serving-api-5dd488fc48-6z9s2\" (UID: \"ccb50b80-e763-43c4-a92f-c79f450b31fe\") " pod="opendatahub/model-serving-api-5dd488fc48-6z9s2" Jun 14 14:47:27.877963 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:27.877858 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wspn8\"" Jun 14 14:47:27.886414 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:27.886384 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-6z9s2" Jun 14 14:47:28.064671 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:28.064631 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6z9s2"] Jun 14 14:47:28.067903 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:47:28.067878 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb50b80_e763_43c4_a92f_c79f450b31fe.slice/crio-208b58be8c8630f6d886816525028b4552e75c322deefacf6bcf52fa852c9a84 WatchSource:0}: Error finding container 208b58be8c8630f6d886816525028b4552e75c322deefacf6bcf52fa852c9a84: Status 404 returned error can't find the container with id 208b58be8c8630f6d886816525028b4552e75c322deefacf6bcf52fa852c9a84 Jun 14 14:47:28.482387 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:28.482327 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-6z9s2" event={"ID":"ccb50b80-e763-43c4-a92f-c79f450b31fe","Type":"ContainerStarted","Data":"208b58be8c8630f6d886816525028b4552e75c322deefacf6bcf52fa852c9a84"} Jun 14 14:47:29.750936 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:29.750910 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 14:47:30.494254 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:30.494212 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" event={"ID":"9672735f-f4a8-4df9-b022-2dc5d18837dc","Type":"ContainerStarted","Data":"76b82d843a6a90929c711c9b6bae95a432aa223feedb3d69f8b24d0ab3965f5c"} Jun 14 14:47:31.500413 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:31.500381 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-6z9s2" event={"ID":"ccb50b80-e763-43c4-a92f-c79f450b31fe","Type":"ContainerStarted","Data":"28bcd266332c487b7c16f34936cbd3523dd9998755eb879b0082df895de30597"} Jun 14 14:47:31.500830 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:31.500467 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-6z9s2" Jun 14 14:47:31.515506 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:31.515466 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-798fd884dc-6lt7r" podStartSLOduration=3.729584137 podStartE2EDuration="6.515452646s" totalImagesPullingTime="2.785868509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:30.510505568 +0000 UTC m=+483.381438880" watchObservedRunningTime="2026-06-14 14:47:31.515452646 +0000 UTC m=+484.386385990" Jun 14 14:47:31.515963 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:31.515934 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-6z9s2" podStartSLOduration=2.7541163319999997 podStartE2EDuration="5.515924704s" totalImagesPullingTime="2.761808372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:31.514075727 +0000 UTC m=+484.385009052" watchObservedRunningTime="2026-06-14 14:47:31.515924704 +0000 UTC m=+484.386858016" Jun 14 14:47:36.610449 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.610404 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-8vh7m"] Jun 14 14:47:36.614193 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.614170 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb"] Jun 14 14:47:36.614342 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.614307 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-8vh7m" Jun 14 14:47:36.617403 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.617385 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb" Jun 14 14:47:36.617771 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.617754 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 14 14:47:36.617771 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.617760 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mcbh4\"" Jun 14 14:47:36.619279 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.619256 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 14 14:47:36.619403 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.619292 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-spq6g\"" Jun 14 14:47:36.627613 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.627580 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-8vh7m"] Jun 14 14:47:36.629345 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.629326 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb"] Jun 14 14:47:36.804757 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.804726 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4mhg\" (UniqueName: \"kubernetes.io/projected/2dd39433-a6e9-44ad-a1e1-d3c86a91c50e-kube-api-access-w4mhg\") pod \"kserve-controller-manager-69fc866d76-8vh7m\" (UID: \"2dd39433-a6e9-44ad-a1e1-d3c86a91c50e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8vh7m" Jun 14 14:47:36.804945 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.804781 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2dd39433-a6e9-44ad-a1e1-d3c86a91c50e-cert\") pod \"kserve-controller-manager-69fc866d76-8vh7m\" (UID: \"2dd39433-a6e9-44ad-a1e1-d3c86a91c50e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8vh7m" Jun 14 14:47:36.804945 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.804860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/148d8001-1f88-44ef-8901-073f785c6b02-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-jjqwb\" (UID: \"148d8001-1f88-44ef-8901-073f785c6b02\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb" Jun 14 14:47:36.804945 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.804892 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nml6h\" (UniqueName: \"kubernetes.io/projected/148d8001-1f88-44ef-8901-073f785c6b02-kube-api-access-nml6h\") pod \"llmisvc-controller-manager-864bfd7bc9-jjqwb\" (UID: \"148d8001-1f88-44ef-8901-073f785c6b02\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb" Jun 14 14:47:36.905593 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.905482 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4mhg\" (UniqueName: \"kubernetes.io/projected/2dd39433-a6e9-44ad-a1e1-d3c86a91c50e-kube-api-access-w4mhg\") pod \"kserve-controller-manager-69fc866d76-8vh7m\" (UID: \"2dd39433-a6e9-44ad-a1e1-d3c86a91c50e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8vh7m" Jun 14 14:47:36.905593 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.905530 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2dd39433-a6e9-44ad-a1e1-d3c86a91c50e-cert\") pod \"kserve-controller-manager-69fc866d76-8vh7m\" (UID: \"2dd39433-a6e9-44ad-a1e1-d3c86a91c50e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8vh7m" Jun 14 14:47:36.905593 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.905583 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/148d8001-1f88-44ef-8901-073f785c6b02-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-jjqwb\" (UID: \"148d8001-1f88-44ef-8901-073f785c6b02\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb" Jun 14 14:47:36.905880 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.905608 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nml6h\" (UniqueName: \"kubernetes.io/projected/148d8001-1f88-44ef-8901-073f785c6b02-kube-api-access-nml6h\") pod \"llmisvc-controller-manager-864bfd7bc9-jjqwb\" (UID: \"148d8001-1f88-44ef-8901-073f785c6b02\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb" Jun 14 14:47:36.908066 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.908038 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/148d8001-1f88-44ef-8901-073f785c6b02-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-jjqwb\" (UID: \"148d8001-1f88-44ef-8901-073f785c6b02\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb" Jun 14 14:47:36.908187 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.908165 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2dd39433-a6e9-44ad-a1e1-d3c86a91c50e-cert\") pod \"kserve-controller-manager-69fc866d76-8vh7m\" (UID: \"2dd39433-a6e9-44ad-a1e1-d3c86a91c50e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8vh7m" Jun 14 14:47:36.918855 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.918835 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4mhg\" (UniqueName: \"kubernetes.io/projected/2dd39433-a6e9-44ad-a1e1-d3c86a91c50e-kube-api-access-w4mhg\") pod \"kserve-controller-manager-69fc866d76-8vh7m\" (UID: \"2dd39433-a6e9-44ad-a1e1-d3c86a91c50e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8vh7m" Jun 14 14:47:36.921095 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.921073 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nml6h\" (UniqueName: \"kubernetes.io/projected/148d8001-1f88-44ef-8901-073f785c6b02-kube-api-access-nml6h\") pod \"llmisvc-controller-manager-864bfd7bc9-jjqwb\" (UID: \"148d8001-1f88-44ef-8901-073f785c6b02\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb" Jun 14 14:47:36.928836 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.928811 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-8vh7m" Jun 14 14:47:36.934936 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:36.934916 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb" Jun 14 14:47:37.087390 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:37.087344 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-8vh7m"] Jun 14 14:47:37.090440 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:47:37.090403 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd39433_a6e9_44ad_a1e1_d3c86a91c50e.slice/crio-13e99acb45b5e2225cc425a3976cccde655cf2c9a255976c2e15ff2ef586f224 WatchSource:0}: Error finding container 13e99acb45b5e2225cc425a3976cccde655cf2c9a255976c2e15ff2ef586f224: Status 404 returned error can't find the container with id 13e99acb45b5e2225cc425a3976cccde655cf2c9a255976c2e15ff2ef586f224 Jun 14 14:47:37.108689 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:37.108667 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb"] Jun 14 14:47:37.110833 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:47:37.110808 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod148d8001_1f88_44ef_8901_073f785c6b02.slice/crio-f8afa538bf141858f8ad6ba3cdd0846a54732d10e8468c7313726199a3cc8ef8 WatchSource:0}: Error finding container f8afa538bf141858f8ad6ba3cdd0846a54732d10e8468c7313726199a3cc8ef8: Status 404 returned error can't find the container with id f8afa538bf141858f8ad6ba3cdd0846a54732d10e8468c7313726199a3cc8ef8 Jun 14 14:47:37.528091 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:37.528047 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-8vh7m" event={"ID":"2dd39433-a6e9-44ad-a1e1-d3c86a91c50e","Type":"ContainerStarted","Data":"13e99acb45b5e2225cc425a3976cccde655cf2c9a255976c2e15ff2ef586f224"} Jun 14 14:47:37.529098 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:37.529077 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb" event={"ID":"148d8001-1f88-44ef-8901-073f785c6b02","Type":"ContainerStarted","Data":"f8afa538bf141858f8ad6ba3cdd0846a54732d10e8468c7313726199a3cc8ef8"} Jun 14 14:47:39.546048 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:39.545457 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-8vh7m" event={"ID":"2dd39433-a6e9-44ad-a1e1-d3c86a91c50e","Type":"ContainerStarted","Data":"94dd16db48f842f0551af29f9af6f89a372f48be90f1b939f6dae8169c3151d1"} Jun 14 14:47:39.546048 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:39.545870 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-8vh7m" Jun 14 14:47:39.563497 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:39.563409 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-8vh7m" podStartSLOduration=1.225087463 podStartE2EDuration="3.563395091s" totalImagesPullingTime="2.338307628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:39.562799686 +0000 UTC m=+492.433733000" watchObservedRunningTime="2026-06-14 14:47:39.563395091 +0000 UTC m=+492.434328403" Jun 14 14:47:40.553127 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:40.553087 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb" event={"ID":"148d8001-1f88-44ef-8901-073f785c6b02","Type":"ContainerStarted","Data":"8f28fee1061ede1cf359ae48b8d9ea511e7d4508951baaeb60ed70a07a32181d"} Jun 14 14:47:40.553595 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:40.553312 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb" Jun 14 14:47:40.590981 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:40.590931 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb" podStartSLOduration=1.5786540169999999 podStartE2EDuration="4.590915901s" totalImagesPullingTime="3.012261884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:40.589444905 +0000 UTC m=+493.460378228" watchObservedRunningTime="2026-06-14 14:47:40.590915901 +0000 UTC m=+493.461849214" Jun 14 14:47:42.469857 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.469829 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9"] Jun 14 14:47:42.474589 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.474570 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9" Jun 14 14:47:42.477171 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.477148 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 14 14:47:42.477713 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.477695 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-hbkzt\"" Jun 14 14:47:42.477937 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.477917 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 14 14:47:42.485797 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.485777 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9"] Jun 14 14:47:42.509142 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.509110 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-6z9s2" Jun 14 14:47:42.523960 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.523928 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-678bbb5d45-jhhqj"] Jun 14 14:47:42.526889 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.526868 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-678bbb5d45-jhhqj" Jun 14 14:47:42.529590 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.529568 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xg5x7\"" Jun 14 14:47:42.529925 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.529906 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 14:47:42.533823 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.533803 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-678bbb5d45-jhhqj"] Jun 14 14:47:42.554058 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.554036 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/43fa4b1b-4c51-4472-9c51-800821962c30-redirect-config\") pod \"dashboard-redirect-678bbb5d45-jhhqj\" (UID: \"43fa4b1b-4c51-4472-9c51-800821962c30\") " pod="opendatahub/dashboard-redirect-678bbb5d45-jhhqj" Jun 14 14:47:42.554152 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.554098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zkqm\" (UniqueName: \"kubernetes.io/projected/43fa4b1b-4c51-4472-9c51-800821962c30-kube-api-access-2zkqm\") pod \"dashboard-redirect-678bbb5d45-jhhqj\" (UID: \"43fa4b1b-4c51-4472-9c51-800821962c30\") " pod="opendatahub/dashboard-redirect-678bbb5d45-jhhqj" Jun 14 14:47:42.554152 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.554147 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/75dc39ef-fa61-459a-b07e-c575f1f3e5dc-operator-config\") pod \"servicemesh-operator3-57f65f65fb-vqxz9\" (UID: \"75dc39ef-fa61-459a-b07e-c575f1f3e5dc\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9" Jun 14 14:47:42.554268 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.554188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4t9h\" (UniqueName: \"kubernetes.io/projected/75dc39ef-fa61-459a-b07e-c575f1f3e5dc-kube-api-access-x4t9h\") pod \"servicemesh-operator3-57f65f65fb-vqxz9\" (UID: \"75dc39ef-fa61-459a-b07e-c575f1f3e5dc\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9" Jun 14 14:47:42.654804 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.654769 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zkqm\" (UniqueName: \"kubernetes.io/projected/43fa4b1b-4c51-4472-9c51-800821962c30-kube-api-access-2zkqm\") pod \"dashboard-redirect-678bbb5d45-jhhqj\" (UID: \"43fa4b1b-4c51-4472-9c51-800821962c30\") " pod="opendatahub/dashboard-redirect-678bbb5d45-jhhqj" Jun 14 14:47:42.654991 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.654816 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/75dc39ef-fa61-459a-b07e-c575f1f3e5dc-operator-config\") pod \"servicemesh-operator3-57f65f65fb-vqxz9\" (UID: \"75dc39ef-fa61-459a-b07e-c575f1f3e5dc\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9" Jun 14 14:47:42.654991 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.654836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4t9h\" (UniqueName: \"kubernetes.io/projected/75dc39ef-fa61-459a-b07e-c575f1f3e5dc-kube-api-access-x4t9h\") pod \"servicemesh-operator3-57f65f65fb-vqxz9\" (UID: \"75dc39ef-fa61-459a-b07e-c575f1f3e5dc\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9" Jun 14 14:47:42.654991 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.654885 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/43fa4b1b-4c51-4472-9c51-800821962c30-redirect-config\") pod \"dashboard-redirect-678bbb5d45-jhhqj\" (UID: \"43fa4b1b-4c51-4472-9c51-800821962c30\") " pod="opendatahub/dashboard-redirect-678bbb5d45-jhhqj" Jun 14 14:47:42.655563 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.655522 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/43fa4b1b-4c51-4472-9c51-800821962c30-redirect-config\") pod \"dashboard-redirect-678bbb5d45-jhhqj\" (UID: \"43fa4b1b-4c51-4472-9c51-800821962c30\") " pod="opendatahub/dashboard-redirect-678bbb5d45-jhhqj" Jun 14 14:47:42.657346 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.657329 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/75dc39ef-fa61-459a-b07e-c575f1f3e5dc-operator-config\") pod \"servicemesh-operator3-57f65f65fb-vqxz9\" (UID: \"75dc39ef-fa61-459a-b07e-c575f1f3e5dc\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9" Jun 14 14:47:42.672877 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.672857 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4t9h\" (UniqueName: \"kubernetes.io/projected/75dc39ef-fa61-459a-b07e-c575f1f3e5dc-kube-api-access-x4t9h\") pod \"servicemesh-operator3-57f65f65fb-vqxz9\" (UID: \"75dc39ef-fa61-459a-b07e-c575f1f3e5dc\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9" Jun 14 14:47:42.672994 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.672978 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zkqm\" (UniqueName: \"kubernetes.io/projected/43fa4b1b-4c51-4472-9c51-800821962c30-kube-api-access-2zkqm\") pod \"dashboard-redirect-678bbb5d45-jhhqj\" (UID: \"43fa4b1b-4c51-4472-9c51-800821962c30\") " pod="opendatahub/dashboard-redirect-678bbb5d45-jhhqj" Jun 14 14:47:42.784923 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.784835 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9" Jun 14 14:47:42.841227 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.841202 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-678bbb5d45-jhhqj" Jun 14 14:47:42.923487 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.923457 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9"] Jun 14 14:47:42.925069 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:47:42.925045 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75dc39ef_fa61_459a_b07e_c575f1f3e5dc.slice/crio-6d3496677d3c612587d16209ec8ec79c9e02e09bcf799ecb9a2baa7bb71ae397 WatchSource:0}: Error finding container 6d3496677d3c612587d16209ec8ec79c9e02e09bcf799ecb9a2baa7bb71ae397: Status 404 returned error can't find the container with id 6d3496677d3c612587d16209ec8ec79c9e02e09bcf799ecb9a2baa7bb71ae397 Jun 14 14:47:42.985688 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:42.985668 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-678bbb5d45-jhhqj"] Jun 14 14:47:42.987835 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:47:42.987805 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43fa4b1b_4c51_4472_9c51_800821962c30.slice/crio-ef15af04ed541d9d7efbb6f1746ae0577e1d7981d40aa1e7b9fd2f2af3ada578 WatchSource:0}: Error finding container ef15af04ed541d9d7efbb6f1746ae0577e1d7981d40aa1e7b9fd2f2af3ada578: Status 404 returned error can't find the container with id ef15af04ed541d9d7efbb6f1746ae0577e1d7981d40aa1e7b9fd2f2af3ada578 Jun 14 14:47:43.570410 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:43.570374 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9" event={"ID":"75dc39ef-fa61-459a-b07e-c575f1f3e5dc","Type":"ContainerStarted","Data":"6d3496677d3c612587d16209ec8ec79c9e02e09bcf799ecb9a2baa7bb71ae397"} Jun 14 14:47:43.571462 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:43.571441 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-678bbb5d45-jhhqj" event={"ID":"43fa4b1b-4c51-4472-9c51-800821962c30","Type":"ContainerStarted","Data":"ef15af04ed541d9d7efbb6f1746ae0577e1d7981d40aa1e7b9fd2f2af3ada578"} Jun 14 14:47:46.592677 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:46.592638 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9" event={"ID":"75dc39ef-fa61-459a-b07e-c575f1f3e5dc","Type":"ContainerStarted","Data":"4833b721aa763b9db546a63ae8e23a65a31312b4e5909b66d6dbd5f00851c631"} Jun 14 14:47:46.593150 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:46.592703 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9" Jun 14 14:47:46.594254 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:46.594230 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-678bbb5d45-jhhqj" event={"ID":"43fa4b1b-4c51-4472-9c51-800821962c30","Type":"ContainerStarted","Data":"fe991f4ecd7d7df09738e3970ef00fbd89463fbb79894601f402cd7b5d78790c"} Jun 14 14:47:46.614474 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:46.614429 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9" podStartSLOduration=1.480140032 podStartE2EDuration="4.614412989s" totalImagesPullingTime="3.134272957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:46.61180847 +0000 UTC m=+499.482741784" watchObservedRunningTime="2026-06-14 14:47:46.614412989 +0000 UTC m=+499.485346301" Jun 14 14:47:46.627481 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:46.627426 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-678bbb5d45-jhhqj" podStartSLOduration=1.558672769 podStartE2EDuration="4.627407618s" totalImagesPullingTime="3.068734849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:46.627159109 +0000 UTC m=+499.498092401" watchObservedRunningTime="2026-06-14 14:47:46.627407618 +0000 UTC m=+499.498340931" Jun 14 14:47:53.942498 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:53.942457 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc"] Jun 14 14:47:53.945659 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:53.945638 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:53.947722 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:53.947701 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 14 14:47:53.947870 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:53.947712 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 14 14:47:53.947870 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:53.947715 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 14:47:53.948015 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:53.947717 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jt9gw\"" Jun 14 14:47:53.948015 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:53.947755 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 14 14:47:53.957950 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:53.957929 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc"] Jun 14 14:47:54.060709 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.060679 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd068637-0670-49a6-a54c-372c605fd1ee-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.060709 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.060710 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd068637-0670-49a6-a54c-372c605fd1ee-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.060879 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.060726 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd068637-0670-49a6-a54c-372c605fd1ee-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.060879 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.060746 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd068637-0670-49a6-a54c-372c605fd1ee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.060879 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.060820 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd068637-0670-49a6-a54c-372c605fd1ee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.060879 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.060870 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rkzj\" (UniqueName: \"kubernetes.io/projected/cd068637-0670-49a6-a54c-372c605fd1ee-kube-api-access-8rkzj\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.061031 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.060927 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd068637-0670-49a6-a54c-372c605fd1ee-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.161306 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.161271 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd068637-0670-49a6-a54c-372c605fd1ee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.161474 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.161324 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rkzj\" (UniqueName: \"kubernetes.io/projected/cd068637-0670-49a6-a54c-372c605fd1ee-kube-api-access-8rkzj\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.161474 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.161368 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd068637-0670-49a6-a54c-372c605fd1ee-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.161474 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.161392 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd068637-0670-49a6-a54c-372c605fd1ee-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.161474 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.161415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd068637-0670-49a6-a54c-372c605fd1ee-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.161474 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.161439 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd068637-0670-49a6-a54c-372c605fd1ee-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.161474 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.161466 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd068637-0670-49a6-a54c-372c605fd1ee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.161985 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.161954 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd068637-0670-49a6-a54c-372c605fd1ee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.163953 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.163924 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd068637-0670-49a6-a54c-372c605fd1ee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.164294 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.164269 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd068637-0670-49a6-a54c-372c605fd1ee-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.164397 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.164265 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd068637-0670-49a6-a54c-372c605fd1ee-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.164397 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.164337 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd068637-0670-49a6-a54c-372c605fd1ee-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.171221 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.171198 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd068637-0670-49a6-a54c-372c605fd1ee-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.171488 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.171466 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rkzj\" (UniqueName: \"kubernetes.io/projected/cd068637-0670-49a6-a54c-372c605fd1ee-kube-api-access-8rkzj\") pod \"istiod-openshift-gateway-75c67f8887-9wxcc\" (UID: \"cd068637-0670-49a6-a54c-372c605fd1ee\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.255528 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.255498 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:54.387911 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.387876 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc"] Jun 14 14:47:54.389044 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:47:54.389016 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd068637_0670_49a6_a54c_372c605fd1ee.slice/crio-d424ef7a9e1afd0bfaae8c94bd4e4a8cea351d1d302faeeb95a88afdf60ae1cf WatchSource:0}: Error finding container d424ef7a9e1afd0bfaae8c94bd4e4a8cea351d1d302faeeb95a88afdf60ae1cf: Status 404 returned error can't find the container with id d424ef7a9e1afd0bfaae8c94bd4e4a8cea351d1d302faeeb95a88afdf60ae1cf Jun 14 14:47:54.632035 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:54.631944 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" event={"ID":"cd068637-0670-49a6-a54c-372c605fd1ee","Type":"ContainerStarted","Data":"d424ef7a9e1afd0bfaae8c94bd4e4a8cea351d1d302faeeb95a88afdf60ae1cf"} Jun 14 14:47:57.601644 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:57.601614 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vqxz9" Jun 14 14:47:58.629634 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:58.629592 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 14 14:47:58.629902 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:58.629657 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 14 14:47:59.666900 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:59.666857 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" event={"ID":"cd068637-0670-49a6-a54c-372c605fd1ee","Type":"ContainerStarted","Data":"43f12af91ac6984400a88f14de68ec50d944725cb9c14364afba8d91af6c8b3a"} Jun 14 14:47:59.667344 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:59.667090 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:47:59.668873 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:59.668848 2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-9wxcc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 14 14:47:59.669020 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:59.668900 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" podUID="cd068637-0670-49a6-a54c-372c605fd1ee" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:47:59.688723 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:47:59.688672 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" podStartSLOduration=2.450708131 podStartE2EDuration="6.688658415s" totalImagesPullingTime="4.237950284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:59.686040466 +0000 UTC m=+512.556973782" watchObservedRunningTime="2026-06-14 14:47:59.688658415 +0000 UTC m=+512.559591728" Jun 14 14:48:00.673744 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:48:00.673718 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9wxcc" Jun 14 14:48:10.558302 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:48:10.558267 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-8vh7m" Jun 14 14:48:11.570926 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:48:11.570891 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jjqwb" Jun 14 14:49:09.341778 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:09.341743 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9gf7t"] Jun 14 14:49:09.345228 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:09.345209 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gf7t" Jun 14 14:49:09.347373 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:09.347353 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 14:49:09.347944 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:09.347919 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 14:49:09.347944 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:09.347922 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-d5rmp\"" Jun 14 14:49:09.356111 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:09.356091 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9gf7t"] Jun 14 14:49:09.416994 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:09.416969 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxbjw\" (UniqueName: \"kubernetes.io/projected/b01678f9-13a1-4656-a8ba-0cec902a9c68-kube-api-access-zxbjw\") pod \"authorino-operator-75cc8d5cb7-9gf7t\" (UID: \"b01678f9-13a1-4656-a8ba-0cec902a9c68\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gf7t" Jun 14 14:49:09.517712 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:09.517687 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxbjw\" (UniqueName: \"kubernetes.io/projected/b01678f9-13a1-4656-a8ba-0cec902a9c68-kube-api-access-zxbjw\") pod \"authorino-operator-75cc8d5cb7-9gf7t\" (UID: \"b01678f9-13a1-4656-a8ba-0cec902a9c68\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gf7t" Jun 14 14:49:09.530004 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:09.529981 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxbjw\" (UniqueName: \"kubernetes.io/projected/b01678f9-13a1-4656-a8ba-0cec902a9c68-kube-api-access-zxbjw\") pod \"authorino-operator-75cc8d5cb7-9gf7t\" (UID: \"b01678f9-13a1-4656-a8ba-0cec902a9c68\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gf7t" Jun 14 14:49:09.656596 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:09.656496 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gf7t" Jun 14 14:49:09.790923 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:09.790898 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9gf7t"] Jun 14 14:49:09.793621 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:49:09.793593 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb01678f9_13a1_4656_a8ba_0cec902a9c68.slice/crio-8cc9178bb1a7716421c92a0d7ea2d216a1e7461606aa729e0e7a6e7bd495fcbf WatchSource:0}: Error finding container 8cc9178bb1a7716421c92a0d7ea2d216a1e7461606aa729e0e7a6e7bd495fcbf: Status 404 returned error can't find the container with id 8cc9178bb1a7716421c92a0d7ea2d216a1e7461606aa729e0e7a6e7bd495fcbf Jun 14 14:49:10.014296 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:10.014264 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gf7t" event={"ID":"b01678f9-13a1-4656-a8ba-0cec902a9c68","Type":"ContainerStarted","Data":"8cc9178bb1a7716421c92a0d7ea2d216a1e7461606aa729e0e7a6e7bd495fcbf"} Jun 14 14:49:12.026086 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:12.026061 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gf7t" event={"ID":"b01678f9-13a1-4656-a8ba-0cec902a9c68","Type":"ContainerStarted","Data":"33736352abe3ad537654839791042f9a772ae4ff062935e09f9a56d258f16f31"} Jun 14 14:49:12.026404 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:12.026179 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gf7t" Jun 14 14:49:12.041628 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:12.041584 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gf7t" podStartSLOduration=0.933089269 podStartE2EDuration="3.041568892s" totalImagesPullingTime="2.108479623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:49:12.040066342 +0000 UTC m=+584.910999655" watchObservedRunningTime="2026-06-14 14:49:12.041568892 +0000 UTC m=+584.912502199" Jun 14 14:49:23.032963 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:23.032928 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gf7t" Jun 14 14:49:25.765048 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.765013 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8"] Jun 14 14:49:25.771524 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.771505 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" Jun 14 14:49:25.773635 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.773609 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9t7vc\"" Jun 14 14:49:25.779238 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.779200 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8"] Jun 14 14:49:25.856345 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.856314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac18941a-82ec-45aa-a9e1-8fda5f76edbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-n9sh8\" (UID: \"ac18941a-82ec-45aa-a9e1-8fda5f76edbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" Jun 14 14:49:25.856488 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.856434 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppn2b\" (UniqueName: \"kubernetes.io/projected/ac18941a-82ec-45aa-a9e1-8fda5f76edbc-kube-api-access-ppn2b\") pod \"kuadrant-operator-controller-manager-55467d9f7-n9sh8\" (UID: \"ac18941a-82ec-45aa-a9e1-8fda5f76edbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" Jun 14 14:49:25.889257 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.889228 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8"] Jun 14 14:49:25.889489 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:49:25.889470 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-ppn2b], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" podUID="ac18941a-82ec-45aa-a9e1-8fda5f76edbc" Jun 14 14:49:25.893391 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.893368 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8"] Jun 14 14:49:25.915826 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.915796 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v"] Jun 14 14:49:25.920094 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.920073 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" Jun 14 14:49:25.934162 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.934137 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v"] Jun 14 14:49:25.958061 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.958032 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac18941a-82ec-45aa-a9e1-8fda5f76edbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-n9sh8\" (UID: \"ac18941a-82ec-45aa-a9e1-8fda5f76edbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" Jun 14 14:49:25.958186 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.958149 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jmx6\" (UniqueName: \"kubernetes.io/projected/1090a36a-5c38-4fb9-9ebe-0881f7b4752a-kube-api-access-6jmx6\") pod \"kuadrant-operator-controller-manager-55467d9f7-xz62v\" (UID: \"1090a36a-5c38-4fb9-9ebe-0881f7b4752a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" Jun 14 14:49:25.958244 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.958208 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppn2b\" (UniqueName: \"kubernetes.io/projected/ac18941a-82ec-45aa-a9e1-8fda5f76edbc-kube-api-access-ppn2b\") pod \"kuadrant-operator-controller-manager-55467d9f7-n9sh8\" (UID: \"ac18941a-82ec-45aa-a9e1-8fda5f76edbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" Jun 14 14:49:25.958330 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.958309 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1090a36a-5c38-4fb9-9ebe-0881f7b4752a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xz62v\" (UID: \"1090a36a-5c38-4fb9-9ebe-0881f7b4752a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" Jun 14 14:49:25.958409 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:25.958391 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac18941a-82ec-45aa-a9e1-8fda5f76edbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-n9sh8\" (UID: \"ac18941a-82ec-45aa-a9e1-8fda5f76edbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" Jun 14 14:49:25.962555 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:49:25.962524 2566 projected.go:196] Error preparing data for projected volume kube-api-access-ppn2b for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-n9sh8" not found Jun 14 14:49:25.962680 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:49:25.962645 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac18941a-82ec-45aa-a9e1-8fda5f76edbc-kube-api-access-ppn2b podName:ac18941a-82ec-45aa-a9e1-8fda5f76edbc nodeName:}" failed. No retries permitted until 2026-06-14 14:49:26.462611814 +0000 UTC m=+599.333545108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ppn2b" (UniqueName: "kubernetes.io/projected/ac18941a-82ec-45aa-a9e1-8fda5f76edbc-kube-api-access-ppn2b") pod "kuadrant-operator-controller-manager-55467d9f7-n9sh8" (UID: "ac18941a-82ec-45aa-a9e1-8fda5f76edbc") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-n9sh8" not found Jun 14 14:49:26.059847 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:26.059769 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jmx6\" (UniqueName: \"kubernetes.io/projected/1090a36a-5c38-4fb9-9ebe-0881f7b4752a-kube-api-access-6jmx6\") pod \"kuadrant-operator-controller-manager-55467d9f7-xz62v\" (UID: \"1090a36a-5c38-4fb9-9ebe-0881f7b4752a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" Jun 14 14:49:26.059980 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:26.059866 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1090a36a-5c38-4fb9-9ebe-0881f7b4752a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xz62v\" (UID: \"1090a36a-5c38-4fb9-9ebe-0881f7b4752a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" Jun 14 14:49:26.060199 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:26.060184 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1090a36a-5c38-4fb9-9ebe-0881f7b4752a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xz62v\" (UID: \"1090a36a-5c38-4fb9-9ebe-0881f7b4752a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" Jun 14 14:49:26.073102 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:26.073080 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jmx6\" (UniqueName: \"kubernetes.io/projected/1090a36a-5c38-4fb9-9ebe-0881f7b4752a-kube-api-access-6jmx6\") pod \"kuadrant-operator-controller-manager-55467d9f7-xz62v\" (UID: \"1090a36a-5c38-4fb9-9ebe-0881f7b4752a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" Jun 14 14:49:26.093119 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:26.093088 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" Jun 14 14:49:26.096886 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:49:26.096854 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-n9sh8\" is forbidden: User \"system:node:ip-10-0-135-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-57.ec2.internal' and this object" podUID="ac18941a-82ec-45aa-a9e1-8fda5f76edbc" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" Jun 14 14:49:26.101010 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:26.100994 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" Jun 14 14:49:26.106223 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:49:26.106192 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-n9sh8\" is forbidden: User \"system:node:ip-10-0-135-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-57.ec2.internal' and this object" podUID="ac18941a-82ec-45aa-a9e1-8fda5f76edbc" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" Jun 14 14:49:26.160683 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:26.160652 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac18941a-82ec-45aa-a9e1-8fda5f76edbc-extensions-socket-volume\") pod \"ac18941a-82ec-45aa-a9e1-8fda5f76edbc\" (UID: \"ac18941a-82ec-45aa-a9e1-8fda5f76edbc\") " Jun 14 14:49:26.160825 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:26.160814 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppn2b\" (UniqueName: \"kubernetes.io/projected/ac18941a-82ec-45aa-a9e1-8fda5f76edbc-kube-api-access-ppn2b\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:49:26.160869 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:26.160851 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac18941a-82ec-45aa-a9e1-8fda5f76edbc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ac18941a-82ec-45aa-a9e1-8fda5f76edbc" (UID: "ac18941a-82ec-45aa-a9e1-8fda5f76edbc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:49:26.233678 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:26.233647 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" Jun 14 14:49:26.261577 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:26.261526 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac18941a-82ec-45aa-a9e1-8fda5f76edbc-extensions-socket-volume\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:49:26.390852 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:26.390822 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v"] Jun 14 14:49:26.394743 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:49:26.394714 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1090a36a_5c38_4fb9_9ebe_0881f7b4752a.slice/crio-78c8b74f39833f332c80986910831b689472e2c1bb5c1bb275abca05b760c1df WatchSource:0}: Error finding container 78c8b74f39833f332c80986910831b689472e2c1bb5c1bb275abca05b760c1df: Status 404 returned error can't find the container with id 78c8b74f39833f332c80986910831b689472e2c1bb5c1bb275abca05b760c1df Jun 14 14:49:27.100085 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:27.100050 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" event={"ID":"1090a36a-5c38-4fb9-9ebe-0881f7b4752a","Type":"ContainerStarted","Data":"78c8b74f39833f332c80986910831b689472e2c1bb5c1bb275abca05b760c1df"} Jun 14 14:49:27.100445 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:27.100121 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" Jun 14 14:49:27.102623 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:49:27.102595 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-n9sh8\" is forbidden: User \"system:node:ip-10-0-135-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-57.ec2.internal' and this object" podUID="ac18941a-82ec-45aa-a9e1-8fda5f76edbc" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" Jun 14 14:49:27.111246 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:49:27.111212 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-n9sh8\" is forbidden: User \"system:node:ip-10-0-135-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-57.ec2.internal' and this object" podUID="ac18941a-82ec-45aa-a9e1-8fda5f76edbc" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" Jun 14 14:49:27.536291 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:27.536266 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 14:49:27.537372 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:27.537354 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 14:49:27.544086 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:27.544070 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 14:49:27.545124 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:27.545107 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 14:49:27.569090 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:27.569066 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac18941a-82ec-45aa-a9e1-8fda5f76edbc" path="/var/lib/kubelet/pods/ac18941a-82ec-45aa-a9e1-8fda5f76edbc/volumes" Jun 14 14:49:27.569837 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:49:27.569815 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-n9sh8\" is forbidden: User \"system:node:ip-10-0-135-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-57.ec2.internal' and this object" podUID="ac18941a-82ec-45aa-a9e1-8fda5f76edbc" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9sh8" Jun 14 14:49:31.124731 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:31.124686 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" event={"ID":"1090a36a-5c38-4fb9-9ebe-0881f7b4752a","Type":"ContainerStarted","Data":"3cb7b8fec75b0a6e527d8c8cc3b55bd3b7551e4a6794064b1bb4bfca1918e471"} Jun 14 14:49:31.125143 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:31.124844 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" Jun 14 14:49:31.142254 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:31.142199 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" podStartSLOduration=1.877920233 podStartE2EDuration="6.142178027s" totalImagesPullingTime="4.264257794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:49:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:49:31.140516761 +0000 UTC m=+604.011450086" watchObservedRunningTime="2026-06-14 14:49:31.142178027 +0000 UTC m=+604.013111340" Jun 14 14:49:38.344230 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:38.344197 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v"] Jun 14 14:49:38.344635 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:38.344399 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" podUID="1090a36a-5c38-4fb9-9ebe-0881f7b4752a" containerName="manager" containerID="cri-o://3cb7b8fec75b0a6e527d8c8cc3b55bd3b7551e4a6794064b1bb4bfca1918e471" gracePeriod=10 Jun 14 14:49:38.347058 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:38.347027 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" Jun 14 14:49:38.608902 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:38.608846 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" Jun 14 14:49:38.673446 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:38.673419 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1090a36a-5c38-4fb9-9ebe-0881f7b4752a-extensions-socket-volume\") pod \"1090a36a-5c38-4fb9-9ebe-0881f7b4752a\" (UID: \"1090a36a-5c38-4fb9-9ebe-0881f7b4752a\") " Jun 14 14:49:38.673599 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:38.673498 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jmx6\" (UniqueName: \"kubernetes.io/projected/1090a36a-5c38-4fb9-9ebe-0881f7b4752a-kube-api-access-6jmx6\") pod \"1090a36a-5c38-4fb9-9ebe-0881f7b4752a\" (UID: \"1090a36a-5c38-4fb9-9ebe-0881f7b4752a\") " Jun 14 14:49:38.673906 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:38.673872 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1090a36a-5c38-4fb9-9ebe-0881f7b4752a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1090a36a-5c38-4fb9-9ebe-0881f7b4752a" (UID: "1090a36a-5c38-4fb9-9ebe-0881f7b4752a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:49:38.675553 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:38.675521 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1090a36a-5c38-4fb9-9ebe-0881f7b4752a-kube-api-access-6jmx6" (OuterVolumeSpecName: "kube-api-access-6jmx6") pod "1090a36a-5c38-4fb9-9ebe-0881f7b4752a" (UID: "1090a36a-5c38-4fb9-9ebe-0881f7b4752a"). InnerVolumeSpecName "kube-api-access-6jmx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:49:38.774405 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:38.774385 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jmx6\" (UniqueName: \"kubernetes.io/projected/1090a36a-5c38-4fb9-9ebe-0881f7b4752a-kube-api-access-6jmx6\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:49:38.774405 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:38.774405 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1090a36a-5c38-4fb9-9ebe-0881f7b4752a-extensions-socket-volume\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:49:39.165592 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:39.165559 2566 generic.go:356] "Generic (PLEG): container finished" podID="1090a36a-5c38-4fb9-9ebe-0881f7b4752a" containerID="3cb7b8fec75b0a6e527d8c8cc3b55bd3b7551e4a6794064b1bb4bfca1918e471" exitCode=0 Jun 14 14:49:39.165760 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:39.165635 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" Jun 14 14:49:39.165760 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:39.165636 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" event={"ID":"1090a36a-5c38-4fb9-9ebe-0881f7b4752a","Type":"ContainerDied","Data":"3cb7b8fec75b0a6e527d8c8cc3b55bd3b7551e4a6794064b1bb4bfca1918e471"} Jun 14 14:49:39.165760 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:39.165691 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v" event={"ID":"1090a36a-5c38-4fb9-9ebe-0881f7b4752a","Type":"ContainerDied","Data":"78c8b74f39833f332c80986910831b689472e2c1bb5c1bb275abca05b760c1df"} Jun 14 14:49:39.165760 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:39.165715 2566 scope.go:117] "RemoveContainer" containerID="3cb7b8fec75b0a6e527d8c8cc3b55bd3b7551e4a6794064b1bb4bfca1918e471" Jun 14 14:49:39.174907 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:39.174892 2566 scope.go:117] "RemoveContainer" containerID="3cb7b8fec75b0a6e527d8c8cc3b55bd3b7551e4a6794064b1bb4bfca1918e471" Jun 14 14:49:39.175157 ip-10-0-135-57 kubenswrapper[2566]: E0614 14:49:39.175138 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cb7b8fec75b0a6e527d8c8cc3b55bd3b7551e4a6794064b1bb4bfca1918e471\": container with ID starting with 3cb7b8fec75b0a6e527d8c8cc3b55bd3b7551e4a6794064b1bb4bfca1918e471 not found: ID does not exist" containerID="3cb7b8fec75b0a6e527d8c8cc3b55bd3b7551e4a6794064b1bb4bfca1918e471" Jun 14 14:49:39.175264 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:39.175164 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb7b8fec75b0a6e527d8c8cc3b55bd3b7551e4a6794064b1bb4bfca1918e471"} err="failed to get container status \"3cb7b8fec75b0a6e527d8c8cc3b55bd3b7551e4a6794064b1bb4bfca1918e471\": rpc error: code = NotFound desc = could not find container \"3cb7b8fec75b0a6e527d8c8cc3b55bd3b7551e4a6794064b1bb4bfca1918e471\": container with ID starting with 3cb7b8fec75b0a6e527d8c8cc3b55bd3b7551e4a6794064b1bb4bfca1918e471 not found: ID does not exist" Jun 14 14:49:39.188921 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:39.188896 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v"] Jun 14 14:49:39.201720 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:39.201698 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xz62v"] Jun 14 14:49:39.566491 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:39.566460 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1090a36a-5c38-4fb9-9ebe-0881f7b4752a" path="/var/lib/kubelet/pods/1090a36a-5c38-4fb9-9ebe-0881f7b4752a/volumes" Jun 14 14:49:56.819172 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.819096 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:49:56.819591 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.819479 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1090a36a-5c38-4fb9-9ebe-0881f7b4752a" containerName="manager" Jun 14 14:49:56.819591 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.819491 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1090a36a-5c38-4fb9-9ebe-0881f7b4752a" containerName="manager" Jun 14 14:49:56.819591 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.819580 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1090a36a-5c38-4fb9-9ebe-0881f7b4752a" containerName="manager" Jun 14 14:49:56.822555 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.822526 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-rhhl8" Jun 14 14:49:56.824553 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.824524 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-txrcp\"" Jun 14 14:49:56.824668 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.824574 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 14:49:56.826379 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.826355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn7pt\" (UniqueName: \"kubernetes.io/projected/b619dfbb-9179-4d34-8e8f-8a29aaf220c1-kube-api-access-tn7pt\") pod \"limitador-limitador-54d6d988d5-rhhl8\" (UID: \"b619dfbb-9179-4d34-8e8f-8a29aaf220c1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rhhl8" Jun 14 14:49:56.826491 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.826469 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b619dfbb-9179-4d34-8e8f-8a29aaf220c1-config-file\") pod \"limitador-limitador-54d6d988d5-rhhl8\" (UID: \"b619dfbb-9179-4d34-8e8f-8a29aaf220c1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rhhl8" Jun 14 14:49:56.831414 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.831392 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:49:56.858861 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.858838 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:49:56.927242 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.927211 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b619dfbb-9179-4d34-8e8f-8a29aaf220c1-config-file\") pod \"limitador-limitador-54d6d988d5-rhhl8\" (UID: \"b619dfbb-9179-4d34-8e8f-8a29aaf220c1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rhhl8" Jun 14 14:49:56.927354 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.927288 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn7pt\" (UniqueName: \"kubernetes.io/projected/b619dfbb-9179-4d34-8e8f-8a29aaf220c1-kube-api-access-tn7pt\") pod \"limitador-limitador-54d6d988d5-rhhl8\" (UID: \"b619dfbb-9179-4d34-8e8f-8a29aaf220c1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rhhl8" Jun 14 14:49:56.927825 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.927808 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b619dfbb-9179-4d34-8e8f-8a29aaf220c1-config-file\") pod \"limitador-limitador-54d6d988d5-rhhl8\" (UID: \"b619dfbb-9179-4d34-8e8f-8a29aaf220c1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rhhl8" Jun 14 14:49:56.934687 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:56.934665 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn7pt\" (UniqueName: \"kubernetes.io/projected/b619dfbb-9179-4d34-8e8f-8a29aaf220c1-kube-api-access-tn7pt\") pod \"limitador-limitador-54d6d988d5-rhhl8\" (UID: \"b619dfbb-9179-4d34-8e8f-8a29aaf220c1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rhhl8" Jun 14 14:49:57.134242 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:57.134172 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-rhhl8" Jun 14 14:49:57.271496 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:57.271442 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:49:57.273803 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:49:57.273771 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb619dfbb_9179_4d34_8e8f_8a29aaf220c1.slice/crio-b2d989c4d6dcc86aa5649f343f742508e126070cd874b818c30e29624da6d434 WatchSource:0}: Error finding container b2d989c4d6dcc86aa5649f343f742508e126070cd874b818c30e29624da6d434: Status 404 returned error can't find the container with id b2d989c4d6dcc86aa5649f343f742508e126070cd874b818c30e29624da6d434 Jun 14 14:49:58.263104 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:49:58.263068 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-rhhl8" event={"ID":"b619dfbb-9179-4d34-8e8f-8a29aaf220c1","Type":"ContainerStarted","Data":"b2d989c4d6dcc86aa5649f343f742508e126070cd874b818c30e29624da6d434"} Jun 14 14:50:00.277896 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:00.277860 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-rhhl8" event={"ID":"b619dfbb-9179-4d34-8e8f-8a29aaf220c1","Type":"ContainerStarted","Data":"ff754c0055cff95b7761d8a0653a5acafbf3f7d4ba9a7893041771bef7f5bda4"} Jun 14 14:50:00.278260 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:00.277982 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-rhhl8" Jun 14 14:50:00.295271 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:00.295211 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-rhhl8" podStartSLOduration=1.919911029 podStartE2EDuration="4.295196905s" totalImagesPullingTime="2.375285876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:50:00.292585366 +0000 UTC m=+633.163518686" watchObservedRunningTime="2026-06-14 14:50:00.295196905 +0000 UTC m=+633.166130221" Jun 14 14:50:11.284390 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:11.284357 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-rhhl8" Jun 14 14:50:49.039284 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:49.039248 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 14:50:49.046208 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:49.046190 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 14:50:49.048667 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:49.048558 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 14:50:49.048667 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:49.048591 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-bl65m\"" Jun 14 14:50:49.048667 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:49.048610 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 14 14:50:49.048896 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:49.048610 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 14:50:49.050702 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:49.050681 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 14:50:49.075633 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:49.075611 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh72h\" (UniqueName: \"kubernetes.io/projected/d05d2200-ac4a-437d-a1e5-87c9238b3c45-kube-api-access-kh72h\") pod \"maas-keycloak-0\" (UID: \"d05d2200-ac4a-437d-a1e5-87c9238b3c45\") " pod="keycloak-system/maas-keycloak-0" Jun 14 14:50:49.176981 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:49.176948 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh72h\" (UniqueName: \"kubernetes.io/projected/d05d2200-ac4a-437d-a1e5-87c9238b3c45-kube-api-access-kh72h\") pod \"maas-keycloak-0\" (UID: \"d05d2200-ac4a-437d-a1e5-87c9238b3c45\") " pod="keycloak-system/maas-keycloak-0" Jun 14 14:50:49.184710 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:49.184683 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh72h\" (UniqueName: \"kubernetes.io/projected/d05d2200-ac4a-437d-a1e5-87c9238b3c45-kube-api-access-kh72h\") pod \"maas-keycloak-0\" (UID: \"d05d2200-ac4a-437d-a1e5-87c9238b3c45\") " pod="keycloak-system/maas-keycloak-0" Jun 14 14:50:49.357920 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:49.357846 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 14:50:49.490731 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:49.490706 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 14:50:49.492165 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:50:49.492135 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd05d2200_ac4a_437d_a1e5_87c9238b3c45.slice/crio-f4c81e9854b5c6b11b6a2f35825c114a760ada1ebdb861c855d090e509e8169d WatchSource:0}: Error finding container f4c81e9854b5c6b11b6a2f35825c114a760ada1ebdb861c855d090e509e8169d: Status 404 returned error can't find the container with id f4c81e9854b5c6b11b6a2f35825c114a760ada1ebdb861c855d090e509e8169d Jun 14 14:50:49.526670 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:49.526640 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d05d2200-ac4a-437d-a1e5-87c9238b3c45","Type":"ContainerStarted","Data":"f4c81e9854b5c6b11b6a2f35825c114a760ada1ebdb861c855d090e509e8169d"} Jun 14 14:50:54.569747 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:54.569661 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d05d2200-ac4a-437d-a1e5-87c9238b3c45","Type":"ContainerStarted","Data":"f0c70565e095934bede5c48a54bcd940e20f02f637cf389a097252c6e25dd1bc"} Jun 14 14:50:54.587359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:54.587296 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.831324714 podStartE2EDuration="5.587275511s" totalImagesPullingTime="4.755950797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:50:54.584953098 +0000 UTC m=+687.455886412" watchObservedRunningTime="2026-06-14 14:50:54.587275511 +0000 UTC m=+687.458208826" Jun 14 14:50:55.358376 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:55.358333 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 14 14:50:55.359403 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:55.359368 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 14 14:50:56.358650 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:56.358592 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 14 14:50:57.358557 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:57.358465 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 14 14:50:58.359318 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:58.359269 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 14 14:50:59.358183 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:59.358133 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 14 14:50:59.358681 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:50:59.358642 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 14 14:51:00.358596 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:51:00.358531 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 14 14:51:01.358791 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:51:01.358737 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 14 14:51:02.358384 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:51:02.358349 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 14 14:51:03.359256 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:51:03.359200 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 14 14:51:04.359405 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:51:04.359350 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 14 14:51:05.358654 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:51:05.358600 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 14 14:51:06.358338 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:51:06.358235 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 14 14:51:07.465733 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:51:07.465697 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 14 14:51:07.486826 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:51:07.486509 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:51:17.474323 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:51:17.474233 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 14 14:51:59.624967 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:51:59.624923 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:52:12.317027 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:12.316988 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 14:52:12.317507 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:12.317177 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" containerID="cri-o://f0c70565e095934bede5c48a54bcd940e20f02f637cf389a097252c6e25dd1bc" gracePeriod=30 Jun 14 14:52:13.997755 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:13.997671 2566 generic.go:356] "Generic (PLEG): container finished" podID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerID="f0c70565e095934bede5c48a54bcd940e20f02f637cf389a097252c6e25dd1bc" exitCode=143 Jun 14 14:52:13.997755 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:13.997715 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d05d2200-ac4a-437d-a1e5-87c9238b3c45","Type":"ContainerDied","Data":"f0c70565e095934bede5c48a54bcd940e20f02f637cf389a097252c6e25dd1bc"} Jun 14 14:52:14.364235 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:14.364212 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 14:52:14.460105 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:14.460067 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh72h\" (UniqueName: \"kubernetes.io/projected/d05d2200-ac4a-437d-a1e5-87c9238b3c45-kube-api-access-kh72h\") pod \"d05d2200-ac4a-437d-a1e5-87c9238b3c45\" (UID: \"d05d2200-ac4a-437d-a1e5-87c9238b3c45\") " Jun 14 14:52:14.462117 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:14.462087 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d05d2200-ac4a-437d-a1e5-87c9238b3c45-kube-api-access-kh72h" (OuterVolumeSpecName: "kube-api-access-kh72h") pod "d05d2200-ac4a-437d-a1e5-87c9238b3c45" (UID: "d05d2200-ac4a-437d-a1e5-87c9238b3c45"). InnerVolumeSpecName "kube-api-access-kh72h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:52:14.561163 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:14.561086 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh72h\" (UniqueName: \"kubernetes.io/projected/d05d2200-ac4a-437d-a1e5-87c9238b3c45-kube-api-access-kh72h\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 14:52:15.004053 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.004023 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 14:52:15.004451 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.004022 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d05d2200-ac4a-437d-a1e5-87c9238b3c45","Type":"ContainerDied","Data":"f4c81e9854b5c6b11b6a2f35825c114a760ada1ebdb861c855d090e509e8169d"} Jun 14 14:52:15.004451 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.004183 2566 scope.go:117] "RemoveContainer" containerID="f0c70565e095934bede5c48a54bcd940e20f02f637cf389a097252c6e25dd1bc" Jun 14 14:52:15.023608 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.023584 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 14:52:15.025914 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.025893 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 14:52:15.047581 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.047530 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 14:52:15.047929 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.047915 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" Jun 14 14:52:15.047980 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.047933 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" Jun 14 14:52:15.048015 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.048008 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" containerName="keycloak" Jun 14 14:52:15.052213 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.052196 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 14:52:15.054418 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.054399 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-bl65m\"" Jun 14 14:52:15.054529 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.054404 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 14 14:52:15.054529 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.054449 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 14:52:15.054529 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.054452 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 14 14:52:15.054719 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.054455 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 14:52:15.060794 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.060773 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 14:52:15.167170 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.167137 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5fc15a45-a2b8-4406-ae84-dd6c8c7d791d-test-realms\") pod \"maas-keycloak-0\" (UID: \"5fc15a45-a2b8-4406-ae84-dd6c8c7d791d\") " pod="keycloak-system/maas-keycloak-0" Jun 14 14:52:15.167310 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.167182 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2bnb\" (UniqueName: \"kubernetes.io/projected/5fc15a45-a2b8-4406-ae84-dd6c8c7d791d-kube-api-access-l2bnb\") pod \"maas-keycloak-0\" (UID: \"5fc15a45-a2b8-4406-ae84-dd6c8c7d791d\") " pod="keycloak-system/maas-keycloak-0" Jun 14 14:52:15.268468 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.268393 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2bnb\" (UniqueName: \"kubernetes.io/projected/5fc15a45-a2b8-4406-ae84-dd6c8c7d791d-kube-api-access-l2bnb\") pod \"maas-keycloak-0\" (UID: \"5fc15a45-a2b8-4406-ae84-dd6c8c7d791d\") " pod="keycloak-system/maas-keycloak-0" Jun 14 14:52:15.268627 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.268479 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5fc15a45-a2b8-4406-ae84-dd6c8c7d791d-test-realms\") pod \"maas-keycloak-0\" (UID: \"5fc15a45-a2b8-4406-ae84-dd6c8c7d791d\") " pod="keycloak-system/maas-keycloak-0" Jun 14 14:52:15.269108 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.269088 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5fc15a45-a2b8-4406-ae84-dd6c8c7d791d-test-realms\") pod \"maas-keycloak-0\" (UID: \"5fc15a45-a2b8-4406-ae84-dd6c8c7d791d\") " pod="keycloak-system/maas-keycloak-0" Jun 14 14:52:15.275849 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.275827 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2bnb\" (UniqueName: \"kubernetes.io/projected/5fc15a45-a2b8-4406-ae84-dd6c8c7d791d-kube-api-access-l2bnb\") pod \"maas-keycloak-0\" (UID: \"5fc15a45-a2b8-4406-ae84-dd6c8c7d791d\") " pod="keycloak-system/maas-keycloak-0" Jun 14 14:52:15.363293 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.363265 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 14:52:15.493386 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.493359 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 14:52:15.494982 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:52:15.494955 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc15a45_a2b8_4406_ae84_dd6c8c7d791d.slice/crio-854c4b3a7987c012169abf9bdb5ae6b7a6c10f0bb4bba1b6d6e1356f28bc6885 WatchSource:0}: Error finding container 854c4b3a7987c012169abf9bdb5ae6b7a6c10f0bb4bba1b6d6e1356f28bc6885: Status 404 returned error can't find the container with id 854c4b3a7987c012169abf9bdb5ae6b7a6c10f0bb4bba1b6d6e1356f28bc6885 Jun 14 14:52:15.496280 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.496264 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 14:52:15.565798 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:15.565737 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d05d2200-ac4a-437d-a1e5-87c9238b3c45" path="/var/lib/kubelet/pods/d05d2200-ac4a-437d-a1e5-87c9238b3c45/volumes" Jun 14 14:52:16.011610 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:16.011582 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"5fc15a45-a2b8-4406-ae84-dd6c8c7d791d","Type":"ContainerStarted","Data":"97cc5dc4b447009dfa5613ae1c8cbff94fcd6d9b2961a4d5161c18ecea99b821"} Jun 14 14:52:16.012012 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:16.011632 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"5fc15a45-a2b8-4406-ae84-dd6c8c7d791d","Type":"ContainerStarted","Data":"854c4b3a7987c012169abf9bdb5ae6b7a6c10f0bb4bba1b6d6e1356f28bc6885"} Jun 14 14:52:16.027111 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:16.027048 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.636102564 podStartE2EDuration="1.027002638s" totalImagesPullingTime="390.900074ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:52:16.026042164 +0000 UTC m=+768.896975472" watchObservedRunningTime="2026-06-14 14:52:16.027002638 +0000 UTC m=+768.897935952" Jun 14 14:52:16.364417 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:16.364378 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 14 14:52:16.366091 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:16.366054 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5fc15a45-a2b8-4406-ae84-dd6c8c7d791d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 14 14:52:17.364297 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:17.364247 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5fc15a45-a2b8-4406-ae84-dd6c8c7d791d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 14 14:52:18.364355 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:18.364309 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5fc15a45-a2b8-4406-ae84-dd6c8c7d791d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 14 14:52:19.364041 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:19.363990 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5fc15a45-a2b8-4406-ae84-dd6c8c7d791d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 14 14:52:20.364612 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:20.364558 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5fc15a45-a2b8-4406-ae84-dd6c8c7d791d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 14 14:52:21.363960 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:21.363908 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5fc15a45-a2b8-4406-ae84-dd6c8c7d791d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 14 14:52:22.364599 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:22.364521 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5fc15a45-a2b8-4406-ae84-dd6c8c7d791d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 14 14:52:23.364767 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:23.364714 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5fc15a45-a2b8-4406-ae84-dd6c8c7d791d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 14 14:52:24.363602 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:24.363564 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5fc15a45-a2b8-4406-ae84-dd6c8c7d791d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 14 14:52:25.363379 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:25.363343 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 14 14:52:25.364354 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:25.363796 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5fc15a45-a2b8-4406-ae84-dd6c8c7d791d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 14 14:52:26.364315 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:26.364267 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5fc15a45-a2b8-4406-ae84-dd6c8c7d791d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 14 14:52:27.363645 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:27.363600 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5fc15a45-a2b8-4406-ae84-dd6c8c7d791d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 14 14:52:28.363927 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:28.363877 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5fc15a45-a2b8-4406-ae84-dd6c8c7d791d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 14 14:52:29.484948 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:29.484864 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 14 14:52:29.502510 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:29.502465 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="5fc15a45-a2b8-4406-ae84-dd6c8c7d791d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:52:39.491033 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:52:39.490998 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 14 14:53:02.757386 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:02.757308 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:53:27.456002 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:27.455969 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:53:36.589356 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.589323 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns"] Jun 14 14:53:36.593877 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.593857 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.595911 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.595887 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wb6w7\"" Jun 14 14:53:36.596023 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.595993 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 14:53:36.596520 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.596479 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 14:53:36.596520 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.596485 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 14 14:53:36.604927 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.604904 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns"] Jun 14 14:53:36.631768 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.631747 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d641f7d7-2daf-471c-adaf-716c5de09dff-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.631866 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.631777 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d641f7d7-2daf-471c-adaf-716c5de09dff-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.631866 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.631795 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d641f7d7-2daf-471c-adaf-716c5de09dff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.631866 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.631812 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d641f7d7-2daf-471c-adaf-716c5de09dff-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.631866 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.631827 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmxqk\" (UniqueName: \"kubernetes.io/projected/d641f7d7-2daf-471c-adaf-716c5de09dff-kube-api-access-lmxqk\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.631997 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.631978 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d641f7d7-2daf-471c-adaf-716c5de09dff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.733359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.733329 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d641f7d7-2daf-471c-adaf-716c5de09dff-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.733359 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.733360 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d641f7d7-2daf-471c-adaf-716c5de09dff-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.733571 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.733379 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d641f7d7-2daf-471c-adaf-716c5de09dff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.733571 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.733399 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d641f7d7-2daf-471c-adaf-716c5de09dff-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.733571 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.733422 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmxqk\" (UniqueName: \"kubernetes.io/projected/d641f7d7-2daf-471c-adaf-716c5de09dff-kube-api-access-lmxqk\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.733571 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.733535 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d641f7d7-2daf-471c-adaf-716c5de09dff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.733804 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.733781 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d641f7d7-2daf-471c-adaf-716c5de09dff-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.733862 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.733820 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d641f7d7-2daf-471c-adaf-716c5de09dff-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.733931 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.733914 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d641f7d7-2daf-471c-adaf-716c5de09dff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.735655 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.735636 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d641f7d7-2daf-471c-adaf-716c5de09dff-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.735947 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.735931 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d641f7d7-2daf-471c-adaf-716c5de09dff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.740632 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.740608 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmxqk\" (UniqueName: \"kubernetes.io/projected/d641f7d7-2daf-471c-adaf-716c5de09dff-kube-api-access-lmxqk\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns\" (UID: \"d641f7d7-2daf-471c-adaf-716c5de09dff\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:36.904672 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:36.904590 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:37.036358 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:37.036331 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns"] Jun 14 14:53:37.038618 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:53:37.038577 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd641f7d7_2daf_471c_adaf_716c5de09dff.slice/crio-122227a2d6f0a6a19bebf96d3639f9bcb79c1d9727bd7433f3c5e6006008a06c WatchSource:0}: Error finding container 122227a2d6f0a6a19bebf96d3639f9bcb79c1d9727bd7433f3c5e6006008a06c: Status 404 returned error can't find the container with id 122227a2d6f0a6a19bebf96d3639f9bcb79c1d9727bd7433f3c5e6006008a06c Jun 14 14:53:37.259185 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:37.259149 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:53:37.459748 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:37.459713 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" event={"ID":"d641f7d7-2daf-471c-adaf-716c5de09dff","Type":"ContainerStarted","Data":"122227a2d6f0a6a19bebf96d3639f9bcb79c1d9727bd7433f3c5e6006008a06c"} Jun 14 14:53:40.478631 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:40.478594 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" event={"ID":"d641f7d7-2daf-471c-adaf-716c5de09dff","Type":"ContainerStarted","Data":"af73f9391ec1d89ac0db964430cd4f5951630ef1810f658a91ea397fdce19aae"} Jun 14 14:53:43.495867 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:43.495836 2566 generic.go:356] "Generic (PLEG): container finished" podID="d641f7d7-2daf-471c-adaf-716c5de09dff" containerID="af73f9391ec1d89ac0db964430cd4f5951630ef1810f658a91ea397fdce19aae" exitCode=0 Jun 14 14:53:43.496378 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:43.495912 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" event={"ID":"d641f7d7-2daf-471c-adaf-716c5de09dff","Type":"ContainerDied","Data":"af73f9391ec1d89ac0db964430cd4f5951630ef1810f658a91ea397fdce19aae"} Jun 14 14:53:45.513996 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:45.513961 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" event={"ID":"d641f7d7-2daf-471c-adaf-716c5de09dff","Type":"ContainerStarted","Data":"482995844b4137f1f68276101e800590c34fbd7d1dea1bf954af40a2239fde3d"} Jun 14 14:53:45.538039 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:45.537992 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" podStartSLOduration=2.940372901 podStartE2EDuration="9.537977526s" totalImagesPullingTime="3.973169712s" totalInitContainerRuntime="2.624434913s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:53:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:53:45.536173445 +0000 UTC m=+858.407106767" watchObservedRunningTime="2026-06-14 14:53:45.537977526 +0000 UTC m=+858.408911177" Jun 14 14:53:46.905289 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:46.905246 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:46.905683 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:46.905313 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:46.917485 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:46.917456 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:53:47.310326 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:47.310286 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:53:47.534451 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:53:47.534411 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns" Jun 14 14:54:13.377063 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.377024 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg"] Jun 14 14:54:13.391751 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.391729 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.395421 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.395399 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 14 14:54:13.399449 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.399427 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg"] Jun 14 14:54:13.554649 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.554616 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8w8r\" (UniqueName: \"kubernetes.io/projected/46cb0f12-5504-4966-93d1-1bcc56974d04-kube-api-access-k8w8r\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.554789 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.554667 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46cb0f12-5504-4966-93d1-1bcc56974d04-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.554789 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.554724 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46cb0f12-5504-4966-93d1-1bcc56974d04-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.554865 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.554802 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/46cb0f12-5504-4966-93d1-1bcc56974d04-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.554865 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.554833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46cb0f12-5504-4966-93d1-1bcc56974d04-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.554865 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.554851 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46cb0f12-5504-4966-93d1-1bcc56974d04-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.656211 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.656134 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/46cb0f12-5504-4966-93d1-1bcc56974d04-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.656211 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.656174 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46cb0f12-5504-4966-93d1-1bcc56974d04-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.656211 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.656190 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46cb0f12-5504-4966-93d1-1bcc56974d04-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.656597 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.656261 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8w8r\" (UniqueName: \"kubernetes.io/projected/46cb0f12-5504-4966-93d1-1bcc56974d04-kube-api-access-k8w8r\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.656597 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.656294 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46cb0f12-5504-4966-93d1-1bcc56974d04-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.656597 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.656308 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46cb0f12-5504-4966-93d1-1bcc56974d04-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.656794 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.656687 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/46cb0f12-5504-4966-93d1-1bcc56974d04-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.656794 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.656737 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46cb0f12-5504-4966-93d1-1bcc56974d04-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.656794 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.656764 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46cb0f12-5504-4966-93d1-1bcc56974d04-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.658384 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.658366 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46cb0f12-5504-4966-93d1-1bcc56974d04-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.658735 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.658718 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46cb0f12-5504-4966-93d1-1bcc56974d04-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.669601 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.669581 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8w8r\" (UniqueName: \"kubernetes.io/projected/46cb0f12-5504-4966-93d1-1bcc56974d04-kube-api-access-k8w8r\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg\" (UID: \"46cb0f12-5504-4966-93d1-1bcc56974d04\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.727592 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.727560 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:13.861308 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:13.861283 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg"] Jun 14 14:54:13.863513 ip-10-0-135-57 kubenswrapper[2566]: W0614 14:54:13.863486 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46cb0f12_5504_4966_93d1_1bcc56974d04.slice/crio-b9c0074374e708dd1305550e179c4fce01f2fd582a255d1e48062ebe76480ae7 WatchSource:0}: Error finding container b9c0074374e708dd1305550e179c4fce01f2fd582a255d1e48062ebe76480ae7: Status 404 returned error can't find the container with id b9c0074374e708dd1305550e179c4fce01f2fd582a255d1e48062ebe76480ae7 Jun 14 14:54:14.384452 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:14.384415 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:54:14.658400 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:14.658310 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" event={"ID":"46cb0f12-5504-4966-93d1-1bcc56974d04","Type":"ContainerStarted","Data":"fe166c87040fb559b8440fe2d5b480e8e4da3c85ca78f4ad961d3f43ca3d36f4"} Jun 14 14:54:14.658400 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:14.658366 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" event={"ID":"46cb0f12-5504-4966-93d1-1bcc56974d04","Type":"ContainerStarted","Data":"b9c0074374e708dd1305550e179c4fce01f2fd582a255d1e48062ebe76480ae7"} Jun 14 14:54:15.664610 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:15.664570 2566 generic.go:356] "Generic (PLEG): container finished" podID="46cb0f12-5504-4966-93d1-1bcc56974d04" containerID="fe166c87040fb559b8440fe2d5b480e8e4da3c85ca78f4ad961d3f43ca3d36f4" exitCode=0 Jun 14 14:54:15.665000 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:15.664628 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" event={"ID":"46cb0f12-5504-4966-93d1-1bcc56974d04","Type":"ContainerDied","Data":"fe166c87040fb559b8440fe2d5b480e8e4da3c85ca78f4ad961d3f43ca3d36f4"} Jun 14 14:54:16.671287 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:16.671246 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" event={"ID":"46cb0f12-5504-4966-93d1-1bcc56974d04","Type":"ContainerStarted","Data":"b96e893f10423c8be4c1aac2697cded8779331574d6fe25fde62a32ef30c118b"} Jun 14 14:54:16.691286 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:16.691233 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" podStartSLOduration=2.30263329 podStartE2EDuration="3.691213645s" totalImagesPullingTime="171.856001ms" totalInitContainerRuntime="1.216724354s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:54:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:54:16.690196129 +0000 UTC m=+889.561129442" watchObservedRunningTime="2026-06-14 14:54:16.691213645 +0000 UTC m=+889.562146958" Jun 14 14:54:21.287555 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:21.287465 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:54:23.728447 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:23.728413 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:23.728839 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:23.728465 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:23.744380 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:23.744356 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:24.721995 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:24.721970 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg" Jun 14 14:54:27.581966 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:27.581939 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 14:54:27.582890 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:27.582865 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 14:54:27.586250 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:27.586228 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 14:54:27.587353 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:54:27.587331 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 14:57:25.571196 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:57:25.571116 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:57:36.277976 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:57:36.277931 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:57:44.873444 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:57:44.873404 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:57:55.004141 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:57:55.004107 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:58:04.219424 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:58:04.219389 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:58:14.380300 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:58:14.380258 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:58:47.474300 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:58:47.474216 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:58:52.069471 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:58:52.069435 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:59:27.614016 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:59:27.613989 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 14:59:27.617177 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:59:27.617152 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 14:59:27.618937 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:59:27.618911 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 14:59:27.621619 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:59:27.621600 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 14:59:28.258610 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:59:28.258568 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 14:59:43.866915 ip-10-0-135-57 kubenswrapper[2566]: I0614 14:59:43.866877 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:00:22.263003 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:00:22.262920 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:00:38.955031 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:00:38.954986 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:00:52.757206 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:00:52.757173 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:00:57.260699 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:00:57.260660 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:01:09.663597 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:01:09.663562 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:02:09.155550 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:02:09.155461 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:02:18.159255 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:02:18.159209 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:02:34.858713 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:02:34.858675 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:02:43.553962 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:02:43.553922 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:03:00.863594 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:03:00.863556 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:03:09.173734 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:03:09.173695 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:03:41.665266 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:03:41.665188 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:03:50.671714 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:03:50.671681 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:03:58.768925 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:03:58.768894 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:04:06.869708 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:04:06.869672 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:04:15.353611 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:04:15.353570 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:04:27.645569 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:04:27.645526 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 15:04:27.649899 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:04:27.649877 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 15:04:27.650778 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:04:27.650756 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 15:04:27.655821 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:04:27.655799 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 15:04:40.753731 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:04:40.753695 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:04:52.956635 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:04:52.956553 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:05:40.576244 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:05:40.576210 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:05:48.261325 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:05:48.261294 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:06:07.370355 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:06:07.370315 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:06:15.961833 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:06:15.961800 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:06:24.900819 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:06:24.900738 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:06:33.363842 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:06:33.363806 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:06:42.361831 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:06:42.361792 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:06:51.058356 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:06:51.058321 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:06:59.965678 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:06:59.965643 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:07:08.061044 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:07:08.061005 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:07:16.657817 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:07:16.657785 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:07:25.056525 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:07:25.056482 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:09:27.677605 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:09:27.677573 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 15:09:27.682125 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:09:27.682097 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 15:09:27.691590 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:09:27.691572 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 15:09:27.695827 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:09:27.695811 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 15:09:47.769928 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:09:47.769891 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:09:52.709587 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:09:52.709556 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:10:18.776077 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:10:18.776046 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:10:23.179769 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:10:23.179734 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:10:33.112301 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:10:33.112270 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:10:42.917199 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:10:42.917165 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:10:52.469114 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:10:52.469026 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:11:02.467817 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:11:02.467782 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:11:11.863315 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:11:11.863277 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:11:22.070628 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:11:22.070588 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:11:31.165381 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:11:31.165339 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:11:41.678084 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:11:41.678051 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:11:50.765857 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:11:50.765826 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:11:55.261953 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:11:55.261916 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:12:23.780450 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:12:23.780374 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:13:06.661481 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:13:06.661441 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:13:15.168531 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:13:15.168490 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:13:23.871425 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:13:23.871390 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:13:32.264793 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:13:32.264758 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:13:41.066919 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:13:41.066883 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:13:51.662767 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:13:51.662694 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:14:00.462523 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:14:00.462482 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:14:05.661808 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:14:05.661771 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:14:12.957759 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:14:12.957723 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:14:21.357293 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:14:21.357256 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:14:27.709803 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:14:27.709768 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 15:14:27.714771 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:14:27.714749 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 15:14:27.724717 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:14:27.724699 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 15:14:27.728812 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:14:27.728791 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 15:14:29.365525 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:14:29.365489 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:14:39.664113 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:14:39.664076 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:14:57.665102 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:14:57.665065 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:15:00.140602 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:00.140566 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29690835-g2k9t"] Jun 14 15:15:00.143962 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:00.143941 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690835-g2k9t" Jun 14 15:15:00.145951 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:00.145929 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-w886h\"" Jun 14 15:15:00.160427 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:00.160404 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29690835-g2k9t"] Jun 14 15:15:00.199516 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:00.199483 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gmsj\" (UniqueName: \"kubernetes.io/projected/e740ad86-e6b2-45f7-8d35-b971d002912c-kube-api-access-6gmsj\") pod \"maas-api-key-cleanup-29690835-g2k9t\" (UID: \"e740ad86-e6b2-45f7-8d35-b971d002912c\") " pod="opendatahub/maas-api-key-cleanup-29690835-g2k9t" Jun 14 15:15:00.300829 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:00.300800 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gmsj\" (UniqueName: \"kubernetes.io/projected/e740ad86-e6b2-45f7-8d35-b971d002912c-kube-api-access-6gmsj\") pod \"maas-api-key-cleanup-29690835-g2k9t\" (UID: \"e740ad86-e6b2-45f7-8d35-b971d002912c\") " pod="opendatahub/maas-api-key-cleanup-29690835-g2k9t" Jun 14 15:15:00.308902 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:00.308880 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gmsj\" (UniqueName: \"kubernetes.io/projected/e740ad86-e6b2-45f7-8d35-b971d002912c-kube-api-access-6gmsj\") pod \"maas-api-key-cleanup-29690835-g2k9t\" (UID: \"e740ad86-e6b2-45f7-8d35-b971d002912c\") " pod="opendatahub/maas-api-key-cleanup-29690835-g2k9t" Jun 14 15:15:00.455660 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:00.455636 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690835-g2k9t" Jun 14 15:15:00.586835 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:00.586810 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29690835-g2k9t"] Jun 14 15:15:00.588602 ip-10-0-135-57 kubenswrapper[2566]: W0614 15:15:00.588575 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode740ad86_e6b2_45f7_8d35_b971d002912c.slice/crio-8bba4f5264af1273e1d6b16b25cfe2aa88c6bc7e758b19d17f771a46889e50b4 WatchSource:0}: Error finding container 8bba4f5264af1273e1d6b16b25cfe2aa88c6bc7e758b19d17f771a46889e50b4: Status 404 returned error can't find the container with id 8bba4f5264af1273e1d6b16b25cfe2aa88c6bc7e758b19d17f771a46889e50b4 Jun 14 15:15:00.590582 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:00.590566 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:15:01.010992 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:01.010959 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690835-g2k9t" event={"ID":"e740ad86-e6b2-45f7-8d35-b971d002912c","Type":"ContainerStarted","Data":"8bba4f5264af1273e1d6b16b25cfe2aa88c6bc7e758b19d17f771a46889e50b4"} Jun 14 15:15:03.023611 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:03.023575 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690835-g2k9t" event={"ID":"e740ad86-e6b2-45f7-8d35-b971d002912c","Type":"ContainerStarted","Data":"6fd4273aae8c332abd8f785d0b28d1557ba7640a595c6b7851f582251015dbb1"} Jun 14 15:15:03.041648 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:03.041597 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29690835-g2k9t" podStartSLOduration=1.046081511 podStartE2EDuration="3.041581435s" totalImagesPullingTime="1.995499924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:03.039009409 +0000 UTC m=+2135.909942722" watchObservedRunningTime="2026-06-14 15:15:03.041581435 +0000 UTC m=+2135.912514745" Jun 14 15:15:04.029919 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:04.029881 2566 generic.go:356] "Generic (PLEG): container finished" podID="e740ad86-e6b2-45f7-8d35-b971d002912c" containerID="6fd4273aae8c332abd8f785d0b28d1557ba7640a595c6b7851f582251015dbb1" exitCode=0 Jun 14 15:15:04.030297 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:04.029961 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690835-g2k9t" event={"ID":"e740ad86-e6b2-45f7-8d35-b971d002912c","Type":"ContainerDied","Data":"6fd4273aae8c332abd8f785d0b28d1557ba7640a595c6b7851f582251015dbb1"} Jun 14 15:15:05.158887 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:05.158865 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690835-g2k9t" Jun 14 15:15:05.249198 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:05.249171 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gmsj\" (UniqueName: \"kubernetes.io/projected/e740ad86-e6b2-45f7-8d35-b971d002912c-kube-api-access-6gmsj\") pod \"e740ad86-e6b2-45f7-8d35-b971d002912c\" (UID: \"e740ad86-e6b2-45f7-8d35-b971d002912c\") " Jun 14 15:15:05.251383 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:05.251347 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e740ad86-e6b2-45f7-8d35-b971d002912c-kube-api-access-6gmsj" (OuterVolumeSpecName: "kube-api-access-6gmsj") pod "e740ad86-e6b2-45f7-8d35-b971d002912c" (UID: "e740ad86-e6b2-45f7-8d35-b971d002912c"). InnerVolumeSpecName "kube-api-access-6gmsj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:15:05.350138 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:05.350072 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gmsj\" (UniqueName: \"kubernetes.io/projected/e740ad86-e6b2-45f7-8d35-b971d002912c-kube-api-access-6gmsj\") on node \"ip-10-0-135-57.ec2.internal\" DevicePath \"\"" Jun 14 15:15:06.041119 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:06.041084 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690835-g2k9t" event={"ID":"e740ad86-e6b2-45f7-8d35-b971d002912c","Type":"ContainerDied","Data":"8bba4f5264af1273e1d6b16b25cfe2aa88c6bc7e758b19d17f771a46889e50b4"} Jun 14 15:15:06.041119 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:06.041111 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690835-g2k9t" Jun 14 15:15:06.041330 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:06.041139 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bba4f5264af1273e1d6b16b25cfe2aa88c6bc7e758b19d17f771a46889e50b4" Jun 14 15:15:06.760775 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:06.760735 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:15:14.872675 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:14.872636 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:15:22.758680 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:22.758604 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:15:40.360309 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:40.360271 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:15:48.757119 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:48.757084 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:15:57.359235 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:15:57.359191 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:16:05.162935 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:16:05.162900 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:16:14.764431 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:16:14.764394 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:16:23.770408 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:16:23.770372 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:16:31.858062 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:16:31.858022 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:16:35.965994 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:16:35.965960 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:16:45.066751 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:16:45.066715 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:16:54.461579 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:16:54.461461 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:17:05.259960 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:17:05.259926 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:17:14.666182 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:17:14.666147 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:17:19.961158 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:17:19.961117 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:17:26.875899 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:17:26.875864 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:17:31.963874 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:17:31.963834 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:17:46.870170 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:17:46.870133 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:17:55.366774 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:17:55.366744 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:18:05.079007 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:05.078973 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:18:10.360579 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:10.360527 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:18:32.556659 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:32.556579 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:18:44.865160 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:44.865124 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:18:50.264140 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:50.264102 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:18:54.161328 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:54.161295 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:18:58.566980 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.566888 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2"] Jun 14 15:18:58.567461 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.567442 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e740ad86-e6b2-45f7-8d35-b971d002912c" containerName="cleanup" Jun 14 15:18:58.567461 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.567462 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e740ad86-e6b2-45f7-8d35-b971d002912c" containerName="cleanup" Jun 14 15:18:58.567613 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.567533 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e740ad86-e6b2-45f7-8d35-b971d002912c" containerName="cleanup" Jun 14 15:18:58.571026 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.571001 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:18:58.574221 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.574197 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 14 15:18:58.574488 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.574472 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-w886h\"" Jun 14 15:18:58.587755 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.587731 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2"] Jun 14 15:18:58.713948 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.713910 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8d4071-73fa-4750-89ab-e255f351531c-openshift-service-ca\") pod \"maas-api-e2e-ait-412109df-6d76d696db-vsdl2\" (UID: \"8c8d4071-73fa-4750-89ab-e255f351531c\") " pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:18:58.714123 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.714003 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c8d4071-73fa-4750-89ab-e255f351531c-maas-api-tls\") pod \"maas-api-e2e-ait-412109df-6d76d696db-vsdl2\" (UID: \"8c8d4071-73fa-4750-89ab-e255f351531c\") " pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:18:58.714123 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.714070 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zhmn\" (UniqueName: \"kubernetes.io/projected/8c8d4071-73fa-4750-89ab-e255f351531c-kube-api-access-2zhmn\") pod \"maas-api-e2e-ait-412109df-6d76d696db-vsdl2\" (UID: \"8c8d4071-73fa-4750-89ab-e255f351531c\") " pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:18:58.814694 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.814661 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8d4071-73fa-4750-89ab-e255f351531c-openshift-service-ca\") pod \"maas-api-e2e-ait-412109df-6d76d696db-vsdl2\" (UID: \"8c8d4071-73fa-4750-89ab-e255f351531c\") " pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:18:58.814856 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.814758 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c8d4071-73fa-4750-89ab-e255f351531c-maas-api-tls\") pod \"maas-api-e2e-ait-412109df-6d76d696db-vsdl2\" (UID: \"8c8d4071-73fa-4750-89ab-e255f351531c\") " pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:18:58.814856 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.814819 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zhmn\" (UniqueName: \"kubernetes.io/projected/8c8d4071-73fa-4750-89ab-e255f351531c-kube-api-access-2zhmn\") pod \"maas-api-e2e-ait-412109df-6d76d696db-vsdl2\" (UID: \"8c8d4071-73fa-4750-89ab-e255f351531c\") " pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:18:58.815276 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.815257 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8d4071-73fa-4750-89ab-e255f351531c-openshift-service-ca\") pod \"maas-api-e2e-ait-412109df-6d76d696db-vsdl2\" (UID: \"8c8d4071-73fa-4750-89ab-e255f351531c\") " pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:18:58.817230 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.817177 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c8d4071-73fa-4750-89ab-e255f351531c-maas-api-tls\") pod \"maas-api-e2e-ait-412109df-6d76d696db-vsdl2\" (UID: \"8c8d4071-73fa-4750-89ab-e255f351531c\") " pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:18:58.822247 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.822221 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zhmn\" (UniqueName: \"kubernetes.io/projected/8c8d4071-73fa-4750-89ab-e255f351531c-kube-api-access-2zhmn\") pod \"maas-api-e2e-ait-412109df-6d76d696db-vsdl2\" (UID: \"8c8d4071-73fa-4750-89ab-e255f351531c\") " pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:18:58.887742 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:58.887712 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:18:59.045871 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:59.045822 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2"] Jun 14 15:18:59.047571 ip-10-0-135-57 kubenswrapper[2566]: W0614 15:18:59.047521 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8d4071_73fa_4750_89ab_e255f351531c.slice/crio-cecb07430078f016dd727bc81c75069017a77f09420891ee0f707fefe8f809de WatchSource:0}: Error finding container cecb07430078f016dd727bc81c75069017a77f09420891ee0f707fefe8f809de: Status 404 returned error can't find the container with id cecb07430078f016dd727bc81c75069017a77f09420891ee0f707fefe8f809de Jun 14 15:18:59.247373 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:59.247337 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" event={"ID":"8c8d4071-73fa-4750-89ab-e255f351531c","Type":"ContainerStarted","Data":"cecb07430078f016dd727bc81c75069017a77f09420891ee0f707fefe8f809de"} Jun 14 15:18:59.963955 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:18:59.963920 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:19:01.259969 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:01.259936 2566 generic.go:356] "Generic (PLEG): container finished" podID="8c8d4071-73fa-4750-89ab-e255f351531c" containerID="9b9ab8d2ff168695be86342fde803f70920fc4c617249eb2b2479dff6d537587" exitCode=1 Jun 14 15:19:01.260438 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:01.260027 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" event={"ID":"8c8d4071-73fa-4750-89ab-e255f351531c","Type":"ContainerDied","Data":"9b9ab8d2ff168695be86342fde803f70920fc4c617249eb2b2479dff6d537587"} Jun 14 15:19:01.260438 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:01.260224 2566 scope.go:117] "RemoveContainer" containerID="9b9ab8d2ff168695be86342fde803f70920fc4c617249eb2b2479dff6d537587" Jun 14 15:19:02.267726 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:02.267695 2566 generic.go:356] "Generic (PLEG): container finished" podID="8c8d4071-73fa-4750-89ab-e255f351531c" containerID="c6dd3fd18cad4ab40dcfe4b026a374f649056b306464f0c973035772f94557ab" exitCode=1 Jun 14 15:19:02.268127 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:02.267781 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" event={"ID":"8c8d4071-73fa-4750-89ab-e255f351531c","Type":"ContainerDied","Data":"c6dd3fd18cad4ab40dcfe4b026a374f649056b306464f0c973035772f94557ab"} Jun 14 15:19:02.268127 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:02.267839 2566 scope.go:117] "RemoveContainer" containerID="9b9ab8d2ff168695be86342fde803f70920fc4c617249eb2b2479dff6d537587" Jun 14 15:19:02.268127 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:02.268044 2566 scope.go:117] "RemoveContainer" containerID="c6dd3fd18cad4ab40dcfe4b026a374f649056b306464f0c973035772f94557ab" Jun 14 15:19:02.268577 ip-10-0-135-57 kubenswrapper[2566]: E0614 15:19:02.268249 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-412109df-6d76d696db-vsdl2_opendatahub(8c8d4071-73fa-4750-89ab-e255f351531c)\"" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" podUID="8c8d4071-73fa-4750-89ab-e255f351531c" Jun 14 15:19:03.280644 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:03.280609 2566 scope.go:117] "RemoveContainer" containerID="c6dd3fd18cad4ab40dcfe4b026a374f649056b306464f0c973035772f94557ab" Jun 14 15:19:03.281066 ip-10-0-135-57 kubenswrapper[2566]: E0614 15:19:03.280781 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-412109df-6d76d696db-vsdl2_opendatahub(8c8d4071-73fa-4750-89ab-e255f351531c)\"" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" podUID="8c8d4071-73fa-4750-89ab-e255f351531c" Jun 14 15:19:03.888089 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:03.888056 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:19:04.285288 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:04.285260 2566 scope.go:117] "RemoveContainer" containerID="c6dd3fd18cad4ab40dcfe4b026a374f649056b306464f0c973035772f94557ab" Jun 14 15:19:04.285700 ip-10-0-135-57 kubenswrapper[2566]: E0614 15:19:04.285425 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-412109df-6d76d696db-vsdl2_opendatahub(8c8d4071-73fa-4750-89ab-e255f351531c)\"" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" podUID="8c8d4071-73fa-4750-89ab-e255f351531c" Jun 14 15:19:07.462197 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:07.462167 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rhhl8"] Jun 14 15:19:08.888626 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:08.888591 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:19:08.889091 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:08.889065 2566 scope.go:117] "RemoveContainer" containerID="c6dd3fd18cad4ab40dcfe4b026a374f649056b306464f0c973035772f94557ab" Jun 14 15:19:08.889290 ip-10-0-135-57 kubenswrapper[2566]: E0614 15:19:08.889266 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-412109df-6d76d696db-vsdl2_opendatahub(8c8d4071-73fa-4750-89ab-e255f351531c)\"" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" podUID="8c8d4071-73fa-4750-89ab-e255f351531c" Jun 14 15:19:22.366274 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:22.366244 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-678bbb5d45-jhhqj_43fa4b1b-4c51-4472-9c51-800821962c30/nginx/0.log" Jun 14 15:19:22.477626 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:22.477591 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-8vh7m_2dd39433-a6e9-44ad-a1e1-d3c86a91c50e/manager/0.log" Jun 14 15:19:22.559359 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:22.559332 2566 scope.go:117] "RemoveContainer" containerID="c6dd3fd18cad4ab40dcfe4b026a374f649056b306464f0c973035772f94557ab" Jun 14 15:19:22.588870 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:22.588850 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-jjqwb_148d8001-1f88-44ef-8901-073f785c6b02/manager/0.log" Jun 14 15:19:22.814087 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:22.814062 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-412109df-6d76d696db-vsdl2_8c8d4071-73fa-4750-89ab-e255f351531c/maas-api/1.log" Jun 14 15:19:23.134838 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:23.134747 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29690835-g2k9t_e740ad86-e6b2-45f7-8d35-b971d002912c/cleanup/0.log" Jun 14 15:19:23.359360 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:23.359335 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-6z9s2_ccb50b80-e763-43c4-a92f-c79f450b31fe/server/0.log" Jun 14 15:19:23.390073 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:23.389990 2566 generic.go:356] "Generic (PLEG): container finished" podID="8c8d4071-73fa-4750-89ab-e255f351531c" containerID="d61122a41a78de7bf38175352f69cef17fbd92a3685751aa10ce4205f79ee62e" exitCode=1 Jun 14 15:19:23.390441 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:23.390063 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" event={"ID":"8c8d4071-73fa-4750-89ab-e255f351531c","Type":"ContainerDied","Data":"d61122a41a78de7bf38175352f69cef17fbd92a3685751aa10ce4205f79ee62e"} Jun 14 15:19:23.390441 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:23.390150 2566 scope.go:117] "RemoveContainer" containerID="c6dd3fd18cad4ab40dcfe4b026a374f649056b306464f0c973035772f94557ab" Jun 14 15:19:23.390574 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:23.390446 2566 scope.go:117] "RemoveContainer" containerID="d61122a41a78de7bf38175352f69cef17fbd92a3685751aa10ce4205f79ee62e" Jun 14 15:19:23.390696 ip-10-0-135-57 kubenswrapper[2566]: E0614 15:19:23.390674 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-412109df-6d76d696db-vsdl2_opendatahub(8c8d4071-73fa-4750-89ab-e255f351531c)\"" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" podUID="8c8d4071-73fa-4750-89ab-e255f351531c" Jun 14 15:19:23.837730 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:23.837700 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc868665f-v9lvk_3b00c660-4a69-4af7-a1e0-d8ada3a15493/copy-manifests/0.log" Jun 14 15:19:23.844836 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:23.844815 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc868665f-v9lvk_3b00c660-4a69-4af7-a1e0-d8ada3a15493/manager/0.log" Jun 14 15:19:23.888221 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:23.888199 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:19:24.398291 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:24.398265 2566 scope.go:117] "RemoveContainer" containerID="d61122a41a78de7bf38175352f69cef17fbd92a3685751aa10ce4205f79ee62e" Jun 14 15:19:24.398784 ip-10-0-135-57 kubenswrapper[2566]: E0614 15:19:24.398502 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-412109df-6d76d696db-vsdl2_opendatahub(8c8d4071-73fa-4750-89ab-e255f351531c)\"" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" podUID="8c8d4071-73fa-4750-89ab-e255f351531c" Jun 14 15:19:25.314315 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:25.314281 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9gf7t_b01678f9-13a1-4656-a8ba-0cec902a9c68/manager/0.log" Jun 14 15:19:25.883018 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:25.882991 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-rhhl8_b619dfbb-9179-4d34-8e8f-8a29aaf220c1/limitador/0.log" Jun 14 15:19:26.458297 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:26.458248 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9wxcc_cd068637-0670-49a6-a54c-372c605fd1ee/discovery/0.log" Jun 14 15:19:26.566597 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:26.566569 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798fd884dc-6lt7r_9672735f-f4a8-4df9-b022-2dc5d18837dc/kube-auth-proxy/0.log" Jun 14 15:19:27.710548 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:27.710472 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns_d641f7d7-2daf-471c-adaf-716c5de09dff/storage-initializer/0.log" Jun 14 15:19:27.717843 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:27.717820 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-trbns_d641f7d7-2daf-471c-adaf-716c5de09dff/main/0.log" Jun 14 15:19:27.743571 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:27.743550 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 15:19:27.747880 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:27.747859 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 15:19:27.758357 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:27.758340 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 15:19:27.762281 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:27.762267 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mmbs_96baa92a-c1c7-4ca2-8d22-75c0621d5482/ovn-acl-logging/0.log" Jun 14 15:19:27.942290 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:27.942266 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg_46cb0f12-5504-4966-93d1-1bcc56974d04/main/0.log" Jun 14 15:19:27.948713 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:27.948690 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-xw7vg_46cb0f12-5504-4966-93d1-1bcc56974d04/storage-initializer/0.log" Jun 14 15:19:28.888315 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:28.888281 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:19:28.888838 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:28.888812 2566 scope.go:117] "RemoveContainer" containerID="d61122a41a78de7bf38175352f69cef17fbd92a3685751aa10ce4205f79ee62e" Jun 14 15:19:28.889038 ip-10-0-135-57 kubenswrapper[2566]: E0614 15:19:28.889015 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-412109df-6d76d696db-vsdl2_opendatahub(8c8d4071-73fa-4750-89ab-e255f351531c)\"" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" podUID="8c8d4071-73fa-4750-89ab-e255f351531c" Jun 14 15:19:34.771355 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:34.771324 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hcw6x_44d32134-7e4e-4026-9157-bcb08b28a558/global-pull-secret-syncer/0.log" Jun 14 15:19:34.905242 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:34.905193 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j5x6f_6dc2a5a3-7cd8-40d7-afd9-2620e07d1ad4/konnectivity-agent/0.log" Jun 14 15:19:34.997910 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:34.997882 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-57.ec2.internal_73d13947db166b6a6edbf8d9dacc9ada/haproxy/0.log" Jun 14 15:19:37.471145 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:37.471101 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-vqxz9_75dc39ef-fa61-459a-b07e-c575f1f3e5dc/sail-operator/0.log" Jun 14 15:19:39.559031 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:39.559004 2566 scope.go:117] "RemoveContainer" containerID="d61122a41a78de7bf38175352f69cef17fbd92a3685751aa10ce4205f79ee62e" Jun 14 15:19:39.559411 ip-10-0-135-57 kubenswrapper[2566]: E0614 15:19:39.559161 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-412109df-6d76d696db-vsdl2_opendatahub(8c8d4071-73fa-4750-89ab-e255f351531c)\"" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" podUID="8c8d4071-73fa-4750-89ab-e255f351531c" Jun 14 15:19:40.607316 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:40.607278 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9gf7t_b01678f9-13a1-4656-a8ba-0cec902a9c68/manager/0.log" Jun 14 15:19:40.815873 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:40.815846 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-rhhl8_b619dfbb-9179-4d34-8e8f-8a29aaf220c1/limitador/0.log" Jun 14 15:19:42.657212 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:42.657131 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3af41db9-a200-4ca0-9dcb-f36c621d57cf/alertmanager/0.log" Jun 14 15:19:42.684052 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:42.684023 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3af41db9-a200-4ca0-9dcb-f36c621d57cf/config-reloader/0.log" Jun 14 15:19:42.707603 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:42.707579 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3af41db9-a200-4ca0-9dcb-f36c621d57cf/kube-rbac-proxy-web/0.log" Jun 14 15:19:42.733962 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:42.733933 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3af41db9-a200-4ca0-9dcb-f36c621d57cf/kube-rbac-proxy/0.log" Jun 14 15:19:42.757160 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:42.757137 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3af41db9-a200-4ca0-9dcb-f36c621d57cf/kube-rbac-proxy-metric/0.log" Jun 14 15:19:42.779244 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:42.779213 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3af41db9-a200-4ca0-9dcb-f36c621d57cf/prom-label-proxy/0.log" Jun 14 15:19:42.802288 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:42.802262 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3af41db9-a200-4ca0-9dcb-f36c621d57cf/init-config-reloader/0.log" Jun 14 15:19:42.901724 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:42.901700 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-lvfv8_a1b5a475-5cc2-4696-8597-4c13691f155d/kube-state-metrics/0.log" Jun 14 15:19:42.922468 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:42.922403 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-lvfv8_a1b5a475-5cc2-4696-8597-4c13691f155d/kube-rbac-proxy-main/0.log" Jun 14 15:19:42.948239 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:42.948218 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-lvfv8_a1b5a475-5cc2-4696-8597-4c13691f155d/kube-rbac-proxy-self/0.log" Jun 14 15:19:42.979615 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:42.979585 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-57d4998bbb-thjqc_965c489f-96c2-4d00-ad1e-f18421844e40/metrics-server/0.log" Jun 14 15:19:43.215621 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:43.215600 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgttw_ba6eac9c-55fb-4931-9904-bb567c23eb6d/node-exporter/0.log" Jun 14 15:19:43.243503 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:43.243483 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgttw_ba6eac9c-55fb-4931-9904-bb567c23eb6d/kube-rbac-proxy/0.log" Jun 14 15:19:43.265588 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:43.265573 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgttw_ba6eac9c-55fb-4931-9904-bb567c23eb6d/init-textfile/0.log" Jun 14 15:19:43.841940 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:43.841904 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-677bcfc67f-gsct6_4f8bb0b3-ab88-4fd0-b983-1ad47efd1347/thanos-query/0.log" Jun 14 15:19:43.865261 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:43.865231 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-677bcfc67f-gsct6_4f8bb0b3-ab88-4fd0-b983-1ad47efd1347/kube-rbac-proxy-web/0.log" Jun 14 15:19:43.891017 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:43.891000 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-677bcfc67f-gsct6_4f8bb0b3-ab88-4fd0-b983-1ad47efd1347/kube-rbac-proxy/0.log" Jun 14 15:19:43.913501 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:43.913482 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-677bcfc67f-gsct6_4f8bb0b3-ab88-4fd0-b983-1ad47efd1347/prom-label-proxy/0.log" Jun 14 15:19:43.938850 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:43.938809 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-677bcfc67f-gsct6_4f8bb0b3-ab88-4fd0-b983-1ad47efd1347/kube-rbac-proxy-rules/0.log" Jun 14 15:19:43.973740 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:43.973722 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-677bcfc67f-gsct6_4f8bb0b3-ab88-4fd0-b983-1ad47efd1347/kube-rbac-proxy-metrics/0.log" Jun 14 15:19:45.945074 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:45.945043 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/1.log" Jun 14 15:19:45.949706 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:45.949685 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-mgjpl_11cceb40-aca4-4ff0-b0f9-352cca8e5a79/console-operator/2.log" Jun 14 15:19:46.370063 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.370026 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs"] Jun 14 15:19:46.373785 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.373765 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.375649 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.375627 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n9rwp\"/\"openshift-service-ca.crt\"" Jun 14 15:19:46.375649 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.375641 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n9rwp\"/\"default-dockercfg-6m4tx\"" Jun 14 15:19:46.376127 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.376112 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n9rwp\"/\"kube-root-ca.crt\"" Jun 14 15:19:46.383256 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.383235 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs"] Jun 14 15:19:46.452987 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.452954 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-proc\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.452987 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.452988 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-podres\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.453293 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.453110 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-lib-modules\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.453293 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.453164 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbqw4\" (UniqueName: \"kubernetes.io/projected/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-kube-api-access-rbqw4\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.453293 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.453221 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-sys\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.553962 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.553932 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-lib-modules\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.554129 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.553974 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbqw4\" (UniqueName: \"kubernetes.io/projected/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-kube-api-access-rbqw4\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.554129 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.554101 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-sys\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.554255 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.554134 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-sys\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.554255 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.554103 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-lib-modules\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.554255 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.554217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-proc\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.554255 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.554250 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-podres\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.554448 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.554293 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-proc\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.554448 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.554400 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-podres\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.561411 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.561390 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbqw4\" (UniqueName: \"kubernetes.io/projected/12b25d5d-fb27-46c0-83d8-8bc8ba67fffe-kube-api-access-rbqw4\") pod \"perf-node-gather-daemonset-hv8fs\" (UID: \"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.639444 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.639363 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-j6v2f_e655f23a-203b-4b6f-aa19-ec3111a93f8d/download-server/0.log" Jun 14 15:19:46.684435 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.684411 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:46.818792 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:46.818764 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs"] Jun 14 15:19:46.820199 ip-10-0-135-57 kubenswrapper[2566]: W0614 15:19:46.820173 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod12b25d5d_fb27_46c0_83d8_8bc8ba67fffe.slice/crio-d435d783afa17059d60161187cd9d01f1b1ce0eaf41e96c8710b332ffb9c6eca WatchSource:0}: Error finding container d435d783afa17059d60161187cd9d01f1b1ce0eaf41e96c8710b332ffb9c6eca: Status 404 returned error can't find the container with id d435d783afa17059d60161187cd9d01f1b1ce0eaf41e96c8710b332ffb9c6eca Jun 14 15:19:47.432891 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:47.432861 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-mp7dh_1590e269-f5bf-4167-8aa6-245d3c99b8b0/volume-data-source-validator/0.log" Jun 14 15:19:47.523318 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:47.523280 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" event={"ID":"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe","Type":"ContainerStarted","Data":"b86a7b73dae6062a80703db1db8904d04206a5a85b7a31a2d48325648398ecde"} Jun 14 15:19:47.523521 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:47.523330 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" event={"ID":"12b25d5d-fb27-46c0-83d8-8bc8ba67fffe","Type":"ContainerStarted","Data":"d435d783afa17059d60161187cd9d01f1b1ce0eaf41e96c8710b332ffb9c6eca"} Jun 14 15:19:47.523521 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:47.523358 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:47.544144 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:47.544100 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" podStartSLOduration=1.544086656 podStartE2EDuration="1.544086656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:19:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:19:47.541067575 +0000 UTC m=+2420.412000888" watchObservedRunningTime="2026-06-14 15:19:47.544086656 +0000 UTC m=+2420.415019970" Jun 14 15:19:48.634927 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:48.634889 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f7d7x_08ce8c7c-2214-40f7-93ea-b44b51b75e1f/dns/0.log" Jun 14 15:19:48.660220 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:48.660200 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f7d7x_08ce8c7c-2214-40f7-93ea-b44b51b75e1f/kube-rbac-proxy/0.log" Jun 14 15:19:48.685359 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:48.685335 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-24l22_b77fe2f8-fd37-40f0-ac13-6cbf4e850c9b/dns-node-resolver/0.log" Jun 14 15:19:49.287124 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:49.287093 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-759cfff566-d2t4v_71881136-77ed-43fa-9e91-7dd04bc273ae/registry/0.log" Jun 14 15:19:49.295234 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:49.295206 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-759cfff566-d2t4v_71881136-77ed-43fa-9e91-7dd04bc273ae/registry/1.log" Jun 14 15:19:49.373180 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:49.373157 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mtw64_853c09c4-64cc-443b-be20-c50c89c658b9/node-ca/0.log" Jun 14 15:19:50.444813 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:50.444784 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9wxcc_cd068637-0670-49a6-a54c-372c605fd1ee/discovery/0.log" Jun 14 15:19:50.468950 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:50.468920 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798fd884dc-6lt7r_9672735f-f4a8-4df9-b022-2dc5d18837dc/kube-auth-proxy/0.log" Jun 14 15:19:51.396236 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:51.396203 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kcjq8_143f5e39-8acd-4190-94b3-ca136a6a90c2/serve-healthcheck-canary/0.log" Jun 14 15:19:51.935206 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:51.935181 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-k6khp_1566f1d4-22a5-4d5b-9d58-58a93760eff1/insights-operator/0.log" Jun 14 15:19:51.935607 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:51.935303 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-k6khp_1566f1d4-22a5-4d5b-9d58-58a93760eff1/insights-operator/1.log" Jun 14 15:19:52.042576 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:52.042534 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wvqfq_f4ec8dc3-7b6c-4988-8481-b4f5447392a7/kube-rbac-proxy/0.log" Jun 14 15:19:52.068730 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:52.068702 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wvqfq_f4ec8dc3-7b6c-4988-8481-b4f5447392a7/exporter/0.log" Jun 14 15:19:52.095039 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:52.095019 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wvqfq_f4ec8dc3-7b6c-4988-8481-b4f5447392a7/extractor/0.log" Jun 14 15:19:53.538983 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:53.538959 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-hv8fs" Jun 14 15:19:53.559330 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:53.559307 2566 scope.go:117] "RemoveContainer" containerID="d61122a41a78de7bf38175352f69cef17fbd92a3685751aa10ce4205f79ee62e" Jun 14 15:19:54.442508 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:54.442483 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-678bbb5d45-jhhqj_43fa4b1b-4c51-4472-9c51-800821962c30/nginx/0.log" Jun 14 15:19:54.472839 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:54.472816 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-8vh7m_2dd39433-a6e9-44ad-a1e1-d3c86a91c50e/manager/0.log" Jun 14 15:19:54.557775 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:54.557647 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-jjqwb_148d8001-1f88-44ef-8901-073f785c6b02/manager/0.log" Jun 14 15:19:54.565547 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:54.565508 2566 generic.go:356] "Generic (PLEG): container finished" podID="8c8d4071-73fa-4750-89ab-e255f351531c" containerID="fee82d2ef80bbd3080d8d4a066722b4116ae23c07e79bc0599054973db568167" exitCode=1 Jun 14 15:19:54.565697 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:54.565566 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" event={"ID":"8c8d4071-73fa-4750-89ab-e255f351531c","Type":"ContainerDied","Data":"fee82d2ef80bbd3080d8d4a066722b4116ae23c07e79bc0599054973db568167"} Jun 14 15:19:54.565697 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:54.565651 2566 scope.go:117] "RemoveContainer" containerID="d61122a41a78de7bf38175352f69cef17fbd92a3685751aa10ce4205f79ee62e" Jun 14 15:19:54.566024 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:54.565999 2566 scope.go:117] "RemoveContainer" containerID="fee82d2ef80bbd3080d8d4a066722b4116ae23c07e79bc0599054973db568167" Jun 14 15:19:54.566217 ip-10-0-135-57 kubenswrapper[2566]: E0614 15:19:54.566194 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-412109df-6d76d696db-vsdl2_opendatahub(8c8d4071-73fa-4750-89ab-e255f351531c)\"" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" podUID="8c8d4071-73fa-4750-89ab-e255f351531c" Jun 14 15:19:54.633901 ip-10-0-135-57 kubenswrapper[2566]: E0614 15:19:54.633867 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d61122a41a78de7bf38175352f69cef17fbd92a3685751aa10ce4205f79ee62e\": container with ID starting with d61122a41a78de7bf38175352f69cef17fbd92a3685751aa10ce4205f79ee62e not found: ID does not exist" containerID="d61122a41a78de7bf38175352f69cef17fbd92a3685751aa10ce4205f79ee62e" Jun 14 15:19:54.634006 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:54.633991 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-412109df-6d76d696db-vsdl2_8c8d4071-73fa-4750-89ab-e255f351531c/maas-api/3.log" Jun 14 15:19:54.709391 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:54.709362 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29690835-g2k9t_e740ad86-e6b2-45f7-8d35-b971d002912c/cleanup/0.log" Jun 14 15:19:54.854141 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:54.854068 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-6z9s2_ccb50b80-e763-43c4-a92f-c79f450b31fe/server/0.log" Jun 14 15:19:55.198785 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:55.198762 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc868665f-v9lvk_3b00c660-4a69-4af7-a1e0-d8ada3a15493/manager/0.log" Jun 14 15:19:55.226670 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:55.226647 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc868665f-v9lvk_3b00c660-4a69-4af7-a1e0-d8ada3a15493/copy-manifests/0.log" Jun 14 15:19:57.143242 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:57.143204 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-84v7l_d7c8c03c-0b79-42d7-a052-1b4223431618/openshift-lws-operator/0.log" Jun 14 15:19:58.887906 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:58.887878 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:19:58.888276 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:58.887926 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" Jun 14 15:19:58.888276 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:58.888266 2566 scope.go:117] "RemoveContainer" containerID="fee82d2ef80bbd3080d8d4a066722b4116ae23c07e79bc0599054973db568167" Jun 14 15:19:58.888470 ip-10-0-135-57 kubenswrapper[2566]: E0614 15:19:58.888451 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-412109df-6d76d696db-vsdl2_opendatahub(8c8d4071-73fa-4750-89ab-e255f351531c)\"" pod="opendatahub/maas-api-e2e-ait-412109df-6d76d696db-vsdl2" podUID="8c8d4071-73fa-4750-89ab-e255f351531c" Jun 14 15:19:59.476472 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:59.476443 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9wxcc_cd068637-0670-49a6-a54c-372c605fd1ee/discovery/0.log" Jun 14 15:19:59.487204 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:19:59.487181 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798fd884dc-6lt7r_9672735f-f4a8-4df9-b022-2dc5d18837dc/kube-auth-proxy/0.log" Jun 14 15:20:00.914913 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:20:00.914879 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9wxcc_cd068637-0670-49a6-a54c-372c605fd1ee/discovery/0.log" Jun 14 15:20:00.926308 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:20:00.926282 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798fd884dc-6lt7r_9672735f-f4a8-4df9-b022-2dc5d18837dc/kube-auth-proxy/0.log" Jun 14 15:20:02.819355 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:20:02.819328 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-mfcxf_81661230-a191-4baa-8589-510a9c0082ff/kube-storage-version-migrator-operator/1.log" Jun 14 15:20:02.820175 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:20:02.820160 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-mfcxf_81661230-a191-4baa-8589-510a9c0082ff/kube-storage-version-migrator-operator/0.log" Jun 14 15:20:02.956010 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:20:02.955973 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9wxcc_cd068637-0670-49a6-a54c-372c605fd1ee/discovery/0.log" Jun 14 15:20:02.965273 ip-10-0-135-57 kubenswrapper[2566]: I0614 15:20:02.965253 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798fd884dc-6lt7r_9672735f-f4a8-4df9-b022-2dc5d18837dc/kube-auth-proxy/0.log"