Jun 13 01:08:23.702223 ip-10-0-143-139 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 13 01:08:23.702236 ip-10-0-143-139 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 13 01:08:23.702247 ip-10-0-143-139 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 13 01:08:23.702489 ip-10-0-143-139 systemd[1]: Failed to start Kubernetes Kubelet. Jun 13 01:08:33.951840 ip-10-0-143-139 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 13 01:08:33.951859 ip-10-0-143-139 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2692ccff37304995bb80e263ebfb0be7 -- Jun 13 01:11:05.217447 ip-10-0-143-139 systemd[1]: Starting Kubernetes Kubelet... Jun 13 01:11:05.602164 ip-10-0-143-139 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 01:11:05.602164 ip-10-0-143-139 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 13 01:11:05.602164 ip-10-0-143-139 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 01:11:05.602164 ip-10-0-143-139 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 13 01:11:05.602164 ip-10-0-143-139 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 01:11:05.604819 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.604730 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 13 01:11:05.610173 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610153 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:11:05.610173 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610169 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:11:05.610173 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610174 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:11:05.610173 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610178 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610186 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610192 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610198 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610203 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610206 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610211 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610215 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610219 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610223 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610227 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610231 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610236 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610240 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610244 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610248 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610264 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610269 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610273 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:11:05.610420 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610277 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610281 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610285 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610289 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610294 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610298 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610303 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610308 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610312 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610316 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610322 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610326 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610330 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610335 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610339 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610344 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610349 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610355 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610360 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:11:05.611132 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610364 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610369 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610373 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610378 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610382 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610386 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610390 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610396 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610400 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610404 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610409 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610413 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610417 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610421 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610425 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610429 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610433 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610437 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610441 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610445 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:11:05.611608 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610450 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610454 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610460 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610466 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610472 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610477 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610481 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610486 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610493 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610498 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610503 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610507 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610512 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610516 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610520 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610524 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610529 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610533 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610537 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:11:05.612090 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610542 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610546 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610550 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610554 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610558 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610562 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610566 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610571 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610575 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610579 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610583 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610587 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610592 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610596 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610600 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610604 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610608 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610612 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.610650 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611562 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:11:05.612582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611573 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611576 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611580 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611583 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611586 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611589 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611592 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611595 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611597 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611600 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611603 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611606 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611608 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611611 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611614 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611616 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611619 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611623 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611625 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:11:05.613058 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611629 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611631 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611634 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611637 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611639 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611642 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611644 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611647 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611649 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611652 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611654 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611657 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611664 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611667 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611670 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611672 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611675 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611678 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611680 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611683 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:11:05.613560 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611686 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611688 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611691 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611693 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611695 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611698 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611700 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611703 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611706 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611710 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611712 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611715 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611718 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611720 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611723 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611727 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611732 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611735 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611738 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611741 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:11:05.614055 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611744 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611747 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611750 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611753 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611757 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611761 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611766 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611769 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611771 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611774 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611777 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611780 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611782 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611785 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611788 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611791 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611794 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611797 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611799 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:11:05.614582 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611802 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611805 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611808 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611811 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611814 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611817 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611819 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611822 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611825 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611827 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611830 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611832 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611835 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611837 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611840 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611842 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611845 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611849 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611851 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.611855 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:11:05.615048 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612229 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612234 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612236 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612239 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612242 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612244 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612247 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612249 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612252 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612255 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612258 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612260 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612263 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612265 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612268 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612270 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612273 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612276 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612278 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612281 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:11:05.615575 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612283 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612286 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612289 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612291 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612294 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612297 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612299 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612302 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612304 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612309 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612312 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612314 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612317 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612320 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612323 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612325 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612328 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612330 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612333 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612335 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:11:05.616064 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612338 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612340 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612343 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612345 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612348 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612350 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612353 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612355 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612358 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612360 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612363 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612366 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612370 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612373 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612375 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612378 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612381 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612384 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612386 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:11:05.616601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612389 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612391 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612395 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612398 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612400 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612403 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612406 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612408 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612412 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612415 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612418 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612421 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612424 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612427 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612429 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612434 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612438 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612441 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612444 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:11:05.617065 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612446 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612449 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612452 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612454 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612457 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612459 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612462 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612464 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612468 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612472 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612474 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612476 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612479 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612481 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612484 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612488 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612490 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612493 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612495 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612498 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.612501 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:11:05.617545 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612577 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612584 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612590 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612595 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612599 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612602 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612606 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612610 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612613 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612616 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612619 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612623 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612626 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612628 2574 flags.go:64] FLAG: --cgroup-root="" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612631 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612634 2574 flags.go:64] FLAG: --client-ca-file="" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612637 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612640 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612644 2574 flags.go:64] FLAG: --cluster-domain="" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612648 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612651 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612654 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612657 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612660 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 13 01:11:05.618150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612663 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612666 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612670 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612673 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612676 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612679 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612682 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612685 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612690 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612693 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612695 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612698 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612701 2574 flags.go:64] FLAG: --enable-server="true" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612704 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612708 2574 flags.go:64] FLAG: --event-burst="100" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612711 2574 flags.go:64] FLAG: --event-qps="50" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612714 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612717 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612719 2574 flags.go:64] FLAG: --eviction-hard="" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612723 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612726 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612729 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612731 2574 flags.go:64] FLAG: --eviction-soft="" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612734 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612737 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 13 01:11:05.618727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612740 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612742 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612746 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612749 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612752 2574 flags.go:64] FLAG: --feature-gates="" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612758 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612761 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612764 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612767 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612771 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612774 2574 flags.go:64] FLAG: --help="false" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612777 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612780 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612783 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612786 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612789 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612793 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612796 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612799 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612801 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612804 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612807 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612810 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612813 2574 flags.go:64] FLAG: --kube-reserved="" Jun 13 01:11:05.619369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612815 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612818 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612821 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612823 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612826 2574 flags.go:64] FLAG: --lock-file="" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612829 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612832 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612835 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612840 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612842 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612847 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612850 2574 flags.go:64] FLAG: --logging-format="text" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612852 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612856 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612859 2574 flags.go:64] FLAG: --manifest-url="" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612862 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612866 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612869 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612873 2574 flags.go:64] FLAG: --max-pods="110" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612876 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612879 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612881 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612884 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612887 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612890 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 13 01:11:05.619981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612894 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612900 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612903 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612906 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612909 2574 flags.go:64] FLAG: --pod-cidr="" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612912 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612917 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612920 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612923 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612926 2574 flags.go:64] FLAG: --port="10250" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612929 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612932 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b76dc4922ad69e45" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612935 2574 flags.go:64] FLAG: --qos-reserved="" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612938 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612941 2574 flags.go:64] FLAG: --register-node="true" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612944 2574 flags.go:64] FLAG: --register-with-taints="" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612948 2574 flags.go:64] FLAG: --registry-burst="10" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612952 2574 flags.go:64] FLAG: --registry-qps="5" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612954 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612957 2574 flags.go:64] FLAG: --reserved-memory="" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612961 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612964 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612967 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612970 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612973 2574 flags.go:64] FLAG: --runonce="false" Jun 13 01:11:05.620611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612976 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612979 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612982 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612984 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612987 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612990 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612993 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.612996 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613000 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613003 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613005 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613008 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613011 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613014 2574 flags.go:64] FLAG: --system-cgroups="" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613016 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613021 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613024 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613027 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613030 2574 flags.go:64] FLAG: --tls-min-version="" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613033 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613035 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613038 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613042 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613045 2574 flags.go:64] FLAG: --v="2" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613051 2574 flags.go:64] FLAG: --version="false" Jun 13 01:11:05.621238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613055 2574 flags.go:64] FLAG: --vmodule="" Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613058 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.613062 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613203 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613207 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613210 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613213 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613217 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613220 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613223 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613226 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613229 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613232 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613235 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613237 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613240 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613243 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613245 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613248 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613250 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:11:05.621894 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613253 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613256 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613258 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613262 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613266 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613270 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613273 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613276 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613279 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613283 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613286 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613291 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613294 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613297 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613299 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613302 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613304 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613307 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613310 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:11:05.622409 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613313 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613315 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613318 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613320 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613323 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613325 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613328 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613331 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613333 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613336 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613339 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613341 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613344 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613347 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613349 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613352 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613354 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613357 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613359 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613361 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:11:05.622875 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613364 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613367 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613371 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613373 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613377 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613380 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613382 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613385 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613388 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613390 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613393 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613395 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613398 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613400 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613403 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613406 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613408 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613411 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613413 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613416 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:11:05.623431 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613418 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613421 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613423 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613426 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613429 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613431 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613435 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613439 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613442 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613445 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613447 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613450 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613452 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613455 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613459 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613461 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613465 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613467 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613470 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613472 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:11:05.623930 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613475 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613478 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.613481 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.614465 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.621313 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.621328 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.621345 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.621351 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621406 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621410 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621414 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621417 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621420 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621423 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621426 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:11:05.624425 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621429 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621432 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621435 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621438 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621440 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621443 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621446 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621448 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621451 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621454 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621457 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621459 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621462 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621464 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621467 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621470 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621472 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621475 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621478 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621481 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:11:05.624806 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621484 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621487 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621490 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621493 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621495 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621498 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621501 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621503 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621506 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621510 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621514 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621517 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621520 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621523 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621526 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621529 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621531 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621534 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621537 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:11:05.625306 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621539 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621542 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621544 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621547 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621550 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621553 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621555 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621558 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621561 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621563 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621566 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621568 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621571 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621574 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621577 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621580 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621582 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621585 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621587 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621590 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:11:05.625778 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621593 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621595 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621598 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621600 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621603 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621605 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621608 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621611 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621614 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621616 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621619 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621622 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621624 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621627 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621630 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621633 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621637 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621640 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621644 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:11:05.626327 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621647 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621650 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621652 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621655 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621657 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621660 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621663 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621666 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621668 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621671 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621674 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621677 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621679 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621681 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.621686 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 01:11:05.626787 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621798 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621802 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621805 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621808 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621811 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621814 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621817 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621819 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621822 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621825 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621828 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621830 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621833 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621835 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621838 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621840 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621843 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621845 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621848 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621850 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:11:05.627203 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621853 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621856 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621858 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621861 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621864 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621866 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621869 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621872 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621874 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621877 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621879 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621882 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621884 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621887 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621889 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621892 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621894 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621898 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621901 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621905 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:11:05.627698 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621907 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621910 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621912 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621915 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621925 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621929 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621932 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621935 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621938 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621940 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621942 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621945 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621948 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621951 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621954 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621957 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621959 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621962 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621964 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621967 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:11:05.628191 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621969 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621972 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621974 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621977 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621979 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621982 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621984 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621987 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621990 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621992 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621994 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.621998 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622002 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622006 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622009 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622013 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622016 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622018 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622021 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:11:05.628673 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622024 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622026 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622029 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622031 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622034 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622036 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622039 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622041 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622044 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622046 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622049 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622052 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622054 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622057 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622059 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622062 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622064 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622067 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622069 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:11:05.629141 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:05.622071 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:11:05.629615 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.622077 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 01:11:05.629615 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.622192 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 13 01:11:05.629615 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.624949 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 13 01:11:05.629615 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.626218 2574 server.go:1019] "Starting client certificate rotation" Jun 13 01:11:05.629615 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.626318 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 01:11:05.629615 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.626350 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 01:11:05.629615 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.629217 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 01:11:05.634438 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.634416 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 01:11:05.647272 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.647201 2574 log.go:25] "Validated CRI v1 runtime API" Jun 13 01:11:05.650510 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.650493 2574 log.go:25] "Validated CRI v1 image API" Jun 13 01:11:05.651374 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.651351 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 13 01:11:05.654624 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.654603 2574 fs.go:135] Filesystem UUIDs: map[73aaf271-14e7-4ca3-bc22-e777e738637b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b77d9d3f-826e-495d-a9b6-ae274b18046f:/dev/nvme0n1p3] Jun 13 01:11:05.654681 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.654624 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 13 01:11:05.658871 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.658854 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 01:11:05.658930 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.658756 2574 manager.go:216] Machine: {Timestamp:2026-06-13 01:11:05.65826123 +0000 UTC m=+0.329661059 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100697 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f42817a19f453f4f0888b50f756f9 SystemUUID:ec2f4281-7a19-f453-f4f0-888b50f756f9 BootID:2692ccff-3730-4995-bb80-e263ebfb0be7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b4:48:fe:30:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b4:48:fe:30:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:04:30:67:8c:78 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 13 01:11:05.658930 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.658899 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 13 01:11:05.659021 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.658979 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 13 01:11:05.662627 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.662599 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 13 01:11:05.662762 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.662627 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-139.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 13 01:11:05.663340 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.663330 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 13 01:11:05.663371 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.663343 2574 container_manager_linux.go:309] "Creating device plugin manager" Jun 13 01:11:05.663371 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.663351 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 01:11:05.663371 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.663364 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 01:11:05.664184 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.664174 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 13 01:11:05.669322 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.669300 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 13 01:11:05.669451 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.669440 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 13 01:11:05.669512 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.669480 2574 kubelet.go:486] "Attempting to sync node with API server" Jun 13 01:11:05.669512 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.669496 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 13 01:11:05.669602 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.669519 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 13 01:11:05.669602 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.669534 2574 kubelet.go:398] "Adding apiserver pod source" Jun 13 01:11:05.669602 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.669568 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 13 01:11:05.669974 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.669959 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 01:11:05.670036 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.669983 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 01:11:05.671988 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.671969 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 13 01:11:05.673889 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.673876 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 13 01:11:05.673938 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.673907 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 13 01:11:05.675103 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.675091 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 13 01:11:05.675161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.675107 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 13 01:11:05.675161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.675131 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 13 01:11:05.675161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.675137 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 13 01:11:05.675161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.675146 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 13 01:11:05.675161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.675152 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 13 01:11:05.675161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.675160 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 13 01:11:05.675358 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.675165 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 13 01:11:05.675358 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.675173 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 13 01:11:05.675358 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.675178 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 13 01:11:05.675358 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.675191 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 13 01:11:05.675358 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.675199 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 13 01:11:05.675358 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.675230 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 13 01:11:05.675358 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.675238 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 13 01:11:05.678698 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.678679 2574 server.go:1268] "Started kubelet" Jun 13 01:11:05.678786 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.678755 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 13 01:11:05.678854 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.678758 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 13 01:11:05.678854 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.678825 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 13 01:11:05.683300 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.683275 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 13 01:11:05.683535 ip-10-0-143-139 systemd[1]: Started Kubernetes Kubelet. Jun 13 01:11:05.684291 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.684264 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 13 01:11:05.685314 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.684305 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 13 01:11:05.685314 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.684467 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9cs9g" Jun 13 01:11:05.685314 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.684558 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-139.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 13 01:11:05.685695 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.685679 2574 server.go:310] "Adding debug handlers to kubelet server" Jun 13 01:11:05.686926 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.686904 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 13 01:11:05.687022 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.686978 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9cs9g" Jun 13 01:11:05.689258 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.688398 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-139.ec2.internal.18b87ecba189bd09 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-139.ec2.internal,UID:ip-10-0-143-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-139.ec2.internal,},FirstTimestamp:2026-06-13 01:11:05.678650633 +0000 UTC m=+0.350050462,LastTimestamp:2026-06-13 01:11:05.678650633 +0000 UTC m=+0.350050462,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-139.ec2.internal,}" Jun 13 01:11:05.692395 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.692381 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 13 01:11:05.692454 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.692399 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 13 01:11:05.692454 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.692448 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jun 13 01:11:05.693400 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.693381 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 13 01:11:05.693400 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.693402 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 13 01:11:05.693659 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.693405 2574 factory.go:153] Registering CRI-O factory Jun 13 01:11:05.693659 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.693507 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 13 01:11:05.693659 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.693518 2574 reconciler.go:29] "Reconciler: start to sync state" Jun 13 01:11:05.693659 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.693546 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 13 01:11:05.693659 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.693554 2574 factory.go:223] Registration of the crio container factory successfully Jun 13 01:11:05.693659 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.693616 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 13 01:11:05.693659 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.693626 2574 factory.go:55] Registering systemd factory Jun 13 01:11:05.693659 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.693635 2574 factory.go:223] Registration of the systemd container factory successfully Jun 13 01:11:05.693659 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.693657 2574 factory.go:103] Registering Raw factory Jun 13 01:11:05.694173 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.693671 2574 manager.go:1196] Started watching for new ooms in manager Jun 13 01:11:05.694173 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.694129 2574 manager.go:349] Starting recovery of all containers Jun 13 01:11:05.697378 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.697357 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:11:05.700369 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.700158 2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-139.ec2.internal\" not found" node="ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.704052 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.704041 2574 manager.go:354] Recovery completed Jun 13 01:11:05.708209 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.708196 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:11:05.710064 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.710048 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:11:05.710154 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.710077 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:11:05.710154 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.710088 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:11:05.710585 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.710571 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 13 01:11:05.710585 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.710583 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 13 01:11:05.710585 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.710588 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:11:05.710709 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.710600 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 13 01:11:05.711270 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.711258 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:11:05.711328 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.711282 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:11:05.711328 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.711292 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:11:05.712123 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.712098 2574 policy_none.go:49] "None policy: Start" Jun 13 01:11:05.712160 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.712130 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 13 01:11:05.712160 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.712142 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 13 01:11:05.713347 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.713335 2574 policy_none.go:47] "Start" Jun 13 01:11:05.749670 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.749654 2574 manager.go:337] "Starting Device Plugin manager" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.749683 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.749692 2574 server.go:87] "Starting device plugin registration server" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.749927 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.749939 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.750027 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.750161 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.750169 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.750664 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.750714 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-139.ec2.internal\" not found" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.755304 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.756345 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.756389 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.756415 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.756457 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 13 01:11:05.765290 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.758716 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:11:05.850294 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.850243 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:11:05.851507 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.851488 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:11:05.851608 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.851523 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:11:05.851608 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.851538 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:11:05.851608 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.851567 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.856555 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.856496 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal"] Jun 13 01:11:05.856617 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.856578 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:11:05.858037 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.858022 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:11:05.858144 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.858049 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:11:05.858144 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.858058 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:11:05.859205 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.859186 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.859292 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.859216 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-139.ec2.internal\": node \"ip-10-0-143-139.ec2.internal\" not found" Jun 13 01:11:05.859583 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.859572 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:11:05.859694 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.859682 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.859731 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.859713 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:11:05.860300 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.860282 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:11:05.860417 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.860282 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:11:05.860417 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.860311 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:11:05.860417 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.860322 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:11:05.860417 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.860333 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:11:05.860417 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.860350 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:11:05.861914 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.861891 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.862005 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.861926 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:11:05.862646 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.862629 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:11:05.862736 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.862658 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:11:05.862736 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.862671 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:11:05.873305 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.873286 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jun 13 01:11:05.893004 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.892983 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-139.ec2.internal\" not found" node="ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.894992 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.894976 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d79c6332bb546fa2ad596ee51ac7514-config\") pod \"kube-apiserver-proxy-ip-10-0-143-139.ec2.internal\" (UID: \"5d79c6332bb546fa2ad596ee51ac7514\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.895053 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.894999 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5013d1eb9715c51d401b1dcfe0f89d24-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"5013d1eb9715c51d401b1dcfe0f89d24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.895053 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.895018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5013d1eb9715c51d401b1dcfe0f89d24-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"5013d1eb9715c51d401b1dcfe0f89d24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.897532 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.897516 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-139.ec2.internal\" not found" node="ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.973379 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:05.973345 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jun 13 01:11:05.995745 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.995718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5013d1eb9715c51d401b1dcfe0f89d24-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"5013d1eb9715c51d401b1dcfe0f89d24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.995812 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.995751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5013d1eb9715c51d401b1dcfe0f89d24-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"5013d1eb9715c51d401b1dcfe0f89d24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.995812 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.995769 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d79c6332bb546fa2ad596ee51ac7514-config\") pod \"kube-apiserver-proxy-ip-10-0-143-139.ec2.internal\" (UID: \"5d79c6332bb546fa2ad596ee51ac7514\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.995916 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.995836 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5013d1eb9715c51d401b1dcfe0f89d24-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"5013d1eb9715c51d401b1dcfe0f89d24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.995916 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.995885 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5013d1eb9715c51d401b1dcfe0f89d24-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"5013d1eb9715c51d401b1dcfe0f89d24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jun 13 01:11:05.995996 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:05.995924 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d79c6332bb546fa2ad596ee51ac7514-config\") pod \"kube-apiserver-proxy-ip-10-0-143-139.ec2.internal\" (UID: \"5d79c6332bb546fa2ad596ee51ac7514\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" Jun 13 01:11:06.074416 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:06.074375 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jun 13 01:11:06.175246 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:06.175167 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jun 13 01:11:06.195484 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.195458 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jun 13 01:11:06.200700 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.200676 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" Jun 13 01:11:06.275358 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:06.275312 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jun 13 01:11:06.375865 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:06.375840 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jun 13 01:11:06.476445 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:06.476377 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jun 13 01:11:06.577083 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:06.577048 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jun 13 01:11:06.626042 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.625601 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 13 01:11:06.626042 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.625775 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 01:11:06.626042 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.625805 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 01:11:06.674755 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.674727 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:11:06.691626 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.691575 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-12 01:06:05 +0000 UTC" deadline="2027-12-27 21:36:12.24487784 +0000 UTC" Jun 13 01:11:06.691626 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.691622 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13508h25m5.553260143s" Jun 13 01:11:06.691626 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.691626 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:11:06.692571 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.692548 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jun 13 01:11:06.692680 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.692584 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 13 01:11:06.702865 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.702839 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 01:11:06.703718 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.703702 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" Jun 13 01:11:06.704617 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.704601 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 01:11:06.715711 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.715694 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 01:11:06.724408 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.724388 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-47xtk" Jun 13 01:11:06.732257 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.732212 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-47xtk" Jun 13 01:11:06.733054 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:06.733032 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d79c6332bb546fa2ad596ee51ac7514.slice/crio-8fd21d76af4ca29a0e8ab657f9309a6d49421c224c43fa72aac7cc9febeb4ca8 WatchSource:0}: Error finding container 8fd21d76af4ca29a0e8ab657f9309a6d49421c224c43fa72aac7cc9febeb4ca8: Status 404 returned error can't find the container with id 8fd21d76af4ca29a0e8ab657f9309a6d49421c224c43fa72aac7cc9febeb4ca8 Jun 13 01:11:06.733358 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:06.733339 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5013d1eb9715c51d401b1dcfe0f89d24.slice/crio-d8e345a8a06d7a7d7e88880eeaf4f7c7f9f2d334e915624d819fe3b52e1585f5 WatchSource:0}: Error finding container d8e345a8a06d7a7d7e88880eeaf4f7c7f9f2d334e915624d819fe3b52e1585f5: Status 404 returned error can't find the container with id d8e345a8a06d7a7d7e88880eeaf4f7c7f9f2d334e915624d819fe3b52e1585f5 Jun 13 01:11:06.738461 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.738442 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:11:06.759453 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.759414 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" event={"ID":"5013d1eb9715c51d401b1dcfe0f89d24","Type":"ContainerStarted","Data":"d8e345a8a06d7a7d7e88880eeaf4f7c7f9f2d334e915624d819fe3b52e1585f5"} Jun 13 01:11:06.760429 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:06.760407 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" event={"ID":"5d79c6332bb546fa2ad596ee51ac7514","Type":"ContainerStarted","Data":"8fd21d76af4ca29a0e8ab657f9309a6d49421c224c43fa72aac7cc9febeb4ca8"} Jun 13 01:11:07.670364 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.670332 2574 apiserver.go:52] "Watching apiserver" Jun 13 01:11:07.676696 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.676672 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 13 01:11:07.677072 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.677045 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-tktw8","openshift-multus/multus-tqkdp","openshift-network-diagnostics/network-check-target-bjddg","openshift-network-operator/iptables-alerter-vrz79","kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4","openshift-dns/node-resolver-6lbfr","openshift-image-registry/node-ca-wtshb","openshift-multus/network-metrics-daemon-h48sb","openshift-ovn-kubernetes/ovnkube-node-4t9pm","kube-system/global-pull-secret-syncer-ddhc4","kube-system/konnectivity-agent-scnvp","openshift-cluster-node-tuning-operator/tuned-jfv49","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal"] Jun 13 01:11:07.678671 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.678611 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6lbfr" Jun 13 01:11:07.679756 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.679729 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-scnvp" Jun 13 01:11:07.680930 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.680906 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:07.681036 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.680975 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7tlx4\"" Jun 13 01:11:07.681036 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:07.680994 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:07.681036 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.681028 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 13 01:11:07.681210 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.681084 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 13 01:11:07.681929 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.681903 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cbtkt\"" Jun 13 01:11:07.682021 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.681978 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vrz79" Jun 13 01:11:07.682219 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.682107 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 13 01:11:07.682538 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.682517 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 13 01:11:07.683403 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.683386 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wtshb" Jun 13 01:11:07.684170 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.684149 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:11:07.684445 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.684412 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 13 01:11:07.684522 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.684462 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 13 01:11:07.684592 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.684415 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cmpgt\"" Jun 13 01:11:07.684764 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.684748 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.685339 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.685320 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 13 01:11:07.685439 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.685384 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 13 01:11:07.685867 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.685507 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qxs79\"" Jun 13 01:11:07.685867 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.685720 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 13 01:11:07.686218 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.686195 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:07.686314 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:07.686261 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:07.687232 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.687062 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7j64s\"" Jun 13 01:11:07.687232 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.687132 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 13 01:11:07.687232 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.687162 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 13 01:11:07.691851 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.688505 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.691851 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.688842 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 13 01:11:07.691851 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.691041 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:11:07.691851 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.691421 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.692080 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.692057 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 13 01:11:07.692371 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.692288 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g2djh\"" Jun 13 01:11:07.693776 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.693456 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.694107 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.694089 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 13 01:11:07.694199 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.694147 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 13 01:11:07.694199 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.694182 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 13 01:11:07.694459 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.694440 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qkx9r\"" Jun 13 01:11:07.694578 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.694559 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 13 01:11:07.695196 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.695099 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:07.695196 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:07.695177 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:07.695649 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.695629 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 13 01:11:07.695768 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.695745 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 13 01:11:07.696482 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.696097 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 13 01:11:07.696482 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.696106 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 13 01:11:07.696482 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.696251 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 13 01:11:07.696482 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.696450 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-swn2n\"" Jun 13 01:11:07.696784 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.696631 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 13 01:11:07.697616 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.697593 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.699702 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.699681 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kqrb2\"" Jun 13 01:11:07.700077 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.700058 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 13 01:11:07.700617 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.700601 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 13 01:11:07.705217 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705185 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-modprobe-d\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.705322 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705297 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30048d20-4691-4de9-8a59-6a29d363f4e0-ovn-node-metrics-cert\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.705499 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705328 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.705499 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705349 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-run\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.705499 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705372 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rzzw\" (UniqueName: \"kubernetes.io/projected/9602554f-7ebe-403d-aefc-2a740e24f9d0-kube-api-access-8rzzw\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.705499 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705473 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-systemd-units\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.705697 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-run-netns\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.705697 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-var-lib-openvswitch\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.705697 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705558 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7e1c0e0d-ba91-42c9-87ed-31b04d107dfa-serviceca\") pod \"node-ca-wtshb\" (UID: \"7e1c0e0d-ba91-42c9-87ed-31b04d107dfa\") " pod="openshift-image-registry/node-ca-wtshb" Jun 13 01:11:07.705697 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705580 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-cni-bin\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.705697 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-host\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.705697 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30048d20-4691-4de9-8a59-6a29d363f4e0-env-overrides\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.705697 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705665 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99950e12-9739-4b46-a978-b8aceafc3484-hosts-file\") pod \"node-resolver-6lbfr\" (UID: \"99950e12-9739-4b46-a978-b8aceafc3484\") " pod="openshift-dns/node-resolver-6lbfr" Jun 13 01:11:07.705697 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-var-lib-kubelet\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.706048 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705710 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-multus-cni-dir\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.706048 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9602554f-7ebe-403d-aefc-2a740e24f9d0-cni-binary-copy\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.706048 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705756 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-hostroot\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.706048 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-etc-kubernetes\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.706048 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705855 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e4699105-7209-4d5f-817c-189575d43ae0-agent-certs\") pod \"konnectivity-agent-scnvp\" (UID: \"e4699105-7209-4d5f-817c-189575d43ae0\") " pod="kube-system/konnectivity-agent-scnvp" Jun 13 01:11:07.706048 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705889 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30048d20-4691-4de9-8a59-6a29d363f4e0-ovnkube-config\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.706048 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705923 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:07.706048 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd7wt\" (UniqueName: \"kubernetes.io/projected/2620eb52-f1c4-4e87-a859-58ee881785e8-kube-api-access-xd7wt\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.706048 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.705985 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-run-systemd\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.706048 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706014 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-node-log\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.706048 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706050 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-log-socket\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706077 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c691a532-4b73-4518-8158-cfebdbafdbea-dbus\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706127 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb9f9763-1893-4702-83d8-03aac0193330-host-slash\") pod \"iptables-alerter-vrz79\" (UID: \"eb9f9763-1893-4702-83d8-03aac0193330\") " pod="openshift-network-operator/iptables-alerter-vrz79" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706149 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-os-release\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706190 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-run-netns\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706207 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-multus-conf-dir\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706225 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-kubelet\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-slash\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706256 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-etc-openvswitch\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706270 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706285 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e4699105-7209-4d5f-817c-189575d43ae0-konnectivity-ca\") pod \"konnectivity-agent-scnvp\" (UID: \"e4699105-7209-4d5f-817c-189575d43ae0\") " pod="kube-system/konnectivity-agent-scnvp" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706303 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-socket-dir\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-sys-fs\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-sysctl-conf\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706367 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-system-cni-dir\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706382 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss8m9\" (UniqueName: \"kubernetes.io/projected/30048d20-4691-4de9-8a59-6a29d363f4e0-kube-api-access-ss8m9\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.706528 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706402 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99950e12-9739-4b46-a978-b8aceafc3484-tmp-dir\") pod \"node-resolver-6lbfr\" (UID: \"99950e12-9739-4b46-a978-b8aceafc3484\") " pod="openshift-dns/node-resolver-6lbfr" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706426 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-run-multus-certs\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706450 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-sysctl-d\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-lib-modules\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-var-lib-cni-bin\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706551 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-var-lib-kubelet\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706573 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30048d20-4691-4de9-8a59-6a29d363f4e0-ovnkube-script-lib\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706595 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c691a532-4b73-4518-8158-cfebdbafdbea-kubelet-config\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706617 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr72z\" (UniqueName: \"kubernetes.io/projected/eb9f9763-1893-4702-83d8-03aac0193330-kube-api-access-jr72z\") pod \"iptables-alerter-vrz79\" (UID: \"eb9f9763-1893-4702-83d8-03aac0193330\") " pod="openshift-network-operator/iptables-alerter-vrz79" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-device-dir\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706664 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cjj2\" (UniqueName: \"kubernetes.io/projected/20a1c119-db29-439b-b40a-788a1a1779d1-kube-api-access-2cjj2\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2620eb52-f1c4-4e87-a859-58ee881785e8-tmp\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706707 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-run-k8s-cni-cncf-io\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e1c0e0d-ba91-42c9-87ed-31b04d107dfa-host\") pod \"node-ca-wtshb\" (UID: \"7e1c0e0d-ba91-42c9-87ed-31b04d107dfa\") " pod="openshift-image-registry/node-ca-wtshb" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706752 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-sysconfig\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706787 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-multus-socket-dir-parent\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.707256 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706811 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54r8k\" (UniqueName: \"kubernetes.io/projected/7e1c0e0d-ba91-42c9-87ed-31b04d107dfa-kube-api-access-54r8k\") pod \"node-ca-wtshb\" (UID: \"7e1c0e0d-ba91-42c9-87ed-31b04d107dfa\") " pod="openshift-image-registry/node-ca-wtshb" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706865 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq5ql\" (UniqueName: \"kubernetes.io/projected/3e747bdd-f2b9-467c-b520-103a6c772f14-kube-api-access-zq5ql\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706942 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-kubernetes\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-cnibin\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.706991 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spvgz\" (UniqueName: \"kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz\") pod \"network-check-target-bjddg\" (UID: \"32cc2ce4-eb79-4a14-85b8-553b843e8f02\") " pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.707015 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-run-ovn\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.707037 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-sys\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.707067 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-run-openvswitch\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.707081 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj8fh\" (UniqueName: \"kubernetes.io/projected/99950e12-9739-4b46-a978-b8aceafc3484-kube-api-access-gj8fh\") pod \"node-resolver-6lbfr\" (UID: \"99950e12-9739-4b46-a978-b8aceafc3484\") " pod="openshift-dns/node-resolver-6lbfr" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.707105 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb9f9763-1893-4702-83d8-03aac0193330-iptables-alerter-script\") pod \"iptables-alerter-vrz79\" (UID: \"eb9f9763-1893-4702-83d8-03aac0193330\") " pod="openshift-network-operator/iptables-alerter-vrz79" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.707140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-registration-dir\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.707155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-systemd\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.707168 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-tuned\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.708041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.707211 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-var-lib-cni-multus\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.708926 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.707245 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9602554f-7ebe-403d-aefc-2a740e24f9d0-multus-daemon-config\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.708926 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.707330 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-cni-netd\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.736826 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.736678 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 01:06:06 +0000 UTC" deadline="2027-11-09 00:48:16.996048711 +0000 UTC" Jun 13 01:11:07.736826 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.736776 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12335h37m9.259289831s" Jun 13 01:11:07.755568 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.755548 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:11:07.794467 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.794442 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 13 01:11:07.808375 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808346 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-var-lib-cni-bin\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.808514 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808382 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-var-lib-kubelet\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.808514 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30048d20-4691-4de9-8a59-6a29d363f4e0-ovnkube-script-lib\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.808514 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808430 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c691a532-4b73-4518-8158-cfebdbafdbea-kubelet-config\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:07.808514 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808454 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr72z\" (UniqueName: \"kubernetes.io/projected/eb9f9763-1893-4702-83d8-03aac0193330-kube-api-access-jr72z\") pod \"iptables-alerter-vrz79\" (UID: \"eb9f9763-1893-4702-83d8-03aac0193330\") " pod="openshift-network-operator/iptables-alerter-vrz79" Jun 13 01:11:07.808514 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808480 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-device-dir\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.808514 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808486 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-var-lib-kubelet\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.808514 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808503 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cjj2\" (UniqueName: \"kubernetes.io/projected/20a1c119-db29-439b-b40a-788a1a1779d1-kube-api-access-2cjj2\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.808810 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808525 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2620eb52-f1c4-4e87-a859-58ee881785e8-tmp\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.808810 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808544 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-var-lib-cni-bin\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.808810 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808550 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-run-k8s-cni-cncf-io\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.808810 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808609 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-device-dir\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.808810 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c691a532-4b73-4518-8158-cfebdbafdbea-kubelet-config\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:07.809003 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808927 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-run-k8s-cni-cncf-io\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.809003 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808964 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06fa4c27-9487-4d5d-8675-e6fed12c972a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.809003 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.808994 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e1c0e0d-ba91-42c9-87ed-31b04d107dfa-host\") pod \"node-ca-wtshb\" (UID: \"7e1c0e0d-ba91-42c9-87ed-31b04d107dfa\") " pod="openshift-image-registry/node-ca-wtshb" Jun 13 01:11:07.809161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809021 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-sysconfig\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.809161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809047 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-multus-socket-dir-parent\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.809161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809078 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 13 01:11:07.809161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809089 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30048d20-4691-4de9-8a59-6a29d363f4e0-ovnkube-script-lib\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.809161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809099 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e1c0e0d-ba91-42c9-87ed-31b04d107dfa-host\") pod \"node-ca-wtshb\" (UID: \"7e1c0e0d-ba91-42c9-87ed-31b04d107dfa\") " pod="openshift-image-registry/node-ca-wtshb" Jun 13 01:11:07.809161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809106 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:07.809426 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809174 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-multus-socket-dir-parent\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.809426 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809197 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-sysconfig\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.809426 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:07.809216 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:07.809426 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:07.809281 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs podName:3e747bdd-f2b9-467c-b520-103a6c772f14 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:08.309248835 +0000 UTC m=+2.980648655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs") pod "network-metrics-daemon-h48sb" (UID: "3e747bdd-f2b9-467c-b520-103a6c772f14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:07.809426 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06fa4c27-9487-4d5d-8675-e6fed12c972a-system-cni-dir\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.809426 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809323 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54r8k\" (UniqueName: \"kubernetes.io/projected/7e1c0e0d-ba91-42c9-87ed-31b04d107dfa-kube-api-access-54r8k\") pod \"node-ca-wtshb\" (UID: \"7e1c0e0d-ba91-42c9-87ed-31b04d107dfa\") " pod="openshift-image-registry/node-ca-wtshb" Jun 13 01:11:07.809426 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809344 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.809426 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809368 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq5ql\" (UniqueName: \"kubernetes.io/projected/3e747bdd-f2b9-467c-b520-103a6c772f14-kube-api-access-zq5ql\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:07.809426 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.809426 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809416 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-kubernetes\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809439 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-cnibin\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvgz\" (UniqueName: \"kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz\") pod \"network-check-target-bjddg\" (UID: \"32cc2ce4-eb79-4a14-85b8-553b843e8f02\") " pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-run-ovn\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809494 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06fa4c27-9487-4d5d-8675-e6fed12c972a-cni-binary-copy\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-sys\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809566 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-run-ovn\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-run-openvswitch\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809580 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-kubernetes\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809599 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj8fh\" (UniqueName: \"kubernetes.io/projected/99950e12-9739-4b46-a978-b8aceafc3484-kube-api-access-gj8fh\") pod \"node-resolver-6lbfr\" (UID: \"99950e12-9739-4b46-a978-b8aceafc3484\") " pod="openshift-dns/node-resolver-6lbfr" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809624 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06fa4c27-9487-4d5d-8675-e6fed12c972a-cnibin\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809637 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-sys\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809650 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vw4v\" (UniqueName: \"kubernetes.io/projected/06fa4c27-9487-4d5d-8675-e6fed12c972a-kube-api-access-4vw4v\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809681 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb9f9763-1893-4702-83d8-03aac0193330-iptables-alerter-script\") pod \"iptables-alerter-vrz79\" (UID: \"eb9f9763-1893-4702-83d8-03aac0193330\") " pod="openshift-network-operator/iptables-alerter-vrz79" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809542 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-cnibin\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809706 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-registration-dir\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.809949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809723 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809780 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-systemd\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809786 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-registration-dir\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809731 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-systemd\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809827 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-run-openvswitch\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-tuned\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809869 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-var-lib-cni-multus\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809901 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9602554f-7ebe-403d-aefc-2a740e24f9d0-multus-daemon-config\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809932 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-cni-netd\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809955 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-modprobe-d\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.809998 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30048d20-4691-4de9-8a59-6a29d363f4e0-ovn-node-metrics-cert\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810025 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-cni-netd\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810023 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810065 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-run\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810088 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rzzw\" (UniqueName: \"kubernetes.io/projected/9602554f-7ebe-403d-aefc-2a740e24f9d0-kube-api-access-8rzzw\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810125 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-systemd-units\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810148 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-modprobe-d\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.810843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810149 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-run-netns\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810167 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-var-lib-cni-multus\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810188 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-run-netns\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810182 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810202 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-var-lib-openvswitch\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810245 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-systemd-units\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810299 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-run\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810335 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-var-lib-openvswitch\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810246 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7e1c0e0d-ba91-42c9-87ed-31b04d107dfa-serviceca\") pod \"node-ca-wtshb\" (UID: \"7e1c0e0d-ba91-42c9-87ed-31b04d107dfa\") " pod="openshift-image-registry/node-ca-wtshb" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810375 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-cni-bin\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810402 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06fa4c27-9487-4d5d-8675-e6fed12c972a-os-release\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06fa4c27-9487-4d5d-8675-e6fed12c972a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-host\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810478 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30048d20-4691-4de9-8a59-6a29d363f4e0-env-overrides\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99950e12-9739-4b46-a978-b8aceafc3484-hosts-file\") pod \"node-resolver-6lbfr\" (UID: \"99950e12-9739-4b46-a978-b8aceafc3484\") " pod="openshift-dns/node-resolver-6lbfr" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810557 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9602554f-7ebe-403d-aefc-2a740e24f9d0-multus-daemon-config\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810563 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-host\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.811637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810592 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-cni-bin\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-var-lib-kubelet\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810624 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7e1c0e0d-ba91-42c9-87ed-31b04d107dfa-serviceca\") pod \"node-ca-wtshb\" (UID: \"7e1c0e0d-ba91-42c9-87ed-31b04d107dfa\") " pod="openshift-image-registry/node-ca-wtshb" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810642 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99950e12-9739-4b46-a978-b8aceafc3484-hosts-file\") pod \"node-resolver-6lbfr\" (UID: \"99950e12-9739-4b46-a978-b8aceafc3484\") " pod="openshift-dns/node-resolver-6lbfr" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810679 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-multus-cni-dir\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810713 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb9f9763-1893-4702-83d8-03aac0193330-iptables-alerter-script\") pod \"iptables-alerter-vrz79\" (UID: \"eb9f9763-1893-4702-83d8-03aac0193330\") " pod="openshift-network-operator/iptables-alerter-vrz79" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810717 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-var-lib-kubelet\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810753 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9602554f-7ebe-403d-aefc-2a740e24f9d0-cni-binary-copy\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810784 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-multus-cni-dir\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810825 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-hostroot\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810849 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-etc-kubernetes\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810875 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e4699105-7209-4d5f-817c-189575d43ae0-agent-certs\") pod \"konnectivity-agent-scnvp\" (UID: \"e4699105-7209-4d5f-817c-189575d43ae0\") " pod="kube-system/konnectivity-agent-scnvp" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810910 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30048d20-4691-4de9-8a59-6a29d363f4e0-env-overrides\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810928 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-etc-kubernetes\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30048d20-4691-4de9-8a59-6a29d363f4e0-ovnkube-config\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810967 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-hostroot\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.810998 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811139 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd7wt\" (UniqueName: \"kubernetes.io/projected/2620eb52-f1c4-4e87-a859-58ee881785e8-kube-api-access-xd7wt\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.812491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811167 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-run-systemd\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:07.811176 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811193 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-node-log\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-log-socket\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:07.811234 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret podName:c691a532-4b73-4518-8158-cfebdbafdbea nodeName:}" failed. No retries permitted until 2026-06-13 01:11:08.311217321 +0000 UTC m=+2.982617143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret") pod "global-pull-secret-syncer-ddhc4" (UID: "c691a532-4b73-4518-8158-cfebdbafdbea") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811253 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-log-socket\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811258 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c691a532-4b73-4518-8158-cfebdbafdbea-dbus\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb9f9763-1893-4702-83d8-03aac0193330-host-slash\") pod \"iptables-alerter-vrz79\" (UID: \"eb9f9763-1893-4702-83d8-03aac0193330\") " pod="openshift-network-operator/iptables-alerter-vrz79" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811301 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9602554f-7ebe-403d-aefc-2a740e24f9d0-cni-binary-copy\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811310 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-os-release\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811311 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-node-log\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811338 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-run-netns\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-multus-conf-dir\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811369 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb9f9763-1893-4702-83d8-03aac0193330-host-slash\") pod \"iptables-alerter-vrz79\" (UID: \"eb9f9763-1893-4702-83d8-03aac0193330\") " pod="openshift-network-operator/iptables-alerter-vrz79" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811405 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-kubelet\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811415 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-run-systemd\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811427 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30048d20-4691-4de9-8a59-6a29d363f4e0-ovnkube-config\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811429 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-slash\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811467 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-etc-openvswitch\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811473 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-multus-conf-dir\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811480 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c691a532-4b73-4518-8158-cfebdbafdbea-dbus\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811473 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-slash\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811486 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-os-release\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811496 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-run-netns\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811514 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-etc-openvswitch\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811504 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811531 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-kubelet\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30048d20-4691-4de9-8a59-6a29d363f4e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811569 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e4699105-7209-4d5f-817c-189575d43ae0-konnectivity-ca\") pod \"konnectivity-agent-scnvp\" (UID: \"e4699105-7209-4d5f-817c-189575d43ae0\") " pod="kube-system/konnectivity-agent-scnvp" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-socket-dir\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-sys-fs\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-sysctl-conf\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811697 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-system-cni-dir\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811722 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss8m9\" (UniqueName: \"kubernetes.io/projected/30048d20-4691-4de9-8a59-6a29d363f4e0-kube-api-access-ss8m9\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99950e12-9739-4b46-a978-b8aceafc3484-tmp-dir\") pod \"node-resolver-6lbfr\" (UID: \"99950e12-9739-4b46-a978-b8aceafc3484\") " pod="openshift-dns/node-resolver-6lbfr" Jun 13 01:11:07.813983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811763 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-sys-fs\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06fa4c27-9487-4d5d-8675-e6fed12c972a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811797 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-run-multus-certs\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811823 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-sysctl-d\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811839 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-sysctl-conf\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811722 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20a1c119-db29-439b-b40a-788a1a1779d1-socket-dir\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811845 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-lib-modules\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811940 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-host-run-multus-certs\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.811999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9602554f-7ebe-403d-aefc-2a740e24f9d0-system-cni-dir\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.812044 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-sysctl-d\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.812093 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2620eb52-f1c4-4e87-a859-58ee881785e8-lib-modules\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.812109 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99950e12-9739-4b46-a978-b8aceafc3484-tmp-dir\") pod \"node-resolver-6lbfr\" (UID: \"99950e12-9739-4b46-a978-b8aceafc3484\") " pod="openshift-dns/node-resolver-6lbfr" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.812161 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e4699105-7209-4d5f-817c-189575d43ae0-konnectivity-ca\") pod \"konnectivity-agent-scnvp\" (UID: \"e4699105-7209-4d5f-817c-189575d43ae0\") " pod="kube-system/konnectivity-agent-scnvp" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.812763 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2620eb52-f1c4-4e87-a859-58ee881785e8-etc-tuned\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.813192 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2620eb52-f1c4-4e87-a859-58ee881785e8-tmp\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.813423 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30048d20-4691-4de9-8a59-6a29d363f4e0-ovn-node-metrics-cert\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.814581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.813430 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e4699105-7209-4d5f-817c-189575d43ae0-agent-certs\") pod \"konnectivity-agent-scnvp\" (UID: \"e4699105-7209-4d5f-817c-189575d43ae0\") " pod="kube-system/konnectivity-agent-scnvp" Jun 13 01:11:07.835471 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.835444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr72z\" (UniqueName: \"kubernetes.io/projected/eb9f9763-1893-4702-83d8-03aac0193330-kube-api-access-jr72z\") pod \"iptables-alerter-vrz79\" (UID: \"eb9f9763-1893-4702-83d8-03aac0193330\") " pod="openshift-network-operator/iptables-alerter-vrz79" Jun 13 01:11:07.842171 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.842143 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd7wt\" (UniqueName: \"kubernetes.io/projected/2620eb52-f1c4-4e87-a859-58ee881785e8-kube-api-access-xd7wt\") pod \"tuned-jfv49\" (UID: \"2620eb52-f1c4-4e87-a859-58ee881785e8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:07.842545 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.842524 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cjj2\" (UniqueName: \"kubernetes.io/projected/20a1c119-db29-439b-b40a-788a1a1779d1-kube-api-access-2cjj2\") pod \"aws-ebs-csi-driver-node-r52t4\" (UID: \"20a1c119-db29-439b-b40a-788a1a1779d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:07.846864 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.846844 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj8fh\" (UniqueName: \"kubernetes.io/projected/99950e12-9739-4b46-a978-b8aceafc3484-kube-api-access-gj8fh\") pod \"node-resolver-6lbfr\" (UID: \"99950e12-9739-4b46-a978-b8aceafc3484\") " pod="openshift-dns/node-resolver-6lbfr" Jun 13 01:11:07.850403 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.850371 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq5ql\" (UniqueName: \"kubernetes.io/projected/3e747bdd-f2b9-467c-b520-103a6c772f14-kube-api-access-zq5ql\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:07.850497 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:07.850396 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:07.850497 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:07.850442 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:07.850497 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:07.850463 2574 projected.go:196] Error preparing data for projected volume kube-api-access-spvgz for pod openshift-network-diagnostics/network-check-target-bjddg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:07.850620 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:07.850544 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz podName:32cc2ce4-eb79-4a14-85b8-553b843e8f02 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:08.350526768 +0000 UTC m=+3.021926584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-spvgz" (UniqueName: "kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz") pod "network-check-target-bjddg" (UID: "32cc2ce4-eb79-4a14-85b8-553b843e8f02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:07.852191 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.852173 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss8m9\" (UniqueName: \"kubernetes.io/projected/30048d20-4691-4de9-8a59-6a29d363f4e0-kube-api-access-ss8m9\") pod \"ovnkube-node-4t9pm\" (UID: \"30048d20-4691-4de9-8a59-6a29d363f4e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:07.855419 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.855399 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54r8k\" (UniqueName: \"kubernetes.io/projected/7e1c0e0d-ba91-42c9-87ed-31b04d107dfa-kube-api-access-54r8k\") pod \"node-ca-wtshb\" (UID: \"7e1c0e0d-ba91-42c9-87ed-31b04d107dfa\") " pod="openshift-image-registry/node-ca-wtshb" Jun 13 01:11:07.863540 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.863520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rzzw\" (UniqueName: \"kubernetes.io/projected/9602554f-7ebe-403d-aefc-2a740e24f9d0-kube-api-access-8rzzw\") pod \"multus-tqkdp\" (UID: \"9602554f-7ebe-403d-aefc-2a740e24f9d0\") " pod="openshift-multus/multus-tqkdp" Jun 13 01:11:07.912780 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.912730 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06fa4c27-9487-4d5d-8675-e6fed12c972a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.912964 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.912794 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06fa4c27-9487-4d5d-8675-e6fed12c972a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.912964 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.912835 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06fa4c27-9487-4d5d-8675-e6fed12c972a-system-cni-dir\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.912964 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.912866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06fa4c27-9487-4d5d-8675-e6fed12c972a-cni-binary-copy\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.912964 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.912890 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06fa4c27-9487-4d5d-8675-e6fed12c972a-cnibin\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.912964 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.912913 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vw4v\" (UniqueName: \"kubernetes.io/projected/06fa4c27-9487-4d5d-8675-e6fed12c972a-kube-api-access-4vw4v\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.912964 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.912948 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06fa4c27-9487-4d5d-8675-e6fed12c972a-os-release\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.913244 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.912986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06fa4c27-9487-4d5d-8675-e6fed12c972a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.913244 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.913058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06fa4c27-9487-4d5d-8675-e6fed12c972a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.913244 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.913136 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06fa4c27-9487-4d5d-8675-e6fed12c972a-cnibin\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.913244 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.913177 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06fa4c27-9487-4d5d-8675-e6fed12c972a-system-cni-dir\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.913450 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.913428 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06fa4c27-9487-4d5d-8675-e6fed12c972a-os-release\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.913512 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.913455 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06fa4c27-9487-4d5d-8675-e6fed12c972a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.913618 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.913599 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06fa4c27-9487-4d5d-8675-e6fed12c972a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.913618 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.913612 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06fa4c27-9487-4d5d-8675-e6fed12c972a-cni-binary-copy\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.932296 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.932220 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vw4v\" (UniqueName: \"kubernetes.io/projected/06fa4c27-9487-4d5d-8675-e6fed12c972a-kube-api-access-4vw4v\") pod \"multus-additional-cni-plugins-tktw8\" (UID: \"06fa4c27-9487-4d5d-8675-e6fed12c972a\") " pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:07.994205 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:07.994168 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6lbfr" Jun 13 01:11:08.000831 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.000807 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-scnvp" Jun 13 01:11:08.011048 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.011023 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vrz79" Jun 13 01:11:08.018339 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.018313 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wtshb" Jun 13 01:11:08.026293 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.026275 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" Jun 13 01:11:08.035136 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.034931 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jfv49" Jun 13 01:11:08.040589 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.040565 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tqkdp" Jun 13 01:11:08.047537 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.047513 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:08.051575 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.051557 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tktw8" Jun 13 01:11:08.161209 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.161177 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:11:08.315401 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.315316 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:08.315401 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.315372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:08.315621 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:08.315479 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:08.315621 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:08.315486 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:08.315621 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:08.315529 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret podName:c691a532-4b73-4518-8158-cfebdbafdbea nodeName:}" failed. No retries permitted until 2026-06-13 01:11:09.315515223 +0000 UTC m=+3.986915039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret") pod "global-pull-secret-syncer-ddhc4" (UID: "c691a532-4b73-4518-8158-cfebdbafdbea") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:08.315621 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:08.315547 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs podName:3e747bdd-f2b9-467c-b520-103a6c772f14 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:09.315537909 +0000 UTC m=+3.986937737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs") pod "network-metrics-daemon-h48sb" (UID: "3e747bdd-f2b9-467c-b520-103a6c772f14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:08.416643 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.416612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvgz\" (UniqueName: \"kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz\") pod \"network-check-target-bjddg\" (UID: \"32cc2ce4-eb79-4a14-85b8-553b843e8f02\") " pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:08.416836 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:08.416818 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:08.416890 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:08.416843 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:08.416890 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:08.416854 2574 projected.go:196] Error preparing data for projected volume kube-api-access-spvgz for pod openshift-network-diagnostics/network-check-target-bjddg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:08.417011 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:08.416912 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz podName:32cc2ce4-eb79-4a14-85b8-553b843e8f02 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:09.41689859 +0000 UTC m=+4.088298406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-spvgz" (UniqueName: "kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz") pod "network-check-target-bjddg" (UID: "32cc2ce4-eb79-4a14-85b8-553b843e8f02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:08.583253 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:08.583221 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99950e12_9739_4b46_a978_b8aceafc3484.slice/crio-a2c8c5af9891df3a2fe35f3edfb2f2a2fc2944adcf0365914f88c7625a82d7d8 WatchSource:0}: Error finding container a2c8c5af9891df3a2fe35f3edfb2f2a2fc2944adcf0365914f88c7625a82d7d8: Status 404 returned error can't find the container with id a2c8c5af9891df3a2fe35f3edfb2f2a2fc2944adcf0365914f88c7625a82d7d8 Jun 13 01:11:08.584872 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:08.584847 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9602554f_7ebe_403d_aefc_2a740e24f9d0.slice/crio-4354edb6ec23f8c5dc092d20a4bdb587ce693b0f2f996e385e92b49b5c5b9c20 WatchSource:0}: Error finding container 4354edb6ec23f8c5dc092d20a4bdb587ce693b0f2f996e385e92b49b5c5b9c20: Status 404 returned error can't find the container with id 4354edb6ec23f8c5dc092d20a4bdb587ce693b0f2f996e385e92b49b5c5b9c20 Jun 13 01:11:08.585621 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:08.585533 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9f9763_1893_4702_83d8_03aac0193330.slice/crio-200bf551b680e4a7b07ccdce0dff205b78ccaabe913ede89be31dc04dd4f8ffd WatchSource:0}: Error finding container 200bf551b680e4a7b07ccdce0dff205b78ccaabe913ede89be31dc04dd4f8ffd: Status 404 returned error can't find the container with id 200bf551b680e4a7b07ccdce0dff205b78ccaabe913ede89be31dc04dd4f8ffd Jun 13 01:11:08.588416 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:08.588399 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1c0e0d_ba91_42c9_87ed_31b04d107dfa.slice/crio-1d17d3f305e5790df6f4177842aff8a34c5dfe9a194f572727136f673c8b304a WatchSource:0}: Error finding container 1d17d3f305e5790df6f4177842aff8a34c5dfe9a194f572727136f673c8b304a: Status 404 returned error can't find the container with id 1d17d3f305e5790df6f4177842aff8a34c5dfe9a194f572727136f673c8b304a Jun 13 01:11:08.588981 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:08.588961 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2620eb52_f1c4_4e87_a859_58ee881785e8.slice/crio-86dcbe4bbd1a88637816d2d85a928f8bad5f1b8960d1bd939dca27d8ea1894c8 WatchSource:0}: Error finding container 86dcbe4bbd1a88637816d2d85a928f8bad5f1b8960d1bd939dca27d8ea1894c8: Status 404 returned error can't find the container with id 86dcbe4bbd1a88637816d2d85a928f8bad5f1b8960d1bd939dca27d8ea1894c8 Jun 13 01:11:08.590472 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:08.590460 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30048d20_4691_4de9_8a59_6a29d363f4e0.slice/crio-9b79a9529e900b7d3671469d859dc64e8a77e2e33d9b9ae8b488d051790e4516 WatchSource:0}: Error finding container 9b79a9529e900b7d3671469d859dc64e8a77e2e33d9b9ae8b488d051790e4516: Status 404 returned error can't find the container with id 9b79a9529e900b7d3671469d859dc64e8a77e2e33d9b9ae8b488d051790e4516 Jun 13 01:11:08.592241 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:08.592066 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4699105_7209_4d5f_817c_189575d43ae0.slice/crio-2ba329aab8bcb6fc6178e067c49eab65792ce77fa3d5f562cd2223d6bfc87a63 WatchSource:0}: Error finding container 2ba329aab8bcb6fc6178e067c49eab65792ce77fa3d5f562cd2223d6bfc87a63: Status 404 returned error can't find the container with id 2ba329aab8bcb6fc6178e067c49eab65792ce77fa3d5f562cd2223d6bfc87a63 Jun 13 01:11:08.592779 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:08.592681 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06fa4c27_9487_4d5d_8675_e6fed12c972a.slice/crio-f8efa10ff31f1ed36d84d93ce2430389d3fc8900ab3b47136a047f0b52c2ee24 WatchSource:0}: Error finding container f8efa10ff31f1ed36d84d93ce2430389d3fc8900ab3b47136a047f0b52c2ee24: Status 404 returned error can't find the container with id f8efa10ff31f1ed36d84d93ce2430389d3fc8900ab3b47136a047f0b52c2ee24 Jun 13 01:11:08.593692 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:08.593658 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a1c119_db29_439b_b40a_788a1a1779d1.slice/crio-c64fb735e40e1b7c747f7d5d9b4cc7922f28ce737a44670bf40357c432d3264f WatchSource:0}: Error finding container c64fb735e40e1b7c747f7d5d9b4cc7922f28ce737a44670bf40357c432d3264f: Status 404 returned error can't find the container with id c64fb735e40e1b7c747f7d5d9b4cc7922f28ce737a44670bf40357c432d3264f Jun 13 01:11:08.738095 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.737853 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 01:06:06 +0000 UTC" deadline="2027-11-16 11:55:19.006551401 +0000 UTC" Jun 13 01:11:08.738095 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.738095 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12514h44m10.268462249s" Jun 13 01:11:08.764709 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.764682 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tqkdp" event={"ID":"9602554f-7ebe-403d-aefc-2a740e24f9d0","Type":"ContainerStarted","Data":"4354edb6ec23f8c5dc092d20a4bdb587ce693b0f2f996e385e92b49b5c5b9c20"} Jun 13 01:11:08.766872 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.766847 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktw8" event={"ID":"06fa4c27-9487-4d5d-8675-e6fed12c972a","Type":"ContainerStarted","Data":"f8efa10ff31f1ed36d84d93ce2430389d3fc8900ab3b47136a047f0b52c2ee24"} Jun 13 01:11:08.768774 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.768744 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" event={"ID":"30048d20-4691-4de9-8a59-6a29d363f4e0","Type":"ContainerStarted","Data":"9b79a9529e900b7d3671469d859dc64e8a77e2e33d9b9ae8b488d051790e4516"} Jun 13 01:11:08.769691 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.769668 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wtshb" event={"ID":"7e1c0e0d-ba91-42c9-87ed-31b04d107dfa","Type":"ContainerStarted","Data":"1d17d3f305e5790df6f4177842aff8a34c5dfe9a194f572727136f673c8b304a"} Jun 13 01:11:08.770786 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.770763 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6lbfr" event={"ID":"99950e12-9739-4b46-a978-b8aceafc3484","Type":"ContainerStarted","Data":"a2c8c5af9891df3a2fe35f3edfb2f2a2fc2944adcf0365914f88c7625a82d7d8"} Jun 13 01:11:08.772549 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.772525 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" event={"ID":"5d79c6332bb546fa2ad596ee51ac7514","Type":"ContainerStarted","Data":"2462b449ac990aec8ada2aada2cb8e0670ae726a2eb2fd9d5f558eda58273e1f"} Jun 13 01:11:08.773657 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.773635 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jfv49" event={"ID":"2620eb52-f1c4-4e87-a859-58ee881785e8","Type":"ContainerStarted","Data":"86dcbe4bbd1a88637816d2d85a928f8bad5f1b8960d1bd939dca27d8ea1894c8"} Jun 13 01:11:08.775448 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.775428 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" event={"ID":"20a1c119-db29-439b-b40a-788a1a1779d1","Type":"ContainerStarted","Data":"c64fb735e40e1b7c747f7d5d9b4cc7922f28ce737a44670bf40357c432d3264f"} Jun 13 01:11:08.776869 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.776843 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-scnvp" event={"ID":"e4699105-7209-4d5f-817c-189575d43ae0","Type":"ContainerStarted","Data":"2ba329aab8bcb6fc6178e067c49eab65792ce77fa3d5f562cd2223d6bfc87a63"} Jun 13 01:11:08.778645 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.778619 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vrz79" event={"ID":"eb9f9763-1893-4702-83d8-03aac0193330","Type":"ContainerStarted","Data":"200bf551b680e4a7b07ccdce0dff205b78ccaabe913ede89be31dc04dd4f8ffd"} Jun 13 01:11:08.794621 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:08.794585 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" podStartSLOduration=2.7945729459999997 podStartE2EDuration="2.794572946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:08.794007502 +0000 UTC m=+3.465407341" watchObservedRunningTime="2026-06-13 01:11:08.794572946 +0000 UTC m=+3.465972781" Jun 13 01:11:09.327175 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:09.327141 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:09.327371 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:09.327215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:09.327443 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:09.327411 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:09.327443 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:09.327437 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:09.327540 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:09.327491 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret podName:c691a532-4b73-4518-8158-cfebdbafdbea nodeName:}" failed. No retries permitted until 2026-06-13 01:11:11.327470334 +0000 UTC m=+5.998870165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret") pod "global-pull-secret-syncer-ddhc4" (UID: "c691a532-4b73-4518-8158-cfebdbafdbea") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:09.327540 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:09.327512 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs podName:3e747bdd-f2b9-467c-b520-103a6c772f14 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:11.327500209 +0000 UTC m=+5.998900028 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs") pod "network-metrics-daemon-h48sb" (UID: "3e747bdd-f2b9-467c-b520-103a6c772f14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:09.429018 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:09.428428 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvgz\" (UniqueName: \"kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz\") pod \"network-check-target-bjddg\" (UID: \"32cc2ce4-eb79-4a14-85b8-553b843e8f02\") " pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:09.429018 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:09.428591 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:09.429018 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:09.428611 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:09.429018 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:09.428623 2574 projected.go:196] Error preparing data for projected volume kube-api-access-spvgz for pod openshift-network-diagnostics/network-check-target-bjddg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:09.429018 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:09.428680 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz podName:32cc2ce4-eb79-4a14-85b8-553b843e8f02 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:11.428662754 +0000 UTC m=+6.100062575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-spvgz" (UniqueName: "kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz") pod "network-check-target-bjddg" (UID: "32cc2ce4-eb79-4a14-85b8-553b843e8f02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:09.759499 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:09.759432 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:09.759905 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:09.759588 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:09.760076 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:09.760057 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:09.760208 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:09.760186 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:09.760604 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:09.760585 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:09.760705 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:09.760685 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:09.790714 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:09.790674 2574 generic.go:356] "Generic (PLEG): container finished" podID="5013d1eb9715c51d401b1dcfe0f89d24" containerID="298750bc2170c441b2daf64245c53228fb4778f44e77f1d07ccbafd5ed2c1a2c" exitCode=0 Jun 13 01:11:09.791347 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:09.791211 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" event={"ID":"5013d1eb9715c51d401b1dcfe0f89d24","Type":"ContainerDied","Data":"298750bc2170c441b2daf64245c53228fb4778f44e77f1d07ccbafd5ed2c1a2c"} Jun 13 01:11:10.798419 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:10.798377 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" event={"ID":"5013d1eb9715c51d401b1dcfe0f89d24","Type":"ContainerStarted","Data":"c4ddea1fcfd8c002d76e143ddd1101650549d07551db238fc1e9b90a9bb50f81"} Jun 13 01:11:10.820737 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:10.820677 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" podStartSLOduration=4.820656741 podStartE2EDuration="4.820656741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:10.819967665 +0000 UTC m=+5.491367506" watchObservedRunningTime="2026-06-13 01:11:10.820656741 +0000 UTC m=+5.492056584" Jun 13 01:11:11.347352 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:11.347283 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:11.347352 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:11.347353 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:11.347578 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:11.347476 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:11.347578 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:11.347536 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs podName:3e747bdd-f2b9-467c-b520-103a6c772f14 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:15.347517164 +0000 UTC m=+10.018916987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs") pod "network-metrics-daemon-h48sb" (UID: "3e747bdd-f2b9-467c-b520-103a6c772f14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:11.347922 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:11.347901 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:11.348000 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:11.347957 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret podName:c691a532-4b73-4518-8158-cfebdbafdbea nodeName:}" failed. No retries permitted until 2026-06-13 01:11:15.347942315 +0000 UTC m=+10.019342145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret") pod "global-pull-secret-syncer-ddhc4" (UID: "c691a532-4b73-4518-8158-cfebdbafdbea") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:11.448625 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:11.447956 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvgz\" (UniqueName: \"kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz\") pod \"network-check-target-bjddg\" (UID: \"32cc2ce4-eb79-4a14-85b8-553b843e8f02\") " pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:11.448625 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:11.448190 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:11.448625 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:11.448212 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:11.448625 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:11.448226 2574 projected.go:196] Error preparing data for projected volume kube-api-access-spvgz for pod openshift-network-diagnostics/network-check-target-bjddg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:11.448625 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:11.448286 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz podName:32cc2ce4-eb79-4a14-85b8-553b843e8f02 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:15.448267324 +0000 UTC m=+10.119667146 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-spvgz" (UniqueName: "kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz") pod "network-check-target-bjddg" (UID: "32cc2ce4-eb79-4a14-85b8-553b843e8f02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:11.758180 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:11.757225 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:11.758180 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:11.757352 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:11.758180 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:11.757699 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:11.758180 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:11.757792 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:11.758180 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:11.757848 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:11.758180 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:11.757998 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:13.757032 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:13.756965 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:13.757514 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:13.757097 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:13.757514 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:13.757490 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:13.757630 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:13.757598 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:13.757690 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:13.757647 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:13.757738 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:13.757720 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:15.383622 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:15.383571 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:15.384079 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:15.383659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:15.384079 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:15.383790 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:15.384079 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:15.383851 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret podName:c691a532-4b73-4518-8158-cfebdbafdbea nodeName:}" failed. No retries permitted until 2026-06-13 01:11:23.383831862 +0000 UTC m=+18.055231679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret") pod "global-pull-secret-syncer-ddhc4" (UID: "c691a532-4b73-4518-8158-cfebdbafdbea") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:15.384425 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:15.384302 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:15.384425 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:15.384366 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs podName:3e747bdd-f2b9-467c-b520-103a6c772f14 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:23.384349335 +0000 UTC m=+18.055749155 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs") pod "network-metrics-daemon-h48sb" (UID: "3e747bdd-f2b9-467c-b520-103a6c772f14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:15.484959 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:15.484921 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvgz\" (UniqueName: \"kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz\") pod \"network-check-target-bjddg\" (UID: \"32cc2ce4-eb79-4a14-85b8-553b843e8f02\") " pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:15.485140 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:15.485099 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:15.485197 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:15.485155 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:15.485197 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:15.485171 2574 projected.go:196] Error preparing data for projected volume kube-api-access-spvgz for pod openshift-network-diagnostics/network-check-target-bjddg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:15.485291 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:15.485239 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz podName:32cc2ce4-eb79-4a14-85b8-553b843e8f02 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:23.485219231 +0000 UTC m=+18.156619057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-spvgz" (UniqueName: "kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz") pod "network-check-target-bjddg" (UID: "32cc2ce4-eb79-4a14-85b8-553b843e8f02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:15.761259 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:15.760667 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:15.761259 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:15.760787 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:15.761512 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:15.761487 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:15.761808 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:15.761616 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:15.761808 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:15.761654 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:15.761808 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:15.761759 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:17.757179 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:17.757145 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:17.757636 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:17.757278 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:17.757712 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:17.757663 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:17.757810 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:17.757769 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:17.757873 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:17.757823 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:17.757930 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:17.757894 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:19.757070 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:19.757016 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:19.757070 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:19.757071 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:19.757583 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:19.757022 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:19.757583 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:19.757170 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:19.757583 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:19.757282 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:19.757583 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:19.757402 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:21.757308 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:21.757259 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:21.757778 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:21.757261 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:21.757778 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:21.757386 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:21.757778 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:21.757446 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:21.757778 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:21.757262 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:21.757778 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:21.757537 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:23.444174 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:23.444126 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:23.444658 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:23.444209 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:23.444658 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:23.444244 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:23.444658 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:23.444302 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:23.444658 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:23.444325 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret podName:c691a532-4b73-4518-8158-cfebdbafdbea nodeName:}" failed. No retries permitted until 2026-06-13 01:11:39.444303571 +0000 UTC m=+34.115703403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret") pod "global-pull-secret-syncer-ddhc4" (UID: "c691a532-4b73-4518-8158-cfebdbafdbea") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:23.444658 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:23.444363 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs podName:3e747bdd-f2b9-467c-b520-103a6c772f14 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:39.444346462 +0000 UTC m=+34.115746297 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs") pod "network-metrics-daemon-h48sb" (UID: "3e747bdd-f2b9-467c-b520-103a6c772f14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:23.545595 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:23.545559 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvgz\" (UniqueName: \"kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz\") pod \"network-check-target-bjddg\" (UID: \"32cc2ce4-eb79-4a14-85b8-553b843e8f02\") " pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:23.545782 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:23.545760 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:23.545842 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:23.545786 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:23.545842 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:23.545798 2574 projected.go:196] Error preparing data for projected volume kube-api-access-spvgz for pod openshift-network-diagnostics/network-check-target-bjddg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:23.545952 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:23.545854 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz podName:32cc2ce4-eb79-4a14-85b8-553b843e8f02 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:39.545835435 +0000 UTC m=+34.217235251 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-spvgz" (UniqueName: "kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz") pod "network-check-target-bjddg" (UID: "32cc2ce4-eb79-4a14-85b8-553b843e8f02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:23.757248 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:23.757168 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:23.757248 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:23.757207 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:23.757561 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:23.757168 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:23.757561 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:23.757311 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:23.757561 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:23.757385 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:23.757561 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:23.757485 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:25.757978 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:25.757952 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:25.758447 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:25.758049 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:25.758447 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:25.758106 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:25.758447 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:25.758212 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:25.758447 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:25.758237 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:25.758447 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:25.758285 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:27.757078 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.756955 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:27.757677 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.756957 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:27.757677 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.757000 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:27.757677 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:27.757217 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:27.757677 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:27.757326 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:27.757677 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:27.757426 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:27.838873 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.838843 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tqkdp" event={"ID":"9602554f-7ebe-403d-aefc-2a740e24f9d0","Type":"ContainerStarted","Data":"2191de9e1dc768891a99c405f97f1ddde20e6280f55e079aa86a2e9576f5e0a7"} Jun 13 01:11:27.840657 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.840614 2574 generic.go:356] "Generic (PLEG): container finished" podID="06fa4c27-9487-4d5d-8675-e6fed12c972a" containerID="31e721d9204b24ec5e03ad73d6d66cfea97e5ea617a28e0768905bcb6bdb0cb2" exitCode=0 Jun 13 01:11:27.840739 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.840649 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktw8" event={"ID":"06fa4c27-9487-4d5d-8675-e6fed12c972a","Type":"ContainerDied","Data":"31e721d9204b24ec5e03ad73d6d66cfea97e5ea617a28e0768905bcb6bdb0cb2"} Jun 13 01:11:27.846017 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.845996 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:11:27.846484 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.846404 2574 generic.go:356] "Generic (PLEG): container finished" podID="30048d20-4691-4de9-8a59-6a29d363f4e0" containerID="70cef0d3b6e99664d38698b5f478b6e6833a4bd76fb94a709f0c1f438ece27bb" exitCode=1 Jun 13 01:11:27.846484 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.846427 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" event={"ID":"30048d20-4691-4de9-8a59-6a29d363f4e0","Type":"ContainerStarted","Data":"90381a5c05def7050100edfa327eed31cd29fb8edb1db71ddd0d24b04aedc226"} Jun 13 01:11:27.846639 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.846495 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" event={"ID":"30048d20-4691-4de9-8a59-6a29d363f4e0","Type":"ContainerStarted","Data":"7eee1bc87db4f0358b3e9eba23587341e94e392a048310bb9acea1253ae89991"} Jun 13 01:11:27.846639 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.846545 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" event={"ID":"30048d20-4691-4de9-8a59-6a29d363f4e0","Type":"ContainerStarted","Data":"11b12a067743d7eb536f16fff934e48b4755dd6bb9ffc0ac2f923488f1a3e929"} Jun 13 01:11:27.846639 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.846592 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" event={"ID":"30048d20-4691-4de9-8a59-6a29d363f4e0","Type":"ContainerDied","Data":"70cef0d3b6e99664d38698b5f478b6e6833a4bd76fb94a709f0c1f438ece27bb"} Jun 13 01:11:27.846791 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.846643 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" event={"ID":"30048d20-4691-4de9-8a59-6a29d363f4e0","Type":"ContainerStarted","Data":"372368d0e80f062fd2ae84b4af59dfa4831084548e470500c749ceac931da8e9"} Jun 13 01:11:27.848811 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.848786 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wtshb" event={"ID":"7e1c0e0d-ba91-42c9-87ed-31b04d107dfa","Type":"ContainerStarted","Data":"5de775dc33fe122e5611cda1a0bfdf87d4a83755151a06a0e38eebec9b2f13e4"} Jun 13 01:11:27.850332 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.850312 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6lbfr" event={"ID":"99950e12-9739-4b46-a978-b8aceafc3484","Type":"ContainerStarted","Data":"f9d97c524f1439ecadbf3b962da3a7025dac45190236f46c20343122cdcfbf74"} Jun 13 01:11:27.851864 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.851844 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jfv49" event={"ID":"2620eb52-f1c4-4e87-a859-58ee881785e8","Type":"ContainerStarted","Data":"95b1028c133e3c086c328d1632eec92c813fd8c2c69abe824160f60dc61b17ee"} Jun 13 01:11:27.853329 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.853305 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" event={"ID":"20a1c119-db29-439b-b40a-788a1a1779d1","Type":"ContainerStarted","Data":"10a62208a236f37dc7007cb2eeee8e352a7de9fc6dea55f891858b4c6e9921c2"} Jun 13 01:11:27.854773 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.854750 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-scnvp" event={"ID":"e4699105-7209-4d5f-817c-189575d43ae0","Type":"ContainerStarted","Data":"651a329ea0cf70cbe0b46ffdf218331c1ee2fc0156ae3c85aeebef68167e4f5c"} Jun 13 01:11:27.877848 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.877724 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tqkdp" podStartSLOduration=4.343693772 podStartE2EDuration="22.877710476s" totalImagesPullingTime="18.534016704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:27.859624334 +0000 UTC m=+22.531024173" watchObservedRunningTime="2026-06-13 01:11:27.877710476 +0000 UTC m=+22.549110296" Jun 13 01:11:27.878291 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.878263 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-scnvp" podStartSLOduration=4.823285423 podStartE2EDuration="22.87825286s" totalImagesPullingTime="18.054967437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:27.87777488 +0000 UTC m=+22.549174708" watchObservedRunningTime="2026-06-13 01:11:27.87825286 +0000 UTC m=+22.549652698" Jun 13 01:11:27.914517 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.914458 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6lbfr" podStartSLOduration=4.440592121 podStartE2EDuration="22.91444258s" totalImagesPullingTime="18.473850459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:27.914135019 +0000 UTC m=+22.585534854" watchObservedRunningTime="2026-06-13 01:11:27.91444258 +0000 UTC m=+22.585842418" Jun 13 01:11:27.928908 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.928844 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wtshb" podStartSLOduration=4.45983305 podStartE2EDuration="22.928826041s" totalImagesPullingTime="18.468992991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:27.928788198 +0000 UTC m=+22.600188036" watchObservedRunningTime="2026-06-13 01:11:27.928826041 +0000 UTC m=+22.600225862" Jun 13 01:11:27.950922 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:27.950869 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jfv49" podStartSLOduration=4.420949413 podStartE2EDuration="22.950852821s" totalImagesPullingTime="18.529903408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:27.950372982 +0000 UTC m=+22.621772823" watchObservedRunningTime="2026-06-13 01:11:27.950852821 +0000 UTC m=+22.622252658" Jun 13 01:11:28.036090 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:28.036060 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-scnvp_e4699105-7209-4d5f-817c-189575d43ae0/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:28.681264 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:28.681218 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 13 01:11:28.761496 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:28.761329 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-13T01:11:28.681239873Z","UUID":"bab43bbb-d552-4487-80f3-291496d0f29a","Handler":null,"Name":"","Endpoint":""} Jun 13 01:11:28.763013 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:28.762989 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 13 01:11:28.763177 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:28.763020 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 13 01:11:28.860621 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:28.860593 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:11:28.861029 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:28.861002 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" event={"ID":"30048d20-4691-4de9-8a59-6a29d363f4e0","Type":"ContainerStarted","Data":"98e9a3bf7ce7b6a18c22da1933742ef602e4cbef6b253d3372a2b92ad90f0b58"} Jun 13 01:11:28.862993 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:28.862967 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" event={"ID":"20a1c119-db29-439b-b40a-788a1a1779d1","Type":"ContainerStarted","Data":"0cdb31ca837e13958358f4271c29e5257f98614fba6f7d50d7e68e8678d7eebf"} Jun 13 01:11:28.866026 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:28.865966 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vrz79" event={"ID":"eb9f9763-1893-4702-83d8-03aac0193330","Type":"ContainerStarted","Data":"46104489eda143f49f148ee71f7e386b63243ca9862a557f777fc9612d3c3fe2"} Jun 13 01:11:29.757486 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:29.757267 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:29.757646 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:29.757267 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:29.757646 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:29.757614 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:29.757758 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:29.757271 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:29.757758 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:29.757683 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:29.757758 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:29.757743 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:29.870245 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:29.870205 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" event={"ID":"20a1c119-db29-439b-b40a-788a1a1779d1","Type":"ContainerStarted","Data":"d739c210dfbe7707bdc7c380a378bb62a489d138697cb988ca78e91545a88ea1"} Jun 13 01:11:29.889664 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:29.889608 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vrz79" podStartSLOduration=6.352359606 podStartE2EDuration="24.889586231s" totalImagesPullingTime="18.537226625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:28.883982367 +0000 UTC m=+23.555382206" watchObservedRunningTime="2026-06-13 01:11:29.889586231 +0000 UTC m=+24.560986126" Jun 13 01:11:29.889835 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:29.889736 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52t4" podStartSLOduration=4.282552267 podStartE2EDuration="24.889728372s" totalImagesPullingTime="20.607176105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:29.889249365 +0000 UTC m=+24.560649203" watchObservedRunningTime="2026-06-13 01:11:29.889728372 +0000 UTC m=+24.561128212" Jun 13 01:11:30.020526 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:30.020484 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-scnvp" Jun 13 01:11:30.021246 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:30.021219 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-scnvp" Jun 13 01:11:30.876725 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:30.876697 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:11:30.877372 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:30.877158 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" event={"ID":"30048d20-4691-4de9-8a59-6a29d363f4e0","Type":"ContainerStarted","Data":"24c1c101816bdd39d61d22261ddc53cda763a75dec93bf6b5a1e6e07bfa170eb"} Jun 13 01:11:31.757568 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:31.757530 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:31.757568 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:31.757548 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:31.757810 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:31.757665 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:31.757810 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:31.757740 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:31.757914 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:31.757734 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:31.757914 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:31.757832 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:32.883337 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:32.883154 2574 generic.go:356] "Generic (PLEG): container finished" podID="06fa4c27-9487-4d5d-8675-e6fed12c972a" containerID="173fee94380e6ee2be81fe7eedd08c7a17f1e97ae2aea24a89c05c535a8cd18b" exitCode=0 Jun 13 01:11:32.884045 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:32.883247 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktw8" event={"ID":"06fa4c27-9487-4d5d-8675-e6fed12c972a","Type":"ContainerDied","Data":"173fee94380e6ee2be81fe7eedd08c7a17f1e97ae2aea24a89c05c535a8cd18b"} Jun 13 01:11:32.887009 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:32.886990 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:11:32.887426 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:32.887403 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" event={"ID":"30048d20-4691-4de9-8a59-6a29d363f4e0","Type":"ContainerStarted","Data":"e80671fe09e173e6d952383cfca30c1cf561184df0f795d8c89dd9605a47384d"} Jun 13 01:11:32.887703 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:32.887680 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:32.887794 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:32.887750 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:32.887794 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:32.887794 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:32.887919 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:32.887902 2574 scope.go:117] "RemoveContainer" containerID="70cef0d3b6e99664d38698b5f478b6e6833a4bd76fb94a709f0c1f438ece27bb" Jun 13 01:11:32.904536 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:32.904512 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:32.904678 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:32.904664 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:11:33.756639 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:33.756611 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:33.756787 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:33.756611 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:33.756787 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:33.756735 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:33.756906 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:33.756828 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:33.756906 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:33.756830 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:33.756998 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:33.756954 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:33.891473 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:33.891442 2574 generic.go:356] "Generic (PLEG): container finished" podID="06fa4c27-9487-4d5d-8675-e6fed12c972a" containerID="841f030c30c926aa3a13d31eb06309b04f457894bb79b84dcb141ba4615446aa" exitCode=0 Jun 13 01:11:33.891951 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:33.891522 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktw8" event={"ID":"06fa4c27-9487-4d5d-8675-e6fed12c972a","Type":"ContainerDied","Data":"841f030c30c926aa3a13d31eb06309b04f457894bb79b84dcb141ba4615446aa"} Jun 13 01:11:33.895701 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:33.895671 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:11:33.896052 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:33.896030 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" event={"ID":"30048d20-4691-4de9-8a59-6a29d363f4e0","Type":"ContainerStarted","Data":"d8b96a2fa4a1d77d7d9a5aea8e7af3ea0ff86622fb0de4a98836ae0d8ff76a5d"} Jun 13 01:11:33.939981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:33.939920 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" podStartSLOduration=10.377475736 podStartE2EDuration="28.939897062s" totalImagesPullingTime="18.562421326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:33.938522033 +0000 UTC m=+28.609921871" watchObservedRunningTime="2026-06-13 01:11:33.939897062 +0000 UTC m=+28.611296908" Jun 13 01:11:34.370293 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:34.370264 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ddhc4"] Jun 13 01:11:34.370464 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:34.370362 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:34.370464 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:34.370443 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:34.372843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:34.372786 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bjddg"] Jun 13 01:11:34.372998 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:34.372885 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:34.372998 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:34.372963 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:34.373479 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:34.373456 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h48sb"] Jun 13 01:11:34.373589 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:34.373553 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:34.373663 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:34.373644 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:34.900591 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:34.900348 2574 generic.go:356] "Generic (PLEG): container finished" podID="06fa4c27-9487-4d5d-8675-e6fed12c972a" containerID="b1cfa8a2efc4c81f2205620a69e80cfcdfea98efd6cd67333f3084eae5860d3b" exitCode=0 Jun 13 01:11:34.900958 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:34.900426 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktw8" event={"ID":"06fa4c27-9487-4d5d-8675-e6fed12c972a","Type":"ContainerDied","Data":"b1cfa8a2efc4c81f2205620a69e80cfcdfea98efd6cd67333f3084eae5860d3b"} Jun 13 01:11:35.758696 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:35.758279 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:35.758696 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:35.758406 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:35.758696 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:35.758544 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:35.758979 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:35.758888 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:36.757241 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:36.757157 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:36.757827 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:36.757299 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:36.848941 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:36.848871 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-scnvp" Jun 13 01:11:36.849253 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:36.849043 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 13 01:11:36.849574 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:36.849548 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-scnvp" Jun 13 01:11:37.757564 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:37.757521 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:37.757564 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:37.757549 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:37.758232 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:37.757649 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:37.758232 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:37.757754 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:38.757169 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:38.757131 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:38.757330 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:38.757247 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:11:39.464790 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:39.464715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:39.464790 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:39.464775 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:39.465373 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:39.464873 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:39.465373 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:39.464933 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret podName:c691a532-4b73-4518-8158-cfebdbafdbea nodeName:}" failed. No retries permitted until 2026-06-13 01:12:11.464918648 +0000 UTC m=+66.136318464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret") pod "global-pull-secret-syncer-ddhc4" (UID: "c691a532-4b73-4518-8158-cfebdbafdbea") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:39.465373 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:39.464876 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:39.465373 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:39.465039 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs podName:3e747bdd-f2b9-467c-b520-103a6c772f14 nodeName:}" failed. No retries permitted until 2026-06-13 01:12:11.465020896 +0000 UTC m=+66.136420728 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs") pod "network-metrics-daemon-h48sb" (UID: "3e747bdd-f2b9-467c-b520-103a6c772f14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:39.565768 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:39.565733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvgz\" (UniqueName: \"kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz\") pod \"network-check-target-bjddg\" (UID: \"32cc2ce4-eb79-4a14-85b8-553b843e8f02\") " pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:39.565951 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:39.565856 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:39.565951 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:39.565870 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:39.565951 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:39.565880 2574 projected.go:196] Error preparing data for projected volume kube-api-access-spvgz for pod openshift-network-diagnostics/network-check-target-bjddg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:39.565951 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:39.565932 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz podName:32cc2ce4-eb79-4a14-85b8-553b843e8f02 nodeName:}" failed. No retries permitted until 2026-06-13 01:12:11.565920131 +0000 UTC m=+66.237319949 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-spvgz" (UniqueName: "kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz") pod "network-check-target-bjddg" (UID: "32cc2ce4-eb79-4a14-85b8-553b843e8f02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:39.756668 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:39.756586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:39.756839 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:39.756676 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjddg" podUID="32cc2ce4-eb79-4a14-85b8-553b843e8f02" Jun 13 01:11:39.756839 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:39.756761 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:39.756956 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:39.756837 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddhc4" podUID="c691a532-4b73-4518-8158-cfebdbafdbea" Jun 13 01:11:39.915010 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:39.914976 2574 generic.go:356] "Generic (PLEG): container finished" podID="06fa4c27-9487-4d5d-8675-e6fed12c972a" containerID="a8f18c40133740c904989b1d43f3377c0949f692e17e5e72c87917070b0a9b4d" exitCode=0 Jun 13 01:11:39.915183 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:39.915037 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktw8" event={"ID":"06fa4c27-9487-4d5d-8675-e6fed12c972a","Type":"ContainerDied","Data":"a8f18c40133740c904989b1d43f3377c0949f692e17e5e72c87917070b0a9b4d"} Jun 13 01:11:40.160496 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.160469 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeReady" Jun 13 01:11:40.160693 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.160608 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 13 01:11:40.207318 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.207285 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hvksv"] Jun 13 01:11:40.228312 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.228284 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lpnms"] Jun 13 01:11:40.228453 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.228419 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:40.230648 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.230627 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hswsv\"" Jun 13 01:11:40.230648 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.230627 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 13 01:11:40.230865 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.230726 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 13 01:11:40.246724 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.246697 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lpnms"] Jun 13 01:11:40.246724 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.246729 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hvksv"] Jun 13 01:11:40.246950 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.246820 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lpnms" Jun 13 01:11:40.249886 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.249862 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 13 01:11:40.250035 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.249910 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qsm9c\"" Jun 13 01:11:40.250035 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.249990 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 13 01:11:40.250145 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.250133 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 13 01:11:40.370292 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.370198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:40.370292 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.370238 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr7l2\" (UniqueName: \"kubernetes.io/projected/3b81f243-dfba-47c9-995d-93e6d4577bb4-kube-api-access-cr7l2\") pod \"ingress-canary-lpnms\" (UID: \"3b81f243-dfba-47c9-995d-93e6d4577bb4\") " pod="openshift-ingress-canary/ingress-canary-lpnms" Jun 13 01:11:40.370292 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.370254 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca7840d9-989c-44d8-b024-deefde6a5539-tmp-dir\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:40.370497 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.370363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca7840d9-989c-44d8-b024-deefde6a5539-config-volume\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:40.370497 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.370404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b81f243-dfba-47c9-995d-93e6d4577bb4-cert\") pod \"ingress-canary-lpnms\" (UID: \"3b81f243-dfba-47c9-995d-93e6d4577bb4\") " pod="openshift-ingress-canary/ingress-canary-lpnms" Jun 13 01:11:40.370497 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.370457 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwcpf\" (UniqueName: \"kubernetes.io/projected/ca7840d9-989c-44d8-b024-deefde6a5539-kube-api-access-dwcpf\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:40.471468 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.471433 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr7l2\" (UniqueName: \"kubernetes.io/projected/3b81f243-dfba-47c9-995d-93e6d4577bb4-kube-api-access-cr7l2\") pod \"ingress-canary-lpnms\" (UID: \"3b81f243-dfba-47c9-995d-93e6d4577bb4\") " pod="openshift-ingress-canary/ingress-canary-lpnms" Jun 13 01:11:40.471468 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.471469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca7840d9-989c-44d8-b024-deefde6a5539-tmp-dir\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:40.471915 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.471526 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca7840d9-989c-44d8-b024-deefde6a5539-config-volume\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:40.471915 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.471562 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b81f243-dfba-47c9-995d-93e6d4577bb4-cert\") pod \"ingress-canary-lpnms\" (UID: \"3b81f243-dfba-47c9-995d-93e6d4577bb4\") " pod="openshift-ingress-canary/ingress-canary-lpnms" Jun 13 01:11:40.471915 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.471695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwcpf\" (UniqueName: \"kubernetes.io/projected/ca7840d9-989c-44d8-b024-deefde6a5539-kube-api-access-dwcpf\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:40.471915 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.471739 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:40.471915 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:40.471840 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:40.471915 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:40.471893 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls podName:ca7840d9-989c-44d8-b024-deefde6a5539 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:40.971875978 +0000 UTC m=+35.643275808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls") pod "dns-default-hvksv" (UID: "ca7840d9-989c-44d8-b024-deefde6a5539") : secret "dns-default-metrics-tls" not found Jun 13 01:11:40.471915 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.471910 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca7840d9-989c-44d8-b024-deefde6a5539-tmp-dir\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:40.472328 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.472144 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca7840d9-989c-44d8-b024-deefde6a5539-config-volume\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:40.476315 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.476193 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b81f243-dfba-47c9-995d-93e6d4577bb4-cert\") pod \"ingress-canary-lpnms\" (UID: \"3b81f243-dfba-47c9-995d-93e6d4577bb4\") " pod="openshift-ingress-canary/ingress-canary-lpnms" Jun 13 01:11:40.482472 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.482449 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwcpf\" (UniqueName: \"kubernetes.io/projected/ca7840d9-989c-44d8-b024-deefde6a5539-kube-api-access-dwcpf\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:40.482700 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.482682 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr7l2\" (UniqueName: \"kubernetes.io/projected/3b81f243-dfba-47c9-995d-93e6d4577bb4-kube-api-access-cr7l2\") pod \"ingress-canary-lpnms\" (UID: \"3b81f243-dfba-47c9-995d-93e6d4577bb4\") " pod="openshift-ingress-canary/ingress-canary-lpnms" Jun 13 01:11:40.555632 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.555600 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lpnms" Jun 13 01:11:40.756753 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.756720 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:11:40.759340 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.759318 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-86b5g\"" Jun 13 01:11:40.759656 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.759642 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 01:11:40.788732 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.788706 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lpnms"] Jun 13 01:11:40.793969 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:40.793940 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b81f243_dfba_47c9_995d_93e6d4577bb4.slice/crio-c20e02c45faafb294e4d59cb7aabc113fe52e148c7f601c843b606123a908e1e WatchSource:0}: Error finding container c20e02c45faafb294e4d59cb7aabc113fe52e148c7f601c843b606123a908e1e: Status 404 returned error can't find the container with id c20e02c45faafb294e4d59cb7aabc113fe52e148c7f601c843b606123a908e1e Jun 13 01:11:40.924227 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.924145 2574 generic.go:356] "Generic (PLEG): container finished" podID="06fa4c27-9487-4d5d-8675-e6fed12c972a" containerID="752e76891963bcd460c96ba08428a33c69577f687a9b3ccc047fa3139fee7832" exitCode=0 Jun 13 01:11:40.924227 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.924217 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktw8" event={"ID":"06fa4c27-9487-4d5d-8675-e6fed12c972a","Type":"ContainerDied","Data":"752e76891963bcd460c96ba08428a33c69577f687a9b3ccc047fa3139fee7832"} Jun 13 01:11:40.925368 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.925337 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lpnms" event={"ID":"3b81f243-dfba-47c9-995d-93e6d4577bb4","Type":"ContainerStarted","Data":"c20e02c45faafb294e4d59cb7aabc113fe52e148c7f601c843b606123a908e1e"} Jun 13 01:11:40.976455 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:40.976407 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:40.976638 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:40.976548 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:40.976638 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:40.976613 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls podName:ca7840d9-989c-44d8-b024-deefde6a5539 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:41.976593733 +0000 UTC m=+36.647993553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls") pod "dns-default-hvksv" (UID: "ca7840d9-989c-44d8-b024-deefde6a5539") : secret "dns-default-metrics-tls" not found Jun 13 01:11:41.757517 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:41.757332 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:11:41.758104 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:41.757387 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:11:41.760078 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:41.760053 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 01:11:41.760922 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:41.760905 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 01:11:41.761026 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:41.760931 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 01:11:41.761026 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:41.760906 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-78kc5\"" Jun 13 01:11:41.932101 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:41.932057 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktw8" event={"ID":"06fa4c27-9487-4d5d-8675-e6fed12c972a","Type":"ContainerStarted","Data":"a2567b9b847f5276aebcbea36d783add6778a6b7f1b6f43327c78e6e8b1bdc0a"} Jun 13 01:11:41.953695 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:41.953633 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tktw8" podStartSLOduration=7.573623427 podStartE2EDuration="35.953615398s" totalImagesPullingTime="28.379991971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:41.952429454 +0000 UTC m=+36.623829292" watchObservedRunningTime="2026-06-13 01:11:41.953615398 +0000 UTC m=+36.625015236" Jun 13 01:11:41.985624 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:41.985581 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:41.985803 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:41.985696 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:41.985803 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:41.985769 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls podName:ca7840d9-989c-44d8-b024-deefde6a5539 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:43.985753394 +0000 UTC m=+38.657153210 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls") pod "dns-default-hvksv" (UID: "ca7840d9-989c-44d8-b024-deefde6a5539") : secret "dns-default-metrics-tls" not found Jun 13 01:11:42.936444 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:42.936408 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lpnms" event={"ID":"3b81f243-dfba-47c9-995d-93e6d4577bb4","Type":"ContainerStarted","Data":"df56cf58e21b2f85307ebc523121f7fe745639c34b7968c063a86f22f26e0557"} Jun 13 01:11:44.001246 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:44.001156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:44.001591 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:44.001312 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:44.001591 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:44.001381 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls podName:ca7840d9-989c-44d8-b024-deefde6a5539 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:48.001365768 +0000 UTC m=+42.672765586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls") pod "dns-default-hvksv" (UID: "ca7840d9-989c-44d8-b024-deefde6a5539") : secret "dns-default-metrics-tls" not found Jun 13 01:11:48.026926 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:48.026890 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:48.027440 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:48.027038 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:48.027440 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:48.027102 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls podName:ca7840d9-989c-44d8-b024-deefde6a5539 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:56.027087835 +0000 UTC m=+50.698487651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls") pod "dns-default-hvksv" (UID: "ca7840d9-989c-44d8-b024-deefde6a5539") : secret "dns-default-metrics-tls" not found Jun 13 01:11:54.374859 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.374805 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lpnms" podStartSLOduration=12.446966594 podStartE2EDuration="14.374789517s" totalImagesPullingTime="1.927822923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:42.953102845 +0000 UTC m=+37.624502702" watchObservedRunningTime="2026-06-13 01:11:54.374789517 +0000 UTC m=+49.046189332" Jun 13 01:11:54.375285 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.375141 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg"] Jun 13 01:11:54.404788 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.404766 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg"] Jun 13 01:11:54.404933 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.404847 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg" Jun 13 01:11:54.407032 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.407010 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 13 01:11:54.407138 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.407106 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-94kxc\"" Jun 13 01:11:54.407759 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.407742 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 13 01:11:54.407841 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.407810 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 13 01:11:54.407892 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.407849 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 13 01:11:54.426346 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.426326 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82"] Jun 13 01:11:54.450940 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.450907 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82"] Jun 13 01:11:54.451075 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.451003 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:11:54.453597 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.453581 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 13 01:11:54.572166 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.572131 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c7dcff3-e462-4817-be2d-f7b596d5c16f-tmp\") pod \"klusterlet-addon-workmgr-89fcdc94-llm82\" (UID: \"2c7dcff3-e462-4817-be2d-f7b596d5c16f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:11:54.572166 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.572169 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcgxs\" (UniqueName: \"kubernetes.io/projected/2c7dcff3-e462-4817-be2d-f7b596d5c16f-kube-api-access-vcgxs\") pod \"klusterlet-addon-workmgr-89fcdc94-llm82\" (UID: \"2c7dcff3-e462-4817-be2d-f7b596d5c16f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:11:54.572376 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.572192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2c7dcff3-e462-4817-be2d-f7b596d5c16f-klusterlet-config\") pod \"klusterlet-addon-workmgr-89fcdc94-llm82\" (UID: \"2c7dcff3-e462-4817-be2d-f7b596d5c16f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:11:54.572376 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.572277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a2b1aa5-f490-4707-9f02-b13cb4ff64c9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-676549f8fb-726dg\" (UID: \"5a2b1aa5-f490-4707-9f02-b13cb4ff64c9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg" Jun 13 01:11:54.572376 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.572324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zz98\" (UniqueName: \"kubernetes.io/projected/5a2b1aa5-f490-4707-9f02-b13cb4ff64c9-kube-api-access-9zz98\") pod \"managed-serviceaccount-addon-agent-676549f8fb-726dg\" (UID: \"5a2b1aa5-f490-4707-9f02-b13cb4ff64c9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg" Jun 13 01:11:54.672651 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.672618 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2c7dcff3-e462-4817-be2d-f7b596d5c16f-klusterlet-config\") pod \"klusterlet-addon-workmgr-89fcdc94-llm82\" (UID: \"2c7dcff3-e462-4817-be2d-f7b596d5c16f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:11:54.672856 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.672676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a2b1aa5-f490-4707-9f02-b13cb4ff64c9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-676549f8fb-726dg\" (UID: \"5a2b1aa5-f490-4707-9f02-b13cb4ff64c9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg" Jun 13 01:11:54.672926 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.672868 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zz98\" (UniqueName: \"kubernetes.io/projected/5a2b1aa5-f490-4707-9f02-b13cb4ff64c9-kube-api-access-9zz98\") pod \"managed-serviceaccount-addon-agent-676549f8fb-726dg\" (UID: \"5a2b1aa5-f490-4707-9f02-b13cb4ff64c9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg" Jun 13 01:11:54.672986 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.672970 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c7dcff3-e462-4817-be2d-f7b596d5c16f-tmp\") pod \"klusterlet-addon-workmgr-89fcdc94-llm82\" (UID: \"2c7dcff3-e462-4817-be2d-f7b596d5c16f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:11:54.673038 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.672998 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcgxs\" (UniqueName: \"kubernetes.io/projected/2c7dcff3-e462-4817-be2d-f7b596d5c16f-kube-api-access-vcgxs\") pod \"klusterlet-addon-workmgr-89fcdc94-llm82\" (UID: \"2c7dcff3-e462-4817-be2d-f7b596d5c16f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:11:54.673384 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.673364 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c7dcff3-e462-4817-be2d-f7b596d5c16f-tmp\") pod \"klusterlet-addon-workmgr-89fcdc94-llm82\" (UID: \"2c7dcff3-e462-4817-be2d-f7b596d5c16f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:11:54.676473 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.676445 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a2b1aa5-f490-4707-9f02-b13cb4ff64c9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-676549f8fb-726dg\" (UID: \"5a2b1aa5-f490-4707-9f02-b13cb4ff64c9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg" Jun 13 01:11:54.676565 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.676453 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2c7dcff3-e462-4817-be2d-f7b596d5c16f-klusterlet-config\") pod \"klusterlet-addon-workmgr-89fcdc94-llm82\" (UID: \"2c7dcff3-e462-4817-be2d-f7b596d5c16f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:11:54.680724 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.680696 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zz98\" (UniqueName: \"kubernetes.io/projected/5a2b1aa5-f490-4707-9f02-b13cb4ff64c9-kube-api-access-9zz98\") pod \"managed-serviceaccount-addon-agent-676549f8fb-726dg\" (UID: \"5a2b1aa5-f490-4707-9f02-b13cb4ff64c9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg" Jun 13 01:11:54.680883 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.680865 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcgxs\" (UniqueName: \"kubernetes.io/projected/2c7dcff3-e462-4817-be2d-f7b596d5c16f-kube-api-access-vcgxs\") pod \"klusterlet-addon-workmgr-89fcdc94-llm82\" (UID: \"2c7dcff3-e462-4817-be2d-f7b596d5c16f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:11:54.725783 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.725747 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg" Jun 13 01:11:54.759340 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.759306 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:11:54.872650 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.872622 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg"] Jun 13 01:11:54.887083 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:54.887049 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a2b1aa5_f490_4707_9f02_b13cb4ff64c9.slice/crio-3c1495f7dbc3e4cc52649271dfe9217604de62b6cdc2e9e82c4ef5df4bc91a52 WatchSource:0}: Error finding container 3c1495f7dbc3e4cc52649271dfe9217604de62b6cdc2e9e82c4ef5df4bc91a52: Status 404 returned error can't find the container with id 3c1495f7dbc3e4cc52649271dfe9217604de62b6cdc2e9e82c4ef5df4bc91a52 Jun 13 01:11:54.918035 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.917152 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82"] Jun 13 01:11:54.921860 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:11:54.921835 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c7dcff3_e462_4817_be2d_f7b596d5c16f.slice/crio-3f10e3ebe1bbfdf4c0cd11e55082385b76520c92b8d7a1749386f6cf5263d7fc WatchSource:0}: Error finding container 3f10e3ebe1bbfdf4c0cd11e55082385b76520c92b8d7a1749386f6cf5263d7fc: Status 404 returned error can't find the container with id 3f10e3ebe1bbfdf4c0cd11e55082385b76520c92b8d7a1749386f6cf5263d7fc Jun 13 01:11:54.963372 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.963328 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" event={"ID":"2c7dcff3-e462-4817-be2d-f7b596d5c16f","Type":"ContainerStarted","Data":"3f10e3ebe1bbfdf4c0cd11e55082385b76520c92b8d7a1749386f6cf5263d7fc"} Jun 13 01:11:54.964411 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:54.964378 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg" event={"ID":"5a2b1aa5-f490-4707-9f02-b13cb4ff64c9","Type":"ContainerStarted","Data":"3c1495f7dbc3e4cc52649271dfe9217604de62b6cdc2e9e82c4ef5df4bc91a52"} Jun 13 01:11:56.084186 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:56.083844 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:11:56.084186 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:56.084034 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:56.084186 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:11:56.084098 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls podName:ca7840d9-989c-44d8-b024-deefde6a5539 nodeName:}" failed. No retries permitted until 2026-06-13 01:12:12.08407979 +0000 UTC m=+66.755479607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls") pod "dns-default-hvksv" (UID: "ca7840d9-989c-44d8-b024-deefde6a5539") : secret "dns-default-metrics-tls" not found Jun 13 01:11:59.978551 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:59.978514 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" event={"ID":"2c7dcff3-e462-4817-be2d-f7b596d5c16f","Type":"ContainerStarted","Data":"9688db9ef53dd172f6d736e8d783136610eef197c8388f43b183318661f421bc"} Jun 13 01:11:59.979036 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:59.978793 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:11:59.980448 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:59.980425 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:11:59.998170 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:11:59.995494 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" podStartSLOduration=1.400433191 podStartE2EDuration="5.995476826s" totalImagesPullingTime="4.595043635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:59.994540173 +0000 UTC m=+54.665940025" watchObservedRunningTime="2026-06-13 01:11:59.995476826 +0000 UTC m=+54.666876665" Jun 13 01:12:01.984686 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:01.984646 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg" event={"ID":"5a2b1aa5-f490-4707-9f02-b13cb4ff64c9","Type":"ContainerStarted","Data":"e86b53e45af97a31fe1aa83ce13fa1bd680ad0f028cd8b29943f30e9fe4b73c2"} Jun 13 01:12:02.002450 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:02.002401 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg" podStartSLOduration=1.800186319 podStartE2EDuration="8.002384559s" totalImagesPullingTime="6.20219824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:12:02.00099043 +0000 UTC m=+56.672390288" watchObservedRunningTime="2026-06-13 01:12:02.002384559 +0000 UTC m=+56.673784397" Jun 13 01:12:04.911924 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:04.911896 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4t9pm" Jun 13 01:12:11.503754 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:11.503707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:12:11.504237 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:11.503772 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:12:11.506218 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:11.506196 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 01:12:11.506260 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:11.506238 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 01:12:11.514175 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:12:11.514158 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 01:12:11.514230 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:12:11.514215 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs podName:3e747bdd-f2b9-467c-b520-103a6c772f14 nodeName:}" failed. No retries permitted until 2026-06-13 01:13:15.514200426 +0000 UTC m=+130.185600242 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs") pod "network-metrics-daemon-h48sb" (UID: "3e747bdd-f2b9-467c-b520-103a6c772f14") : secret "metrics-daemon-secret" not found Jun 13 01:12:11.516430 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:11.516406 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c691a532-4b73-4518-8158-cfebdbafdbea-original-pull-secret\") pod \"global-pull-secret-syncer-ddhc4\" (UID: \"c691a532-4b73-4518-8158-cfebdbafdbea\") " pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:12:11.604390 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:11.604346 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvgz\" (UniqueName: \"kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz\") pod \"network-check-target-bjddg\" (UID: \"32cc2ce4-eb79-4a14-85b8-553b843e8f02\") " pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:12:11.607162 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:11.607141 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 01:12:11.617541 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:11.617519 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 01:12:11.628653 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:11.628622 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spvgz\" (UniqueName: \"kubernetes.io/projected/32cc2ce4-eb79-4a14-85b8-553b843e8f02-kube-api-access-spvgz\") pod \"network-check-target-bjddg\" (UID: \"32cc2ce4-eb79-4a14-85b8-553b843e8f02\") " pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:12:11.767403 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:11.767317 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddhc4" Jun 13 01:12:11.774924 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:11.774905 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-78kc5\"" Jun 13 01:12:11.782807 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:11.782786 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:12:11.926900 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:11.926793 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ddhc4"] Jun 13 01:12:11.941996 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:11.941967 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bjddg"] Jun 13 01:12:11.946214 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:12:11.946189 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32cc2ce4_eb79_4a14_85b8_553b843e8f02.slice/crio-10a7e7ac956f26c865fc2d5fd21dc010e523444db62b02f2868aa23d9f6cdd34 WatchSource:0}: Error finding container 10a7e7ac956f26c865fc2d5fd21dc010e523444db62b02f2868aa23d9f6cdd34: Status 404 returned error can't find the container with id 10a7e7ac956f26c865fc2d5fd21dc010e523444db62b02f2868aa23d9f6cdd34 Jun 13 01:12:12.010453 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:12.010418 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bjddg" event={"ID":"32cc2ce4-eb79-4a14-85b8-553b843e8f02","Type":"ContainerStarted","Data":"10a7e7ac956f26c865fc2d5fd21dc010e523444db62b02f2868aa23d9f6cdd34"} Jun 13 01:12:12.011530 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:12.011507 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ddhc4" event={"ID":"c691a532-4b73-4518-8158-cfebdbafdbea","Type":"ContainerStarted","Data":"fd0d0fc8349ffd9b07f9fc3e8a32b08b1b1ce6e87f7cb801ededfa345790aedb"} Jun 13 01:12:12.108110 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:12.108019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:12:12.108258 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:12:12.108184 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:12:12.108309 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:12:12.108258 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls podName:ca7840d9-989c-44d8-b024-deefde6a5539 nodeName:}" failed. No retries permitted until 2026-06-13 01:12:44.108242712 +0000 UTC m=+98.779642531 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls") pod "dns-default-hvksv" (UID: "ca7840d9-989c-44d8-b024-deefde6a5539") : secret "dns-default-metrics-tls" not found Jun 13 01:12:17.029674 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:17.029631 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bjddg" event={"ID":"32cc2ce4-eb79-4a14-85b8-553b843e8f02","Type":"ContainerStarted","Data":"7f2f9751e27af6e62267086fe6a11dd91bda2e902048efa520af1feff3aaeeb7"} Jun 13 01:12:17.030325 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:17.029739 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:12:17.031171 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:17.031149 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ddhc4" event={"ID":"c691a532-4b73-4518-8158-cfebdbafdbea","Type":"ContainerStarted","Data":"c7cab877aede4e355e1118a1ceeb9acd373a75959ae2508b3711c725df87abbf"} Jun 13 01:12:17.048235 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:17.048175 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bjddg" podStartSLOduration=67.628319917 podStartE2EDuration="1m12.048159304s" totalImagesPullingTime="4.419839387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:12:17.04745705 +0000 UTC m=+71.718856899" watchObservedRunningTime="2026-06-13 01:12:17.048159304 +0000 UTC m=+71.719559142" Jun 13 01:12:44.133156 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:44.133040 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:12:44.133565 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:12:44.133207 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:12:44.133565 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:12:44.133270 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls podName:ca7840d9-989c-44d8-b024-deefde6a5539 nodeName:}" failed. No retries permitted until 2026-06-13 01:13:48.133255302 +0000 UTC m=+162.804655119 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls") pod "dns-default-hvksv" (UID: "ca7840d9-989c-44d8-b024-deefde6a5539") : secret "dns-default-metrics-tls" not found Jun 13 01:12:48.037534 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:48.037499 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bjddg" Jun 13 01:12:48.053868 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:12:48.053817 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ddhc4" podStartSLOduration=97.613201404 podStartE2EDuration="1m42.053786099s" totalImagesPullingTime="4.440584695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:12:17.065171287 +0000 UTC m=+71.736571127" watchObservedRunningTime="2026-06-13 01:12:48.053786099 +0000 UTC m=+102.725185934" Jun 13 01:13:15.542958 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:13:15.542906 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:13:15.543571 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:13:15.543080 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 01:13:15.543571 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:13:15.543204 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs podName:3e747bdd-f2b9-467c-b520-103a6c772f14 nodeName:}" failed. No retries permitted until 2026-06-13 01:15:17.543182112 +0000 UTC m=+252.214581930 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs") pod "network-metrics-daemon-h48sb" (UID: "3e747bdd-f2b9-467c-b520-103a6c772f14") : secret "metrics-daemon-secret" not found Jun 13 01:13:43.237051 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:13:43.237008 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hvksv" podUID="ca7840d9-989c-44d8-b024-deefde6a5539" Jun 13 01:13:43.283983 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:13:43.283954 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvksv" Jun 13 01:13:43.765971 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:13:43.765935 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h48sb" podUID="3e747bdd-f2b9-467c-b520-103a6c772f14" Jun 13 01:13:48.166386 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:13:48.166345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:13:48.166816 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:13:48.166513 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:13:48.166816 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:13:48.166583 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls podName:ca7840d9-989c-44d8-b024-deefde6a5539 nodeName:}" failed. No retries permitted until 2026-06-13 01:15:50.166566657 +0000 UTC m=+284.837966473 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls") pod "dns-default-hvksv" (UID: "ca7840d9-989c-44d8-b024-deefde6a5539") : secret "dns-default-metrics-tls" not found Jun 13 01:13:58.757270 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:13:58.757180 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:13:59.979568 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:13:59.979468 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" podUID="2c7dcff3-e462-4817-be2d-f7b596d5c16f" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused" Jun 13 01:14:00.334522 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:00.334441 2574 generic.go:356] "Generic (PLEG): container finished" podID="2c7dcff3-e462-4817-be2d-f7b596d5c16f" containerID="9688db9ef53dd172f6d736e8d783136610eef197c8388f43b183318661f421bc" exitCode=1 Jun 13 01:14:00.334661 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:00.334515 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" event={"ID":"2c7dcff3-e462-4817-be2d-f7b596d5c16f","Type":"ContainerDied","Data":"9688db9ef53dd172f6d736e8d783136610eef197c8388f43b183318661f421bc"} Jun 13 01:14:00.334805 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:00.334791 2574 scope.go:117] "RemoveContainer" containerID="9688db9ef53dd172f6d736e8d783136610eef197c8388f43b183318661f421bc" Jun 13 01:14:01.338427 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:01.338393 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" event={"ID":"2c7dcff3-e462-4817-be2d-f7b596d5c16f","Type":"ContainerStarted","Data":"092ad77435e9ab0e0ae7c9dc28e442c642760680409d101d714bf8d7f6fb8aec"} Jun 13 01:14:01.338834 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:01.338722 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:14:01.339279 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:01.339251 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89fcdc94-llm82" Jun 13 01:14:01.340033 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:01.340013 2574 generic.go:356] "Generic (PLEG): container finished" podID="5a2b1aa5-f490-4707-9f02-b13cb4ff64c9" containerID="e86b53e45af97a31fe1aa83ce13fa1bd680ad0f028cd8b29943f30e9fe4b73c2" exitCode=255 Jun 13 01:14:01.340150 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:01.340087 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg" event={"ID":"5a2b1aa5-f490-4707-9f02-b13cb4ff64c9","Type":"ContainerDied","Data":"e86b53e45af97a31fe1aa83ce13fa1bd680ad0f028cd8b29943f30e9fe4b73c2"} Jun 13 01:14:01.345623 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:01.345603 2574 scope.go:117] "RemoveContainer" containerID="e86b53e45af97a31fe1aa83ce13fa1bd680ad0f028cd8b29943f30e9fe4b73c2" Jun 13 01:14:02.344993 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:02.344958 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-676549f8fb-726dg" event={"ID":"5a2b1aa5-f490-4707-9f02-b13cb4ff64c9","Type":"ContainerStarted","Data":"7fde39d6df137a06587ceff8ebf3520108783617be053a475e7a70a77c7db5b5"} Jun 13 01:14:19.320630 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.320595 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b656b9cf7-trmqp"] Jun 13 01:14:19.322764 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.322747 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.327155 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.327134 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 13 01:14:19.327268 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.327195 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 13 01:14:19.327581 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.327567 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mqb2w\"" Jun 13 01:14:19.328023 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.328007 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 13 01:14:19.332810 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.332788 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 13 01:14:19.338321 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.338299 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b656b9cf7-trmqp"] Jun 13 01:14:19.377888 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.377866 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/667228e0-9e32-4e3d-9cc0-110f3eaba507-image-registry-private-configuration\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.377991 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.377896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.377991 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.377956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/667228e0-9e32-4e3d-9cc0-110f3eaba507-trusted-ca\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.377991 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.377974 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-bound-sa-token\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.377991 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.377990 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdgjr\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-kube-api-access-qdgjr\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.378190 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.378007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-certificates\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.378190 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.378070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/667228e0-9e32-4e3d-9cc0-110f3eaba507-ca-trust-extracted\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.378190 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.378098 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/667228e0-9e32-4e3d-9cc0-110f3eaba507-installation-pull-secrets\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.421250 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.421217 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-64ktm"] Jun 13 01:14:19.423079 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.423062 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.425649 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.425630 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 13 01:14:19.425751 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.425665 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 13 01:14:19.426125 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.426095 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 13 01:14:19.426345 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.426331 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 13 01:14:19.426686 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.426672 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vd27p\"" Jun 13 01:14:19.432990 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.432974 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 13 01:14:19.439165 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.439144 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-64ktm"] Jun 13 01:14:19.478650 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.478616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/667228e0-9e32-4e3d-9cc0-110f3eaba507-image-registry-private-configuration\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.478831 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.478675 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.478831 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.478703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-tmp\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.478831 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.478748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/667228e0-9e32-4e3d-9cc0-110f3eaba507-trusted-ca\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.478831 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.478765 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-bound-sa-token\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.478831 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.478780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdgjr\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-kube-api-access-qdgjr\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.478831 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.478795 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-snapshots\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.478831 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.478819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.478831 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.478837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-certificates\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.479505 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.478852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.479505 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:19.478854 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 01:14:19.479505 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.478868 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npm5h\" (UniqueName: \"kubernetes.io/projected/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-kube-api-access-npm5h\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.479505 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:19.478875 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b656b9cf7-trmqp: secret "image-registry-tls" not found Jun 13 01:14:19.479505 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.478899 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/667228e0-9e32-4e3d-9cc0-110f3eaba507-ca-trust-extracted\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.479505 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.478925 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-serving-cert\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.479505 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:19.478986 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls podName:667228e0-9e32-4e3d-9cc0-110f3eaba507 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:19.978961355 +0000 UTC m=+194.650361176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls") pod "image-registry-5b656b9cf7-trmqp" (UID: "667228e0-9e32-4e3d-9cc0-110f3eaba507") : secret "image-registry-tls" not found Jun 13 01:14:19.479505 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.479073 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/667228e0-9e32-4e3d-9cc0-110f3eaba507-installation-pull-secrets\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.479505 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.479273 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/667228e0-9e32-4e3d-9cc0-110f3eaba507-ca-trust-extracted\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.479965 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.479595 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-certificates\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.479965 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.479826 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/667228e0-9e32-4e3d-9cc0-110f3eaba507-trusted-ca\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.481296 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.481268 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/667228e0-9e32-4e3d-9cc0-110f3eaba507-image-registry-private-configuration\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.481403 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.481386 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/667228e0-9e32-4e3d-9cc0-110f3eaba507-installation-pull-secrets\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.488337 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.488318 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-bound-sa-token\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.488485 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.488468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdgjr\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-kube-api-access-qdgjr\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.580223 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.580104 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-tmp\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.580223 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.580202 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-snapshots\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.580223 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.580221 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.580478 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.580237 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.580478 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.580251 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npm5h\" (UniqueName: \"kubernetes.io/projected/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-kube-api-access-npm5h\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.580478 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.580274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-serving-cert\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.581688 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.581349 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-tmp\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.581688 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.581522 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-snapshots\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.581688 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.581605 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.585099 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.581960 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.585099 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.584315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-serving-cert\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.588809 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.588787 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npm5h\" (UniqueName: \"kubernetes.io/projected/c7b5138c-ff49-48a7-aa9e-32bf01eacf4c-kube-api-access-npm5h\") pod \"insights-operator-5bbd86d6bd-64ktm\" (UID: \"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.732345 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.732309 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" Jun 13 01:14:19.859275 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.859190 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-64ktm"] Jun 13 01:14:19.862937 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:14:19.862912 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b5138c_ff49_48a7_aa9e_32bf01eacf4c.slice/crio-d6720adcbb28573248441545ab2cf55af67b158b945140af8c3295ca5beeff59 WatchSource:0}: Error finding container d6720adcbb28573248441545ab2cf55af67b158b945140af8c3295ca5beeff59: Status 404 returned error can't find the container with id d6720adcbb28573248441545ab2cf55af67b158b945140af8c3295ca5beeff59 Jun 13 01:14:19.983761 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:19.983721 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:19.983959 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:19.983883 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 01:14:19.983959 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:19.983909 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b656b9cf7-trmqp: secret "image-registry-tls" not found Jun 13 01:14:19.984067 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:19.983977 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls podName:667228e0-9e32-4e3d-9cc0-110f3eaba507 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:20.983958274 +0000 UTC m=+195.655358089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls") pod "image-registry-5b656b9cf7-trmqp" (UID: "667228e0-9e32-4e3d-9cc0-110f3eaba507") : secret "image-registry-tls" not found Jun 13 01:14:20.399672 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:20.399633 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" event={"ID":"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c","Type":"ContainerStarted","Data":"d6720adcbb28573248441545ab2cf55af67b158b945140af8c3295ca5beeff59"} Jun 13 01:14:20.991140 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:20.991080 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:20.991317 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:20.991233 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 01:14:20.991317 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:20.991255 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b656b9cf7-trmqp: secret "image-registry-tls" not found Jun 13 01:14:20.991317 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:20.991314 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls podName:667228e0-9e32-4e3d-9cc0-110f3eaba507 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:22.99129672 +0000 UTC m=+197.662696536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls") pod "image-registry-5b656b9cf7-trmqp" (UID: "667228e0-9e32-4e3d-9cc0-110f3eaba507") : secret "image-registry-tls" not found Jun 13 01:14:22.407092 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:22.407051 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" event={"ID":"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c","Type":"ContainerStarted","Data":"c6e5d57e9639c507b1577da8c7fb89a3e679e0f3876f7b6041c5786bd5cf163f"} Jun 13 01:14:22.994697 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:22.994619 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" podStartSLOduration=1.8213320880000001 podStartE2EDuration="3.994602912s" totalImagesPullingTime="2.173270824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:22.422522673 +0000 UTC m=+197.093922510" watchObservedRunningTime="2026-06-13 01:14:22.994602912 +0000 UTC m=+197.666002784" Jun 13 01:14:22.995161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:22.995141 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w8r5b"] Jun 13 01:14:22.997224 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:22.997196 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:22.999430 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:22.999407 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 13 01:14:22.999540 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:22.999456 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 13 01:14:22.999540 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:22.999509 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hgh9r\"" Jun 13 01:14:23.006350 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.006322 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:23.006475 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:23.006459 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 01:14:23.006515 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:23.006477 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b656b9cf7-trmqp: secret "image-registry-tls" not found Jun 13 01:14:23.006549 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:23.006527 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls podName:667228e0-9e32-4e3d-9cc0-110f3eaba507 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:27.006512263 +0000 UTC m=+201.677912080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls") pod "image-registry-5b656b9cf7-trmqp" (UID: "667228e0-9e32-4e3d-9cc0-110f3eaba507") : secret "image-registry-tls" not found Jun 13 01:14:23.009238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.009215 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w8r5b"] Jun 13 01:14:23.106698 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.106661 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d2dj\" (UniqueName: \"kubernetes.io/projected/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-api-access-4d2dj\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.106887 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.106723 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/829a5fbe-395f-47e3-b9a9-fe97f48d5420-data-volume\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.106887 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.106777 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.106887 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.106802 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/829a5fbe-395f-47e3-b9a9-fe97f48d5420-crio-socket\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.107002 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.106880 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.208180 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.208138 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d2dj\" (UniqueName: \"kubernetes.io/projected/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-api-access-4d2dj\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.208336 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.208200 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/829a5fbe-395f-47e3-b9a9-fe97f48d5420-data-volume\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.208336 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.208230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.208336 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.208257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/829a5fbe-395f-47e3-b9a9-fe97f48d5420-crio-socket\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.208336 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.208320 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.208490 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:23.208326 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:23.208490 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:23.208411 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm podName:829a5fbe-395f-47e3-b9a9-fe97f48d5420 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:23.70839183 +0000 UTC m=+198.379791659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8r5b" (UID: "829a5fbe-395f-47e3-b9a9-fe97f48d5420") : configmap "kube-rbac-proxy" not found Jun 13 01:14:23.208490 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.208410 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/829a5fbe-395f-47e3-b9a9-fe97f48d5420-crio-socket\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.208490 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:23.208440 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:23.208614 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:23.208568 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls podName:829a5fbe-395f-47e3-b9a9-fe97f48d5420 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:23.708550967 +0000 UTC m=+198.379950800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8r5b" (UID: "829a5fbe-395f-47e3-b9a9-fe97f48d5420") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:23.208614 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.208590 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/829a5fbe-395f-47e3-b9a9-fe97f48d5420-data-volume\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.216236 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.216210 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d2dj\" (UniqueName: \"kubernetes.io/projected/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-api-access-4d2dj\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.713076 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.713037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.713461 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:23.713144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:23.713461 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:23.713188 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:23.713461 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:23.713250 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm podName:829a5fbe-395f-47e3-b9a9-fe97f48d5420 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:24.713235295 +0000 UTC m=+199.384635114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8r5b" (UID: "829a5fbe-395f-47e3-b9a9-fe97f48d5420") : configmap "kube-rbac-proxy" not found Jun 13 01:14:23.713461 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:23.713264 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:23.713461 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:23.713318 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls podName:829a5fbe-395f-47e3-b9a9-fe97f48d5420 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:24.713304395 +0000 UTC m=+199.384704211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8r5b" (UID: "829a5fbe-395f-47e3-b9a9-fe97f48d5420") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:24.313862 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:24.313824 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-flz7g"] Jun 13 01:14:24.315951 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:24.315936 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-flz7g" Jun 13 01:14:24.319508 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:24.319484 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jlbjm\"" Jun 13 01:14:24.319642 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:24.319618 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 13 01:14:24.320200 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:24.320182 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 13 01:14:24.326600 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:24.326578 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-flz7g"] Jun 13 01:14:24.418847 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:24.418816 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzxws\" (UniqueName: \"kubernetes.io/projected/7d3ea1a8-6411-41dc-b2b2-5df6fb3eff52-kube-api-access-kzxws\") pod \"migrator-d4bcd4867-flz7g\" (UID: \"7d3ea1a8-6411-41dc-b2b2-5df6fb3eff52\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-flz7g" Jun 13 01:14:24.519791 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:24.519756 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzxws\" (UniqueName: \"kubernetes.io/projected/7d3ea1a8-6411-41dc-b2b2-5df6fb3eff52-kube-api-access-kzxws\") pod \"migrator-d4bcd4867-flz7g\" (UID: \"7d3ea1a8-6411-41dc-b2b2-5df6fb3eff52\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-flz7g" Jun 13 01:14:24.531909 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:24.531872 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzxws\" (UniqueName: \"kubernetes.io/projected/7d3ea1a8-6411-41dc-b2b2-5df6fb3eff52-kube-api-access-kzxws\") pod \"migrator-d4bcd4867-flz7g\" (UID: \"7d3ea1a8-6411-41dc-b2b2-5df6fb3eff52\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-flz7g" Jun 13 01:14:24.624593 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:24.624509 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-flz7g" Jun 13 01:14:24.721411 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:24.721380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:24.721765 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:24.721451 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:24.721765 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:24.721532 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:24.721765 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:24.721599 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:24.721765 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:24.721607 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm podName:829a5fbe-395f-47e3-b9a9-fe97f48d5420 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:26.721586517 +0000 UTC m=+201.392986333 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8r5b" (UID: "829a5fbe-395f-47e3-b9a9-fe97f48d5420") : configmap "kube-rbac-proxy" not found Jun 13 01:14:24.721765 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:24.721636 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls podName:829a5fbe-395f-47e3-b9a9-fe97f48d5420 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:26.721625237 +0000 UTC m=+201.393025063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8r5b" (UID: "829a5fbe-395f-47e3-b9a9-fe97f48d5420") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:24.744855 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:24.743433 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-flz7g"] Jun 13 01:14:24.746397 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:14:24.746365 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3ea1a8_6411_41dc_b2b2_5df6fb3eff52.slice/crio-5e2de4ac9db5a6dfb73e9b3db303c2bf823aca4ff112482eee9e1cb9cfc61fcd WatchSource:0}: Error finding container 5e2de4ac9db5a6dfb73e9b3db303c2bf823aca4ff112482eee9e1cb9cfc61fcd: Status 404 returned error can't find the container with id 5e2de4ac9db5a6dfb73e9b3db303c2bf823aca4ff112482eee9e1cb9cfc61fcd Jun 13 01:14:24.763587 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:24.763559 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6lbfr_99950e12-9739-4b46-a978-b8aceafc3484/dns-node-resolver/0.log" Jun 13 01:14:25.417017 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:25.416976 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-flz7g" event={"ID":"7d3ea1a8-6411-41dc-b2b2-5df6fb3eff52","Type":"ContainerStarted","Data":"5e2de4ac9db5a6dfb73e9b3db303c2bf823aca4ff112482eee9e1cb9cfc61fcd"} Jun 13 01:14:26.165630 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:26.165595 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wtshb_7e1c0e0d-ba91-42c9-87ed-31b04d107dfa/node-ca/0.log" Jun 13 01:14:26.422161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:26.422130 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-flz7g" event={"ID":"7d3ea1a8-6411-41dc-b2b2-5df6fb3eff52","Type":"ContainerStarted","Data":"aa27c0a4d3798288b52a199932bb3dff7d6f26b217ba189d2025b259eef89a6c"} Jun 13 01:14:26.422327 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:26.422181 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-flz7g" event={"ID":"7d3ea1a8-6411-41dc-b2b2-5df6fb3eff52","Type":"ContainerStarted","Data":"248f0657b5179fd51544cc4639215d8c2952ab4bfca6371f36d1a61698a0bf36"} Jun 13 01:14:26.436888 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:26.436835 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-flz7g" podStartSLOduration=1.262528 podStartE2EDuration="2.436817499s" totalImagesPullingTime="1.174289499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:26.436568103 +0000 UTC m=+201.107967940" watchObservedRunningTime="2026-06-13 01:14:26.436817499 +0000 UTC m=+201.108217338" Jun 13 01:14:26.737207 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:26.737092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:26.737207 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:26.737198 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:26.737399 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:26.737259 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:26.737399 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:26.737272 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:26.737399 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:26.737326 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm podName:829a5fbe-395f-47e3-b9a9-fe97f48d5420 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:30.737312707 +0000 UTC m=+205.408712522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8r5b" (UID: "829a5fbe-395f-47e3-b9a9-fe97f48d5420") : configmap "kube-rbac-proxy" not found Jun 13 01:14:26.737399 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:26.737339 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls podName:829a5fbe-395f-47e3-b9a9-fe97f48d5420 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:30.737333707 +0000 UTC m=+205.408733523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8r5b" (UID: "829a5fbe-395f-47e3-b9a9-fe97f48d5420") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:26.768813 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:26.768788 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lpnms_3b81f243-dfba-47c9-995d-93e6d4577bb4/serve-healthcheck-canary/0.log" Jun 13 01:14:27.039908 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:27.039823 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:27.040045 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:27.039964 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 01:14:27.040045 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:27.039984 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b656b9cf7-trmqp: secret "image-registry-tls" not found Jun 13 01:14:27.040045 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:27.040038 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls podName:667228e0-9e32-4e3d-9cc0-110f3eaba507 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:35.040023879 +0000 UTC m=+209.711423695 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls") pod "image-registry-5b656b9cf7-trmqp" (UID: "667228e0-9e32-4e3d-9cc0-110f3eaba507") : secret "image-registry-tls" not found Jun 13 01:14:30.771505 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:30.771458 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:30.771928 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:30.771556 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:30.771928 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:30.771622 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:30.771928 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:30.771649 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:30.771928 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:30.771698 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls podName:829a5fbe-395f-47e3-b9a9-fe97f48d5420 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:38.771679763 +0000 UTC m=+213.443079580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8r5b" (UID: "829a5fbe-395f-47e3-b9a9-fe97f48d5420") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:30.771928 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:30.771713 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm podName:829a5fbe-395f-47e3-b9a9-fe97f48d5420 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:38.771705229 +0000 UTC m=+213.443105045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8r5b" (UID: "829a5fbe-395f-47e3-b9a9-fe97f48d5420") : configmap "kube-rbac-proxy" not found Jun 13 01:14:35.106847 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:35.106803 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:35.109351 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:35.109328 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls\") pod \"image-registry-5b656b9cf7-trmqp\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:35.231886 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:35.231850 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:35.356977 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:35.356898 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b656b9cf7-trmqp"] Jun 13 01:14:35.360353 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:14:35.360326 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667228e0_9e32_4e3d_9cc0_110f3eaba507.slice/crio-122be02bbbc03a61d109aff92855803517792bc174fa9f36f71d28b40f77255a WatchSource:0}: Error finding container 122be02bbbc03a61d109aff92855803517792bc174fa9f36f71d28b40f77255a: Status 404 returned error can't find the container with id 122be02bbbc03a61d109aff92855803517792bc174fa9f36f71d28b40f77255a Jun 13 01:14:35.450643 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:35.450606 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" event={"ID":"667228e0-9e32-4e3d-9cc0-110f3eaba507","Type":"ContainerStarted","Data":"9d7170971f25a6b472579c981d561c2c3ecb9e1ca6658bb21a75e8468be4e1d2"} Jun 13 01:14:35.450817 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:35.450658 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" event={"ID":"667228e0-9e32-4e3d-9cc0-110f3eaba507","Type":"ContainerStarted","Data":"122be02bbbc03a61d109aff92855803517792bc174fa9f36f71d28b40f77255a"} Jun 13 01:14:35.450817 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:35.450739 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:14:35.467650 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:35.467605 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" podStartSLOduration=16.467588041 podStartE2EDuration="16.467588041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:35.466735882 +0000 UTC m=+210.138135721" watchObservedRunningTime="2026-06-13 01:14:35.467588041 +0000 UTC m=+210.138987893" Jun 13 01:14:38.836273 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:38.836240 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:38.836616 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:38.836301 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:38.836793 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:38.836760 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/829a5fbe-395f-47e3-b9a9-fe97f48d5420-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:38.838579 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:38.838559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/829a5fbe-395f-47e3-b9a9-fe97f48d5420-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8r5b\" (UID: \"829a5fbe-395f-47e3-b9a9-fe97f48d5420\") " pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:38.906341 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:38.906301 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w8r5b" Jun 13 01:14:39.031384 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:39.031354 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w8r5b"] Jun 13 01:14:39.034281 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:14:39.034253 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod829a5fbe_395f_47e3_b9a9_fe97f48d5420.slice/crio-89ced3833980a94467ef9979448a0fe61c3dc783728f72f9008a7135fe6e62b2 WatchSource:0}: Error finding container 89ced3833980a94467ef9979448a0fe61c3dc783728f72f9008a7135fe6e62b2: Status 404 returned error can't find the container with id 89ced3833980a94467ef9979448a0fe61c3dc783728f72f9008a7135fe6e62b2 Jun 13 01:14:39.465800 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:39.465736 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8r5b" event={"ID":"829a5fbe-395f-47e3-b9a9-fe97f48d5420","Type":"ContainerStarted","Data":"89ced3833980a94467ef9979448a0fe61c3dc783728f72f9008a7135fe6e62b2"} Jun 13 01:14:42.475768 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:42.475731 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8r5b" event={"ID":"829a5fbe-395f-47e3-b9a9-fe97f48d5420","Type":"ContainerStarted","Data":"8d8631f3645dce65c1bb394b80ba49be8e33de097887172a7a1e33b0e9537688"} Jun 13 01:14:43.481639 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:43.481598 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8r5b" event={"ID":"829a5fbe-395f-47e3-b9a9-fe97f48d5420","Type":"ContainerStarted","Data":"54d3074ad55bddd973d403b64d733b55699307308c903da3a8a00aa395eb8d0f"} Jun 13 01:14:45.490483 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:45.490445 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8r5b" event={"ID":"829a5fbe-395f-47e3-b9a9-fe97f48d5420","Type":"ContainerStarted","Data":"937c4a74ba0b3e726771469b4e29617b9d77f9a90f865909375918ef9e740920"} Jun 13 01:14:45.507853 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:45.507801 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w8r5b" podStartSLOduration=18.076821827 podStartE2EDuration="23.507787444s" totalImagesPullingTime="5.430965617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:14:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:45.506417177 +0000 UTC m=+220.177817015" watchObservedRunningTime="2026-06-13 01:14:45.507787444 +0000 UTC m=+220.179187322" Jun 13 01:14:47.433643 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:47.433607 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b656b9cf7-trmqp"] Jun 13 01:14:54.266599 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:54.266563 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mdc8c"] Jun 13 01:14:54.269586 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:54.269567 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mdc8c" Jun 13 01:14:54.271907 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:54.271886 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 13 01:14:54.271990 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:54.271925 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-s8tq4\"" Jun 13 01:14:54.280762 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:54.280738 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mdc8c"] Jun 13 01:14:54.356690 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:54.356649 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6b5044c6-aacc-413d-a116-2622e560fe3d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-mdc8c\" (UID: \"6b5044c6-aacc-413d-a116-2622e560fe3d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mdc8c" Jun 13 01:14:54.457038 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:54.456997 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6b5044c6-aacc-413d-a116-2622e560fe3d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-mdc8c\" (UID: \"6b5044c6-aacc-413d-a116-2622e560fe3d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mdc8c" Jun 13 01:14:54.457242 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:54.457167 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 13 01:14:54.457242 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:14:54.457231 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5044c6-aacc-413d-a116-2622e560fe3d-tls-certificates podName:6b5044c6-aacc-413d-a116-2622e560fe3d nodeName:}" failed. No retries permitted until 2026-06-13 01:14:54.957215505 +0000 UTC m=+229.628615320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/6b5044c6-aacc-413d-a116-2622e560fe3d-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-mdc8c" (UID: "6b5044c6-aacc-413d-a116-2622e560fe3d") : secret "prometheus-operator-admission-webhook-tls" not found Jun 13 01:14:54.961296 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:54.961256 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6b5044c6-aacc-413d-a116-2622e560fe3d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-mdc8c\" (UID: \"6b5044c6-aacc-413d-a116-2622e560fe3d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mdc8c" Jun 13 01:14:54.963717 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:54.963681 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6b5044c6-aacc-413d-a116-2622e560fe3d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-mdc8c\" (UID: \"6b5044c6-aacc-413d-a116-2622e560fe3d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mdc8c" Jun 13 01:14:55.178249 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:55.178208 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mdc8c" Jun 13 01:14:55.297628 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:55.297597 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mdc8c"] Jun 13 01:14:55.300391 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:14:55.300357 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5044c6_aacc_413d_a116_2622e560fe3d.slice/crio-0064dcfdcbd064ea903053bb579869838b6c9dda03a499f033c3d0b412479632 WatchSource:0}: Error finding container 0064dcfdcbd064ea903053bb579869838b6c9dda03a499f033c3d0b412479632: Status 404 returned error can't find the container with id 0064dcfdcbd064ea903053bb579869838b6c9dda03a499f033c3d0b412479632 Jun 13 01:14:55.523384 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:55.523298 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mdc8c" event={"ID":"6b5044c6-aacc-413d-a116-2622e560fe3d","Type":"ContainerStarted","Data":"0064dcfdcbd064ea903053bb579869838b6c9dda03a499f033c3d0b412479632"} Jun 13 01:14:56.527495 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:56.527451 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mdc8c" event={"ID":"6b5044c6-aacc-413d-a116-2622e560fe3d","Type":"ContainerStarted","Data":"e748009b18055530b2cd548600f584392277acd044981b36b2a60649f5e3edca"} Jun 13 01:14:56.527859 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:56.527684 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mdc8c" Jun 13 01:14:56.532396 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:56.532374 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mdc8c" Jun 13 01:14:56.542960 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:56.542910 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mdc8c" podStartSLOduration=1.443789311 podStartE2EDuration="2.542897586s" totalImagesPullingTime="1.099108275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:56.541490331 +0000 UTC m=+231.212890169" watchObservedRunningTime="2026-06-13 01:14:56.542897586 +0000 UTC m=+231.214297424" Jun 13 01:14:57.439251 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:57.439219 2574 patch_prober.go:28] interesting pod/image-registry-5b656b9cf7-trmqp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 01:14:57.439420 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:14:57.439295 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" podUID="667228e0-9e32-4e3d-9cc0-110f3eaba507" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:15:02.851093 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.851058 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5krxm"] Jun 13 01:15:02.854813 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.854782 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:02.858963 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.857669 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 13 01:15:02.858963 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.857704 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wl8wg\"" Jun 13 01:15:02.858963 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.857750 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs"] Jun 13 01:15:02.858963 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.857796 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 13 01:15:02.859745 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.859721 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 13 01:15:02.860156 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.860139 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 13 01:15:02.860330 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.860156 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 13 01:15:02.860635 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.860618 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 13 01:15:02.862746 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.862731 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:02.865195 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.865176 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-z9w2j\"" Jun 13 01:15:02.865417 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.865401 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 13 01:15:02.865506 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.865431 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 13 01:15:02.865987 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.865972 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 13 01:15:02.888180 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:02.888158 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs"] Jun 13 01:15:03.022205 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-wtmp\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.022205 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022212 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-textfile\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.022448 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022233 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.022448 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1a7b72ae-4c83-4f89-b848-b5282788fc53-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.022448 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a7b72ae-4c83-4f89-b848-b5282788fc53-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.022448 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.022448 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022326 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n594k\" (UniqueName: \"kubernetes.io/projected/1a7b72ae-4c83-4f89-b848-b5282788fc53-kube-api-access-n594k\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.022448 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022417 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0646d30-6447-4e6e-afa5-c3f8049694c2-metrics-client-ca\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.022448 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022447 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1a7b72ae-4c83-4f89-b848-b5282788fc53-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.022761 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7b72ae-4c83-4f89-b848-b5282788fc53-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.022761 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0646d30-6447-4e6e-afa5-c3f8049694c2-sys\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.022761 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022576 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-tls\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.022761 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022616 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t8s6\" (UniqueName: \"kubernetes.io/projected/d0646d30-6447-4e6e-afa5-c3f8049694c2-kube-api-access-6t8s6\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.022761 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022644 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a7b72ae-4c83-4f89-b848-b5282788fc53-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.022761 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.022671 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0646d30-6447-4e6e-afa5-c3f8049694c2-root\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.123091 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.122995 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0646d30-6447-4e6e-afa5-c3f8049694c2-metrics-client-ca\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.123091 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1a7b72ae-4c83-4f89-b848-b5282788fc53-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.123091 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123065 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7b72ae-4c83-4f89-b848-b5282788fc53-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.123405 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0646d30-6447-4e6e-afa5-c3f8049694c2-sys\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.123405 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123140 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-tls\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.123405 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123163 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t8s6\" (UniqueName: \"kubernetes.io/projected/d0646d30-6447-4e6e-afa5-c3f8049694c2-kube-api-access-6t8s6\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.123405 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123184 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a7b72ae-4c83-4f89-b848-b5282788fc53-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.123405 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123221 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0646d30-6447-4e6e-afa5-c3f8049694c2-root\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.123405 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123221 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0646d30-6447-4e6e-afa5-c3f8049694c2-sys\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.123405 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-wtmp\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.123405 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123283 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-textfile\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.123405 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.123405 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123340 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1a7b72ae-4c83-4f89-b848-b5282788fc53-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.123405 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123367 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a7b72ae-4c83-4f89-b848-b5282788fc53-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.123405 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123397 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.123973 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123427 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n594k\" (UniqueName: \"kubernetes.io/projected/1a7b72ae-4c83-4f89-b848-b5282788fc53-kube-api-access-n594k\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.123973 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123631 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-wtmp\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.123973 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123688 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0646d30-6447-4e6e-afa5-c3f8049694c2-root\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.123973 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123800 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0646d30-6447-4e6e-afa5-c3f8049694c2-metrics-client-ca\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.123973 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123843 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1a7b72ae-4c83-4f89-b848-b5282788fc53-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.123973 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.123910 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a7b72ae-4c83-4f89-b848-b5282788fc53-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.124304 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.124038 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-textfile\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.124363 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.124321 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.124536 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.124516 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1a7b72ae-4c83-4f89-b848-b5282788fc53-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.125643 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.125618 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7b72ae-4c83-4f89-b848-b5282788fc53-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.125766 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.125748 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-tls\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.126108 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.126083 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0646d30-6447-4e6e-afa5-c3f8049694c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.126181 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.126165 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a7b72ae-4c83-4f89-b848-b5282788fc53-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.131416 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.131389 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n594k\" (UniqueName: \"kubernetes.io/projected/1a7b72ae-4c83-4f89-b848-b5282788fc53-kube-api-access-n594k\") pod \"kube-state-metrics-678bc549d7-cr9gs\" (UID: \"1a7b72ae-4c83-4f89-b848-b5282788fc53\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.131670 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.131651 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t8s6\" (UniqueName: \"kubernetes.io/projected/d0646d30-6447-4e6e-afa5-c3f8049694c2-kube-api-access-6t8s6\") pod \"node-exporter-5krxm\" (UID: \"d0646d30-6447-4e6e-afa5-c3f8049694c2\") " pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.168536 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.168501 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5krxm" Jun 13 01:15:03.172632 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.172605 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" Jun 13 01:15:03.183371 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:15:03.183335 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0646d30_6447_4e6e_afa5_c3f8049694c2.slice/crio-adef6051968993b4df7c207f4181af214833caa56d47220f71bcec5f0d6df283 WatchSource:0}: Error finding container adef6051968993b4df7c207f4181af214833caa56d47220f71bcec5f0d6df283: Status 404 returned error can't find the container with id adef6051968993b4df7c207f4181af214833caa56d47220f71bcec5f0d6df283 Jun 13 01:15:03.301623 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.301592 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs"] Jun 13 01:15:03.305210 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:15:03.305188 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7b72ae_4c83_4f89_b848_b5282788fc53.slice/crio-bba3148376d584dd4d308fe056bb20cfe540f9187ac434b662fbea9df7f03e9e WatchSource:0}: Error finding container bba3148376d584dd4d308fe056bb20cfe540f9187ac434b662fbea9df7f03e9e: Status 404 returned error can't find the container with id bba3148376d584dd4d308fe056bb20cfe540f9187ac434b662fbea9df7f03e9e Jun 13 01:15:03.549890 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.549853 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" event={"ID":"1a7b72ae-4c83-4f89-b848-b5282788fc53","Type":"ContainerStarted","Data":"bba3148376d584dd4d308fe056bb20cfe540f9187ac434b662fbea9df7f03e9e"} Jun 13 01:15:03.550905 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:03.550873 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5krxm" event={"ID":"d0646d30-6447-4e6e-afa5-c3f8049694c2","Type":"ContainerStarted","Data":"adef6051968993b4df7c207f4181af214833caa56d47220f71bcec5f0d6df283"} Jun 13 01:15:05.559054 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.559016 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" event={"ID":"1a7b72ae-4c83-4f89-b848-b5282788fc53","Type":"ContainerStarted","Data":"89ff2569ae89169dc6f72888983a35ccb05b737f73d1761513a1517a8e5bfac3"} Jun 13 01:15:05.559532 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.559083 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" event={"ID":"1a7b72ae-4c83-4f89-b848-b5282788fc53","Type":"ContainerStarted","Data":"862eaabe57146107282544b4e3f00ed78a7f387ca840367bd29e5e24bd2d4e33"} Jun 13 01:15:05.559532 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.559132 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" event={"ID":"1a7b72ae-4c83-4f89-b848-b5282788fc53","Type":"ContainerStarted","Data":"50cdd662db0da03479cf248ee5ef9978a051ecae5f78df960e8b29de3cedf058"} Jun 13 01:15:05.560640 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.560614 2574 generic.go:356] "Generic (PLEG): container finished" podID="d0646d30-6447-4e6e-afa5-c3f8049694c2" containerID="9bc40337f164560593849dd86946fdaf2c751c6eef2d7b2e0cdafc276318d795" exitCode=0 Jun 13 01:15:05.560704 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.560664 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5krxm" event={"ID":"d0646d30-6447-4e6e-afa5-c3f8049694c2","Type":"ContainerDied","Data":"9bc40337f164560593849dd86946fdaf2c751c6eef2d7b2e0cdafc276318d795"} Jun 13 01:15:05.584396 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.584319 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-cr9gs" podStartSLOduration=2.370849723 podStartE2EDuration="3.584262921s" totalImagesPullingTime="1.213413198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:05.584179708 +0000 UTC m=+240.255579600" watchObservedRunningTime="2026-06-13 01:15:05.584262921 +0000 UTC m=+240.255662760" Jun 13 01:15:05.828543 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.828473 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8b8d597bc-lg2cb"] Jun 13 01:15:05.832083 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.832063 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:05.837887 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.837824 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-78qu49f1uf2gi\"" Jun 13 01:15:05.838216 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.838195 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 13 01:15:05.838311 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.838269 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-f9vgx\"" Jun 13 01:15:05.838559 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.838537 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 13 01:15:05.838658 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.838567 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 13 01:15:05.838658 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.838573 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 13 01:15:05.838658 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.838568 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 13 01:15:05.849549 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.849529 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8b8d597bc-lg2cb"] Jun 13 01:15:05.949190 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.949146 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:05.949384 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.949227 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:05.949384 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.949248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-metrics-client-ca\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:05.949384 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.949270 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw8cl\" (UniqueName: \"kubernetes.io/projected/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-kube-api-access-zw8cl\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:05.949384 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.949288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-tls\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:05.949384 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.949337 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:05.949384 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.949376 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-grpc-tls\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:05.949611 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:05.949426 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.050583 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.050544 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.050727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.050598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-metrics-client-ca\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.050727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.050634 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw8cl\" (UniqueName: \"kubernetes.io/projected/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-kube-api-access-zw8cl\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.050727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.050679 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-tls\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.050891 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.050811 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.050891 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.050855 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-grpc-tls\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.051016 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.050887 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.051016 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.050958 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.051513 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.051485 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-metrics-client-ca\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.053817 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.053789 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.053934 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.053815 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-tls\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.053934 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.053856 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.054026 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.053962 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-grpc-tls\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.054268 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.054250 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.054343 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.054325 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.085108 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.067427 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw8cl\" (UniqueName: \"kubernetes.io/projected/25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054-kube-api-access-zw8cl\") pod \"thanos-querier-8b8d597bc-lg2cb\" (UID: \"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054\") " pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.140543 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.140510 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:06.270928 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.270897 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8b8d597bc-lg2cb"] Jun 13 01:15:06.565158 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.565110 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" event={"ID":"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054","Type":"ContainerStarted","Data":"322813efac1a794cb3c70ca1c2777e26ee25389436a935a050d1edee9ce9e046"} Jun 13 01:15:06.567107 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.567077 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5krxm" event={"ID":"d0646d30-6447-4e6e-afa5-c3f8049694c2","Type":"ContainerStarted","Data":"c462fa2d978df10c9121564cb9ba5de483ae3fd1e42e5b131c095ae6cab2ac8a"} Jun 13 01:15:06.567232 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.567155 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5krxm" event={"ID":"d0646d30-6447-4e6e-afa5-c3f8049694c2","Type":"ContainerStarted","Data":"52545d41c1051d86c337e81d6af8c99a5b2c4bfbb3c1edd5553cb24d3e5933d2"} Jun 13 01:15:06.587790 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:06.587742 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5krxm" podStartSLOduration=3.168121147 podStartE2EDuration="4.587728252s" totalImagesPullingTime="1.332571547s" totalInitContainerRuntime="87.035558ms" isStatefulPod=true podCreationTimestamp="2026-06-13 01:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:06.586490119 +0000 UTC m=+241.257889979" watchObservedRunningTime="2026-06-13 01:15:06.587728252 +0000 UTC m=+241.259128089" Jun 13 01:15:07.252082 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.252047 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-749c88674c-kpjj4"] Jun 13 01:15:07.255451 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.255427 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.257915 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.257702 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fu271t5mcaihv\"" Jun 13 01:15:07.257915 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.257823 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 13 01:15:07.258613 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.258589 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 13 01:15:07.258713 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.258616 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-x47pf\"" Jun 13 01:15:07.258784 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.258615 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 13 01:15:07.258842 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.258695 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 13 01:15:07.266437 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.266400 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-749c88674c-kpjj4"] Jun 13 01:15:07.363103 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.363066 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/da71d266-93bd-46f7-bb03-6404821efe79-secret-metrics-server-tls\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.363294 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.363131 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da71d266-93bd-46f7-bb03-6404821efe79-client-ca-bundle\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.363294 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.363176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/da71d266-93bd-46f7-bb03-6404821efe79-audit-log\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.363294 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.363218 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da71d266-93bd-46f7-bb03-6404821efe79-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.363294 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.363257 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/da71d266-93bd-46f7-bb03-6404821efe79-secret-metrics-server-client-certs\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.363504 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.363325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/da71d266-93bd-46f7-bb03-6404821efe79-metrics-server-audit-profiles\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.363504 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.363350 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bsmx\" (UniqueName: \"kubernetes.io/projected/da71d266-93bd-46f7-bb03-6404821efe79-kube-api-access-4bsmx\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.438378 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.438341 2574 patch_prober.go:28] interesting pod/image-registry-5b656b9cf7-trmqp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 01:15:07.438547 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.438398 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" podUID="667228e0-9e32-4e3d-9cc0-110f3eaba507" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:15:07.464379 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.464342 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da71d266-93bd-46f7-bb03-6404821efe79-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.464547 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.464396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/da71d266-93bd-46f7-bb03-6404821efe79-secret-metrics-server-client-certs\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.464547 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.464462 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/da71d266-93bd-46f7-bb03-6404821efe79-metrics-server-audit-profiles\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.464547 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.464493 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bsmx\" (UniqueName: \"kubernetes.io/projected/da71d266-93bd-46f7-bb03-6404821efe79-kube-api-access-4bsmx\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.464547 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.464536 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/da71d266-93bd-46f7-bb03-6404821efe79-secret-metrics-server-tls\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.464746 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.464557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da71d266-93bd-46f7-bb03-6404821efe79-client-ca-bundle\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.464746 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.464594 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/da71d266-93bd-46f7-bb03-6404821efe79-audit-log\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.465025 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.464999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/da71d266-93bd-46f7-bb03-6404821efe79-audit-log\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.465489 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.465461 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da71d266-93bd-46f7-bb03-6404821efe79-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.465753 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.465730 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/da71d266-93bd-46f7-bb03-6404821efe79-metrics-server-audit-profiles\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.467852 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.467814 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da71d266-93bd-46f7-bb03-6404821efe79-client-ca-bundle\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.468280 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.468259 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/da71d266-93bd-46f7-bb03-6404821efe79-secret-metrics-server-client-certs\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.468641 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.468618 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/da71d266-93bd-46f7-bb03-6404821efe79-secret-metrics-server-tls\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.475580 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.475555 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bsmx\" (UniqueName: \"kubernetes.io/projected/da71d266-93bd-46f7-bb03-6404821efe79-kube-api-access-4bsmx\") pod \"metrics-server-749c88674c-kpjj4\" (UID: \"da71d266-93bd-46f7-bb03-6404821efe79\") " pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.568081 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.567938 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:07.569833 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.569802 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75ccdbf9db-qhl9q"] Jun 13 01:15:07.573529 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.573512 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.575896 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.575870 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 13 01:15:07.576024 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.575870 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 13 01:15:07.576024 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.575993 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 13 01:15:07.576193 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.576000 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 13 01:15:07.576193 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.576142 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 13 01:15:07.576319 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.576197 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qmjhv\"" Jun 13 01:15:07.576319 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.576277 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 13 01:15:07.576460 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.576377 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 13 01:15:07.581422 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.581404 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 13 01:15:07.585588 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.585563 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75ccdbf9db-qhl9q"] Jun 13 01:15:07.720808 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.720777 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-749c88674c-kpjj4"] Jun 13 01:15:07.724900 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:15:07.724523 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda71d266_93bd_46f7_bb03_6404821efe79.slice/crio-14c193ede5de5824e101d9cae2e21548c46ace59eb44449042e5d7583b43cb9d WatchSource:0}: Error finding container 14c193ede5de5824e101d9cae2e21548c46ace59eb44449042e5d7583b43cb9d: Status 404 returned error can't find the container with id 14c193ede5de5824e101d9cae2e21548c46ace59eb44449042e5d7583b43cb9d Jun 13 01:15:07.766626 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.766599 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-oauth-config\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.766785 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.766630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-trusted-ca-bundle\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.766785 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.766690 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-service-ca\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.766785 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.766733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-config\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.766948 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.766820 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-serving-cert\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.766948 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.766877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-oauth-serving-cert\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.766948 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.766909 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtt84\" (UniqueName: \"kubernetes.io/projected/a2330c82-df6b-4d3f-94f4-170be3300c8a-kube-api-access-xtt84\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.867864 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.867771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-oauth-config\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.867864 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.867826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-trusted-ca-bundle\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.868100 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.867905 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-service-ca\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.868100 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.867966 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-config\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.868100 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.868025 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-serving-cert\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.868100 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.868064 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-oauth-serving-cert\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.868100 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.868093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtt84\" (UniqueName: \"kubernetes.io/projected/a2330c82-df6b-4d3f-94f4-170be3300c8a-kube-api-access-xtt84\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.869228 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.869172 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-oauth-serving-cert\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.869436 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.869408 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-trusted-ca-bundle\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.869690 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.869669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-config\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.869690 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.869680 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-service-ca\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.870780 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.870753 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-oauth-config\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.870946 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.870917 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-serving-cert\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.878471 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.878437 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtt84\" (UniqueName: \"kubernetes.io/projected/a2330c82-df6b-4d3f-94f4-170be3300c8a-kube-api-access-xtt84\") pod \"console-75ccdbf9db-qhl9q\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:07.895680 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:07.895639 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:08.370981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:08.370954 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75ccdbf9db-qhl9q"] Jun 13 01:15:08.374801 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:15:08.374771 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2330c82_df6b_4d3f_94f4_170be3300c8a.slice/crio-aee4ed5f0de58b8ea6deff862d8272defd59b18ae77b8fd103e3a01f7ed1dc2a WatchSource:0}: Error finding container aee4ed5f0de58b8ea6deff862d8272defd59b18ae77b8fd103e3a01f7ed1dc2a: Status 404 returned error can't find the container with id aee4ed5f0de58b8ea6deff862d8272defd59b18ae77b8fd103e3a01f7ed1dc2a Jun 13 01:15:08.579428 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:08.579348 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" event={"ID":"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054","Type":"ContainerStarted","Data":"f09e0b6bbd6dca286747f14af210a4218bdfebefd13e85d0d8c684be679dda2f"} Jun 13 01:15:08.579839 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:08.579433 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" event={"ID":"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054","Type":"ContainerStarted","Data":"7f2658047fbbc13f2d8b275a83f5cac458a0a18ba2440f75d3ccbdcf5551df9d"} Jun 13 01:15:08.579839 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:08.579471 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" event={"ID":"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054","Type":"ContainerStarted","Data":"9c1e4848e8032225dd052e98ecbbb3210f1639c8ce389fbc5b2a47b32cfbf30f"} Jun 13 01:15:08.580606 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:08.580582 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75ccdbf9db-qhl9q" event={"ID":"a2330c82-df6b-4d3f-94f4-170be3300c8a","Type":"ContainerStarted","Data":"aee4ed5f0de58b8ea6deff862d8272defd59b18ae77b8fd103e3a01f7ed1dc2a"} Jun 13 01:15:08.581815 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:08.581790 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" event={"ID":"da71d266-93bd-46f7-bb03-6404821efe79","Type":"ContainerStarted","Data":"14c193ede5de5824e101d9cae2e21548c46ace59eb44449042e5d7583b43cb9d"} Jun 13 01:15:10.594229 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:10.594183 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" event={"ID":"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054","Type":"ContainerStarted","Data":"a6a8339d5fe2e4e924af3252710cf3d39ef28db6144134419f15588cbbd03c24"} Jun 13 01:15:10.594697 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:10.594277 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" event={"ID":"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054","Type":"ContainerStarted","Data":"1e435e8d81dbd4e032e703dea34091a6c2cd5c618b6955828f93ea3d3ab90bd6"} Jun 13 01:15:10.594697 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:10.594320 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" event={"ID":"25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054","Type":"ContainerStarted","Data":"c95213741938ceb81c3b3899a8dce6578de6d52259570887c5a3eb3974b002a6"} Jun 13 01:15:10.594697 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:10.594367 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:10.596273 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:10.596245 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" event={"ID":"da71d266-93bd-46f7-bb03-6404821efe79","Type":"ContainerStarted","Data":"267a95d5e19cc12528f3e1df476b04b2dc0efa45de5998f647e389590d0bd6af"} Jun 13 01:15:10.622006 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:10.621927 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" podStartSLOduration=2.536139372 podStartE2EDuration="5.621905855s" totalImagesPullingTime="3.085766483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:15:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:10.620176804 +0000 UTC m=+245.291576646" watchObservedRunningTime="2026-06-13 01:15:10.621905855 +0000 UTC m=+245.293305694" Jun 13 01:15:10.640708 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:10.640646 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" podStartSLOduration=1.8400514019999998 podStartE2EDuration="3.640623265s" totalImagesPullingTime="1.800571863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:10.63915726 +0000 UTC m=+245.310557101" watchObservedRunningTime="2026-06-13 01:15:10.640623265 +0000 UTC m=+245.312023105" Jun 13 01:15:11.602243 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:11.602148 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75ccdbf9db-qhl9q" event={"ID":"a2330c82-df6b-4d3f-94f4-170be3300c8a","Type":"ContainerStarted","Data":"d8a040dcc885eced11652518c44a80fd9a7cb37a6acf0672ba2c9eb71da9dce7"} Jun 13 01:15:11.621515 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:11.621461 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75ccdbf9db-qhl9q" podStartSLOduration=1.8387028170000002 podStartE2EDuration="4.621443351s" totalImagesPullingTime="2.782740534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:11.620425081 +0000 UTC m=+246.291824932" watchObservedRunningTime="2026-06-13 01:15:11.621443351 +0000 UTC m=+246.292843191" Jun 13 01:15:12.453221 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.453170 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" podUID="667228e0-9e32-4e3d-9cc0-110f3eaba507" containerName="registry" containerID="cri-o://9d7170971f25a6b472579c981d561c2c3ecb9e1ca6658bb21a75e8468be4e1d2" gracePeriod=30 Jun 13 01:15:12.608137 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.608077 2574 generic.go:356] "Generic (PLEG): container finished" podID="667228e0-9e32-4e3d-9cc0-110f3eaba507" containerID="9d7170971f25a6b472579c981d561c2c3ecb9e1ca6658bb21a75e8468be4e1d2" exitCode=0 Jun 13 01:15:12.608701 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.608614 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" event={"ID":"667228e0-9e32-4e3d-9cc0-110f3eaba507","Type":"ContainerDied","Data":"9d7170971f25a6b472579c981d561c2c3ecb9e1ca6658bb21a75e8468be4e1d2"} Jun 13 01:15:12.716534 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.716475 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:15:12.813975 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.813941 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/667228e0-9e32-4e3d-9cc0-110f3eaba507-trusted-ca\") pod \"667228e0-9e32-4e3d-9cc0-110f3eaba507\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " Jun 13 01:15:12.814165 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.814005 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/667228e0-9e32-4e3d-9cc0-110f3eaba507-image-registry-private-configuration\") pod \"667228e0-9e32-4e3d-9cc0-110f3eaba507\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " Jun 13 01:15:12.814165 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.814037 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-bound-sa-token\") pod \"667228e0-9e32-4e3d-9cc0-110f3eaba507\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " Jun 13 01:15:12.814165 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.814054 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-certificates\") pod \"667228e0-9e32-4e3d-9cc0-110f3eaba507\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " Jun 13 01:15:12.814165 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.814096 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/667228e0-9e32-4e3d-9cc0-110f3eaba507-installation-pull-secrets\") pod \"667228e0-9e32-4e3d-9cc0-110f3eaba507\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " Jun 13 01:15:12.814165 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.814141 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdgjr\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-kube-api-access-qdgjr\") pod \"667228e0-9e32-4e3d-9cc0-110f3eaba507\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " Jun 13 01:15:12.814418 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.814182 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/667228e0-9e32-4e3d-9cc0-110f3eaba507-ca-trust-extracted\") pod \"667228e0-9e32-4e3d-9cc0-110f3eaba507\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " Jun 13 01:15:12.814418 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.814230 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls\") pod \"667228e0-9e32-4e3d-9cc0-110f3eaba507\" (UID: \"667228e0-9e32-4e3d-9cc0-110f3eaba507\") " Jun 13 01:15:12.814523 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.814469 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/667228e0-9e32-4e3d-9cc0-110f3eaba507-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "667228e0-9e32-4e3d-9cc0-110f3eaba507" (UID: "667228e0-9e32-4e3d-9cc0-110f3eaba507"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:15:12.814747 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.814628 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "667228e0-9e32-4e3d-9cc0-110f3eaba507" (UID: "667228e0-9e32-4e3d-9cc0-110f3eaba507"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:15:12.816689 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.816648 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/667228e0-9e32-4e3d-9cc0-110f3eaba507-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "667228e0-9e32-4e3d-9cc0-110f3eaba507" (UID: "667228e0-9e32-4e3d-9cc0-110f3eaba507"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:15:12.816892 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.816860 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/667228e0-9e32-4e3d-9cc0-110f3eaba507-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "667228e0-9e32-4e3d-9cc0-110f3eaba507" (UID: "667228e0-9e32-4e3d-9cc0-110f3eaba507"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:15:12.816980 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.816892 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "667228e0-9e32-4e3d-9cc0-110f3eaba507" (UID: "667228e0-9e32-4e3d-9cc0-110f3eaba507"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:15:12.817087 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.817064 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "667228e0-9e32-4e3d-9cc0-110f3eaba507" (UID: "667228e0-9e32-4e3d-9cc0-110f3eaba507"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:15:12.817193 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.817174 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-kube-api-access-qdgjr" (OuterVolumeSpecName: "kube-api-access-qdgjr") pod "667228e0-9e32-4e3d-9cc0-110f3eaba507" (UID: "667228e0-9e32-4e3d-9cc0-110f3eaba507"). InnerVolumeSpecName "kube-api-access-qdgjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:15:12.823172 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.823146 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667228e0-9e32-4e3d-9cc0-110f3eaba507-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "667228e0-9e32-4e3d-9cc0-110f3eaba507" (UID: "667228e0-9e32-4e3d-9cc0-110f3eaba507"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:15:12.915199 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.915170 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-bound-sa-token\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:15:12.915199 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.915195 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-certificates\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:15:12.915199 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.915205 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/667228e0-9e32-4e3d-9cc0-110f3eaba507-installation-pull-secrets\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:15:12.915414 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.915216 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdgjr\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-kube-api-access-qdgjr\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:15:12.915414 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.915224 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/667228e0-9e32-4e3d-9cc0-110f3eaba507-ca-trust-extracted\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:15:12.915414 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.915234 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/667228e0-9e32-4e3d-9cc0-110f3eaba507-registry-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:15:12.915414 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.915242 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/667228e0-9e32-4e3d-9cc0-110f3eaba507-trusted-ca\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:15:12.915414 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:12.915250 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/667228e0-9e32-4e3d-9cc0-110f3eaba507-image-registry-private-configuration\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:15:13.613091 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:13.613061 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" Jun 13 01:15:13.613091 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:13.613073 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b656b9cf7-trmqp" event={"ID":"667228e0-9e32-4e3d-9cc0-110f3eaba507","Type":"ContainerDied","Data":"122be02bbbc03a61d109aff92855803517792bc174fa9f36f71d28b40f77255a"} Jun 13 01:15:13.613592 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:13.613148 2574 scope.go:117] "RemoveContainer" containerID="9d7170971f25a6b472579c981d561c2c3ecb9e1ca6658bb21a75e8468be4e1d2" Jun 13 01:15:13.636490 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:13.636461 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b656b9cf7-trmqp"] Jun 13 01:15:13.640596 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:13.640572 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b656b9cf7-trmqp"] Jun 13 01:15:13.761845 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:13.761816 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="667228e0-9e32-4e3d-9cc0-110f3eaba507" path="/var/lib/kubelet/pods/667228e0-9e32-4e3d-9cc0-110f3eaba507/volumes" Jun 13 01:15:16.608510 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:16.608479 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8b8d597bc-lg2cb" Jun 13 01:15:17.554925 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:17.554884 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:15:17.557219 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:17.557194 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e747bdd-f2b9-467c-b520-103a6c772f14-metrics-certs\") pod \"network-metrics-daemon-h48sb\" (UID: \"3e747bdd-f2b9-467c-b520-103a6c772f14\") " pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:15:17.660881 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:17.660847 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-86b5g\"" Jun 13 01:15:17.668693 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:17.668671 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h48sb" Jun 13 01:15:17.795371 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:17.795274 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h48sb"] Jun 13 01:15:17.797918 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:15:17.797886 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e747bdd_f2b9_467c_b520_103a6c772f14.slice/crio-9a78017297a0c1bb76a207b120a2fc33c8c773594e553160fae3ea05f19ab4a4 WatchSource:0}: Error finding container 9a78017297a0c1bb76a207b120a2fc33c8c773594e553160fae3ea05f19ab4a4: Status 404 returned error can't find the container with id 9a78017297a0c1bb76a207b120a2fc33c8c773594e553160fae3ea05f19ab4a4 Jun 13 01:15:17.895804 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:17.895767 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:17.895982 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:17.895833 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:17.897218 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:17.897193 2574 patch_prober.go:28] interesting pod/console-75ccdbf9db-qhl9q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 13 01:15:17.897330 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:17.897264 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75ccdbf9db-qhl9q" podUID="a2330c82-df6b-4d3f-94f4-170be3300c8a" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 13 01:15:18.634141 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:18.633199 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h48sb" event={"ID":"3e747bdd-f2b9-467c-b520-103a6c772f14","Type":"ContainerStarted","Data":"9a78017297a0c1bb76a207b120a2fc33c8c773594e553160fae3ea05f19ab4a4"} Jun 13 01:15:19.639135 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:19.639083 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h48sb" event={"ID":"3e747bdd-f2b9-467c-b520-103a6c772f14","Type":"ContainerStarted","Data":"4dd26c14239b101bc8740c1bb0aba6d04b5a8a48a76caf5efae5f73957378ee5"} Jun 13 01:15:19.639505 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:19.639162 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h48sb" event={"ID":"3e747bdd-f2b9-467c-b520-103a6c772f14","Type":"ContainerStarted","Data":"617dba860483d2c47f89de193dfddb85604328ee6534dbc71353b36d58743398"} Jun 13 01:15:19.656694 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:19.656646 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h48sb" podStartSLOduration=253.730798343 podStartE2EDuration="4m14.65663051s" totalImagesPullingTime="925.832167ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:19.655487352 +0000 UTC m=+254.326887189" watchObservedRunningTime="2026-06-13 01:15:19.65663051 +0000 UTC m=+254.328030348" Jun 13 01:15:27.568914 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:27.568878 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:27.569412 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:27.568936 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:27.896541 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:27.896509 2574 patch_prober.go:28] interesting pod/console-75ccdbf9db-qhl9q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 13 01:15:27.896699 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:27.896577 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75ccdbf9db-qhl9q" podUID="a2330c82-df6b-4d3f-94f4-170be3300c8a" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 13 01:15:32.696065 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:32.696029 2574 generic.go:356] "Generic (PLEG): container finished" podID="c7b5138c-ff49-48a7-aa9e-32bf01eacf4c" containerID="c6e5d57e9639c507b1577da8c7fb89a3e679e0f3876f7b6041c5786bd5cf163f" exitCode=0 Jun 13 01:15:32.696451 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:32.696102 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" event={"ID":"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c","Type":"ContainerDied","Data":"c6e5d57e9639c507b1577da8c7fb89a3e679e0f3876f7b6041c5786bd5cf163f"} Jun 13 01:15:32.696451 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:32.696430 2574 scope.go:117] "RemoveContainer" containerID="c6e5d57e9639c507b1577da8c7fb89a3e679e0f3876f7b6041c5786bd5cf163f" Jun 13 01:15:33.703458 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:33.703418 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-64ktm" event={"ID":"c7b5138c-ff49-48a7-aa9e-32bf01eacf4c","Type":"ContainerStarted","Data":"b61ecac84910af542add5353681501717e996b29c92553145bc4de2c7be51ea4"} Jun 13 01:15:37.530171 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:37.530138 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-cr9gs_1a7b72ae-4c83-4f89-b848-b5282788fc53/kube-state-metrics/0.log" Jun 13 01:15:37.729749 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:37.729720 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-cr9gs_1a7b72ae-4c83-4f89-b848-b5282788fc53/kube-rbac-proxy-main/0.log" Jun 13 01:15:37.896749 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:37.896718 2574 patch_prober.go:28] interesting pod/console-75ccdbf9db-qhl9q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 13 01:15:37.896901 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:37.896766 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75ccdbf9db-qhl9q" podUID="a2330c82-df6b-4d3f-94f4-170be3300c8a" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 13 01:15:37.929689 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:37.929662 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-cr9gs_1a7b72ae-4c83-4f89-b848-b5282788fc53/kube-rbac-proxy-self/0.log" Jun 13 01:15:38.130352 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:38.130326 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-749c88674c-kpjj4_da71d266-93bd-46f7-bb03-6404821efe79/metrics-server/0.log" Jun 13 01:15:38.528591 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:38.528559 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5krxm_d0646d30-6447-4e6e-afa5-c3f8049694c2/init-textfile/0.log" Jun 13 01:15:38.729080 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:38.729052 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5krxm_d0646d30-6447-4e6e-afa5-c3f8049694c2/node-exporter/0.log" Jun 13 01:15:38.930678 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:38.930650 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5krxm_d0646d30-6447-4e6e-afa5-c3f8049694c2/kube-rbac-proxy/0.log" Jun 13 01:15:42.730383 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:42.730351 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-mdc8c_6b5044c6-aacc-413d-a116-2622e560fe3d/prometheus-operator-admission-webhook/0.log" Jun 13 01:15:42.929766 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:42.929738 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8b8d597bc-lg2cb_25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054/thanos-query/0.log" Jun 13 01:15:43.129467 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:43.129391 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8b8d597bc-lg2cb_25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054/kube-rbac-proxy-web/0.log" Jun 13 01:15:43.329559 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:43.329532 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8b8d597bc-lg2cb_25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054/kube-rbac-proxy/0.log" Jun 13 01:15:43.529944 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:43.529916 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8b8d597bc-lg2cb_25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054/prom-label-proxy/0.log" Jun 13 01:15:43.729217 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:43.729154 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8b8d597bc-lg2cb_25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054/kube-rbac-proxy-rules/0.log" Jun 13 01:15:43.930093 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:43.930066 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8b8d597bc-lg2cb_25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054/kube-rbac-proxy-metrics/0.log" Jun 13 01:15:45.130166 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:45.130135 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75ccdbf9db-qhl9q_a2330c82-df6b-4d3f-94f4-170be3300c8a/console/0.log" Jun 13 01:15:46.284915 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:15:46.284876 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hvksv" podUID="ca7840d9-989c-44d8-b024-deefde6a5539" Jun 13 01:15:46.729532 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:46.729507 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6lbfr_99950e12-9739-4b46-a978-b8aceafc3484/dns-node-resolver/0.log" Jun 13 01:15:46.748355 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:46.748330 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvksv" Jun 13 01:15:47.573699 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:47.573670 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:47.577435 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:47.577406 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-749c88674c-kpjj4" Jun 13 01:15:47.897026 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:47.896994 2574 patch_prober.go:28] interesting pod/console-75ccdbf9db-qhl9q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 13 01:15:47.897213 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:47.897062 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75ccdbf9db-qhl9q" podUID="a2330c82-df6b-4d3f-94f4-170be3300c8a" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 13 01:15:48.128695 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:48.128667 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wtshb_7e1c0e0d-ba91-42c9-87ed-31b04d107dfa/node-ca/0.log" Jun 13 01:15:48.730300 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:48.730270 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lpnms_3b81f243-dfba-47c9-995d-93e6d4577bb4/serve-healthcheck-canary/0.log" Jun 13 01:15:50.231785 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:50.231747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:15:50.234202 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:50.234174 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7840d9-989c-44d8-b024-deefde6a5539-metrics-tls\") pod \"dns-default-hvksv\" (UID: \"ca7840d9-989c-44d8-b024-deefde6a5539\") " pod="openshift-dns/dns-default-hvksv" Jun 13 01:15:50.352029 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:50.351995 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hswsv\"" Jun 13 01:15:50.360064 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:50.360025 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvksv" Jun 13 01:15:50.527967 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:50.527935 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hvksv"] Jun 13 01:15:50.530677 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:15:50.530640 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7840d9_989c_44d8_b024_deefde6a5539.slice/crio-b23ef50cd951a476dbb3afbc234a0396186a8ad9d8d60b0a0c42b61f883bc23d WatchSource:0}: Error finding container b23ef50cd951a476dbb3afbc234a0396186a8ad9d8d60b0a0c42b61f883bc23d: Status 404 returned error can't find the container with id b23ef50cd951a476dbb3afbc234a0396186a8ad9d8d60b0a0c42b61f883bc23d Jun 13 01:15:50.768635 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:50.768596 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvksv" event={"ID":"ca7840d9-989c-44d8-b024-deefde6a5539","Type":"ContainerStarted","Data":"b23ef50cd951a476dbb3afbc234a0396186a8ad9d8d60b0a0c42b61f883bc23d"} Jun 13 01:15:52.784103 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:52.784063 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvksv" event={"ID":"ca7840d9-989c-44d8-b024-deefde6a5539","Type":"ContainerStarted","Data":"3236725aa7ae57bfbf6bba32b8058c50dce5baa03f911d8a984e565d691d19c9"} Jun 13 01:15:52.784492 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:52.784156 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvksv" event={"ID":"ca7840d9-989c-44d8-b024-deefde6a5539","Type":"ContainerStarted","Data":"ae3bdb32a3ff2064488fede4540ce9485047aa70af778addc1a67d1ef1fb1022"} Jun 13 01:15:52.799575 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:52.799509 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hvksv" podStartSLOduration=250.992241502 podStartE2EDuration="4m12.7994876s" totalImagesPullingTime="1.807246098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:52.799362401 +0000 UTC m=+287.470762249" watchObservedRunningTime="2026-06-13 01:15:52.7994876 +0000 UTC m=+287.470887435" Jun 13 01:15:53.787890 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:53.787862 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hvksv" Jun 13 01:15:57.900860 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:57.900823 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:15:57.904883 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:15:57.904862 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:16:03.793659 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:03.793631 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hvksv" Jun 13 01:16:05.708932 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:05.708908 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:16:05.713501 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:05.713481 2574 kubelet.go:1648] "Image garbage collection succeeded" Jun 13 01:16:05.714538 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:05.714522 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:16:31.710396 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.710343 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f658f9c59-knv2q"] Jun 13 01:16:31.712297 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.710628 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="667228e0-9e32-4e3d-9cc0-110f3eaba507" containerName="registry" Jun 13 01:16:31.712297 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.710639 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="667228e0-9e32-4e3d-9cc0-110f3eaba507" containerName="registry" Jun 13 01:16:31.712297 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.710693 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="667228e0-9e32-4e3d-9cc0-110f3eaba507" containerName="registry" Jun 13 01:16:31.712843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.712822 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.726015 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.725978 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f658f9c59-knv2q"] Jun 13 01:16:31.771961 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.771926 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/290dda08-9a65-4cbc-9db9-081e0592684c-console-oauth-config\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.771961 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.771963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-trusted-ca-bundle\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.772188 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.771994 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-console-config\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.772188 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.772027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6bjb\" (UniqueName: \"kubernetes.io/projected/290dda08-9a65-4cbc-9db9-081e0592684c-kube-api-access-d6bjb\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.772188 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.772141 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-service-ca\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.772188 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.772170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-oauth-serving-cert\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.772318 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.772198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/290dda08-9a65-4cbc-9db9-081e0592684c-console-serving-cert\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.873433 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.873400 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/290dda08-9a65-4cbc-9db9-081e0592684c-console-oauth-config\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.873433 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.873440 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-trusted-ca-bundle\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.873683 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.873476 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-console-config\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.873683 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.873492 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6bjb\" (UniqueName: \"kubernetes.io/projected/290dda08-9a65-4cbc-9db9-081e0592684c-kube-api-access-d6bjb\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.873683 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.873515 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-service-ca\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.873683 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.873539 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-oauth-serving-cert\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.873683 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.873596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/290dda08-9a65-4cbc-9db9-081e0592684c-console-serving-cert\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.874305 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.874278 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-console-config\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.874487 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.874345 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-service-ca\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.874487 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.874406 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-oauth-serving-cert\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.874625 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.874543 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-trusted-ca-bundle\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.875975 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.875959 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/290dda08-9a65-4cbc-9db9-081e0592684c-console-oauth-config\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.876073 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.876057 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/290dda08-9a65-4cbc-9db9-081e0592684c-console-serving-cert\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:31.882226 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:31.882201 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6bjb\" (UniqueName: \"kubernetes.io/projected/290dda08-9a65-4cbc-9db9-081e0592684c-kube-api-access-d6bjb\") pod \"console-7f658f9c59-knv2q\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:32.022187 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:32.022086 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:32.158024 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:32.157976 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f658f9c59-knv2q"] Jun 13 01:16:32.161241 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:16:32.160922 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod290dda08_9a65_4cbc_9db9_081e0592684c.slice/crio-3cc31c050ea87a17412399f0588297aed5d31aa33db535bed56308dca1dec4a1 WatchSource:0}: Error finding container 3cc31c050ea87a17412399f0588297aed5d31aa33db535bed56308dca1dec4a1: Status 404 returned error can't find the container with id 3cc31c050ea87a17412399f0588297aed5d31aa33db535bed56308dca1dec4a1 Jun 13 01:16:32.935667 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:32.935630 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f658f9c59-knv2q" event={"ID":"290dda08-9a65-4cbc-9db9-081e0592684c","Type":"ContainerStarted","Data":"39dd0234c7edbdfcff23824d0376d828b07448848e9b503698c820c6e97778b1"} Jun 13 01:16:32.936036 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:32.935688 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f658f9c59-knv2q" event={"ID":"290dda08-9a65-4cbc-9db9-081e0592684c","Type":"ContainerStarted","Data":"3cc31c050ea87a17412399f0588297aed5d31aa33db535bed56308dca1dec4a1"} Jun 13 01:16:32.954395 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:32.954327 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f658f9c59-knv2q" podStartSLOduration=1.954304852 podStartE2EDuration="1.954304852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:16:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:16:32.952876571 +0000 UTC m=+327.624276432" watchObservedRunningTime="2026-06-13 01:16:32.954304852 +0000 UTC m=+327.625704692" Jun 13 01:16:42.022456 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:42.022412 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:42.022924 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:42.022492 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:42.027085 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:42.027056 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:42.977838 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:42.977811 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:16:43.030265 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.030229 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75ccdbf9db-qhl9q"] Jun 13 01:16:43.154173 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.154135 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd85b97c9-z2fxz"] Jun 13 01:16:43.157218 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.157199 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.169079 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.169051 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd85b97c9-z2fxz"] Jun 13 01:16:43.273780 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.273693 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe416418-af7c-439d-a351-c3035e812f72-console-serving-cert\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.273780 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.273728 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe416418-af7c-439d-a351-c3035e812f72-console-config\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.273780 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.273750 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe416418-af7c-439d-a351-c3035e812f72-service-ca\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.273991 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.273784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe416418-af7c-439d-a351-c3035e812f72-oauth-serving-cert\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.273991 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.273830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe416418-af7c-439d-a351-c3035e812f72-console-oauth-config\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.273991 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.273851 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr5mq\" (UniqueName: \"kubernetes.io/projected/fe416418-af7c-439d-a351-c3035e812f72-kube-api-access-pr5mq\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.273991 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.273899 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe416418-af7c-439d-a351-c3035e812f72-trusted-ca-bundle\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.374618 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.374574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe416418-af7c-439d-a351-c3035e812f72-console-oauth-config\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.374618 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.374626 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr5mq\" (UniqueName: \"kubernetes.io/projected/fe416418-af7c-439d-a351-c3035e812f72-kube-api-access-pr5mq\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.374863 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.374742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe416418-af7c-439d-a351-c3035e812f72-trusted-ca-bundle\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.374863 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.374801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe416418-af7c-439d-a351-c3035e812f72-console-serving-cert\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.374863 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.374822 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe416418-af7c-439d-a351-c3035e812f72-console-config\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.374863 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.374846 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe416418-af7c-439d-a351-c3035e812f72-service-ca\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.375058 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.374879 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe416418-af7c-439d-a351-c3035e812f72-oauth-serving-cert\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.375590 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.375568 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe416418-af7c-439d-a351-c3035e812f72-service-ca\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.375684 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.375640 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe416418-af7c-439d-a351-c3035e812f72-oauth-serving-cert\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.375684 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.375655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe416418-af7c-439d-a351-c3035e812f72-trusted-ca-bundle\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.375751 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.375711 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe416418-af7c-439d-a351-c3035e812f72-console-config\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.377085 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.377066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe416418-af7c-439d-a351-c3035e812f72-console-oauth-config\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.377286 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.377267 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe416418-af7c-439d-a351-c3035e812f72-console-serving-cert\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.382489 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.382467 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr5mq\" (UniqueName: \"kubernetes.io/projected/fe416418-af7c-439d-a351-c3035e812f72-kube-api-access-pr5mq\") pod \"console-7bd85b97c9-z2fxz\" (UID: \"fe416418-af7c-439d-a351-c3035e812f72\") " pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.467389 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.467351 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:43.595635 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.595597 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd85b97c9-z2fxz"] Jun 13 01:16:43.599243 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:16:43.599215 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe416418_af7c_439d_a351_c3035e812f72.slice/crio-0c1c55db7af1d8bbf87e65066e7a00abeabdacf2ea29e7855509e0e105ea787e WatchSource:0}: Error finding container 0c1c55db7af1d8bbf87e65066e7a00abeabdacf2ea29e7855509e0e105ea787e: Status 404 returned error can't find the container with id 0c1c55db7af1d8bbf87e65066e7a00abeabdacf2ea29e7855509e0e105ea787e Jun 13 01:16:43.978638 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.978602 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd85b97c9-z2fxz" event={"ID":"fe416418-af7c-439d-a351-c3035e812f72","Type":"ContainerStarted","Data":"d91ad28a3ae2601a0a83a43b471bcd6d6809c983a717d4d76cb0d288ccf19353"} Jun 13 01:16:43.978818 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.978650 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd85b97c9-z2fxz" event={"ID":"fe416418-af7c-439d-a351-c3035e812f72","Type":"ContainerStarted","Data":"0c1c55db7af1d8bbf87e65066e7a00abeabdacf2ea29e7855509e0e105ea787e"} Jun 13 01:16:43.997350 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:43.997299 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bd85b97c9-z2fxz" podStartSLOduration=0.997282408 podStartE2EDuration="997.282408ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:16:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:16:43.996355909 +0000 UTC m=+338.667755747" watchObservedRunningTime="2026-06-13 01:16:43.997282408 +0000 UTC m=+338.668682295" Jun 13 01:16:53.468155 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:53.468030 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:53.468155 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:53.468108 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:53.472986 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:53.472962 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:54.021490 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:54.021460 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bd85b97c9-z2fxz" Jun 13 01:16:54.073592 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:16:54.073557 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f658f9c59-knv2q"] Jun 13 01:17:08.057241 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.057172 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75ccdbf9db-qhl9q" podUID="a2330c82-df6b-4d3f-94f4-170be3300c8a" containerName="console" containerID="cri-o://d8a040dcc885eced11652518c44a80fd9a7cb37a6acf0672ba2c9eb71da9dce7" gracePeriod=15 Jun 13 01:17:08.300648 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.300625 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:17:08.355918 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.355150 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-trusted-ca-bundle\") pod \"a2330c82-df6b-4d3f-94f4-170be3300c8a\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " Jun 13 01:17:08.355918 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.355206 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-config\") pod \"a2330c82-df6b-4d3f-94f4-170be3300c8a\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " Jun 13 01:17:08.355918 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.355244 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-service-ca\") pod \"a2330c82-df6b-4d3f-94f4-170be3300c8a\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " Jun 13 01:17:08.355918 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.355303 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtt84\" (UniqueName: \"kubernetes.io/projected/a2330c82-df6b-4d3f-94f4-170be3300c8a-kube-api-access-xtt84\") pod \"a2330c82-df6b-4d3f-94f4-170be3300c8a\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " Jun 13 01:17:08.355918 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.355337 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-oauth-serving-cert\") pod \"a2330c82-df6b-4d3f-94f4-170be3300c8a\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " Jun 13 01:17:08.355918 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.355385 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-serving-cert\") pod \"a2330c82-df6b-4d3f-94f4-170be3300c8a\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " Jun 13 01:17:08.355918 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.355425 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-oauth-config\") pod \"a2330c82-df6b-4d3f-94f4-170be3300c8a\" (UID: \"a2330c82-df6b-4d3f-94f4-170be3300c8a\") " Jun 13 01:17:08.356445 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.356416 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a2330c82-df6b-4d3f-94f4-170be3300c8a" (UID: "a2330c82-df6b-4d3f-94f4-170be3300c8a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:17:08.357054 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.356837 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-config" (OuterVolumeSpecName: "console-config") pod "a2330c82-df6b-4d3f-94f4-170be3300c8a" (UID: "a2330c82-df6b-4d3f-94f4-170be3300c8a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:17:08.357637 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.357361 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-service-ca" (OuterVolumeSpecName: "service-ca") pod "a2330c82-df6b-4d3f-94f4-170be3300c8a" (UID: "a2330c82-df6b-4d3f-94f4-170be3300c8a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:17:08.360092 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.359900 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a2330c82-df6b-4d3f-94f4-170be3300c8a" (UID: "a2330c82-df6b-4d3f-94f4-170be3300c8a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:17:08.360448 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.360387 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a2330c82-df6b-4d3f-94f4-170be3300c8a" (UID: "a2330c82-df6b-4d3f-94f4-170be3300c8a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:17:08.360669 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.360646 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2330c82-df6b-4d3f-94f4-170be3300c8a-kube-api-access-xtt84" (OuterVolumeSpecName: "kube-api-access-xtt84") pod "a2330c82-df6b-4d3f-94f4-170be3300c8a" (UID: "a2330c82-df6b-4d3f-94f4-170be3300c8a"). InnerVolumeSpecName "kube-api-access-xtt84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:17:08.362313 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.362291 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a2330c82-df6b-4d3f-94f4-170be3300c8a" (UID: "a2330c82-df6b-4d3f-94f4-170be3300c8a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:17:08.456944 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.456912 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtt84\" (UniqueName: \"kubernetes.io/projected/a2330c82-df6b-4d3f-94f4-170be3300c8a-kube-api-access-xtt84\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:17:08.456944 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.456938 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-oauth-serving-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:17:08.456944 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.456948 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-serving-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:17:08.457200 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.456957 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-oauth-config\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:17:08.457200 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.456966 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-trusted-ca-bundle\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:17:08.457200 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.456975 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-console-config\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:17:08.457200 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:08.456984 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2330c82-df6b-4d3f-94f4-170be3300c8a-service-ca\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:17:09.073980 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:09.073947 2574 generic.go:356] "Generic (PLEG): container finished" podID="a2330c82-df6b-4d3f-94f4-170be3300c8a" containerID="d8a040dcc885eced11652518c44a80fd9a7cb37a6acf0672ba2c9eb71da9dce7" exitCode=0 Jun 13 01:17:09.074468 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:09.074002 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75ccdbf9db-qhl9q" event={"ID":"a2330c82-df6b-4d3f-94f4-170be3300c8a","Type":"ContainerDied","Data":"d8a040dcc885eced11652518c44a80fd9a7cb37a6acf0672ba2c9eb71da9dce7"} Jun 13 01:17:09.074468 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:09.074024 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75ccdbf9db-qhl9q" Jun 13 01:17:09.074468 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:09.074042 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75ccdbf9db-qhl9q" event={"ID":"a2330c82-df6b-4d3f-94f4-170be3300c8a","Type":"ContainerDied","Data":"aee4ed5f0de58b8ea6deff862d8272defd59b18ae77b8fd103e3a01f7ed1dc2a"} Jun 13 01:17:09.074468 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:09.074061 2574 scope.go:117] "RemoveContainer" containerID="d8a040dcc885eced11652518c44a80fd9a7cb37a6acf0672ba2c9eb71da9dce7" Jun 13 01:17:09.082267 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:09.082251 2574 scope.go:117] "RemoveContainer" containerID="d8a040dcc885eced11652518c44a80fd9a7cb37a6acf0672ba2c9eb71da9dce7" Jun 13 01:17:09.082556 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:17:09.082537 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8a040dcc885eced11652518c44a80fd9a7cb37a6acf0672ba2c9eb71da9dce7\": container with ID starting with d8a040dcc885eced11652518c44a80fd9a7cb37a6acf0672ba2c9eb71da9dce7 not found: ID does not exist" containerID="d8a040dcc885eced11652518c44a80fd9a7cb37a6acf0672ba2c9eb71da9dce7" Jun 13 01:17:09.082593 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:09.082566 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8a040dcc885eced11652518c44a80fd9a7cb37a6acf0672ba2c9eb71da9dce7"} err="failed to get container status \"d8a040dcc885eced11652518c44a80fd9a7cb37a6acf0672ba2c9eb71da9dce7\": rpc error: code = NotFound desc = could not find container \"d8a040dcc885eced11652518c44a80fd9a7cb37a6acf0672ba2c9eb71da9dce7\": container with ID starting with d8a040dcc885eced11652518c44a80fd9a7cb37a6acf0672ba2c9eb71da9dce7 not found: ID does not exist" Jun 13 01:17:09.094348 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:09.094318 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75ccdbf9db-qhl9q"] Jun 13 01:17:09.100009 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:09.099983 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75ccdbf9db-qhl9q"] Jun 13 01:17:09.761925 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:09.761892 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2330c82-df6b-4d3f-94f4-170be3300c8a" path="/var/lib/kubelet/pods/a2330c82-df6b-4d3f-94f4-170be3300c8a/volumes" Jun 13 01:17:19.100718 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.100665 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f658f9c59-knv2q" podUID="290dda08-9a65-4cbc-9db9-081e0592684c" containerName="console" containerID="cri-o://39dd0234c7edbdfcff23824d0376d828b07448848e9b503698c820c6e97778b1" gracePeriod=15 Jun 13 01:17:19.347472 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.347446 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:17:19.446511 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.446473 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-oauth-serving-cert\") pod \"290dda08-9a65-4cbc-9db9-081e0592684c\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " Jun 13 01:17:19.446511 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.446516 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-trusted-ca-bundle\") pod \"290dda08-9a65-4cbc-9db9-081e0592684c\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " Jun 13 01:17:19.446729 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.446538 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-service-ca\") pod \"290dda08-9a65-4cbc-9db9-081e0592684c\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " Jun 13 01:17:19.446729 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.446566 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/290dda08-9a65-4cbc-9db9-081e0592684c-console-serving-cert\") pod \"290dda08-9a65-4cbc-9db9-081e0592684c\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " Jun 13 01:17:19.446729 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.446626 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-console-config\") pod \"290dda08-9a65-4cbc-9db9-081e0592684c\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " Jun 13 01:17:19.446729 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.446664 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/290dda08-9a65-4cbc-9db9-081e0592684c-console-oauth-config\") pod \"290dda08-9a65-4cbc-9db9-081e0592684c\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " Jun 13 01:17:19.446729 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.446698 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6bjb\" (UniqueName: \"kubernetes.io/projected/290dda08-9a65-4cbc-9db9-081e0592684c-kube-api-access-d6bjb\") pod \"290dda08-9a65-4cbc-9db9-081e0592684c\" (UID: \"290dda08-9a65-4cbc-9db9-081e0592684c\") " Jun 13 01:17:19.446982 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.446937 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "290dda08-9a65-4cbc-9db9-081e0592684c" (UID: "290dda08-9a65-4cbc-9db9-081e0592684c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:17:19.447043 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.446972 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-service-ca" (OuterVolumeSpecName: "service-ca") pod "290dda08-9a65-4cbc-9db9-081e0592684c" (UID: "290dda08-9a65-4cbc-9db9-081e0592684c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:17:19.447099 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.446967 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "290dda08-9a65-4cbc-9db9-081e0592684c" (UID: "290dda08-9a65-4cbc-9db9-081e0592684c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:17:19.447186 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.447151 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-console-config" (OuterVolumeSpecName: "console-config") pod "290dda08-9a65-4cbc-9db9-081e0592684c" (UID: "290dda08-9a65-4cbc-9db9-081e0592684c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:17:19.448883 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.448851 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/290dda08-9a65-4cbc-9db9-081e0592684c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "290dda08-9a65-4cbc-9db9-081e0592684c" (UID: "290dda08-9a65-4cbc-9db9-081e0592684c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:17:19.448988 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.448887 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/290dda08-9a65-4cbc-9db9-081e0592684c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "290dda08-9a65-4cbc-9db9-081e0592684c" (UID: "290dda08-9a65-4cbc-9db9-081e0592684c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:17:19.448988 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.448911 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/290dda08-9a65-4cbc-9db9-081e0592684c-kube-api-access-d6bjb" (OuterVolumeSpecName: "kube-api-access-d6bjb") pod "290dda08-9a65-4cbc-9db9-081e0592684c" (UID: "290dda08-9a65-4cbc-9db9-081e0592684c"). InnerVolumeSpecName "kube-api-access-d6bjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:17:19.547565 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.547530 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-console-config\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:17:19.547565 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.547559 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/290dda08-9a65-4cbc-9db9-081e0592684c-console-oauth-config\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:17:19.547565 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.547570 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6bjb\" (UniqueName: \"kubernetes.io/projected/290dda08-9a65-4cbc-9db9-081e0592684c-kube-api-access-d6bjb\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:17:19.547793 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.547579 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-oauth-serving-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:17:19.547793 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.547588 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-trusted-ca-bundle\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:17:19.547793 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.547596 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/290dda08-9a65-4cbc-9db9-081e0592684c-service-ca\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:17:19.547793 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:19.547604 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/290dda08-9a65-4cbc-9db9-081e0592684c-console-serving-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:17:20.120354 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:20.120271 2574 generic.go:356] "Generic (PLEG): container finished" podID="290dda08-9a65-4cbc-9db9-081e0592684c" containerID="39dd0234c7edbdfcff23824d0376d828b07448848e9b503698c820c6e97778b1" exitCode=0 Jun 13 01:17:20.120354 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:20.120317 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f658f9c59-knv2q" Jun 13 01:17:20.120354 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:20.120327 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f658f9c59-knv2q" event={"ID":"290dda08-9a65-4cbc-9db9-081e0592684c","Type":"ContainerDied","Data":"39dd0234c7edbdfcff23824d0376d828b07448848e9b503698c820c6e97778b1"} Jun 13 01:17:20.120810 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:20.120365 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f658f9c59-knv2q" event={"ID":"290dda08-9a65-4cbc-9db9-081e0592684c","Type":"ContainerDied","Data":"3cc31c050ea87a17412399f0588297aed5d31aa33db535bed56308dca1dec4a1"} Jun 13 01:17:20.120810 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:20.120384 2574 scope.go:117] "RemoveContainer" containerID="39dd0234c7edbdfcff23824d0376d828b07448848e9b503698c820c6e97778b1" Jun 13 01:17:20.128457 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:20.128436 2574 scope.go:117] "RemoveContainer" containerID="39dd0234c7edbdfcff23824d0376d828b07448848e9b503698c820c6e97778b1" Jun 13 01:17:20.128714 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:17:20.128692 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39dd0234c7edbdfcff23824d0376d828b07448848e9b503698c820c6e97778b1\": container with ID starting with 39dd0234c7edbdfcff23824d0376d828b07448848e9b503698c820c6e97778b1 not found: ID does not exist" containerID="39dd0234c7edbdfcff23824d0376d828b07448848e9b503698c820c6e97778b1" Jun 13 01:17:20.128774 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:20.128722 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39dd0234c7edbdfcff23824d0376d828b07448848e9b503698c820c6e97778b1"} err="failed to get container status \"39dd0234c7edbdfcff23824d0376d828b07448848e9b503698c820c6e97778b1\": rpc error: code = NotFound desc = could not find container \"39dd0234c7edbdfcff23824d0376d828b07448848e9b503698c820c6e97778b1\": container with ID starting with 39dd0234c7edbdfcff23824d0376d828b07448848e9b503698c820c6e97778b1 not found: ID does not exist" Jun 13 01:17:20.136046 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:20.136024 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f658f9c59-knv2q"] Jun 13 01:17:20.139680 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:20.139660 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f658f9c59-knv2q"] Jun 13 01:17:21.761412 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:17:21.761378 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="290dda08-9a65-4cbc-9db9-081e0592684c" path="/var/lib/kubelet/pods/290dda08-9a65-4cbc-9db9-081e0592684c/volumes" Jun 13 01:18:06.118875 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.118803 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8"] Jun 13 01:18:06.119255 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.119108 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2330c82-df6b-4d3f-94f4-170be3300c8a" containerName="console" Jun 13 01:18:06.119255 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.119153 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2330c82-df6b-4d3f-94f4-170be3300c8a" containerName="console" Jun 13 01:18:06.119255 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.119162 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="290dda08-9a65-4cbc-9db9-081e0592684c" containerName="console" Jun 13 01:18:06.119255 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.119168 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="290dda08-9a65-4cbc-9db9-081e0592684c" containerName="console" Jun 13 01:18:06.119255 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.119239 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2330c82-df6b-4d3f-94f4-170be3300c8a" containerName="console" Jun 13 01:18:06.119255 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.119252 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="290dda08-9a65-4cbc-9db9-081e0592684c" containerName="console" Jun 13 01:18:06.127188 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.127167 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8" Jun 13 01:18:06.130211 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.130182 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 13 01:18:06.130348 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.130230 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-8rv4t\"" Jun 13 01:18:06.130348 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.130243 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 13 01:18:06.132617 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.132594 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8"] Jun 13 01:18:06.224949 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.224911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhb7v\" (UniqueName: \"kubernetes.io/projected/0fb81237-9744-4583-9270-00bcc9cd1e7d-kube-api-access-qhb7v\") pod \"cert-manager-webhook-7dc76cbb94-m9xz8\" (UID: \"0fb81237-9744-4583-9270-00bcc9cd1e7d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8" Jun 13 01:18:06.225156 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.224961 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fb81237-9744-4583-9270-00bcc9cd1e7d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-m9xz8\" (UID: \"0fb81237-9744-4583-9270-00bcc9cd1e7d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8" Jun 13 01:18:06.325710 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.325673 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fb81237-9744-4583-9270-00bcc9cd1e7d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-m9xz8\" (UID: \"0fb81237-9744-4583-9270-00bcc9cd1e7d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8" Jun 13 01:18:06.325892 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.325756 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhb7v\" (UniqueName: \"kubernetes.io/projected/0fb81237-9744-4583-9270-00bcc9cd1e7d-kube-api-access-qhb7v\") pod \"cert-manager-webhook-7dc76cbb94-m9xz8\" (UID: \"0fb81237-9744-4583-9270-00bcc9cd1e7d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8" Jun 13 01:18:06.333746 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.333716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fb81237-9744-4583-9270-00bcc9cd1e7d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-m9xz8\" (UID: \"0fb81237-9744-4583-9270-00bcc9cd1e7d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8" Jun 13 01:18:06.333984 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.333962 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhb7v\" (UniqueName: \"kubernetes.io/projected/0fb81237-9744-4583-9270-00bcc9cd1e7d-kube-api-access-qhb7v\") pod \"cert-manager-webhook-7dc76cbb94-m9xz8\" (UID: \"0fb81237-9744-4583-9270-00bcc9cd1e7d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8" Jun 13 01:18:06.436794 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.436764 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8" Jun 13 01:18:06.564371 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.564345 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8"] Jun 13 01:18:06.566475 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:18:06.566446 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fb81237_9744_4583_9270_00bcc9cd1e7d.slice/crio-4a1b28c1837ce2e9ff0b1263ffb071638c9f8ea992be976321313f03ac7faa11 WatchSource:0}: Error finding container 4a1b28c1837ce2e9ff0b1263ffb071638c9f8ea992be976321313f03ac7faa11: Status 404 returned error can't find the container with id 4a1b28c1837ce2e9ff0b1263ffb071638c9f8ea992be976321313f03ac7faa11 Jun 13 01:18:06.568377 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:06.568361 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:18:07.303142 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:07.303097 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8" event={"ID":"0fb81237-9744-4583-9270-00bcc9cd1e7d","Type":"ContainerStarted","Data":"4a1b28c1837ce2e9ff0b1263ffb071638c9f8ea992be976321313f03ac7faa11"} Jun 13 01:18:11.321166 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:11.321104 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8" event={"ID":"0fb81237-9744-4583-9270-00bcc9cd1e7d","Type":"ContainerStarted","Data":"1ce07d631f259a5db4e4c5b979dfee1bcbf224510dbd49b6e50ae31555a7d26f"} Jun 13 01:18:11.321629 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:11.321253 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8" Jun 13 01:18:11.338518 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:11.338466 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8" podStartSLOduration=1.560126689 podStartE2EDuration="5.338454291s" totalImagesPullingTime="3.778327602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:18:11.337999191 +0000 UTC m=+426.009399030" watchObservedRunningTime="2026-06-13 01:18:11.338454291 +0000 UTC m=+426.009854129" Jun 13 01:18:17.326706 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:17.326674 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m9xz8" Jun 13 01:18:25.039041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:25.038964 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-pkmwv"] Jun 13 01:18:25.042021 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:25.041997 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-pkmwv" Jun 13 01:18:25.044425 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:25.044409 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8grhp\"" Jun 13 01:18:25.051584 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:25.051558 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-pkmwv"] Jun 13 01:18:25.080500 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:25.080459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8bcb\" (UniqueName: \"kubernetes.io/projected/d502f872-c1a3-469d-8169-fd097f23ee92-kube-api-access-c8bcb\") pod \"cert-manager-59c77684cc-pkmwv\" (UID: \"d502f872-c1a3-469d-8169-fd097f23ee92\") " pod="cert-manager/cert-manager-59c77684cc-pkmwv" Jun 13 01:18:25.080674 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:25.080564 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d502f872-c1a3-469d-8169-fd097f23ee92-bound-sa-token\") pod \"cert-manager-59c77684cc-pkmwv\" (UID: \"d502f872-c1a3-469d-8169-fd097f23ee92\") " pod="cert-manager/cert-manager-59c77684cc-pkmwv" Jun 13 01:18:25.181814 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:25.181780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d502f872-c1a3-469d-8169-fd097f23ee92-bound-sa-token\") pod \"cert-manager-59c77684cc-pkmwv\" (UID: \"d502f872-c1a3-469d-8169-fd097f23ee92\") " pod="cert-manager/cert-manager-59c77684cc-pkmwv" Jun 13 01:18:25.181992 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:25.181841 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8bcb\" (UniqueName: \"kubernetes.io/projected/d502f872-c1a3-469d-8169-fd097f23ee92-kube-api-access-c8bcb\") pod \"cert-manager-59c77684cc-pkmwv\" (UID: \"d502f872-c1a3-469d-8169-fd097f23ee92\") " pod="cert-manager/cert-manager-59c77684cc-pkmwv" Jun 13 01:18:25.189895 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:25.189863 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d502f872-c1a3-469d-8169-fd097f23ee92-bound-sa-token\") pod \"cert-manager-59c77684cc-pkmwv\" (UID: \"d502f872-c1a3-469d-8169-fd097f23ee92\") " pod="cert-manager/cert-manager-59c77684cc-pkmwv" Jun 13 01:18:25.190028 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:25.189948 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8bcb\" (UniqueName: \"kubernetes.io/projected/d502f872-c1a3-469d-8169-fd097f23ee92-kube-api-access-c8bcb\") pod \"cert-manager-59c77684cc-pkmwv\" (UID: \"d502f872-c1a3-469d-8169-fd097f23ee92\") " pod="cert-manager/cert-manager-59c77684cc-pkmwv" Jun 13 01:18:25.351612 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:25.351519 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-pkmwv" Jun 13 01:18:25.478014 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:25.477976 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-pkmwv"] Jun 13 01:18:25.480994 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:18:25.480964 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd502f872_c1a3_469d_8169_fd097f23ee92.slice/crio-4c80b34c68a28a840711be3694c294885ff68b6da4ddccde9ba60a100e76c4f1 WatchSource:0}: Error finding container 4c80b34c68a28a840711be3694c294885ff68b6da4ddccde9ba60a100e76c4f1: Status 404 returned error can't find the container with id 4c80b34c68a28a840711be3694c294885ff68b6da4ddccde9ba60a100e76c4f1 Jun 13 01:18:26.376981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:26.376939 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-pkmwv" event={"ID":"d502f872-c1a3-469d-8169-fd097f23ee92","Type":"ContainerStarted","Data":"f4b952a80ed3d3e57ceeb4d5e03c8c68f37f22bd3fc74474c9448628f6e49c3d"} Jun 13 01:18:26.376981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:26.376984 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-pkmwv" event={"ID":"d502f872-c1a3-469d-8169-fd097f23ee92","Type":"ContainerStarted","Data":"4c80b34c68a28a840711be3694c294885ff68b6da4ddccde9ba60a100e76c4f1"} Jun 13 01:18:26.393175 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:26.393107 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-pkmwv" podStartSLOduration=1.393090898 podStartE2EDuration="1.393090898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:18:26.392281429 +0000 UTC m=+441.063681285" watchObservedRunningTime="2026-06-13 01:18:26.393090898 +0000 UTC m=+441.064490736" Jun 13 01:18:44.131198 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.131102 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq"] Jun 13 01:18:44.135933 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.135916 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.138999 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.138975 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 13 01:18:44.142386 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.142354 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 13 01:18:44.142910 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.142755 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qth8m\"" Jun 13 01:18:44.143511 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.143374 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 13 01:18:44.143511 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.143399 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 13 01:18:44.160463 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.160431 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq"] Jun 13 01:18:44.237699 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.237659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ff18d17-ad85-4020-bf42-fc387195c529-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.237699 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.237699 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ff18d17-ad85-4020-bf42-fc387195c529-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.237962 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.237771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ff18d17-ad85-4020-bf42-fc387195c529-manifests\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.237962 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.237824 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdgnv\" (UniqueName: \"kubernetes.io/projected/9ff18d17-ad85-4020-bf42-fc387195c529-kube-api-access-tdgnv\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.237962 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.237888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff18d17-ad85-4020-bf42-fc387195c529-tmp\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.338312 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.338267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ff18d17-ad85-4020-bf42-fc387195c529-manifests\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.338523 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.338333 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdgnv\" (UniqueName: \"kubernetes.io/projected/9ff18d17-ad85-4020-bf42-fc387195c529-kube-api-access-tdgnv\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.338523 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.338372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff18d17-ad85-4020-bf42-fc387195c529-tmp\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.338523 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.338391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ff18d17-ad85-4020-bf42-fc387195c529-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.338523 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.338407 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ff18d17-ad85-4020-bf42-fc387195c529-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.338784 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.338762 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ff18d17-ad85-4020-bf42-fc387195c529-manifests\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.340742 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.340709 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff18d17-ad85-4020-bf42-fc387195c529-tmp\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.340844 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.340800 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ff18d17-ad85-4020-bf42-fc387195c529-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.340885 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.340840 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ff18d17-ad85-4020-bf42-fc387195c529-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.346530 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.346504 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdgnv\" (UniqueName: \"kubernetes.io/projected/9ff18d17-ad85-4020-bf42-fc387195c529-kube-api-access-tdgnv\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-pcnvq\" (UID: \"9ff18d17-ad85-4020-bf42-fc387195c529\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.447104 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.447072 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:44.584387 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:44.584355 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq"] Jun 13 01:18:44.587224 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:18:44.587197 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff18d17_ad85_4020_bf42_fc387195c529.slice/crio-3ff65ca79a0f3c9c7ce322016de5fe2f129b5b883603cfbe571ecb07dfdb0196 WatchSource:0}: Error finding container 3ff65ca79a0f3c9c7ce322016de5fe2f129b5b883603cfbe571ecb07dfdb0196: Status 404 returned error can't find the container with id 3ff65ca79a0f3c9c7ce322016de5fe2f129b5b883603cfbe571ecb07dfdb0196 Jun 13 01:18:45.453345 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:45.453306 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" event={"ID":"9ff18d17-ad85-4020-bf42-fc387195c529","Type":"ContainerStarted","Data":"3ff65ca79a0f3c9c7ce322016de5fe2f129b5b883603cfbe571ecb07dfdb0196"} Jun 13 01:18:48.468364 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:48.468335 2574 generic.go:356] "Generic (PLEG): container finished" podID="9ff18d17-ad85-4020-bf42-fc387195c529" containerID="c14acfc12f4781201aa53ed0db2034981e28b67b56ed4b2f1d5601174d0fd31e" exitCode=0 Jun 13 01:18:48.468685 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:48.468372 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" event={"ID":"9ff18d17-ad85-4020-bf42-fc387195c529","Type":"ContainerDied","Data":"c14acfc12f4781201aa53ed0db2034981e28b67b56ed4b2f1d5601174d0fd31e"} Jun 13 01:18:49.474763 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:49.474721 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" event={"ID":"9ff18d17-ad85-4020-bf42-fc387195c529","Type":"ContainerStarted","Data":"05758f6ca8504dfe3db33cfcd1bf516f7b8b79301c8fb5242970fed836eaad73"} Jun 13 01:18:49.475255 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:49.475090 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:18:49.500395 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:18:49.500341 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" podStartSLOduration=1.380917085 podStartE2EDuration="5.500321436s" totalImagesPullingTime="3.157915333s" totalInitContainerRuntime="961.489018ms" isStatefulPod=false podCreationTimestamp="2026-06-13 01:18:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:18:49.498259563 +0000 UTC m=+464.169659420" watchObservedRunningTime="2026-06-13 01:18:49.500321436 +0000 UTC m=+464.171721278" Jun 13 01:19:00.481375 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:00.481339 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-pcnvq" Jun 13 01:19:03.515301 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.515270 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs"] Jun 13 01:19:03.519631 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.519614 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs" Jun 13 01:19:03.521815 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.521794 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 13 01:19:03.521936 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.521829 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 13 01:19:03.522559 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.522539 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 13 01:19:03.522651 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.522561 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4gdnq\"" Jun 13 01:19:03.522651 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.522562 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 13 01:19:03.533179 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.533153 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs"] Jun 13 01:19:03.704080 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.704036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce2df81d-1f65-4936-8727-c924f5bdf042-tmp\") pod \"kube-auth-proxy-678b9f85fb-4rkzs\" (UID: \"ce2df81d-1f65-4936-8727-c924f5bdf042\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs" Jun 13 01:19:03.704283 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.704090 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx6kb\" (UniqueName: \"kubernetes.io/projected/ce2df81d-1f65-4936-8727-c924f5bdf042-kube-api-access-bx6kb\") pod \"kube-auth-proxy-678b9f85fb-4rkzs\" (UID: \"ce2df81d-1f65-4936-8727-c924f5bdf042\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs" Jun 13 01:19:03.704283 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.704210 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce2df81d-1f65-4936-8727-c924f5bdf042-tls-certs\") pod \"kube-auth-proxy-678b9f85fb-4rkzs\" (UID: \"ce2df81d-1f65-4936-8727-c924f5bdf042\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs" Jun 13 01:19:03.804966 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.804877 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce2df81d-1f65-4936-8727-c924f5bdf042-tmp\") pod \"kube-auth-proxy-678b9f85fb-4rkzs\" (UID: \"ce2df81d-1f65-4936-8727-c924f5bdf042\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs" Jun 13 01:19:03.804966 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.804944 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx6kb\" (UniqueName: \"kubernetes.io/projected/ce2df81d-1f65-4936-8727-c924f5bdf042-kube-api-access-bx6kb\") pod \"kube-auth-proxy-678b9f85fb-4rkzs\" (UID: \"ce2df81d-1f65-4936-8727-c924f5bdf042\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs" Jun 13 01:19:03.805218 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.805000 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce2df81d-1f65-4936-8727-c924f5bdf042-tls-certs\") pod \"kube-auth-proxy-678b9f85fb-4rkzs\" (UID: \"ce2df81d-1f65-4936-8727-c924f5bdf042\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs" Jun 13 01:19:03.807387 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.807359 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce2df81d-1f65-4936-8727-c924f5bdf042-tmp\") pod \"kube-auth-proxy-678b9f85fb-4rkzs\" (UID: \"ce2df81d-1f65-4936-8727-c924f5bdf042\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs" Jun 13 01:19:03.808006 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.807976 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce2df81d-1f65-4936-8727-c924f5bdf042-tls-certs\") pod \"kube-auth-proxy-678b9f85fb-4rkzs\" (UID: \"ce2df81d-1f65-4936-8727-c924f5bdf042\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs" Jun 13 01:19:03.812799 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.812769 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx6kb\" (UniqueName: \"kubernetes.io/projected/ce2df81d-1f65-4936-8727-c924f5bdf042-kube-api-access-bx6kb\") pod \"kube-auth-proxy-678b9f85fb-4rkzs\" (UID: \"ce2df81d-1f65-4936-8727-c924f5bdf042\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs" Jun 13 01:19:03.829508 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:03.829479 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs" Jun 13 01:19:04.001230 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:04.001077 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs"] Jun 13 01:19:04.003972 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:19:04.003939 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce2df81d_1f65_4936_8727_c924f5bdf042.slice/crio-a4bd83dfac7965b1e67403911ceb79f190d27bdc161146ae21da88a4f42635f0 WatchSource:0}: Error finding container a4bd83dfac7965b1e67403911ceb79f190d27bdc161146ae21da88a4f42635f0: Status 404 returned error can't find the container with id a4bd83dfac7965b1e67403911ceb79f190d27bdc161146ae21da88a4f42635f0 Jun 13 01:19:04.489191 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:04.489158 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-5bvbc"] Jun 13 01:19:04.493491 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:04.493476 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-5bvbc" Jun 13 01:19:04.497349 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:04.497326 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 13 01:19:04.505110 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:04.505086 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-5bvbc"] Jun 13 01:19:04.536886 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:04.536851 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs" event={"ID":"ce2df81d-1f65-4936-8727-c924f5bdf042","Type":"ContainerStarted","Data":"a4bd83dfac7965b1e67403911ceb79f190d27bdc161146ae21da88a4f42635f0"} Jun 13 01:19:04.611188 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:04.611141 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz8w4\" (UniqueName: \"kubernetes.io/projected/91c08f64-35a7-4769-98e3-9bf5403e92c2-kube-api-access-vz8w4\") pod \"model-serving-api-5dd488fc48-5bvbc\" (UID: \"91c08f64-35a7-4769-98e3-9bf5403e92c2\") " pod="opendatahub/model-serving-api-5dd488fc48-5bvbc" Jun 13 01:19:04.611365 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:04.611228 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91c08f64-35a7-4769-98e3-9bf5403e92c2-tls-certs\") pod \"model-serving-api-5dd488fc48-5bvbc\" (UID: \"91c08f64-35a7-4769-98e3-9bf5403e92c2\") " pod="opendatahub/model-serving-api-5dd488fc48-5bvbc" Jun 13 01:19:04.711829 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:04.711765 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91c08f64-35a7-4769-98e3-9bf5403e92c2-tls-certs\") pod \"model-serving-api-5dd488fc48-5bvbc\" (UID: \"91c08f64-35a7-4769-98e3-9bf5403e92c2\") " pod="opendatahub/model-serving-api-5dd488fc48-5bvbc" Jun 13 01:19:04.712017 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:04.711879 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz8w4\" (UniqueName: \"kubernetes.io/projected/91c08f64-35a7-4769-98e3-9bf5403e92c2-kube-api-access-vz8w4\") pod \"model-serving-api-5dd488fc48-5bvbc\" (UID: \"91c08f64-35a7-4769-98e3-9bf5403e92c2\") " pod="opendatahub/model-serving-api-5dd488fc48-5bvbc" Jun 13 01:19:04.712017 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:19:04.711931 2574 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 13 01:19:04.712017 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:19:04.712009 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c08f64-35a7-4769-98e3-9bf5403e92c2-tls-certs podName:91c08f64-35a7-4769-98e3-9bf5403e92c2 nodeName:}" failed. No retries permitted until 2026-06-13 01:19:05.21199038 +0000 UTC m=+479.883390209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/91c08f64-35a7-4769-98e3-9bf5403e92c2-tls-certs") pod "model-serving-api-5dd488fc48-5bvbc" (UID: "91c08f64-35a7-4769-98e3-9bf5403e92c2") : secret "model-serving-api-tls" not found Jun 13 01:19:04.721501 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:04.721470 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz8w4\" (UniqueName: \"kubernetes.io/projected/91c08f64-35a7-4769-98e3-9bf5403e92c2-kube-api-access-vz8w4\") pod \"model-serving-api-5dd488fc48-5bvbc\" (UID: \"91c08f64-35a7-4769-98e3-9bf5403e92c2\") " pod="opendatahub/model-serving-api-5dd488fc48-5bvbc" Jun 13 01:19:05.217688 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:05.217647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91c08f64-35a7-4769-98e3-9bf5403e92c2-tls-certs\") pod \"model-serving-api-5dd488fc48-5bvbc\" (UID: \"91c08f64-35a7-4769-98e3-9bf5403e92c2\") " pod="opendatahub/model-serving-api-5dd488fc48-5bvbc" Jun 13 01:19:05.220582 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:05.220559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91c08f64-35a7-4769-98e3-9bf5403e92c2-tls-certs\") pod \"model-serving-api-5dd488fc48-5bvbc\" (UID: \"91c08f64-35a7-4769-98e3-9bf5403e92c2\") " pod="opendatahub/model-serving-api-5dd488fc48-5bvbc" Jun 13 01:19:05.403738 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:05.403606 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-5bvbc" Jun 13 01:19:06.847078 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:06.846751 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 13 01:19:06.927007 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:06.926915 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-5bvbc"] Jun 13 01:19:06.930224 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:19:06.930192 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c08f64_35a7_4769_98e3_9bf5403e92c2.slice/crio-92cb7b7d94fbde306e9b46ea125bb67f0638cf52473c5561a7e875ff03efe817 WatchSource:0}: Error finding container 92cb7b7d94fbde306e9b46ea125bb67f0638cf52473c5561a7e875ff03efe817: Status 404 returned error can't find the container with id 92cb7b7d94fbde306e9b46ea125bb67f0638cf52473c5561a7e875ff03efe817 Jun 13 01:19:07.553500 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:07.553459 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-5bvbc" event={"ID":"91c08f64-35a7-4769-98e3-9bf5403e92c2","Type":"ContainerStarted","Data":"92cb7b7d94fbde306e9b46ea125bb67f0638cf52473c5561a7e875ff03efe817"} Jun 13 01:19:07.555559 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:07.555524 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs" event={"ID":"ce2df81d-1f65-4936-8727-c924f5bdf042","Type":"ContainerStarted","Data":"b36009d65a77da478114951efd47e53e1b373fcb58b7ff07eaa2c431cea53809"} Jun 13 01:19:07.574635 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:07.574574 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-678b9f85fb-4rkzs" podStartSLOduration=1.7360167039999999 podStartE2EDuration="4.574552079s" totalImagesPullingTime="2.838535375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:19:07.572685649 +0000 UTC m=+482.244085488" watchObservedRunningTime="2026-06-13 01:19:07.574552079 +0000 UTC m=+482.245951918" Jun 13 01:19:09.565636 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:09.565600 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-5bvbc" event={"ID":"91c08f64-35a7-4769-98e3-9bf5403e92c2","Type":"ContainerStarted","Data":"f9bcbb8d4c03aa76880987bd84c72fabbaf3b5a642f8ce02542855caac935a58"} Jun 13 01:19:09.566138 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:09.565782 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-5bvbc" Jun 13 01:19:09.583339 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:09.583283 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-5bvbc" podStartSLOduration=3.930463014 podStartE2EDuration="5.583266638s" totalImagesPullingTime="1.652803624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:19:09.581066873 +0000 UTC m=+484.252466730" watchObservedRunningTime="2026-06-13 01:19:09.583266638 +0000 UTC m=+484.254666476" Jun 13 01:19:14.525498 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.525459 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-l274s"] Jun 13 01:19:14.528925 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.528901 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-l274s" Jun 13 01:19:14.534101 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.534079 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 13 01:19:14.534318 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.534291 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hh2bf\"" Jun 13 01:19:14.542093 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.542068 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22"] Jun 13 01:19:14.545434 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.545413 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-l274s"] Jun 13 01:19:14.545547 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.545488 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22" Jun 13 01:19:14.548927 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.548904 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 13 01:19:14.548927 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.548915 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-2f2cd\"" Jun 13 01:19:14.568158 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.568135 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22"] Jun 13 01:19:14.593921 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.593895 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rpvw\" (UniqueName: \"kubernetes.io/projected/81fe9f64-7854-4865-9bf1-a1de2a885de0-kube-api-access-2rpvw\") pod \"llmisvc-controller-manager-864bfd7bc9-fbs22\" (UID: \"81fe9f64-7854-4865-9bf1-a1de2a885de0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22" Jun 13 01:19:14.594057 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.593960 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81fe9f64-7854-4865-9bf1-a1de2a885de0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-fbs22\" (UID: \"81fe9f64-7854-4865-9bf1-a1de2a885de0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22" Jun 13 01:19:14.594057 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.594022 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8283fee9-8d86-4f24-8991-77d3b811c672-cert\") pod \"kserve-controller-manager-69fc866d76-l274s\" (UID: \"8283fee9-8d86-4f24-8991-77d3b811c672\") " pod="opendatahub/kserve-controller-manager-69fc866d76-l274s" Jun 13 01:19:14.594167 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.594069 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9v9j\" (UniqueName: \"kubernetes.io/projected/8283fee9-8d86-4f24-8991-77d3b811c672-kube-api-access-f9v9j\") pod \"kserve-controller-manager-69fc866d76-l274s\" (UID: \"8283fee9-8d86-4f24-8991-77d3b811c672\") " pod="opendatahub/kserve-controller-manager-69fc866d76-l274s" Jun 13 01:19:14.695161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.695110 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81fe9f64-7854-4865-9bf1-a1de2a885de0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-fbs22\" (UID: \"81fe9f64-7854-4865-9bf1-a1de2a885de0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22" Jun 13 01:19:14.695348 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.695178 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8283fee9-8d86-4f24-8991-77d3b811c672-cert\") pod \"kserve-controller-manager-69fc866d76-l274s\" (UID: \"8283fee9-8d86-4f24-8991-77d3b811c672\") " pod="opendatahub/kserve-controller-manager-69fc866d76-l274s" Jun 13 01:19:14.695348 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.695215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9v9j\" (UniqueName: \"kubernetes.io/projected/8283fee9-8d86-4f24-8991-77d3b811c672-kube-api-access-f9v9j\") pod \"kserve-controller-manager-69fc866d76-l274s\" (UID: \"8283fee9-8d86-4f24-8991-77d3b811c672\") " pod="opendatahub/kserve-controller-manager-69fc866d76-l274s" Jun 13 01:19:14.695348 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.695250 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rpvw\" (UniqueName: \"kubernetes.io/projected/81fe9f64-7854-4865-9bf1-a1de2a885de0-kube-api-access-2rpvw\") pod \"llmisvc-controller-manager-864bfd7bc9-fbs22\" (UID: \"81fe9f64-7854-4865-9bf1-a1de2a885de0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22" Jun 13 01:19:14.695348 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:19:14.695326 2574 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 13 01:19:14.695538 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:19:14.695417 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8283fee9-8d86-4f24-8991-77d3b811c672-cert podName:8283fee9-8d86-4f24-8991-77d3b811c672 nodeName:}" failed. No retries permitted until 2026-06-13 01:19:15.195393723 +0000 UTC m=+489.866793541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8283fee9-8d86-4f24-8991-77d3b811c672-cert") pod "kserve-controller-manager-69fc866d76-l274s" (UID: "8283fee9-8d86-4f24-8991-77d3b811c672") : secret "kserve-webhook-server-cert" not found Jun 13 01:19:14.697676 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.697651 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81fe9f64-7854-4865-9bf1-a1de2a885de0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-fbs22\" (UID: \"81fe9f64-7854-4865-9bf1-a1de2a885de0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22" Jun 13 01:19:14.730797 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.730768 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9v9j\" (UniqueName: \"kubernetes.io/projected/8283fee9-8d86-4f24-8991-77d3b811c672-kube-api-access-f9v9j\") pod \"kserve-controller-manager-69fc866d76-l274s\" (UID: \"8283fee9-8d86-4f24-8991-77d3b811c672\") " pod="opendatahub/kserve-controller-manager-69fc866d76-l274s" Jun 13 01:19:14.730964 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.730807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rpvw\" (UniqueName: \"kubernetes.io/projected/81fe9f64-7854-4865-9bf1-a1de2a885de0-kube-api-access-2rpvw\") pod \"llmisvc-controller-manager-864bfd7bc9-fbs22\" (UID: \"81fe9f64-7854-4865-9bf1-a1de2a885de0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22" Jun 13 01:19:14.854764 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.854666 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22" Jun 13 01:19:14.987731 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:14.987694 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22"] Jun 13 01:19:14.991099 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:19:14.991074 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod81fe9f64_7854_4865_9bf1_a1de2a885de0.slice/crio-7cb4321a4249548aee7ffc364fcfe1862ac8d471f06a5f2279e20354ecd1aeec WatchSource:0}: Error finding container 7cb4321a4249548aee7ffc364fcfe1862ac8d471f06a5f2279e20354ecd1aeec: Status 404 returned error can't find the container with id 7cb4321a4249548aee7ffc364fcfe1862ac8d471f06a5f2279e20354ecd1aeec Jun 13 01:19:15.199874 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:15.199843 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8283fee9-8d86-4f24-8991-77d3b811c672-cert\") pod \"kserve-controller-manager-69fc866d76-l274s\" (UID: \"8283fee9-8d86-4f24-8991-77d3b811c672\") " pod="opendatahub/kserve-controller-manager-69fc866d76-l274s" Jun 13 01:19:15.202225 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:15.202199 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8283fee9-8d86-4f24-8991-77d3b811c672-cert\") pod \"kserve-controller-manager-69fc866d76-l274s\" (UID: \"8283fee9-8d86-4f24-8991-77d3b811c672\") " pod="opendatahub/kserve-controller-manager-69fc866d76-l274s" Jun 13 01:19:15.444443 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:15.444411 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-l274s" Jun 13 01:19:15.581002 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:15.580826 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-l274s"] Jun 13 01:19:15.591811 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:15.591781 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22" event={"ID":"81fe9f64-7854-4865-9bf1-a1de2a885de0","Type":"ContainerStarted","Data":"7cb4321a4249548aee7ffc364fcfe1862ac8d471f06a5f2279e20354ecd1aeec"} Jun 13 01:19:15.617162 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:19:15.617126 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8283fee9_8d86_4f24_8991_77d3b811c672.slice/crio-3e49af6f10ac328410e937023fb33f8beaf7c781aed2bdf06fb617ac6747fbc2 WatchSource:0}: Error finding container 3e49af6f10ac328410e937023fb33f8beaf7c781aed2bdf06fb617ac6747fbc2: Status 404 returned error can't find the container with id 3e49af6f10ac328410e937023fb33f8beaf7c781aed2bdf06fb617ac6747fbc2 Jun 13 01:19:16.599060 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:16.599017 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-l274s" event={"ID":"8283fee9-8d86-4f24-8991-77d3b811c672","Type":"ContainerStarted","Data":"3e49af6f10ac328410e937023fb33f8beaf7c781aed2bdf06fb617ac6747fbc2"} Jun 13 01:19:18.610103 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:18.610020 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22" event={"ID":"81fe9f64-7854-4865-9bf1-a1de2a885de0","Type":"ContainerStarted","Data":"49c8057e522086e909dcf8120c967a19b2fa4c4ca8209dd43e0bbd576e829159"} Jun 13 01:19:18.610553 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:18.610158 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22" Jun 13 01:19:18.611612 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:18.611591 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-l274s" event={"ID":"8283fee9-8d86-4f24-8991-77d3b811c672","Type":"ContainerStarted","Data":"3d48a7d6613b2ef9605dd8bbcf830c31e6396bba653876e6030922e4a6cc03e5"} Jun 13 01:19:18.611711 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:18.611699 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-l274s" Jun 13 01:19:18.627296 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:18.627253 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22" podStartSLOduration=1.287070618 podStartE2EDuration="4.627241211s" totalImagesPullingTime="3.340170593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:19:18.626287126 +0000 UTC m=+493.297686962" watchObservedRunningTime="2026-06-13 01:19:18.627241211 +0000 UTC m=+493.298641048" Jun 13 01:19:18.644836 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:18.644773 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-l274s" podStartSLOduration=1.9292677409999999 podStartE2EDuration="4.644753371s" totalImagesPullingTime="2.71548563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:19:18.641457079 +0000 UTC m=+493.312856917" watchObservedRunningTime="2026-06-13 01:19:18.644753371 +0000 UTC m=+493.316153209" Jun 13 01:19:20.573557 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:20.573517 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-5bvbc" Jun 13 01:19:22.276830 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:22.276796 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-g6jks"] Jun 13 01:19:22.283376 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:22.283355 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6jks" Jun 13 01:19:22.286246 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:22.286219 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 13 01:19:22.286374 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:22.286316 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 13 01:19:22.286542 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:22.286529 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-7kjjw\"" Jun 13 01:19:22.302365 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:22.302341 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-g6jks"] Jun 13 01:19:22.364443 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:22.364400 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdrws\" (UniqueName: \"kubernetes.io/projected/0af9115b-ac78-4824-ad5e-3e19b84101a3-kube-api-access-wdrws\") pod \"servicemesh-operator3-57f65f65fb-g6jks\" (UID: \"0af9115b-ac78-4824-ad5e-3e19b84101a3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6jks" Jun 13 01:19:22.364643 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:22.364454 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0af9115b-ac78-4824-ad5e-3e19b84101a3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-g6jks\" (UID: \"0af9115b-ac78-4824-ad5e-3e19b84101a3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6jks" Jun 13 01:19:22.465098 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:22.465058 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdrws\" (UniqueName: \"kubernetes.io/projected/0af9115b-ac78-4824-ad5e-3e19b84101a3-kube-api-access-wdrws\") pod \"servicemesh-operator3-57f65f65fb-g6jks\" (UID: \"0af9115b-ac78-4824-ad5e-3e19b84101a3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6jks" Jun 13 01:19:22.465315 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:22.465145 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0af9115b-ac78-4824-ad5e-3e19b84101a3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-g6jks\" (UID: \"0af9115b-ac78-4824-ad5e-3e19b84101a3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6jks" Jun 13 01:19:22.467712 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:22.467688 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0af9115b-ac78-4824-ad5e-3e19b84101a3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-g6jks\" (UID: \"0af9115b-ac78-4824-ad5e-3e19b84101a3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6jks" Jun 13 01:19:22.474249 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:22.474227 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdrws\" (UniqueName: \"kubernetes.io/projected/0af9115b-ac78-4824-ad5e-3e19b84101a3-kube-api-access-wdrws\") pod \"servicemesh-operator3-57f65f65fb-g6jks\" (UID: \"0af9115b-ac78-4824-ad5e-3e19b84101a3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6jks" Jun 13 01:19:22.592934 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:22.592859 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6jks" Jun 13 01:19:22.748026 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:22.748001 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-g6jks"] Jun 13 01:19:22.750166 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:19:22.750133 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af9115b_ac78_4824_ad5e_3e19b84101a3.slice/crio-4b9c34b11789486a13243423f7d4b12daaa5e56caf1bdc4f6ccac18eada1fe73 WatchSource:0}: Error finding container 4b9c34b11789486a13243423f7d4b12daaa5e56caf1bdc4f6ccac18eada1fe73: Status 404 returned error can't find the container with id 4b9c34b11789486a13243423f7d4b12daaa5e56caf1bdc4f6ccac18eada1fe73 Jun 13 01:19:23.634970 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:23.634933 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6jks" event={"ID":"0af9115b-ac78-4824-ad5e-3e19b84101a3","Type":"ContainerStarted","Data":"4b9c34b11789486a13243423f7d4b12daaa5e56caf1bdc4f6ccac18eada1fe73"} Jun 13 01:19:27.657155 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:27.657096 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6jks" event={"ID":"0af9115b-ac78-4824-ad5e-3e19b84101a3","Type":"ContainerStarted","Data":"4840f0eba3372822e9533c6161342068e177d5af29822138e5cc3bf6e4f2c015"} Jun 13 01:19:27.657574 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:27.657183 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6jks" Jun 13 01:19:28.399032 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.398971 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6jks" podStartSLOduration=2.216606303 podStartE2EDuration="6.398951164s" totalImagesPullingTime="4.182344861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:19:27.680389976 +0000 UTC m=+502.351789815" watchObservedRunningTime="2026-06-13 01:19:28.398951164 +0000 UTC m=+503.070351002" Jun 13 01:19:28.399931 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.399913 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg"] Jun 13 01:19:28.403500 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.403480 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.406747 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.406722 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 13 01:19:28.406954 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.406936 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 13 01:19:28.407004 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.406965 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 13 01:19:28.407086 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.406941 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 13 01:19:28.414099 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.414067 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9qhz5\"" Jun 13 01:19:28.421821 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.421793 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg"] Jun 13 01:19:28.515300 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.515178 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c10fac-02a5-4b2c-8220-c69e766730b2-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.515300 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.515246 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdpnr\" (UniqueName: \"kubernetes.io/projected/61c10fac-02a5-4b2c-8220-c69e766730b2-kube-api-access-wdpnr\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.515300 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.515281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c10fac-02a5-4b2c-8220-c69e766730b2-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.516065 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.515342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/61c10fac-02a5-4b2c-8220-c69e766730b2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.516065 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.515376 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61c10fac-02a5-4b2c-8220-c69e766730b2-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.516065 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.515446 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/61c10fac-02a5-4b2c-8220-c69e766730b2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.516065 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.515570 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/61c10fac-02a5-4b2c-8220-c69e766730b2-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.616502 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.616461 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61c10fac-02a5-4b2c-8220-c69e766730b2-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.616502 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.616506 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/61c10fac-02a5-4b2c-8220-c69e766730b2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.616753 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.616538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/61c10fac-02a5-4b2c-8220-c69e766730b2-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.616753 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.616557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c10fac-02a5-4b2c-8220-c69e766730b2-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.616753 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.616586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdpnr\" (UniqueName: \"kubernetes.io/projected/61c10fac-02a5-4b2c-8220-c69e766730b2-kube-api-access-wdpnr\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.616753 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.616606 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c10fac-02a5-4b2c-8220-c69e766730b2-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.616753 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.616649 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/61c10fac-02a5-4b2c-8220-c69e766730b2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.617311 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.617285 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/61c10fac-02a5-4b2c-8220-c69e766730b2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.619028 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.619004 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/61c10fac-02a5-4b2c-8220-c69e766730b2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.619104 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.619053 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61c10fac-02a5-4b2c-8220-c69e766730b2-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.619277 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.619261 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c10fac-02a5-4b2c-8220-c69e766730b2-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.619488 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.619468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/61c10fac-02a5-4b2c-8220-c69e766730b2-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.624587 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.624555 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdpnr\" (UniqueName: \"kubernetes.io/projected/61c10fac-02a5-4b2c-8220-c69e766730b2-kube-api-access-wdpnr\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.624662 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.624557 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c10fac-02a5-4b2c-8220-c69e766730b2-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-g7gwg\" (UID: \"61c10fac-02a5-4b2c-8220-c69e766730b2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.716063 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.715979 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:28.870974 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:28.870945 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg"] Jun 13 01:19:28.872935 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:19:28.872910 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c10fac_02a5_4b2c_8220_c69e766730b2.slice/crio-e3fff2531bf6378fd6d11222e0bf5ee2932e6710e47c7e6adf71dc84603ec484 WatchSource:0}: Error finding container e3fff2531bf6378fd6d11222e0bf5ee2932e6710e47c7e6adf71dc84603ec484: Status 404 returned error can't find the container with id e3fff2531bf6378fd6d11222e0bf5ee2932e6710e47c7e6adf71dc84603ec484 Jun 13 01:19:29.670788 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:29.670737 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" event={"ID":"61c10fac-02a5-4b2c-8220-c69e766730b2","Type":"ContainerStarted","Data":"e3fff2531bf6378fd6d11222e0bf5ee2932e6710e47c7e6adf71dc84603ec484"} Jun 13 01:19:31.408287 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:31.408238 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:19:31.408615 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:31.408318 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:19:31.683223 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:31.683129 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" event={"ID":"61c10fac-02a5-4b2c-8220-c69e766730b2","Type":"ContainerStarted","Data":"c8e139b5d7d94799620abff79e6a280805d178bc22e42c041f1e59509909bde4"} Jun 13 01:19:31.683395 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:31.683314 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:31.704722 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:31.704667 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" podStartSLOduration=1.171728064 podStartE2EDuration="3.704651212s" totalImagesPullingTime="2.532923148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:19:31.702791165 +0000 UTC m=+506.374191005" watchObservedRunningTime="2026-06-13 01:19:31.704651212 +0000 UTC m=+506.376051051" Jun 13 01:19:32.689990 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:32.689955 2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-g7gwg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 13 01:19:32.690397 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:32.690015 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" podUID="61c10fac-02a5-4b2c-8220-c69e766730b2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:19:35.688813 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:35.688785 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g7gwg" Jun 13 01:19:37.053139 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:37.053085 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7bc9d68775-jr987"] Jun 13 01:19:37.061401 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:37.061374 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7bc9d68775-jr987" Jun 13 01:19:37.064275 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:37.064233 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7bc9d68775-jr987"] Jun 13 01:19:37.064424 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:37.064272 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5mp7d\"" Jun 13 01:19:37.064424 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:37.064338 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 13 01:19:37.192661 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:37.192624 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b89ed32c-e377-4cf0-98c3-00a8e268e60b-redirect-config\") pod \"dashboard-redirect-7bc9d68775-jr987\" (UID: \"b89ed32c-e377-4cf0-98c3-00a8e268e60b\") " pod="opendatahub/dashboard-redirect-7bc9d68775-jr987" Jun 13 01:19:37.192849 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:37.192684 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq22w\" (UniqueName: \"kubernetes.io/projected/b89ed32c-e377-4cf0-98c3-00a8e268e60b-kube-api-access-wq22w\") pod \"dashboard-redirect-7bc9d68775-jr987\" (UID: \"b89ed32c-e377-4cf0-98c3-00a8e268e60b\") " pod="opendatahub/dashboard-redirect-7bc9d68775-jr987" Jun 13 01:19:37.293479 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:37.293446 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq22w\" (UniqueName: \"kubernetes.io/projected/b89ed32c-e377-4cf0-98c3-00a8e268e60b-kube-api-access-wq22w\") pod \"dashboard-redirect-7bc9d68775-jr987\" (UID: \"b89ed32c-e377-4cf0-98c3-00a8e268e60b\") " pod="opendatahub/dashboard-redirect-7bc9d68775-jr987" Jun 13 01:19:37.293638 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:37.293611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b89ed32c-e377-4cf0-98c3-00a8e268e60b-redirect-config\") pod \"dashboard-redirect-7bc9d68775-jr987\" (UID: \"b89ed32c-e377-4cf0-98c3-00a8e268e60b\") " pod="opendatahub/dashboard-redirect-7bc9d68775-jr987" Jun 13 01:19:37.294335 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:37.294314 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b89ed32c-e377-4cf0-98c3-00a8e268e60b-redirect-config\") pod \"dashboard-redirect-7bc9d68775-jr987\" (UID: \"b89ed32c-e377-4cf0-98c3-00a8e268e60b\") " pod="opendatahub/dashboard-redirect-7bc9d68775-jr987" Jun 13 01:19:37.301483 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:37.301460 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq22w\" (UniqueName: \"kubernetes.io/projected/b89ed32c-e377-4cf0-98c3-00a8e268e60b-kube-api-access-wq22w\") pod \"dashboard-redirect-7bc9d68775-jr987\" (UID: \"b89ed32c-e377-4cf0-98c3-00a8e268e60b\") " pod="opendatahub/dashboard-redirect-7bc9d68775-jr987" Jun 13 01:19:37.373032 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:37.372943 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7bc9d68775-jr987" Jun 13 01:19:37.504672 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:37.504632 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7bc9d68775-jr987"] Jun 13 01:19:37.507972 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:19:37.507943 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb89ed32c_e377_4cf0_98c3_00a8e268e60b.slice/crio-ca960c72761710b4e4467cfcd121515ab4bb7e0d674c864179da685c1a4a8185 WatchSource:0}: Error finding container ca960c72761710b4e4467cfcd121515ab4bb7e0d674c864179da685c1a4a8185: Status 404 returned error can't find the container with id ca960c72761710b4e4467cfcd121515ab4bb7e0d674c864179da685c1a4a8185 Jun 13 01:19:37.711665 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:37.711595 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7bc9d68775-jr987" event={"ID":"b89ed32c-e377-4cf0-98c3-00a8e268e60b","Type":"ContainerStarted","Data":"ca960c72761710b4e4467cfcd121515ab4bb7e0d674c864179da685c1a4a8185"} Jun 13 01:19:38.665054 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:38.664999 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6jks" Jun 13 01:19:39.723672 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:39.723637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7bc9d68775-jr987" event={"ID":"b89ed32c-e377-4cf0-98c3-00a8e268e60b","Type":"ContainerStarted","Data":"0de126e36700b012b5af7f579989c519a7b93b598d05b270473c76fdd69abc77"} Jun 13 01:19:39.760993 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:39.760926 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7bc9d68775-jr987" podStartSLOduration=0.645078078 podStartE2EDuration="2.760907536s" totalImagesPullingTime="2.115829458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:19:39.75851519 +0000 UTC m=+514.429915041" watchObservedRunningTime="2026-06-13 01:19:39.760907536 +0000 UTC m=+514.432307376" Jun 13 01:19:49.618261 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:49.618222 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fbs22" Jun 13 01:19:49.621248 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:19:49.621223 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-l274s" Jun 13 01:20:44.766640 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:44.766609 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w"] Jun 13 01:20:44.770093 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:44.770076 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:20:44.773235 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:44.773208 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bp66b\"" Jun 13 01:20:44.773354 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:44.773282 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 01:20:44.773354 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:44.773285 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 01:20:44.785522 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:44.785493 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w"] Jun 13 01:20:44.872682 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:44.872642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/719251ef-cfbd-4449-b9aa-ee54a2f2187f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bcl9w\" (UID: \"719251ef-cfbd-4449-b9aa-ee54a2f2187f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:20:44.872869 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:44.872695 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rsdc\" (UniqueName: \"kubernetes.io/projected/719251ef-cfbd-4449-b9aa-ee54a2f2187f-kube-api-access-2rsdc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bcl9w\" (UID: \"719251ef-cfbd-4449-b9aa-ee54a2f2187f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:20:44.973670 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:44.973628 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rsdc\" (UniqueName: \"kubernetes.io/projected/719251ef-cfbd-4449-b9aa-ee54a2f2187f-kube-api-access-2rsdc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bcl9w\" (UID: \"719251ef-cfbd-4449-b9aa-ee54a2f2187f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:20:44.973852 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:44.973725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/719251ef-cfbd-4449-b9aa-ee54a2f2187f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bcl9w\" (UID: \"719251ef-cfbd-4449-b9aa-ee54a2f2187f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:20:44.974076 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:44.974059 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/719251ef-cfbd-4449-b9aa-ee54a2f2187f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bcl9w\" (UID: \"719251ef-cfbd-4449-b9aa-ee54a2f2187f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:20:44.985426 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:44.985395 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rsdc\" (UniqueName: \"kubernetes.io/projected/719251ef-cfbd-4449-b9aa-ee54a2f2187f-kube-api-access-2rsdc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bcl9w\" (UID: \"719251ef-cfbd-4449-b9aa-ee54a2f2187f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:20:45.080735 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:45.080645 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:20:45.223023 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:45.222995 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w"] Jun 13 01:20:45.226099 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:20:45.226063 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719251ef_cfbd_4449_b9aa_ee54a2f2187f.slice/crio-09bf7bb9bac3eb204e33dcae9d831742a26aba4cbece73829af4f1234a97f60f WatchSource:0}: Error finding container 09bf7bb9bac3eb204e33dcae9d831742a26aba4cbece73829af4f1234a97f60f: Status 404 returned error can't find the container with id 09bf7bb9bac3eb204e33dcae9d831742a26aba4cbece73829af4f1234a97f60f Jun 13 01:20:46.027568 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:46.027533 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" event={"ID":"719251ef-cfbd-4449-b9aa-ee54a2f2187f","Type":"ContainerStarted","Data":"09bf7bb9bac3eb204e33dcae9d831742a26aba4cbece73829af4f1234a97f60f"} Jun 13 01:20:47.971915 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:47.971880 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dpktl"] Jun 13 01:20:47.975296 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:47.975276 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dpktl" Jun 13 01:20:47.977651 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:47.977636 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-r8qc4\"" Jun 13 01:20:47.989470 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:47.989444 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dpktl"] Jun 13 01:20:48.100024 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:48.099964 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56v8f\" (UniqueName: \"kubernetes.io/projected/0e705b69-bfef-4fdb-86d9-164b193558bd-kube-api-access-56v8f\") pod \"authorino-operator-75cc8d5cb7-dpktl\" (UID: \"0e705b69-bfef-4fdb-86d9-164b193558bd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dpktl" Jun 13 01:20:48.200626 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:48.200586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56v8f\" (UniqueName: \"kubernetes.io/projected/0e705b69-bfef-4fdb-86d9-164b193558bd-kube-api-access-56v8f\") pod \"authorino-operator-75cc8d5cb7-dpktl\" (UID: \"0e705b69-bfef-4fdb-86d9-164b193558bd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dpktl" Jun 13 01:20:48.214718 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:48.214685 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56v8f\" (UniqueName: \"kubernetes.io/projected/0e705b69-bfef-4fdb-86d9-164b193558bd-kube-api-access-56v8f\") pod \"authorino-operator-75cc8d5cb7-dpktl\" (UID: \"0e705b69-bfef-4fdb-86d9-164b193558bd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dpktl" Jun 13 01:20:48.285597 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:48.285511 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dpktl" Jun 13 01:20:48.431275 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:48.431250 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dpktl"] Jun 13 01:20:48.433976 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:20:48.433945 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e705b69_bfef_4fdb_86d9_164b193558bd.slice/crio-cdb97f52e00761f786ec3be8459a3e7f6a86442aace11b06aafd47b0227c6867 WatchSource:0}: Error finding container cdb97f52e00761f786ec3be8459a3e7f6a86442aace11b06aafd47b0227c6867: Status 404 returned error can't find the container with id cdb97f52e00761f786ec3be8459a3e7f6a86442aace11b06aafd47b0227c6867 Jun 13 01:20:49.044702 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:49.044662 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dpktl" event={"ID":"0e705b69-bfef-4fdb-86d9-164b193558bd","Type":"ContainerStarted","Data":"cdb97f52e00761f786ec3be8459a3e7f6a86442aace11b06aafd47b0227c6867"} Jun 13 01:20:51.057893 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:51.057779 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dpktl" event={"ID":"0e705b69-bfef-4fdb-86d9-164b193558bd","Type":"ContainerStarted","Data":"0c5698fa23139edde185331ed1a4eb098384ad69be785a8afb39960fdb407fde"} Jun 13 01:20:51.057893 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:51.057858 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dpktl" Jun 13 01:20:51.078901 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:51.078843 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dpktl" podStartSLOduration=1.747829384 podStartE2EDuration="4.078823032s" totalImagesPullingTime="2.330993648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:20:51.077707649 +0000 UTC m=+585.749107488" watchObservedRunningTime="2026-06-13 01:20:51.078823032 +0000 UTC m=+585.750222873" Jun 13 01:20:54.073204 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:54.073087 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" event={"ID":"719251ef-cfbd-4449-b9aa-ee54a2f2187f","Type":"ContainerStarted","Data":"aea229a55b16485983e478f2cca6a6eff8bbd651094552bee0792f0adc427001"} Jun 13 01:20:54.073589 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:54.073250 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:20:54.099995 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:20:54.099933 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" podStartSLOduration=1.690347133 podStartE2EDuration="10.099915299s" totalImagesPullingTime="8.409568166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:20:54.097945988 +0000 UTC m=+588.769345850" watchObservedRunningTime="2026-06-13 01:20:54.099915299 +0000 UTC m=+588.771315138" Jun 13 01:21:02.064591 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:02.064552 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dpktl" Jun 13 01:21:05.079966 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:05.079926 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:21:05.742652 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:05.742623 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:21:05.742916 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:05.742895 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:21:06.781537 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.781503 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf"] Jun 13 01:21:06.784915 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.784894 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf" Jun 13 01:21:06.798780 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.798754 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf"] Jun 13 01:21:06.842241 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.842203 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w"] Jun 13 01:21:06.842460 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.842396 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" podUID="719251ef-cfbd-4449-b9aa-ee54a2f2187f" containerName="manager" containerID="cri-o://aea229a55b16485983e478f2cca6a6eff8bbd651094552bee0792f0adc427001" gracePeriod=2 Jun 13 01:21:06.847958 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.847932 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w"] Jun 13 01:21:06.864138 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.861036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjp44\" (UniqueName: \"kubernetes.io/projected/7756b215-3d72-4ed9-b0ad-4e69519cbcf6-kube-api-access-wjp44\") pod \"kuadrant-operator-controller-manager-86878c769f-s4lgf\" (UID: \"7756b215-3d72-4ed9-b0ad-4e69519cbcf6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf" Jun 13 01:21:06.864138 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.861082 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7756b215-3d72-4ed9-b0ad-4e69519cbcf6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s4lgf\" (UID: \"7756b215-3d72-4ed9-b0ad-4e69519cbcf6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf" Jun 13 01:21:06.870143 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.870095 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf"] Jun 13 01:21:06.874133 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:21:06.870488 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-wjp44], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf" podUID="7756b215-3d72-4ed9-b0ad-4e69519cbcf6" Jun 13 01:21:06.876957 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.876935 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf"] Jun 13 01:21:06.904003 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.903969 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn"] Jun 13 01:21:06.905541 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.905510 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="719251ef-cfbd-4449-b9aa-ee54a2f2187f" containerName="manager" Jun 13 01:21:06.905727 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.905704 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="719251ef-cfbd-4449-b9aa-ee54a2f2187f" containerName="manager" Jun 13 01:21:06.906023 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.906005 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="719251ef-cfbd-4449-b9aa-ee54a2f2187f" containerName="manager" Jun 13 01:21:06.914506 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.914478 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" Jun 13 01:21:06.917082 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:21:06.917054 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bcl9w\" is forbidden: User \"system:node:ip-10-0-143-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-139.ec2.internal' and this object" podUID="719251ef-cfbd-4449-b9aa-ee54a2f2187f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:21:06.922564 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.922531 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn"] Jun 13 01:21:06.961701 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.961667 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjp44\" (UniqueName: \"kubernetes.io/projected/7756b215-3d72-4ed9-b0ad-4e69519cbcf6-kube-api-access-wjp44\") pod \"kuadrant-operator-controller-manager-86878c769f-s4lgf\" (UID: \"7756b215-3d72-4ed9-b0ad-4e69519cbcf6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf" Jun 13 01:21:06.961824 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.961708 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mwcwn\" (UID: \"7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" Jun 13 01:21:06.961824 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.961731 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7756b215-3d72-4ed9-b0ad-4e69519cbcf6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s4lgf\" (UID: \"7756b215-3d72-4ed9-b0ad-4e69519cbcf6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf" Jun 13 01:21:06.961911 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.961890 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp5tw\" (UniqueName: \"kubernetes.io/projected/7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec-kube-api-access-pp5tw\") pod \"kuadrant-operator-controller-manager-86878c769f-mwcwn\" (UID: \"7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" Jun 13 01:21:06.962066 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:06.962045 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7756b215-3d72-4ed9-b0ad-4e69519cbcf6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s4lgf\" (UID: \"7756b215-3d72-4ed9-b0ad-4e69519cbcf6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf" Jun 13 01:21:06.966760 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:21:06.966740 2574 projected.go:196] Error preparing data for projected volume kube-api-access-wjp44 for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-s4lgf" not found Jun 13 01:21:06.966849 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:21:06.966807 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7756b215-3d72-4ed9-b0ad-4e69519cbcf6-kube-api-access-wjp44 podName:7756b215-3d72-4ed9-b0ad-4e69519cbcf6 nodeName:}" failed. No retries permitted until 2026-06-13 01:21:07.466791471 +0000 UTC m=+602.138191291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wjp44" (UniqueName: "kubernetes.io/projected/7756b215-3d72-4ed9-b0ad-4e69519cbcf6-kube-api-access-wjp44") pod "kuadrant-operator-controller-manager-86878c769f-s4lgf" (UID: "7756b215-3d72-4ed9-b0ad-4e69519cbcf6") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-s4lgf" not found Jun 13 01:21:07.062633 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.062549 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mwcwn\" (UID: \"7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" Jun 13 01:21:07.062786 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.062666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp5tw\" (UniqueName: \"kubernetes.io/projected/7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec-kube-api-access-pp5tw\") pod \"kuadrant-operator-controller-manager-86878c769f-mwcwn\" (UID: \"7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" Jun 13 01:21:07.062939 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.062920 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mwcwn\" (UID: \"7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" Jun 13 01:21:07.072186 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.072156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp5tw\" (UniqueName: \"kubernetes.io/projected/7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec-kube-api-access-pp5tw\") pod \"kuadrant-operator-controller-manager-86878c769f-mwcwn\" (UID: \"7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" Jun 13 01:21:07.091419 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.091391 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:21:07.093690 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:21:07.093659 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bcl9w\" is forbidden: User \"system:node:ip-10-0-143-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-139.ec2.internal' and this object" podUID="719251ef-cfbd-4449-b9aa-ee54a2f2187f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:21:07.134760 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.134723 2574 generic.go:356] "Generic (PLEG): container finished" podID="719251ef-cfbd-4449-b9aa-ee54a2f2187f" containerID="aea229a55b16485983e478f2cca6a6eff8bbd651094552bee0792f0adc427001" exitCode=0 Jun 13 01:21:07.134760 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.134765 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:21:07.134995 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.134815 2574 scope.go:117] "RemoveContainer" containerID="aea229a55b16485983e478f2cca6a6eff8bbd651094552bee0792f0adc427001" Jun 13 01:21:07.134995 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.134909 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf" Jun 13 01:21:07.136987 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:21:07.136962 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bcl9w\" is forbidden: User \"system:node:ip-10-0-143-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-139.ec2.internal' and this object" podUID="719251ef-cfbd-4449-b9aa-ee54a2f2187f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:21:07.139038 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:21:07.139008 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bcl9w\" is forbidden: User \"system:node:ip-10-0-143-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-139.ec2.internal' and this object" podUID="719251ef-cfbd-4449-b9aa-ee54a2f2187f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:21:07.140800 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:21:07.140776 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-s4lgf\" is forbidden: User \"system:node:ip-10-0-143-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-139.ec2.internal' and this object" podUID="7756b215-3d72-4ed9-b0ad-4e69519cbcf6" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf" Jun 13 01:21:07.141714 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.141697 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf" Jun 13 01:21:07.143703 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:21:07.143658 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bcl9w\" is forbidden: User \"system:node:ip-10-0-143-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-139.ec2.internal' and this object" podUID="719251ef-cfbd-4449-b9aa-ee54a2f2187f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:21:07.143762 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.143734 2574 scope.go:117] "RemoveContainer" containerID="aea229a55b16485983e478f2cca6a6eff8bbd651094552bee0792f0adc427001" Jun 13 01:21:07.143998 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:21:07.143979 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aea229a55b16485983e478f2cca6a6eff8bbd651094552bee0792f0adc427001\": container with ID starting with aea229a55b16485983e478f2cca6a6eff8bbd651094552bee0792f0adc427001 not found: ID does not exist" containerID="aea229a55b16485983e478f2cca6a6eff8bbd651094552bee0792f0adc427001" Jun 13 01:21:07.144059 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.144008 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aea229a55b16485983e478f2cca6a6eff8bbd651094552bee0792f0adc427001"} err="failed to get container status \"aea229a55b16485983e478f2cca6a6eff8bbd651094552bee0792f0adc427001\": rpc error: code = NotFound desc = could not find container \"aea229a55b16485983e478f2cca6a6eff8bbd651094552bee0792f0adc427001\": container with ID starting with aea229a55b16485983e478f2cca6a6eff8bbd651094552bee0792f0adc427001 not found: ID does not exist" Jun 13 01:21:07.145488 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:21:07.145468 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-s4lgf\" is forbidden: User \"system:node:ip-10-0-143-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-139.ec2.internal' and this object" podUID="7756b215-3d72-4ed9-b0ad-4e69519cbcf6" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf" Jun 13 01:21:07.163816 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.163782 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rsdc\" (UniqueName: \"kubernetes.io/projected/719251ef-cfbd-4449-b9aa-ee54a2f2187f-kube-api-access-2rsdc\") pod \"719251ef-cfbd-4449-b9aa-ee54a2f2187f\" (UID: \"719251ef-cfbd-4449-b9aa-ee54a2f2187f\") " Jun 13 01:21:07.163954 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.163879 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/719251ef-cfbd-4449-b9aa-ee54a2f2187f-extensions-socket-volume\") pod \"719251ef-cfbd-4449-b9aa-ee54a2f2187f\" (UID: \"719251ef-cfbd-4449-b9aa-ee54a2f2187f\") " Jun 13 01:21:07.163954 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.163919 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7756b215-3d72-4ed9-b0ad-4e69519cbcf6-extensions-socket-volume\") pod \"7756b215-3d72-4ed9-b0ad-4e69519cbcf6\" (UID: \"7756b215-3d72-4ed9-b0ad-4e69519cbcf6\") " Jun 13 01:21:07.164185 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.164169 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjp44\" (UniqueName: \"kubernetes.io/projected/7756b215-3d72-4ed9-b0ad-4e69519cbcf6-kube-api-access-wjp44\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:21:07.164252 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.164164 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7756b215-3d72-4ed9-b0ad-4e69519cbcf6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7756b215-3d72-4ed9-b0ad-4e69519cbcf6" (UID: "7756b215-3d72-4ed9-b0ad-4e69519cbcf6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:21:07.164295 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.164244 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719251ef-cfbd-4449-b9aa-ee54a2f2187f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "719251ef-cfbd-4449-b9aa-ee54a2f2187f" (UID: "719251ef-cfbd-4449-b9aa-ee54a2f2187f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:21:07.166009 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.165989 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/719251ef-cfbd-4449-b9aa-ee54a2f2187f-kube-api-access-2rsdc" (OuterVolumeSpecName: "kube-api-access-2rsdc") pod "719251ef-cfbd-4449-b9aa-ee54a2f2187f" (UID: "719251ef-cfbd-4449-b9aa-ee54a2f2187f"). InnerVolumeSpecName "kube-api-access-2rsdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:21:07.230380 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.230332 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" Jun 13 01:21:07.265155 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.265099 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rsdc\" (UniqueName: \"kubernetes.io/projected/719251ef-cfbd-4449-b9aa-ee54a2f2187f-kube-api-access-2rsdc\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:21:07.265290 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.265156 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/719251ef-cfbd-4449-b9aa-ee54a2f2187f-extensions-socket-volume\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:21:07.265290 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.265174 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7756b215-3d72-4ed9-b0ad-4e69519cbcf6-extensions-socket-volume\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:21:07.369645 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.369567 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn"] Jun 13 01:21:07.372759 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:21:07.372733 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8ec66a_5a1f_4b13_a77c_ddb4581d6cec.slice/crio-f28c9b992f8af87b14e3462ddfb65eea31af4388c65feb8bd879955d5adf0695 WatchSource:0}: Error finding container f28c9b992f8af87b14e3462ddfb65eea31af4388c65feb8bd879955d5adf0695: Status 404 returned error can't find the container with id f28c9b992f8af87b14e3462ddfb65eea31af4388c65feb8bd879955d5adf0695 Jun 13 01:21:07.447100 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:21:07.447070 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bcl9w\" is forbidden: User \"system:node:ip-10-0-143-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-139.ec2.internal' and this object" podUID="719251ef-cfbd-4449-b9aa-ee54a2f2187f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bcl9w" Jun 13 01:21:07.448903 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:21:07.448878 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-s4lgf\" is forbidden: User \"system:node:ip-10-0-143-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-139.ec2.internal' and this object" podUID="7756b215-3d72-4ed9-b0ad-4e69519cbcf6" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf" Jun 13 01:21:07.763196 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.763155 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="719251ef-cfbd-4449-b9aa-ee54a2f2187f" path="/var/lib/kubelet/pods/719251ef-cfbd-4449-b9aa-ee54a2f2187f/volumes" Jun 13 01:21:07.763653 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:07.763631 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7756b215-3d72-4ed9-b0ad-4e69519cbcf6" path="/var/lib/kubelet/pods/7756b215-3d72-4ed9-b0ad-4e69519cbcf6/volumes" Jun 13 01:21:08.143266 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:08.143229 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" event={"ID":"7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec","Type":"ContainerStarted","Data":"4f5d7c7f27d60f550c6c2faa014c6b9748c61e5eaba04b3d68dce52526afc66b"} Jun 13 01:21:08.143693 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:08.143292 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" event={"ID":"7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec","Type":"ContainerStarted","Data":"f28c9b992f8af87b14e3462ddfb65eea31af4388c65feb8bd879955d5adf0695"} Jun 13 01:21:08.143693 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:08.143364 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" Jun 13 01:21:08.143775 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:08.143720 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf" Jun 13 01:21:08.212598 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:08.212547 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" podStartSLOduration=2.212530808 podStartE2EDuration="2.212530808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:21:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:21:08.210093569 +0000 UTC m=+602.881493407" watchObservedRunningTime="2026-06-13 01:21:08.212530808 +0000 UTC m=+602.883930646" Jun 13 01:21:08.213926 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:21:08.213897 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-s4lgf\" is forbidden: User \"system:node:ip-10-0-143-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-139.ec2.internal' and this object" podUID="7756b215-3d72-4ed9-b0ad-4e69519cbcf6" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4lgf" Jun 13 01:21:19.155070 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:21:19.155036 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" Jun 13 01:22:34.655497 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:34.655459 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:22:34.658651 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:34.658631 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:22:34.660898 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:34.660875 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 13 01:22:34.660997 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:34.660875 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 13 01:22:34.661053 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:34.661005 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lpqk8\"" Jun 13 01:22:34.661645 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:34.661629 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 13 01:22:34.667546 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:34.667525 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:22:34.737419 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:34.737384 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqzh4\" (UniqueName: \"kubernetes.io/projected/dac711ba-bb11-48a3-9002-a8fabe200881-kube-api-access-mqzh4\") pod \"maas-keycloak-0\" (UID: \"dac711ba-bb11-48a3-9002-a8fabe200881\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:22:34.838952 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:34.838914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqzh4\" (UniqueName: \"kubernetes.io/projected/dac711ba-bb11-48a3-9002-a8fabe200881-kube-api-access-mqzh4\") pod \"maas-keycloak-0\" (UID: \"dac711ba-bb11-48a3-9002-a8fabe200881\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:22:34.847267 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:34.847235 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqzh4\" (UniqueName: \"kubernetes.io/projected/dac711ba-bb11-48a3-9002-a8fabe200881-kube-api-access-mqzh4\") pod \"maas-keycloak-0\" (UID: \"dac711ba-bb11-48a3-9002-a8fabe200881\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:22:34.969394 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:34.969305 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:22:35.101909 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:35.101882 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:22:35.104174 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:22:35.104142 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddac711ba_bb11_48a3_9002_a8fabe200881.slice/crio-e781f4d5522330157a5d6a1a021f219d6201d9d66c03ec08354b978108b7c822 WatchSource:0}: Error finding container e781f4d5522330157a5d6a1a021f219d6201d9d66c03ec08354b978108b7c822: Status 404 returned error can't find the container with id e781f4d5522330157a5d6a1a021f219d6201d9d66c03ec08354b978108b7c822 Jun 13 01:22:35.558049 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:35.558015 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dac711ba-bb11-48a3-9002-a8fabe200881","Type":"ContainerStarted","Data":"e781f4d5522330157a5d6a1a021f219d6201d9d66c03ec08354b978108b7c822"} Jun 13 01:22:40.588843 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:40.588803 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dac711ba-bb11-48a3-9002-a8fabe200881","Type":"ContainerStarted","Data":"4bd7643cf5851f79b4e09bd640c53bda038a4959fc99a4ce63444e8ae85b2dfc"} Jun 13 01:22:40.607267 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:40.607215 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.960586278 podStartE2EDuration="6.607194696s" totalImagesPullingTime="4.646608418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:22:40.605288076 +0000 UTC m=+695.276687916" watchObservedRunningTime="2026-06-13 01:22:40.607194696 +0000 UTC m=+695.278594534" Jun 13 01:22:40.969819 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:40.969770 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 13 01:22:40.971897 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:40.971852 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 01:22:41.970908 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:41.970855 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 01:22:42.970945 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:42.970874 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 01:22:43.970362 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:43.970306 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 01:22:44.970536 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:44.970494 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 13 01:22:44.971148 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:44.970952 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 01:22:45.970308 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:45.970248 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 01:22:46.970703 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:46.970648 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 01:22:47.969810 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:47.969761 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 01:22:48.970494 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:48.970449 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 01:22:49.970178 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:49.970109 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 01:22:50.970367 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:50.970315 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 01:22:51.970031 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:51.969979 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 01:22:53.076338 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:53.076238 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 13 01:22:53.091084 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:22:53.091033 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:23:03.082573 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:03.082536 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 13 01:23:09.479305 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.479255 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6ddb9ff9b5-pdv7z"] Jun 13 01:23:09.486278 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.486252 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" Jun 13 01:23:09.490196 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.490170 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 13 01:23:09.490335 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.490172 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-87zgw\"" Jun 13 01:23:09.490744 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.490728 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 13 01:23:09.500487 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.500464 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ddb9ff9b5-pdv7z"] Jun 13 01:23:09.586566 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.586535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8903fada-8a96-4a6e-97d6-74da2d563640-webhook-cert\") pod \"maas-controller-6ddb9ff9b5-pdv7z\" (UID: \"8903fada-8a96-4a6e-97d6-74da2d563640\") " pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" Jun 13 01:23:09.586739 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.586647 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjnxs\" (UniqueName: \"kubernetes.io/projected/8903fada-8a96-4a6e-97d6-74da2d563640-kube-api-access-rjnxs\") pod \"maas-controller-6ddb9ff9b5-pdv7z\" (UID: \"8903fada-8a96-4a6e-97d6-74da2d563640\") " pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" Jun 13 01:23:09.645587 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.645552 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c7b74457c-cq6j7"] Jun 13 01:23:09.648161 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.648141 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c7b74457c-cq6j7" Jun 13 01:23:09.657549 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.657521 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c7b74457c-cq6j7"] Jun 13 01:23:09.688012 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.687983 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8903fada-8a96-4a6e-97d6-74da2d563640-webhook-cert\") pod \"maas-controller-6ddb9ff9b5-pdv7z\" (UID: \"8903fada-8a96-4a6e-97d6-74da2d563640\") " pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" Jun 13 01:23:09.688190 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.688069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjnxs\" (UniqueName: \"kubernetes.io/projected/8903fada-8a96-4a6e-97d6-74da2d563640-kube-api-access-rjnxs\") pod \"maas-controller-6ddb9ff9b5-pdv7z\" (UID: \"8903fada-8a96-4a6e-97d6-74da2d563640\") " pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" Jun 13 01:23:09.688190 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:23:09.688162 2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 13 01:23:09.688286 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:23:09.688232 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8903fada-8a96-4a6e-97d6-74da2d563640-webhook-cert podName:8903fada-8a96-4a6e-97d6-74da2d563640 nodeName:}" failed. No retries permitted until 2026-06-13 01:23:10.188213773 +0000 UTC m=+724.859613594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/8903fada-8a96-4a6e-97d6-74da2d563640-webhook-cert") pod "maas-controller-6ddb9ff9b5-pdv7z" (UID: "8903fada-8a96-4a6e-97d6-74da2d563640") : secret "maas-controller-webhook-cert" not found Jun 13 01:23:09.697395 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.697369 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjnxs\" (UniqueName: \"kubernetes.io/projected/8903fada-8a96-4a6e-97d6-74da2d563640-kube-api-access-rjnxs\") pod \"maas-controller-6ddb9ff9b5-pdv7z\" (UID: \"8903fada-8a96-4a6e-97d6-74da2d563640\") " pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" Jun 13 01:23:09.789619 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.789528 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp6ww\" (UniqueName: \"kubernetes.io/projected/cc957b55-166d-4d11-8999-72b5c204e27b-kube-api-access-jp6ww\") pod \"maas-controller-c7b74457c-cq6j7\" (UID: \"cc957b55-166d-4d11-8999-72b5c204e27b\") " pod="opendatahub/maas-controller-c7b74457c-cq6j7" Jun 13 01:23:09.789619 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.789588 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc957b55-166d-4d11-8999-72b5c204e27b-webhook-cert\") pod \"maas-controller-c7b74457c-cq6j7\" (UID: \"cc957b55-166d-4d11-8999-72b5c204e27b\") " pod="opendatahub/maas-controller-c7b74457c-cq6j7" Jun 13 01:23:09.890622 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.890584 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc957b55-166d-4d11-8999-72b5c204e27b-webhook-cert\") pod \"maas-controller-c7b74457c-cq6j7\" (UID: \"cc957b55-166d-4d11-8999-72b5c204e27b\") " pod="opendatahub/maas-controller-c7b74457c-cq6j7" Jun 13 01:23:09.890790 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.890674 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp6ww\" (UniqueName: \"kubernetes.io/projected/cc957b55-166d-4d11-8999-72b5c204e27b-kube-api-access-jp6ww\") pod \"maas-controller-c7b74457c-cq6j7\" (UID: \"cc957b55-166d-4d11-8999-72b5c204e27b\") " pod="opendatahub/maas-controller-c7b74457c-cq6j7" Jun 13 01:23:09.890790 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:23:09.890734 2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 13 01:23:09.890868 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:23:09.890813 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc957b55-166d-4d11-8999-72b5c204e27b-webhook-cert podName:cc957b55-166d-4d11-8999-72b5c204e27b nodeName:}" failed. No retries permitted until 2026-06-13 01:23:10.390796319 +0000 UTC m=+725.062196135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/cc957b55-166d-4d11-8999-72b5c204e27b-webhook-cert") pod "maas-controller-c7b74457c-cq6j7" (UID: "cc957b55-166d-4d11-8999-72b5c204e27b") : secret "maas-controller-webhook-cert" not found Jun 13 01:23:09.899617 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:09.899583 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp6ww\" (UniqueName: \"kubernetes.io/projected/cc957b55-166d-4d11-8999-72b5c204e27b-kube-api-access-jp6ww\") pod \"maas-controller-c7b74457c-cq6j7\" (UID: \"cc957b55-166d-4d11-8999-72b5c204e27b\") " pod="opendatahub/maas-controller-c7b74457c-cq6j7" Jun 13 01:23:10.193264 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:10.193228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8903fada-8a96-4a6e-97d6-74da2d563640-webhook-cert\") pod \"maas-controller-6ddb9ff9b5-pdv7z\" (UID: \"8903fada-8a96-4a6e-97d6-74da2d563640\") " pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" Jun 13 01:23:10.195636 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:10.195617 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8903fada-8a96-4a6e-97d6-74da2d563640-webhook-cert\") pod \"maas-controller-6ddb9ff9b5-pdv7z\" (UID: \"8903fada-8a96-4a6e-97d6-74da2d563640\") " pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" Jun 13 01:23:10.396031 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:10.395989 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc957b55-166d-4d11-8999-72b5c204e27b-webhook-cert\") pod \"maas-controller-c7b74457c-cq6j7\" (UID: \"cc957b55-166d-4d11-8999-72b5c204e27b\") " pod="opendatahub/maas-controller-c7b74457c-cq6j7" Jun 13 01:23:10.396521 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:10.396488 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" Jun 13 01:23:10.398900 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:10.398573 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc957b55-166d-4d11-8999-72b5c204e27b-webhook-cert\") pod \"maas-controller-c7b74457c-cq6j7\" (UID: \"cc957b55-166d-4d11-8999-72b5c204e27b\") " pod="opendatahub/maas-controller-c7b74457c-cq6j7" Jun 13 01:23:10.528897 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:10.528868 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ddb9ff9b5-pdv7z"] Jun 13 01:23:10.530182 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:23:10.530159 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8903fada_8a96_4a6e_97d6_74da2d563640.slice/crio-9a86c1870bed08827ed50bf2aced4060c2871ef0582dc8c1cabecae44d6aa202 WatchSource:0}: Error finding container 9a86c1870bed08827ed50bf2aced4060c2871ef0582dc8c1cabecae44d6aa202: Status 404 returned error can't find the container with id 9a86c1870bed08827ed50bf2aced4060c2871ef0582dc8c1cabecae44d6aa202 Jun 13 01:23:10.531532 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:10.531517 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:23:10.559584 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:10.559554 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c7b74457c-cq6j7" Jun 13 01:23:10.691101 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:10.691075 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c7b74457c-cq6j7"] Jun 13 01:23:10.693129 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:23:10.693079 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc957b55_166d_4d11_8999_72b5c204e27b.slice/crio-a808b10d9d2fb1b5f9408349e40c7eb101c813154aff915dbdd9575ebff68667 WatchSource:0}: Error finding container a808b10d9d2fb1b5f9408349e40c7eb101c813154aff915dbdd9575ebff68667: Status 404 returned error can't find the container with id a808b10d9d2fb1b5f9408349e40c7eb101c813154aff915dbdd9575ebff68667 Jun 13 01:23:10.764329 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:10.764239 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c7b74457c-cq6j7" event={"ID":"cc957b55-166d-4d11-8999-72b5c204e27b","Type":"ContainerStarted","Data":"a808b10d9d2fb1b5f9408349e40c7eb101c813154aff915dbdd9575ebff68667"} Jun 13 01:23:10.765271 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:10.765248 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" event={"ID":"8903fada-8a96-4a6e-97d6-74da2d563640","Type":"ContainerStarted","Data":"9a86c1870bed08827ed50bf2aced4060c2871ef0582dc8c1cabecae44d6aa202"} Jun 13 01:23:12.777758 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:12.777648 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c7b74457c-cq6j7" event={"ID":"cc957b55-166d-4d11-8999-72b5c204e27b","Type":"ContainerStarted","Data":"7cc9e2732c4a4907bc2ed278a518dbb36ec2b2404dd38d45c0ee890b1230c007"} Jun 13 01:23:12.778215 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:12.777818 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c7b74457c-cq6j7" Jun 13 01:23:12.779130 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:12.779097 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" event={"ID":"8903fada-8a96-4a6e-97d6-74da2d563640","Type":"ContainerStarted","Data":"1e62723125f7ae4569a786c783953791a38a54e6faab6f3c92444de5abefd93f"} Jun 13 01:23:12.779246 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:12.779175 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" Jun 13 01:23:12.798628 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:12.798579 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c7b74457c-cq6j7" podStartSLOduration=2.065274443 podStartE2EDuration="3.798563203s" totalImagesPullingTime="1.73328876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:23:12.79659484 +0000 UTC m=+727.467994679" watchObservedRunningTime="2026-06-13 01:23:12.798563203 +0000 UTC m=+727.469963073" Jun 13 01:23:12.818783 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:12.818719 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" podStartSLOduration=1.9260615140000001 podStartE2EDuration="3.818698416s" totalImagesPullingTime="1.892636902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:23:12.815962327 +0000 UTC m=+727.487362165" watchObservedRunningTime="2026-06-13 01:23:12.818698416 +0000 UTC m=+727.490098255" Jun 13 01:23:23.789686 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:23.789651 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" Jun 13 01:23:23.790175 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:23.789960 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c7b74457c-cq6j7" Jun 13 01:23:23.847698 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:23.847662 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ddb9ff9b5-pdv7z"] Jun 13 01:23:23.847972 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:23.847940 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" podUID="8903fada-8a96-4a6e-97d6-74da2d563640" containerName="manager" containerID="cri-o://1e62723125f7ae4569a786c783953791a38a54e6faab6f3c92444de5abefd93f" gracePeriod=30 Jun 13 01:23:24.100615 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.100591 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" Jun 13 01:23:24.120839 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.120728 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8903fada-8a96-4a6e-97d6-74da2d563640-webhook-cert\") pod \"8903fada-8a96-4a6e-97d6-74da2d563640\" (UID: \"8903fada-8a96-4a6e-97d6-74da2d563640\") " Jun 13 01:23:24.120839 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.120787 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjnxs\" (UniqueName: \"kubernetes.io/projected/8903fada-8a96-4a6e-97d6-74da2d563640-kube-api-access-rjnxs\") pod \"8903fada-8a96-4a6e-97d6-74da2d563640\" (UID: \"8903fada-8a96-4a6e-97d6-74da2d563640\") " Jun 13 01:23:24.123321 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.123283 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8903fada-8a96-4a6e-97d6-74da2d563640-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8903fada-8a96-4a6e-97d6-74da2d563640" (UID: "8903fada-8a96-4a6e-97d6-74da2d563640"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:23:24.123726 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.123699 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8903fada-8a96-4a6e-97d6-74da2d563640-kube-api-access-rjnxs" (OuterVolumeSpecName: "kube-api-access-rjnxs") pod "8903fada-8a96-4a6e-97d6-74da2d563640" (UID: "8903fada-8a96-4a6e-97d6-74da2d563640"). InnerVolumeSpecName "kube-api-access-rjnxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:23:24.221821 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.221779 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8903fada-8a96-4a6e-97d6-74da2d563640-webhook-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:23:24.221821 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.221816 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjnxs\" (UniqueName: \"kubernetes.io/projected/8903fada-8a96-4a6e-97d6-74da2d563640-kube-api-access-rjnxs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:23:24.851012 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.850978 2574 generic.go:356] "Generic (PLEG): container finished" podID="8903fada-8a96-4a6e-97d6-74da2d563640" containerID="1e62723125f7ae4569a786c783953791a38a54e6faab6f3c92444de5abefd93f" exitCode=0 Jun 13 01:23:24.851509 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.851022 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" Jun 13 01:23:24.851509 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.851067 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" event={"ID":"8903fada-8a96-4a6e-97d6-74da2d563640","Type":"ContainerDied","Data":"1e62723125f7ae4569a786c783953791a38a54e6faab6f3c92444de5abefd93f"} Jun 13 01:23:24.851509 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.851150 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ddb9ff9b5-pdv7z" event={"ID":"8903fada-8a96-4a6e-97d6-74da2d563640","Type":"ContainerDied","Data":"9a86c1870bed08827ed50bf2aced4060c2871ef0582dc8c1cabecae44d6aa202"} Jun 13 01:23:24.851509 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.851189 2574 scope.go:117] "RemoveContainer" containerID="1e62723125f7ae4569a786c783953791a38a54e6faab6f3c92444de5abefd93f" Jun 13 01:23:24.860598 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.860579 2574 scope.go:117] "RemoveContainer" containerID="1e62723125f7ae4569a786c783953791a38a54e6faab6f3c92444de5abefd93f" Jun 13 01:23:24.860914 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:23:24.860893 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e62723125f7ae4569a786c783953791a38a54e6faab6f3c92444de5abefd93f\": container with ID starting with 1e62723125f7ae4569a786c783953791a38a54e6faab6f3c92444de5abefd93f not found: ID does not exist" containerID="1e62723125f7ae4569a786c783953791a38a54e6faab6f3c92444de5abefd93f" Jun 13 01:23:24.860973 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.860926 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e62723125f7ae4569a786c783953791a38a54e6faab6f3c92444de5abefd93f"} err="failed to get container status \"1e62723125f7ae4569a786c783953791a38a54e6faab6f3c92444de5abefd93f\": rpc error: code = NotFound desc = could not find container \"1e62723125f7ae4569a786c783953791a38a54e6faab6f3c92444de5abefd93f\": container with ID starting with 1e62723125f7ae4569a786c783953791a38a54e6faab6f3c92444de5abefd93f not found: ID does not exist" Jun 13 01:23:24.872285 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.872257 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ddb9ff9b5-pdv7z"] Jun 13 01:23:24.875659 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:24.875633 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6ddb9ff9b5-pdv7z"] Jun 13 01:23:25.763956 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:25.763922 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8903fada-8a96-4a6e-97d6-74da2d563640" path="/var/lib/kubelet/pods/8903fada-8a96-4a6e-97d6-74da2d563640/volumes" Jun 13 01:23:43.616536 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.616501 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-9c7d857d9-kv8vv"] Jun 13 01:23:43.616995 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.616888 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8903fada-8a96-4a6e-97d6-74da2d563640" containerName="manager" Jun 13 01:23:43.616995 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.616900 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8903fada-8a96-4a6e-97d6-74da2d563640" containerName="manager" Jun 13 01:23:43.616995 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.616962 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8903fada-8a96-4a6e-97d6-74da2d563640" containerName="manager" Jun 13 01:23:43.622838 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.622818 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-9c7d857d9-kv8vv" Jun 13 01:23:43.625403 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.625380 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 13 01:23:43.625513 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.625479 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cd95n\"" Jun 13 01:23:43.631085 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.631061 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-9c7d857d9-kv8vv"] Jun 13 01:23:43.694531 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.694496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02738456-62d9-4e93-887e-4b2bd6c459c0-maas-api-tls\") pod \"maas-api-9c7d857d9-kv8vv\" (UID: \"02738456-62d9-4e93-887e-4b2bd6c459c0\") " pod="opendatahub/maas-api-9c7d857d9-kv8vv" Jun 13 01:23:43.694531 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.694529 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02738456-62d9-4e93-887e-4b2bd6c459c0-openshift-service-ca\") pod \"maas-api-9c7d857d9-kv8vv\" (UID: \"02738456-62d9-4e93-887e-4b2bd6c459c0\") " pod="opendatahub/maas-api-9c7d857d9-kv8vv" Jun 13 01:23:43.694741 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.694559 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4djx\" (UniqueName: \"kubernetes.io/projected/02738456-62d9-4e93-887e-4b2bd6c459c0-kube-api-access-t4djx\") pod \"maas-api-9c7d857d9-kv8vv\" (UID: \"02738456-62d9-4e93-887e-4b2bd6c459c0\") " pod="opendatahub/maas-api-9c7d857d9-kv8vv" Jun 13 01:23:43.795870 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.795834 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02738456-62d9-4e93-887e-4b2bd6c459c0-maas-api-tls\") pod \"maas-api-9c7d857d9-kv8vv\" (UID: \"02738456-62d9-4e93-887e-4b2bd6c459c0\") " pod="opendatahub/maas-api-9c7d857d9-kv8vv" Jun 13 01:23:43.795870 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.795870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02738456-62d9-4e93-887e-4b2bd6c459c0-openshift-service-ca\") pod \"maas-api-9c7d857d9-kv8vv\" (UID: \"02738456-62d9-4e93-887e-4b2bd6c459c0\") " pod="opendatahub/maas-api-9c7d857d9-kv8vv" Jun 13 01:23:43.796100 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.795910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4djx\" (UniqueName: \"kubernetes.io/projected/02738456-62d9-4e93-887e-4b2bd6c459c0-kube-api-access-t4djx\") pod \"maas-api-9c7d857d9-kv8vv\" (UID: \"02738456-62d9-4e93-887e-4b2bd6c459c0\") " pod="opendatahub/maas-api-9c7d857d9-kv8vv" Jun 13 01:23:43.796725 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.796698 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02738456-62d9-4e93-887e-4b2bd6c459c0-openshift-service-ca\") pod \"maas-api-9c7d857d9-kv8vv\" (UID: \"02738456-62d9-4e93-887e-4b2bd6c459c0\") " pod="opendatahub/maas-api-9c7d857d9-kv8vv" Jun 13 01:23:43.798709 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.798686 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02738456-62d9-4e93-887e-4b2bd6c459c0-maas-api-tls\") pod \"maas-api-9c7d857d9-kv8vv\" (UID: \"02738456-62d9-4e93-887e-4b2bd6c459c0\") " pod="opendatahub/maas-api-9c7d857d9-kv8vv" Jun 13 01:23:43.804660 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.804632 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4djx\" (UniqueName: \"kubernetes.io/projected/02738456-62d9-4e93-887e-4b2bd6c459c0-kube-api-access-t4djx\") pod \"maas-api-9c7d857d9-kv8vv\" (UID: \"02738456-62d9-4e93-887e-4b2bd6c459c0\") " pod="opendatahub/maas-api-9c7d857d9-kv8vv" Jun 13 01:23:43.934903 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:43.934875 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-9c7d857d9-kv8vv" Jun 13 01:23:44.077055 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.077021 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wqnnb"] Jun 13 01:23:44.083155 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.083108 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-wqnnb" Jun 13 01:23:44.083970 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.083916 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-9c7d857d9-kv8vv"] Jun 13 01:23:44.085527 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.085504 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6mcrf\"" Jun 13 01:23:44.085633 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.085507 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 13 01:23:44.086897 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:23:44.086855 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02738456_62d9_4e93_887e_4b2bd6c459c0.slice/crio-172a718a3b1e4dd266138d70833fa81a30394ae9ecdd45232add134a50ae574f WatchSource:0}: Error finding container 172a718a3b1e4dd266138d70833fa81a30394ae9ecdd45232add134a50ae574f: Status 404 returned error can't find the container with id 172a718a3b1e4dd266138d70833fa81a30394ae9ecdd45232add134a50ae574f Jun 13 01:23:44.093185 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.093157 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wqnnb"] Jun 13 01:23:44.126709 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.126663 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-p9kpm"] Jun 13 01:23:44.131062 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.131037 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-p9kpm" Jun 13 01:23:44.140731 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.140704 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-p9kpm"] Jun 13 01:23:44.199443 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.199354 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8tlt\" (UniqueName: \"kubernetes.io/projected/48784a56-c8d8-44bb-b9e5-f65b352e8d27-kube-api-access-d8tlt\") pod \"payload-processing-699b6cd6c-wqnnb\" (UID: \"48784a56-c8d8-44bb-b9e5-f65b352e8d27\") " pod="openshift-ingress/payload-processing-699b6cd6c-wqnnb" Jun 13 01:23:44.199443 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.199409 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2dds\" (UniqueName: \"kubernetes.io/projected/0021ebc2-c0dd-48ce-969c-7dcbe0e0010e-kube-api-access-k2dds\") pod \"payload-pre-processing-579785bc64-p9kpm\" (UID: \"0021ebc2-c0dd-48ce-969c-7dcbe0e0010e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-p9kpm" Jun 13 01:23:44.300499 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.300469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2dds\" (UniqueName: \"kubernetes.io/projected/0021ebc2-c0dd-48ce-969c-7dcbe0e0010e-kube-api-access-k2dds\") pod \"payload-pre-processing-579785bc64-p9kpm\" (UID: \"0021ebc2-c0dd-48ce-969c-7dcbe0e0010e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-p9kpm" Jun 13 01:23:44.300663 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.300572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8tlt\" (UniqueName: \"kubernetes.io/projected/48784a56-c8d8-44bb-b9e5-f65b352e8d27-kube-api-access-d8tlt\") pod \"payload-processing-699b6cd6c-wqnnb\" (UID: \"48784a56-c8d8-44bb-b9e5-f65b352e8d27\") " pod="openshift-ingress/payload-processing-699b6cd6c-wqnnb" Jun 13 01:23:44.310034 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.310001 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2dds\" (UniqueName: \"kubernetes.io/projected/0021ebc2-c0dd-48ce-969c-7dcbe0e0010e-kube-api-access-k2dds\") pod \"payload-pre-processing-579785bc64-p9kpm\" (UID: \"0021ebc2-c0dd-48ce-969c-7dcbe0e0010e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-p9kpm" Jun 13 01:23:44.310215 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.310079 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8tlt\" (UniqueName: \"kubernetes.io/projected/48784a56-c8d8-44bb-b9e5-f65b352e8d27-kube-api-access-d8tlt\") pod \"payload-processing-699b6cd6c-wqnnb\" (UID: \"48784a56-c8d8-44bb-b9e5-f65b352e8d27\") " pod="openshift-ingress/payload-processing-699b6cd6c-wqnnb" Jun 13 01:23:44.409914 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.409882 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-wqnnb" Jun 13 01:23:44.443233 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.443202 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-p9kpm" Jun 13 01:23:44.565238 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.565198 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wqnnb"] Jun 13 01:23:44.569086 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:23:44.569046 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48784a56_c8d8_44bb_b9e5_f65b352e8d27.slice/crio-8eaade550145cb1d193011629f922bb294a0b5348f361480c602a5f30895da5f WatchSource:0}: Error finding container 8eaade550145cb1d193011629f922bb294a0b5348f361480c602a5f30895da5f: Status 404 returned error can't find the container with id 8eaade550145cb1d193011629f922bb294a0b5348f361480c602a5f30895da5f Jun 13 01:23:44.603687 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.603656 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-p9kpm"] Jun 13 01:23:44.605317 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:23:44.605289 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0021ebc2_c0dd_48ce_969c_7dcbe0e0010e.slice/crio-e937cc12f01acbcfd0c998a6b318987cf7de93172ba8c0a620a12411b4aae067 WatchSource:0}: Error finding container e937cc12f01acbcfd0c998a6b318987cf7de93172ba8c0a620a12411b4aae067: Status 404 returned error can't find the container with id e937cc12f01acbcfd0c998a6b318987cf7de93172ba8c0a620a12411b4aae067 Jun 13 01:23:44.951861 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.951820 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-p9kpm" event={"ID":"0021ebc2-c0dd-48ce-969c-7dcbe0e0010e","Type":"ContainerStarted","Data":"e937cc12f01acbcfd0c998a6b318987cf7de93172ba8c0a620a12411b4aae067"} Jun 13 01:23:44.953349 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.953292 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-wqnnb" event={"ID":"48784a56-c8d8-44bb-b9e5-f65b352e8d27","Type":"ContainerStarted","Data":"8eaade550145cb1d193011629f922bb294a0b5348f361480c602a5f30895da5f"} Jun 13 01:23:44.954778 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:44.954745 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-9c7d857d9-kv8vv" event={"ID":"02738456-62d9-4e93-887e-4b2bd6c459c0","Type":"ContainerStarted","Data":"172a718a3b1e4dd266138d70833fa81a30394ae9ecdd45232add134a50ae574f"} Jun 13 01:23:46.968394 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:46.968356 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-9c7d857d9-kv8vv" event={"ID":"02738456-62d9-4e93-887e-4b2bd6c459c0","Type":"ContainerStarted","Data":"1d298f6c8a34412354770bc8e2b54b218347b5680e91f84618ab25542ed03340"} Jun 13 01:23:46.968767 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:46.968425 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-9c7d857d9-kv8vv" Jun 13 01:23:46.986160 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:46.986090 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-9c7d857d9-kv8vv" podStartSLOduration=2.18565604 podStartE2EDuration="3.986071899s" totalImagesPullingTime="1.800415859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:23:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:23:46.983961264 +0000 UTC m=+761.655361135" watchObservedRunningTime="2026-06-13 01:23:46.986071899 +0000 UTC m=+761.657471736" Jun 13 01:23:47.975872 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:47.975836 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-p9kpm" event={"ID":"0021ebc2-c0dd-48ce-969c-7dcbe0e0010e","Type":"ContainerStarted","Data":"52c6cfd91a85d38dfa154a6a92612092d5e460a9fd176d6480ab8b6f12fdb228"} Jun 13 01:23:47.976363 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:47.975956 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-p9kpm" Jun 13 01:23:47.977546 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:47.977520 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-wqnnb" event={"ID":"48784a56-c8d8-44bb-b9e5-f65b352e8d27","Type":"ContainerStarted","Data":"ed86e59e931b1ce8f051cd842e32b5f63ae93f017f83bba769ca09f17af21eb5"} Jun 13 01:23:47.977645 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:47.977621 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-wqnnb" Jun 13 01:23:47.992179 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:47.992134 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-p9kpm" podStartSLOduration=1.550113643 podStartE2EDuration="3.992096778s" totalImagesPullingTime="2.441983135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:23:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:23:47.991515582 +0000 UTC m=+762.662915418" watchObservedRunningTime="2026-06-13 01:23:47.992096778 +0000 UTC m=+762.663496615" Jun 13 01:23:48.009480 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:48.009430 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-wqnnb" podStartSLOduration=1.538591873 podStartE2EDuration="4.009413787s" totalImagesPullingTime="2.470821914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:23:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:23:48.007846341 +0000 UTC m=+762.679246179" watchObservedRunningTime="2026-06-13 01:23:48.009413787 +0000 UTC m=+762.680813625" Jun 13 01:23:52.983809 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:52.983779 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-9c7d857d9-kv8vv" Jun 13 01:23:54.257748 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:54.257709 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:23:54.258200 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:54.257921 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" containerID="cri-o://4bd7643cf5851f79b4e09bd640c53bda038a4959fc99a4ce63444e8ae85b2dfc" gracePeriod=30 Jun 13 01:23:56.020622 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:56.020535 2574 generic.go:356] "Generic (PLEG): container finished" podID="dac711ba-bb11-48a3-9002-a8fabe200881" containerID="4bd7643cf5851f79b4e09bd640c53bda038a4959fc99a4ce63444e8ae85b2dfc" exitCode=143 Jun 13 01:23:56.020622 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:56.020610 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dac711ba-bb11-48a3-9002-a8fabe200881","Type":"ContainerDied","Data":"4bd7643cf5851f79b4e09bd640c53bda038a4959fc99a4ce63444e8ae85b2dfc"} Jun 13 01:23:56.304746 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:56.304716 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:23:56.416969 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:56.416932 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqzh4\" (UniqueName: \"kubernetes.io/projected/dac711ba-bb11-48a3-9002-a8fabe200881-kube-api-access-mqzh4\") pod \"dac711ba-bb11-48a3-9002-a8fabe200881\" (UID: \"dac711ba-bb11-48a3-9002-a8fabe200881\") " Jun 13 01:23:56.419170 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:56.419145 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dac711ba-bb11-48a3-9002-a8fabe200881-kube-api-access-mqzh4" (OuterVolumeSpecName: "kube-api-access-mqzh4") pod "dac711ba-bb11-48a3-9002-a8fabe200881" (UID: "dac711ba-bb11-48a3-9002-a8fabe200881"). InnerVolumeSpecName "kube-api-access-mqzh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:23:56.518378 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:56.518337 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqzh4\" (UniqueName: \"kubernetes.io/projected/dac711ba-bb11-48a3-9002-a8fabe200881-kube-api-access-mqzh4\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:23:57.026657 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.026628 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:23:57.026657 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.026657 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dac711ba-bb11-48a3-9002-a8fabe200881","Type":"ContainerDied","Data":"e781f4d5522330157a5d6a1a021f219d6201d9d66c03ec08354b978108b7c822"} Jun 13 01:23:57.027231 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.026710 2574 scope.go:117] "RemoveContainer" containerID="4bd7643cf5851f79b4e09bd640c53bda038a4959fc99a4ce63444e8ae85b2dfc" Jun 13 01:23:57.048464 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.048427 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:23:57.051673 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.051645 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:23:57.076403 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.076371 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:23:57.076762 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.076747 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" Jun 13 01:23:57.076805 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.076764 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" Jun 13 01:23:57.076839 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.076829 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" containerName="keycloak" Jun 13 01:23:57.081048 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.081029 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:23:57.083571 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.083542 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 13 01:23:57.083708 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.083608 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 13 01:23:57.089921 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.084194 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 13 01:23:57.089921 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.084625 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lpqk8\"" Jun 13 01:23:57.089921 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.085211 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 13 01:23:57.091007 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.090978 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:23:57.225018 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.224972 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/27628526-47aa-4a39-96ba-27c181729fcd-test-realms\") pod \"maas-keycloak-0\" (UID: \"27628526-47aa-4a39-96ba-27c181729fcd\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:23:57.225233 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.225088 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbxlx\" (UniqueName: \"kubernetes.io/projected/27628526-47aa-4a39-96ba-27c181729fcd-kube-api-access-mbxlx\") pod \"maas-keycloak-0\" (UID: \"27628526-47aa-4a39-96ba-27c181729fcd\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:23:57.325563 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.325481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbxlx\" (UniqueName: \"kubernetes.io/projected/27628526-47aa-4a39-96ba-27c181729fcd-kube-api-access-mbxlx\") pod \"maas-keycloak-0\" (UID: \"27628526-47aa-4a39-96ba-27c181729fcd\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:23:57.325563 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.325543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/27628526-47aa-4a39-96ba-27c181729fcd-test-realms\") pod \"maas-keycloak-0\" (UID: \"27628526-47aa-4a39-96ba-27c181729fcd\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:23:57.326221 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.326200 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/27628526-47aa-4a39-96ba-27c181729fcd-test-realms\") pod \"maas-keycloak-0\" (UID: \"27628526-47aa-4a39-96ba-27c181729fcd\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:23:57.333602 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.333579 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbxlx\" (UniqueName: \"kubernetes.io/projected/27628526-47aa-4a39-96ba-27c181729fcd-kube-api-access-mbxlx\") pod \"maas-keycloak-0\" (UID: \"27628526-47aa-4a39-96ba-27c181729fcd\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:23:57.396636 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.396585 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:23:57.532902 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.532880 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:23:57.534624 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:23:57.534594 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27628526_47aa_4a39_96ba_27c181729fcd.slice/crio-10e13b97d2a63d2e5579560bf8771b02f968730c3bbb7068387efbc6251de466 WatchSource:0}: Error finding container 10e13b97d2a63d2e5579560bf8771b02f968730c3bbb7068387efbc6251de466: Status 404 returned error can't find the container with id 10e13b97d2a63d2e5579560bf8771b02f968730c3bbb7068387efbc6251de466 Jun 13 01:23:57.762831 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:57.762796 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dac711ba-bb11-48a3-9002-a8fabe200881" path="/var/lib/kubelet/pods/dac711ba-bb11-48a3-9002-a8fabe200881/volumes" Jun 13 01:23:58.035065 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:58.034991 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"27628526-47aa-4a39-96ba-27c181729fcd","Type":"ContainerStarted","Data":"82c01fbe54dfdbc67cf5213976891a166466ca3aee352db66751ca4e3bb86d5f"} Jun 13 01:23:58.035065 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:58.035042 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"27628526-47aa-4a39-96ba-27c181729fcd","Type":"ContainerStarted","Data":"10e13b97d2a63d2e5579560bf8771b02f968730c3bbb7068387efbc6251de466"} Jun 13 01:23:58.056207 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:58.056141 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.718869471 podStartE2EDuration="1.056090945s" totalImagesPullingTime="337.221474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:23:58.055037936 +0000 UTC m=+772.726437775" watchObservedRunningTime="2026-06-13 01:23:58.056090945 +0000 UTC m=+772.727490786" Jun 13 01:23:58.397385 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:58.397346 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 13 01:23:58.399025 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:58.398988 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 13 01:23:58.987345 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:58.987312 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-p9kpm" Jun 13 01:23:58.987541 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:58.987403 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-wqnnb" Jun 13 01:23:59.397396 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:23:59.397349 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 13 01:24:00.397263 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:00.397213 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 13 01:24:01.397956 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:01.397902 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 13 01:24:02.397586 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:02.397531 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 13 01:24:03.397649 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:03.397587 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 13 01:24:04.397973 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:04.397920 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 13 01:24:05.397398 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:05.397331 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 13 01:24:06.397515 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:06.397463 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 13 01:24:07.396907 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:07.396867 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 13 01:24:07.397261 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:07.397229 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 13 01:24:08.397890 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:08.397847 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 13 01:24:09.397094 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:09.397037 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 13 01:24:10.397694 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:10.397638 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 13 01:24:11.523484 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:11.523442 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 13 01:24:11.540816 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:11.540772 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:24:21.529781 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:21.529730 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="27628526-47aa-4a39-96ba-27c181729fcd" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:24:31.530135 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:31.530078 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 13 01:24:52.807205 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:52.807170 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b"] Jun 13 01:24:52.811936 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:52.811881 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:52.814461 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:52.814441 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 13 01:24:52.815203 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:52.815170 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mg6hv\"" Jun 13 01:24:52.815340 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:52.815321 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 13 01:24:52.815412 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:52.815382 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 13 01:24:52.824612 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:52.824583 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b"] Jun 13 01:24:52.960355 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:52.960319 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr89j\" (UniqueName: \"kubernetes.io/projected/05913fb2-e9b6-4fb2-acef-65a457ca8233-kube-api-access-gr89j\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:52.960355 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:52.960363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05913fb2-e9b6-4fb2-acef-65a457ca8233-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:52.960568 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:52.960387 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05913fb2-e9b6-4fb2-acef-65a457ca8233-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:52.960568 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:52.960495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05913fb2-e9b6-4fb2-acef-65a457ca8233-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:52.960568 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:52.960532 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/05913fb2-e9b6-4fb2-acef-65a457ca8233-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:52.960683 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:52.960611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05913fb2-e9b6-4fb2-acef-65a457ca8233-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:53.061862 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.061767 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05913fb2-e9b6-4fb2-acef-65a457ca8233-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:53.061862 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.061820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr89j\" (UniqueName: \"kubernetes.io/projected/05913fb2-e9b6-4fb2-acef-65a457ca8233-kube-api-access-gr89j\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:53.061862 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.061848 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05913fb2-e9b6-4fb2-acef-65a457ca8233-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:53.062104 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.061871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05913fb2-e9b6-4fb2-acef-65a457ca8233-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:53.062104 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.061917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05913fb2-e9b6-4fb2-acef-65a457ca8233-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:53.062104 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.061951 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/05913fb2-e9b6-4fb2-acef-65a457ca8233-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:53.062407 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.062383 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05913fb2-e9b6-4fb2-acef-65a457ca8233-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:53.062466 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.062394 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05913fb2-e9b6-4fb2-acef-65a457ca8233-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:53.062517 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.062462 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/05913fb2-e9b6-4fb2-acef-65a457ca8233-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:53.064321 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.064293 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05913fb2-e9b6-4fb2-acef-65a457ca8233-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:53.064558 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.064541 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05913fb2-e9b6-4fb2-acef-65a457ca8233-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:53.069803 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.069776 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr89j\" (UniqueName: \"kubernetes.io/projected/05913fb2-e9b6-4fb2-acef-65a457ca8233-kube-api-access-gr89j\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b\" (UID: \"05913fb2-e9b6-4fb2-acef-65a457ca8233\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:53.123824 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.123774 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:24:53.280463 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.280436 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b"] Jun 13 01:24:53.282076 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:24:53.282048 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05913fb2_e9b6_4fb2_acef_65a457ca8233.slice/crio-daac329435f86f5558811083c5f25d13f1c461992dc1542237ba77b41c762199 WatchSource:0}: Error finding container daac329435f86f5558811083c5f25d13f1c461992dc1542237ba77b41c762199: Status 404 returned error can't find the container with id daac329435f86f5558811083c5f25d13f1c461992dc1542237ba77b41c762199 Jun 13 01:24:53.364981 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:53.364883 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" event={"ID":"05913fb2-e9b6-4fb2-acef-65a457ca8233","Type":"ContainerStarted","Data":"daac329435f86f5558811083c5f25d13f1c461992dc1542237ba77b41c762199"} Jun 13 01:24:57.389539 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:24:57.389499 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" event={"ID":"05913fb2-e9b6-4fb2-acef-65a457ca8233","Type":"ContainerStarted","Data":"4ecd6a00765e3a7890a3eda5ffabfe4c963af1ccecd2154755ceb6a09d64bcfc"} Jun 13 01:25:29.521310 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.521279 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n"] Jun 13 01:25:29.524679 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.524662 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.527043 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.527021 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 13 01:25:29.534890 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.534862 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n"] Jun 13 01:25:29.571358 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.571320 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc525451-6459-470f-b5e2-f1bcc2345ec1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.571524 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.571389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc525451-6459-470f-b5e2-f1bcc2345ec1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.571524 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.571419 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rfd9\" (UniqueName: \"kubernetes.io/projected/fc525451-6459-470f-b5e2-f1bcc2345ec1-kube-api-access-6rfd9\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.571524 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.571502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc525451-6459-470f-b5e2-f1bcc2345ec1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.571671 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.571577 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc525451-6459-470f-b5e2-f1bcc2345ec1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.571671 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.571656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc525451-6459-470f-b5e2-f1bcc2345ec1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.672478 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.672442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc525451-6459-470f-b5e2-f1bcc2345ec1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.672671 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.672521 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc525451-6459-470f-b5e2-f1bcc2345ec1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.672671 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.672546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc525451-6459-470f-b5e2-f1bcc2345ec1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.672671 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.672595 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc525451-6459-470f-b5e2-f1bcc2345ec1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.672671 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.672623 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rfd9\" (UniqueName: \"kubernetes.io/projected/fc525451-6459-470f-b5e2-f1bcc2345ec1-kube-api-access-6rfd9\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.672913 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.672693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc525451-6459-470f-b5e2-f1bcc2345ec1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.672913 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.672876 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc525451-6459-470f-b5e2-f1bcc2345ec1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.673024 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.672929 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc525451-6459-470f-b5e2-f1bcc2345ec1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.673024 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.673003 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc525451-6459-470f-b5e2-f1bcc2345ec1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.674760 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.674743 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc525451-6459-470f-b5e2-f1bcc2345ec1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.675315 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.675294 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc525451-6459-470f-b5e2-f1bcc2345ec1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.681064 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.681044 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rfd9\" (UniqueName: \"kubernetes.io/projected/fc525451-6459-470f-b5e2-f1bcc2345ec1-kube-api-access-6rfd9\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n\" (UID: \"fc525451-6459-470f-b5e2-f1bcc2345ec1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.836373 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.836277 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:29.981993 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:29.981973 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n"] Jun 13 01:25:29.984370 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:25:29.984330 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc525451_6459_470f_b5e2_f1bcc2345ec1.slice/crio-971913523d236d5bc8fae77ce33759f54312830dd74728ccb6f3b48816059fbf WatchSource:0}: Error finding container 971913523d236d5bc8fae77ce33759f54312830dd74728ccb6f3b48816059fbf: Status 404 returned error can't find the container with id 971913523d236d5bc8fae77ce33759f54312830dd74728ccb6f3b48816059fbf Jun 13 01:25:30.561680 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:30.561646 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" event={"ID":"fc525451-6459-470f-b5e2-f1bcc2345ec1","Type":"ContainerStarted","Data":"5619d9a3cdd6b225016c76289b97f7e6617c8b1061638ac64ce476f9c4c595b4"} Jun 13 01:25:30.562067 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:30.561729 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" event={"ID":"fc525451-6459-470f-b5e2-f1bcc2345ec1","Type":"ContainerStarted","Data":"971913523d236d5bc8fae77ce33759f54312830dd74728ccb6f3b48816059fbf"} Jun 13 01:25:31.568544 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:31.568458 2574 generic.go:356] "Generic (PLEG): container finished" podID="fc525451-6459-470f-b5e2-f1bcc2345ec1" containerID="5619d9a3cdd6b225016c76289b97f7e6617c8b1061638ac64ce476f9c4c595b4" exitCode=0 Jun 13 01:25:31.568910 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:31.568549 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" event={"ID":"fc525451-6459-470f-b5e2-f1bcc2345ec1","Type":"ContainerDied","Data":"5619d9a3cdd6b225016c76289b97f7e6617c8b1061638ac64ce476f9c4c595b4"} Jun 13 01:25:33.582663 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:33.582627 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" event={"ID":"fc525451-6459-470f-b5e2-f1bcc2345ec1","Type":"ContainerStarted","Data":"981f0e588124f0b69e2490a1558938b907cf3af02842dc340dcdcf3e0fb6bf17"} Jun 13 01:25:33.602699 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:33.602645 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" podStartSLOduration=2.185655097 podStartE2EDuration="4.602629979s" totalImagesPullingTime="1.153055907s" totalInitContainerRuntime="1.263918975s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:25:33.600386019 +0000 UTC m=+868.271785857" watchObservedRunningTime="2026-06-13 01:25:33.602629979 +0000 UTC m=+868.274029816" Jun 13 01:25:34.504229 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.504191 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4"] Jun 13 01:25:34.508348 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.508324 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.510445 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.510424 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 13 01:25:34.518325 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.518301 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4"] Jun 13 01:25:34.622083 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.622048 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.622563 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.622158 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.622563 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.622185 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.622563 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.622235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.622563 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.622270 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvn7t\" (UniqueName: \"kubernetes.io/projected/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-kube-api-access-dvn7t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.622563 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.622308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.723089 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.723048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.723089 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.723086 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.723363 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.723150 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.723363 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.723167 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvn7t\" (UniqueName: \"kubernetes.io/projected/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-kube-api-access-dvn7t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.723363 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.723186 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.723363 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.723271 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.723536 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.723507 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.723900 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.723871 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.723993 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.723917 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.725623 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.725599 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.725720 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.725697 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.731193 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.731162 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvn7t\" (UniqueName: \"kubernetes.io/projected/2583334b-c2ec-4798-91cd-6f9a9f49bdc1-kube-api-access-dvn7t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4\" (UID: \"2583334b-c2ec-4798-91cd-6f9a9f49bdc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.819696 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.819610 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:34.962857 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:34.962797 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4"] Jun 13 01:25:34.965091 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:25:34.965061 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2583334b_c2ec_4798_91cd_6f9a9f49bdc1.slice/crio-4146c9d85fbecaceb3d1973cd5cbabd557ee0447442aafb35045b0ac85ba3c3f WatchSource:0}: Error finding container 4146c9d85fbecaceb3d1973cd5cbabd557ee0447442aafb35045b0ac85ba3c3f: Status 404 returned error can't find the container with id 4146c9d85fbecaceb3d1973cd5cbabd557ee0447442aafb35045b0ac85ba3c3f Jun 13 01:25:35.594513 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:35.594475 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" event={"ID":"2583334b-c2ec-4798-91cd-6f9a9f49bdc1","Type":"ContainerStarted","Data":"3d698d4a4a4c0f51e360005a5efcd923cc0f2e9764d45c11cfa372ce8e9ee20a"} Jun 13 01:25:35.594670 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:35.594532 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" event={"ID":"2583334b-c2ec-4798-91cd-6f9a9f49bdc1","Type":"ContainerStarted","Data":"4146c9d85fbecaceb3d1973cd5cbabd557ee0447442aafb35045b0ac85ba3c3f"} Jun 13 01:25:36.601171 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:36.601110 2574 generic.go:356] "Generic (PLEG): container finished" podID="2583334b-c2ec-4798-91cd-6f9a9f49bdc1" containerID="3d698d4a4a4c0f51e360005a5efcd923cc0f2e9764d45c11cfa372ce8e9ee20a" exitCode=0 Jun 13 01:25:36.601555 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:36.601217 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" event={"ID":"2583334b-c2ec-4798-91cd-6f9a9f49bdc1","Type":"ContainerDied","Data":"3d698d4a4a4c0f51e360005a5efcd923cc0f2e9764d45c11cfa372ce8e9ee20a"} Jun 13 01:25:37.607976 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:37.607942 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" event={"ID":"2583334b-c2ec-4798-91cd-6f9a9f49bdc1","Type":"ContainerStarted","Data":"f9e948e98562b081c55c36c2b2db5147f266e88a0d69371d3ffbac2b4cc1ab64"} Jun 13 01:25:37.628636 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:37.628585 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" podStartSLOduration=2.082236165 podStartE2EDuration="3.628568916s" totalImagesPullingTime="167.278503ms" totalInitContainerRuntime="1.379054248s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:25:37.626434817 +0000 UTC m=+872.297834665" watchObservedRunningTime="2026-06-13 01:25:37.628568916 +0000 UTC m=+872.299968753" Jun 13 01:25:39.837212 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:39.837165 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:39.837628 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:39.837238 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:39.849993 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:39.849965 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:40.635228 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:40.635200 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n" Jun 13 01:25:42.988933 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:42.988896 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g"] Jun 13 01:25:42.994422 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:42.994398 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:42.997207 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:42.997184 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 13 01:25:43.004082 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.004059 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g"] Jun 13 01:25:43.104088 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.104049 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.104303 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.104104 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.104303 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.104155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.104303 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.104218 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s7vp\" (UniqueName: \"kubernetes.io/projected/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-kube-api-access-4s7vp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.104303 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.104255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.104303 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.104273 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.204815 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.204775 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.205020 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.204830 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.205020 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.204850 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.205020 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.204895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s7vp\" (UniqueName: \"kubernetes.io/projected/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-kube-api-access-4s7vp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.205020 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.204936 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.205020 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.204965 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.205316 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.205262 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.205316 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.205287 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.205391 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.205341 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.207320 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.207299 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.207443 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.207426 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.212746 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.212725 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s7vp\" (UniqueName: \"kubernetes.io/projected/8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a-kube-api-access-4s7vp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g\" (UID: \"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.307777 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.307691 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:25:43.447081 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.447052 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g"] Jun 13 01:25:43.449228 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:25:43.449202 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8faaa0c1_dcaa_4ae1_bd98_5a3e53a8153a.slice/crio-8269511aca9c212411eb2c76cc75a9968e95ae23dedcc206d994aad946224e33 WatchSource:0}: Error finding container 8269511aca9c212411eb2c76cc75a9968e95ae23dedcc206d994aad946224e33: Status 404 returned error can't find the container with id 8269511aca9c212411eb2c76cc75a9968e95ae23dedcc206d994aad946224e33 Jun 13 01:25:43.639649 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.639613 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" event={"ID":"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a","Type":"ContainerStarted","Data":"239f05c7240e235efd81415f3740a5fabf357dc67d2f0583a93b6c86d9898902"} Jun 13 01:25:43.639823 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:43.639678 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" event={"ID":"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a","Type":"ContainerStarted","Data":"8269511aca9c212411eb2c76cc75a9968e95ae23dedcc206d994aad946224e33"} Jun 13 01:25:44.820101 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:44.820064 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:44.820557 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:44.820164 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:44.832954 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:44.832925 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:45.662803 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:45.662772 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4" Jun 13 01:25:54.697803 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:54.697770 2574 generic.go:356] "Generic (PLEG): container finished" podID="8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a" containerID="239f05c7240e235efd81415f3740a5fabf357dc67d2f0583a93b6c86d9898902" exitCode=0 Jun 13 01:25:54.697803 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:54.697807 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" event={"ID":"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a","Type":"ContainerDied","Data":"239f05c7240e235efd81415f3740a5fabf357dc67d2f0583a93b6c86d9898902"} Jun 13 01:25:55.704455 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:55.704421 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" event={"ID":"8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a","Type":"ContainerStarted","Data":"10df3974c01a9f0df5bd1e790f8d088e6fb3441c3bd7d5316a098c4c2510b345"} Jun 13 01:25:55.725167 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:25:55.725093 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" podStartSLOduration=3.115384389 podStartE2EDuration="13.725074154s" totalImagesPullingTime="201.478774ms" totalInitContainerRuntime="10.408210991s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:25:55.722954574 +0000 UTC m=+890.394354411" watchObservedRunningTime="2026-06-13 01:25:55.725074154 +0000 UTC m=+890.396474060" Jun 13 01:26:03.308773 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:26:03.308732 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:26:03.309354 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:26:03.308818 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:26:03.321293 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:26:03.321266 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:26:03.762772 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:26:03.762741 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g" Jun 13 01:26:05.774958 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:26:05.774929 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:26:05.775433 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:26:05.775039 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:26:49.992360 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:26:49.992263 2574 generic.go:356] "Generic (PLEG): container finished" podID="05913fb2-e9b6-4fb2-acef-65a457ca8233" containerID="4ecd6a00765e3a7890a3eda5ffabfe4c963af1ccecd2154755ceb6a09d64bcfc" exitCode=0 Jun 13 01:26:49.992360 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:26:49.992344 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" event={"ID":"05913fb2-e9b6-4fb2-acef-65a457ca8233","Type":"ContainerDied","Data":"4ecd6a00765e3a7890a3eda5ffabfe4c963af1ccecd2154755ceb6a09d64bcfc"} Jun 13 01:26:50.999346 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:26:50.999307 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" event={"ID":"05913fb2-e9b6-4fb2-acef-65a457ca8233","Type":"ContainerStarted","Data":"b2447b64148db31f22cbed05f6f373b9919086819c0adae1dfffc2d96c2a5c33"} Jun 13 01:26:51.019087 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:26:51.019031 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" podStartSLOduration=2.574237272 podStartE2EDuration="1m59.019014651s" totalImagesPullingTime="3.720368739s" totalInitContainerRuntime="1m52.72440864s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:24:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:26:51.017881751 +0000 UTC m=+945.689281615" watchObservedRunningTime="2026-06-13 01:26:51.019014651 +0000 UTC m=+945.690414489" Jun 13 01:26:53.124353 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:26:53.124309 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:26:53.124739 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:26:53.124375 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:26:53.136980 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:26:53.136949 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:26:54.026045 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:26:54.026006 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b" Jun 13 01:28:26.792171 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:26.792129 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c7b74457c-cq6j7"] Jun 13 01:28:26.792817 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:26.792525 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-c7b74457c-cq6j7" podUID="cc957b55-166d-4d11-8999-72b5c204e27b" containerName="manager" containerID="cri-o://7cc9e2732c4a4907bc2ed278a518dbb36ec2b2404dd38d45c0ee890b1230c007" gracePeriod=30 Jun 13 01:28:27.056519 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.056462 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c7b74457c-cq6j7" Jun 13 01:28:27.182348 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.182312 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp6ww\" (UniqueName: \"kubernetes.io/projected/cc957b55-166d-4d11-8999-72b5c204e27b-kube-api-access-jp6ww\") pod \"cc957b55-166d-4d11-8999-72b5c204e27b\" (UID: \"cc957b55-166d-4d11-8999-72b5c204e27b\") " Jun 13 01:28:27.182348 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.182357 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc957b55-166d-4d11-8999-72b5c204e27b-webhook-cert\") pod \"cc957b55-166d-4d11-8999-72b5c204e27b\" (UID: \"cc957b55-166d-4d11-8999-72b5c204e27b\") " Jun 13 01:28:27.184497 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.184469 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc957b55-166d-4d11-8999-72b5c204e27b-kube-api-access-jp6ww" (OuterVolumeSpecName: "kube-api-access-jp6ww") pod "cc957b55-166d-4d11-8999-72b5c204e27b" (UID: "cc957b55-166d-4d11-8999-72b5c204e27b"). InnerVolumeSpecName "kube-api-access-jp6ww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:28:27.184590 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.184519 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc957b55-166d-4d11-8999-72b5c204e27b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cc957b55-166d-4d11-8999-72b5c204e27b" (UID: "cc957b55-166d-4d11-8999-72b5c204e27b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:28:27.283943 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.283905 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp6ww\" (UniqueName: \"kubernetes.io/projected/cc957b55-166d-4d11-8999-72b5c204e27b-kube-api-access-jp6ww\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:28:27.283943 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.283937 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc957b55-166d-4d11-8999-72b5c204e27b-webhook-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:28:27.514782 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.514741 2574 generic.go:356] "Generic (PLEG): container finished" podID="cc957b55-166d-4d11-8999-72b5c204e27b" containerID="7cc9e2732c4a4907bc2ed278a518dbb36ec2b2404dd38d45c0ee890b1230c007" exitCode=0 Jun 13 01:28:27.514975 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.514791 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c7b74457c-cq6j7" Jun 13 01:28:27.514975 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.514835 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c7b74457c-cq6j7" event={"ID":"cc957b55-166d-4d11-8999-72b5c204e27b","Type":"ContainerDied","Data":"7cc9e2732c4a4907bc2ed278a518dbb36ec2b2404dd38d45c0ee890b1230c007"} Jun 13 01:28:27.514975 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.514901 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c7b74457c-cq6j7" event={"ID":"cc957b55-166d-4d11-8999-72b5c204e27b","Type":"ContainerDied","Data":"a808b10d9d2fb1b5f9408349e40c7eb101c813154aff915dbdd9575ebff68667"} Jun 13 01:28:27.514975 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.514934 2574 scope.go:117] "RemoveContainer" containerID="7cc9e2732c4a4907bc2ed278a518dbb36ec2b2404dd38d45c0ee890b1230c007" Jun 13 01:28:27.524493 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.524475 2574 scope.go:117] "RemoveContainer" containerID="7cc9e2732c4a4907bc2ed278a518dbb36ec2b2404dd38d45c0ee890b1230c007" Jun 13 01:28:27.524750 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:28:27.524728 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cc9e2732c4a4907bc2ed278a518dbb36ec2b2404dd38d45c0ee890b1230c007\": container with ID starting with 7cc9e2732c4a4907bc2ed278a518dbb36ec2b2404dd38d45c0ee890b1230c007 not found: ID does not exist" containerID="7cc9e2732c4a4907bc2ed278a518dbb36ec2b2404dd38d45c0ee890b1230c007" Jun 13 01:28:27.524797 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.524760 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cc9e2732c4a4907bc2ed278a518dbb36ec2b2404dd38d45c0ee890b1230c007"} err="failed to get container status \"7cc9e2732c4a4907bc2ed278a518dbb36ec2b2404dd38d45c0ee890b1230c007\": rpc error: code = NotFound desc = could not find container \"7cc9e2732c4a4907bc2ed278a518dbb36ec2b2404dd38d45c0ee890b1230c007\": container with ID starting with 7cc9e2732c4a4907bc2ed278a518dbb36ec2b2404dd38d45c0ee890b1230c007 not found: ID does not exist" Jun 13 01:28:27.536051 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.536023 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c7b74457c-cq6j7"] Jun 13 01:28:27.539453 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.539433 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c7b74457c-cq6j7"] Jun 13 01:28:27.763757 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:28:27.763715 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc957b55-166d-4d11-8999-72b5c204e27b" path="/var/lib/kubelet/pods/cc957b55-166d-4d11-8999-72b5c204e27b/volumes" Jun 13 01:31:05.804858 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:31:05.804832 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:31:05.807203 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:31:05.807183 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:36:05.841085 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:36:05.841055 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:36:05.843021 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:36:05.842996 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:38:33.298872 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.298834 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn"] Jun 13 01:38:33.299517 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.299104 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" podUID="7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec" containerName="manager" containerID="cri-o://4f5d7c7f27d60f550c6c2faa014c6b9748c61e5eaba04b3d68dce52526afc66b" gracePeriod=10 Jun 13 01:38:33.559881 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.559825 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" Jun 13 01:38:33.667498 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.667464 2574 generic.go:356] "Generic (PLEG): container finished" podID="7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec" containerID="4f5d7c7f27d60f550c6c2faa014c6b9748c61e5eaba04b3d68dce52526afc66b" exitCode=0 Jun 13 01:38:33.667665 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.667507 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" Jun 13 01:38:33.667665 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.667510 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" event={"ID":"7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec","Type":"ContainerDied","Data":"4f5d7c7f27d60f550c6c2faa014c6b9748c61e5eaba04b3d68dce52526afc66b"} Jun 13 01:38:33.667665 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.667627 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn" event={"ID":"7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec","Type":"ContainerDied","Data":"f28c9b992f8af87b14e3462ddfb65eea31af4388c65feb8bd879955d5adf0695"} Jun 13 01:38:33.667665 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.667656 2574 scope.go:117] "RemoveContainer" containerID="4f5d7c7f27d60f550c6c2faa014c6b9748c61e5eaba04b3d68dce52526afc66b" Jun 13 01:38:33.675058 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.675032 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pp5tw\" (UniqueName: \"kubernetes.io/projected/7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec-kube-api-access-pp5tw\") pod \"7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec\" (UID: \"7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec\") " Jun 13 01:38:33.675212 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.675147 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec-extensions-socket-volume\") pod \"7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec\" (UID: \"7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec\") " Jun 13 01:38:33.675544 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.675522 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec" (UID: "7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:38:33.676712 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.676696 2574 scope.go:117] "RemoveContainer" containerID="4f5d7c7f27d60f550c6c2faa014c6b9748c61e5eaba04b3d68dce52526afc66b" Jun 13 01:38:33.677008 ip-10-0-143-139 kubenswrapper[2574]: E0613 01:38:33.676985 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f5d7c7f27d60f550c6c2faa014c6b9748c61e5eaba04b3d68dce52526afc66b\": container with ID starting with 4f5d7c7f27d60f550c6c2faa014c6b9748c61e5eaba04b3d68dce52526afc66b not found: ID does not exist" containerID="4f5d7c7f27d60f550c6c2faa014c6b9748c61e5eaba04b3d68dce52526afc66b" Jun 13 01:38:33.677143 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.677022 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f5d7c7f27d60f550c6c2faa014c6b9748c61e5eaba04b3d68dce52526afc66b"} err="failed to get container status \"4f5d7c7f27d60f550c6c2faa014c6b9748c61e5eaba04b3d68dce52526afc66b\": rpc error: code = NotFound desc = could not find container \"4f5d7c7f27d60f550c6c2faa014c6b9748c61e5eaba04b3d68dce52526afc66b\": container with ID starting with 4f5d7c7f27d60f550c6c2faa014c6b9748c61e5eaba04b3d68dce52526afc66b not found: ID does not exist" Jun 13 01:38:33.677143 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.677090 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec-kube-api-access-pp5tw" (OuterVolumeSpecName: "kube-api-access-pp5tw") pod "7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec" (UID: "7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec"). InnerVolumeSpecName "kube-api-access-pp5tw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:38:33.776386 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.776358 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec-extensions-socket-volume\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:38:33.776386 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.776386 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pp5tw\" (UniqueName: \"kubernetes.io/projected/7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec-kube-api-access-pp5tw\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jun 13 01:38:33.984732 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.984700 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn"] Jun 13 01:38:33.990569 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:33.990541 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwcwn"] Jun 13 01:38:35.763579 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:38:35.763546 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec" path="/var/lib/kubelet/pods/7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec/volumes" Jun 13 01:39:34.445961 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.445917 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6"] Jun 13 01:39:34.446571 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.446551 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc957b55-166d-4d11-8999-72b5c204e27b" containerName="manager" Jun 13 01:39:34.446647 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.446575 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc957b55-166d-4d11-8999-72b5c204e27b" containerName="manager" Jun 13 01:39:34.446647 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.446609 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec" containerName="manager" Jun 13 01:39:34.446647 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.446619 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec" containerName="manager" Jun 13 01:39:34.446785 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.446728 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc957b55-166d-4d11-8999-72b5c204e27b" containerName="manager" Jun 13 01:39:34.446785 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.446749 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b8ec66a-5a1f-4b13-a77c-ddb4581d6cec" containerName="manager" Jun 13 01:39:34.449766 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.449748 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6" Jun 13 01:39:34.452261 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.452243 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bp66b\"" Jun 13 01:39:34.464041 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.464019 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6"] Jun 13 01:39:34.533741 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.533701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c73bb980-addc-461c-8150-a66d94f9f734-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wvdx6\" (UID: \"c73bb980-addc-461c-8150-a66d94f9f734\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6" Jun 13 01:39:34.533903 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.533748 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mttp\" (UniqueName: \"kubernetes.io/projected/c73bb980-addc-461c-8150-a66d94f9f734-kube-api-access-6mttp\") pod \"kuadrant-operator-controller-manager-86878c769f-wvdx6\" (UID: \"c73bb980-addc-461c-8150-a66d94f9f734\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6" Jun 13 01:39:34.634369 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.634319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c73bb980-addc-461c-8150-a66d94f9f734-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wvdx6\" (UID: \"c73bb980-addc-461c-8150-a66d94f9f734\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6" Jun 13 01:39:34.634543 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.634391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mttp\" (UniqueName: \"kubernetes.io/projected/c73bb980-addc-461c-8150-a66d94f9f734-kube-api-access-6mttp\") pod \"kuadrant-operator-controller-manager-86878c769f-wvdx6\" (UID: \"c73bb980-addc-461c-8150-a66d94f9f734\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6" Jun 13 01:39:34.634691 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.634672 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c73bb980-addc-461c-8150-a66d94f9f734-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wvdx6\" (UID: \"c73bb980-addc-461c-8150-a66d94f9f734\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6" Jun 13 01:39:34.643408 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.643383 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mttp\" (UniqueName: \"kubernetes.io/projected/c73bb980-addc-461c-8150-a66d94f9f734-kube-api-access-6mttp\") pod \"kuadrant-operator-controller-manager-86878c769f-wvdx6\" (UID: \"c73bb980-addc-461c-8150-a66d94f9f734\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6" Jun 13 01:39:34.760294 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.760217 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6" Jun 13 01:39:34.905391 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.905357 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6"] Jun 13 01:39:34.908601 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:39:34.908574 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc73bb980_addc_461c_8150_a66d94f9f734.slice/crio-0a0d15bdbe19eb93ac993b3303a99ff2e34b538cae33d67e4e7555e62ac9bdd5 WatchSource:0}: Error finding container 0a0d15bdbe19eb93ac993b3303a99ff2e34b538cae33d67e4e7555e62ac9bdd5: Status 404 returned error can't find the container with id 0a0d15bdbe19eb93ac993b3303a99ff2e34b538cae33d67e4e7555e62ac9bdd5 Jun 13 01:39:34.982857 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.982822 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6" event={"ID":"c73bb980-addc-461c-8150-a66d94f9f734","Type":"ContainerStarted","Data":"dd8f2f2239c2e66ddd2dfb7455c31fa1f4d86e57f20e94699513df304e8f1c7d"} Jun 13 01:39:34.983009 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.982881 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6" event={"ID":"c73bb980-addc-461c-8150-a66d94f9f734","Type":"ContainerStarted","Data":"0a0d15bdbe19eb93ac993b3303a99ff2e34b538cae33d67e4e7555e62ac9bdd5"} Jun 13 01:39:34.983009 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:34.982990 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6" Jun 13 01:39:35.004603 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:35.004556 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6" podStartSLOduration=1.004540339 podStartE2EDuration="1.004540339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:39:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:39:35.002499113 +0000 UTC m=+1709.673898977" watchObservedRunningTime="2026-06-13 01:39:35.004540339 +0000 UTC m=+1709.675940177" Jun 13 01:39:45.990697 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:39:45.990667 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvdx6" Jun 13 01:41:05.873928 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:41:05.873890 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:41:05.877141 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:41:05.877106 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:46:05.904095 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:46:05.904061 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:46:05.909099 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:46:05.909074 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4t9pm_30048d20-4691-4de9-8a59-6a29d363f4e0/ovn-acl-logging/0.log" Jun 13 01:49:30.040002 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:30.039964 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7bc9d68775-jr987_b89ed32c-e377-4cf0-98c3-00a8e268e60b/nginx/0.log" Jun 13 01:49:30.268835 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:30.268802 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-l274s_8283fee9-8d86-4f24-8991-77d3b811c672/manager/0.log" Jun 13 01:49:30.401001 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:30.400971 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-fbs22_81fe9f64-7854-4865-9bf1-a1de2a885de0/manager/0.log" Jun 13 01:49:30.534655 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:30.534617 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-9c7d857d9-kv8vv_02738456-62d9-4e93-887e-4b2bd6c459c0/maas-api/0.log" Jun 13 01:49:31.225311 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:31.225277 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-5bvbc_91c08f64-35a7-4769-98e3-9bf5403e92c2/server/0.log" Jun 13 01:49:31.690998 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:31.690966 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f7bcb9597-pcnvq_9ff18d17-ad85-4020-bf42-fc387195c529/copy-manifests/0.log" Jun 13 01:49:31.708570 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:31.708534 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f7bcb9597-pcnvq_9ff18d17-ad85-4020-bf42-fc387195c529/manager/0.log" Jun 13 01:49:33.220633 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:33.220597 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dpktl_0e705b69-bfef-4fdb-86d9-164b193558bd/manager/0.log" Jun 13 01:49:33.725273 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:33.725242 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wvdx6_c73bb980-addc-461c-8150-a66d94f9f734/manager/0.log" Jun 13 01:49:34.443630 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:34.443597 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-g7gwg_61c10fac-02a5-4b2c-8220-c69e766730b2/discovery/0.log" Jun 13 01:49:34.558578 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:34.558549 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-678b9f85fb-4rkzs_ce2df81d-1f65-4936-8727-c924f5bdf042/kube-auth-proxy/0.log" Jun 13 01:49:34.910723 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:34.910673 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-p9kpm_0021ebc2-c0dd-48ce-969c-7dcbe0e0010e/payload-pre-processing/0.log" Jun 13 01:49:35.031072 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:35.031037 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wqnnb_48784a56-c8d8-44bb-b9e5-f65b352e8d27/payload-processing/0.log" Jun 13 01:49:35.481549 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:35.481520 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b_05913fb2-e9b6-4fb2-acef-65a457ca8233/storage-initializer/0.log" Jun 13 01:49:35.489995 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:35.489962 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-kc86b_05913fb2-e9b6-4fb2-acef-65a457ca8233/main/0.log" Jun 13 01:49:35.732437 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:35.732341 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n_fc525451-6459-470f-b5e2-f1bcc2345ec1/storage-initializer/0.log" Jun 13 01:49:35.742701 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:35.742678 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-9vp2n_fc525451-6459-470f-b5e2-f1bcc2345ec1/main/0.log" Jun 13 01:49:35.855630 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:35.855599 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4_2583334b-c2ec-4798-91cd-6f9a9f49bdc1/storage-initializer/0.log" Jun 13 01:49:35.864533 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:35.864498 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctrph4_2583334b-c2ec-4798-91cd-6f9a9f49bdc1/main/0.log" Jun 13 01:49:35.969381 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:35.969323 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g_8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a/storage-initializer/0.log" Jun 13 01:49:35.977242 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:35.977216 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-9tg8g_8faaa0c1-dcaa-4ae1-bd98-5a3e53a8153a/main/0.log" Jun 13 01:49:43.403545 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:43.403515 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ddhc4_c691a532-4b73-4518-8158-cfebdbafdbea/global-pull-secret-syncer/0.log" Jun 13 01:49:43.485735 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:43.485703 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-scnvp_e4699105-7209-4d5f-817c-189575d43ae0/konnectivity-agent/0.log" Jun 13 01:49:43.587622 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:43.587583 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-139.ec2.internal_5d79c6332bb546fa2ad596ee51ac7514/haproxy/0.log" Jun 13 01:49:47.655856 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:47.655811 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-g6jks_0af9115b-ac78-4824-ad5e-3e19b84101a3/sail-operator/0.log" Jun 13 01:49:48.544375 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:48.544334 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dpktl_0e705b69-bfef-4fdb-86d9-164b193558bd/manager/0.log" Jun 13 01:49:48.735557 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:48.735525 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wvdx6_c73bb980-addc-461c-8150-a66d94f9f734/manager/0.log" Jun 13 01:49:50.656139 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:50.656092 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-cr9gs_1a7b72ae-4c83-4f89-b848-b5282788fc53/kube-state-metrics/0.log" Jun 13 01:49:50.708836 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:50.708799 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-cr9gs_1a7b72ae-4c83-4f89-b848-b5282788fc53/kube-rbac-proxy-main/0.log" Jun 13 01:49:50.749269 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:50.749241 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-cr9gs_1a7b72ae-4c83-4f89-b848-b5282788fc53/kube-rbac-proxy-self/0.log" Jun 13 01:49:50.779155 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:50.779098 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-749c88674c-kpjj4_da71d266-93bd-46f7-bb03-6404821efe79/metrics-server/0.log" Jun 13 01:49:50.845366 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:50.845322 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5krxm_d0646d30-6447-4e6e-afa5-c3f8049694c2/node-exporter/0.log" Jun 13 01:49:50.866515 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:50.866483 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5krxm_d0646d30-6447-4e6e-afa5-c3f8049694c2/kube-rbac-proxy/0.log" Jun 13 01:49:50.889356 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:50.889330 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5krxm_d0646d30-6447-4e6e-afa5-c3f8049694c2/init-textfile/0.log" Jun 13 01:49:51.430822 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:51.430796 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-mdc8c_6b5044c6-aacc-413d-a116-2622e560fe3d/prometheus-operator-admission-webhook/0.log" Jun 13 01:49:51.594780 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:51.594746 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8b8d597bc-lg2cb_25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054/thanos-query/0.log" Jun 13 01:49:51.621335 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:51.621303 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8b8d597bc-lg2cb_25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054/kube-rbac-proxy-web/0.log" Jun 13 01:49:51.644539 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:51.644508 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8b8d597bc-lg2cb_25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054/kube-rbac-proxy/0.log" Jun 13 01:49:51.665998 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:51.665916 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8b8d597bc-lg2cb_25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054/prom-label-proxy/0.log" Jun 13 01:49:51.686776 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:51.686745 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8b8d597bc-lg2cb_25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054/kube-rbac-proxy-rules/0.log" Jun 13 01:49:51.706530 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:51.706492 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8b8d597bc-lg2cb_25ebb5e9-19ee-4fae-a6dc-fc2ce19a2054/kube-rbac-proxy-metrics/0.log" Jun 13 01:49:54.358176 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:54.358072 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bd85b97c9-z2fxz_fe416418-af7c-439d-a351-c3035e812f72/console/0.log" Jun 13 01:49:54.865992 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:54.865961 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf"] Jun 13 01:49:54.869419 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:54.869403 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:54.871488 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:54.871466 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7rf94\"/\"kube-root-ca.crt\"" Jun 13 01:49:54.872090 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:54.872072 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7rf94\"/\"default-dockercfg-xb55v\"" Jun 13 01:49:54.872163 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:54.872075 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7rf94\"/\"openshift-service-ca.crt\"" Jun 13 01:49:54.876942 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:54.876756 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf"] Jun 13 01:49:55.002086 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.002048 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/892608d6-8e62-4f4a-9791-cbd2cac56711-sys\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.002309 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.002098 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr9qp\" (UniqueName: \"kubernetes.io/projected/892608d6-8e62-4f4a-9791-cbd2cac56711-kube-api-access-wr9qp\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.002309 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.002156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/892608d6-8e62-4f4a-9791-cbd2cac56711-proc\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.002309 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.002261 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/892608d6-8e62-4f4a-9791-cbd2cac56711-lib-modules\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.002439 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.002314 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/892608d6-8e62-4f4a-9791-cbd2cac56711-podres\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.102977 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.102934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/892608d6-8e62-4f4a-9791-cbd2cac56711-sys\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.102977 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.102982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr9qp\" (UniqueName: \"kubernetes.io/projected/892608d6-8e62-4f4a-9791-cbd2cac56711-kube-api-access-wr9qp\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.103276 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.103010 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/892608d6-8e62-4f4a-9791-cbd2cac56711-proc\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.103276 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.103055 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/892608d6-8e62-4f4a-9791-cbd2cac56711-sys\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.103276 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.103082 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/892608d6-8e62-4f4a-9791-cbd2cac56711-lib-modules\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.103276 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.103144 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/892608d6-8e62-4f4a-9791-cbd2cac56711-proc\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.103276 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.103167 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/892608d6-8e62-4f4a-9791-cbd2cac56711-podres\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.103472 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.103302 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/892608d6-8e62-4f4a-9791-cbd2cac56711-lib-modules\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.103472 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.103312 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/892608d6-8e62-4f4a-9791-cbd2cac56711-podres\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.110518 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.110486 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr9qp\" (UniqueName: \"kubernetes.io/projected/892608d6-8e62-4f4a-9791-cbd2cac56711-kube-api-access-wr9qp\") pod \"perf-node-gather-daemonset-f4sbf\" (UID: \"892608d6-8e62-4f4a-9791-cbd2cac56711\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.181140 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.181084 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:55.317668 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:55.317641 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf"] Jun 13 01:49:55.319297 ip-10-0-143-139 kubenswrapper[2574]: W0613 01:49:55.319271 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod892608d6_8e62_4f4a_9791_cbd2cac56711.slice/crio-c2f44291017bdb6ec4c7f2ebe46c7c7e13d926b3e19dfe1ff4cb656792e31000 WatchSource:0}: Error finding container c2f44291017bdb6ec4c7f2ebe46c7c7e13d926b3e19dfe1ff4cb656792e31000: Status 404 returned error can't find the container with id c2f44291017bdb6ec4c7f2ebe46c7c7e13d926b3e19dfe1ff4cb656792e31000 Jun 13 01:49:56.209360 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:56.209324 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" event={"ID":"892608d6-8e62-4f4a-9791-cbd2cac56711","Type":"ContainerStarted","Data":"ace94d106ee3e8e7a463dcd5cdf3098567e2b35ffbec6cd4fce4650fe7e5d02e"} Jun 13 01:49:56.209741 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:56.209378 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" event={"ID":"892608d6-8e62-4f4a-9791-cbd2cac56711","Type":"ContainerStarted","Data":"c2f44291017bdb6ec4c7f2ebe46c7c7e13d926b3e19dfe1ff4cb656792e31000"} Jun 13 01:49:56.209741 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:56.209433 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:49:56.225093 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:56.225039 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" podStartSLOduration=2.225022261 podStartE2EDuration="2.225022261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:49:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:49:56.223062454 +0000 UTC m=+2330.894462298" watchObservedRunningTime="2026-06-13 01:49:56.225022261 +0000 UTC m=+2330.896422099" Jun 13 01:49:56.233498 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:56.233473 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hvksv_ca7840d9-989c-44d8-b024-deefde6a5539/dns/0.log" Jun 13 01:49:56.254306 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:56.254273 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hvksv_ca7840d9-989c-44d8-b024-deefde6a5539/kube-rbac-proxy/0.log" Jun 13 01:49:56.317171 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:56.317144 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6lbfr_99950e12-9739-4b46-a978-b8aceafc3484/dns-node-resolver/0.log" Jun 13 01:49:56.936970 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:56.936941 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wtshb_7e1c0e0d-ba91-42c9-87ed-31b04d107dfa/node-ca/0.log" Jun 13 01:49:57.978132 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:57.978079 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-g7gwg_61c10fac-02a5-4b2c-8220-c69e766730b2/discovery/0.log" Jun 13 01:49:57.999339 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:57.999303 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-678b9f85fb-4rkzs_ce2df81d-1f65-4936-8727-c924f5bdf042/kube-auth-proxy/0.log" Jun 13 01:49:58.122972 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:58.122938 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-p9kpm_0021ebc2-c0dd-48ce-969c-7dcbe0e0010e/payload-pre-processing/0.log" Jun 13 01:49:58.219595 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:58.219554 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wqnnb_48784a56-c8d8-44bb-b9e5-f65b352e8d27/payload-processing/0.log" Jun 13 01:49:58.873635 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:58.873605 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lpnms_3b81f243-dfba-47c9-995d-93e6d4577bb4/serve-healthcheck-canary/0.log" Jun 13 01:49:59.444017 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:59.443973 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-64ktm_c7b5138c-ff49-48a7-aa9e-32bf01eacf4c/insights-operator/0.log" Jun 13 01:49:59.447829 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:59.447802 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-64ktm_c7b5138c-ff49-48a7-aa9e-32bf01eacf4c/insights-operator/1.log" Jun 13 01:49:59.675408 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:59.675379 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w8r5b_829a5fbe-395f-47e3-b9a9-fe97f48d5420/kube-rbac-proxy/0.log" Jun 13 01:49:59.702991 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:59.702909 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w8r5b_829a5fbe-395f-47e3-b9a9-fe97f48d5420/exporter/0.log" Jun 13 01:49:59.726305 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:49:59.726265 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w8r5b_829a5fbe-395f-47e3-b9a9-fe97f48d5420/extractor/0.log" Jun 13 01:50:01.904720 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:01.904685 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7bc9d68775-jr987_b89ed32c-e377-4cf0-98c3-00a8e268e60b/nginx/0.log" Jun 13 01:50:01.959961 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:01.959931 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-l274s_8283fee9-8d86-4f24-8991-77d3b811c672/manager/0.log" Jun 13 01:50:02.095991 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:02.095963 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-fbs22_81fe9f64-7854-4865-9bf1-a1de2a885de0/manager/0.log" Jun 13 01:50:02.143127 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:02.143081 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-9c7d857d9-kv8vv_02738456-62d9-4e93-887e-4b2bd6c459c0/maas-api/0.log" Jun 13 01:50:02.224788 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:02.224716 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-f4sbf" Jun 13 01:50:02.368251 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:02.368219 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-5bvbc_91c08f64-35a7-4769-98e3-9bf5403e92c2/server/0.log" Jun 13 01:50:02.693341 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:02.693309 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f7bcb9597-pcnvq_9ff18d17-ad85-4020-bf42-fc387195c529/manager/0.log" Jun 13 01:50:02.709746 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:02.709716 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f7bcb9597-pcnvq_9ff18d17-ad85-4020-bf42-fc387195c529/copy-manifests/0.log" Jun 13 01:50:08.306424 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:08.306385 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-g7gwg_61c10fac-02a5-4b2c-8220-c69e766730b2/discovery/0.log" Jun 13 01:50:08.316520 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:08.316498 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-678b9f85fb-4rkzs_ce2df81d-1f65-4936-8727-c924f5bdf042/kube-auth-proxy/0.log" Jun 13 01:50:08.407554 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:08.407520 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-p9kpm_0021ebc2-c0dd-48ce-969c-7dcbe0e0010e/payload-pre-processing/0.log" Jun 13 01:50:08.494967 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:08.494930 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wqnnb_48784a56-c8d8-44bb-b9e5-f65b352e8d27/payload-processing/0.log" Jun 13 01:50:09.723162 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:09.723106 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-flz7g_7d3ea1a8-6411-41dc-b2b2-5df6fb3eff52/migrator/0.log" Jun 13 01:50:09.740889 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:09.740858 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-g7gwg_61c10fac-02a5-4b2c-8220-c69e766730b2/discovery/0.log" Jun 13 01:50:09.743596 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:09.743568 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-flz7g_7d3ea1a8-6411-41dc-b2b2-5df6fb3eff52/graceful-termination/0.log" Jun 13 01:50:09.751084 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:09.751060 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-678b9f85fb-4rkzs_ce2df81d-1f65-4936-8727-c924f5bdf042/kube-auth-proxy/0.log" Jun 13 01:50:09.851715 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:09.851670 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-p9kpm_0021ebc2-c0dd-48ce-969c-7dcbe0e0010e/payload-pre-processing/0.log" Jun 13 01:50:09.935267 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:09.935231 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wqnnb_48784a56-c8d8-44bb-b9e5-f65b352e8d27/payload-processing/0.log" Jun 13 01:50:11.656805 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:11.656771 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tktw8_06fa4c27-9487-4d5d-8675-e6fed12c972a/kube-multus-additional-cni-plugins/0.log" Jun 13 01:50:11.680689 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:11.680657 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tktw8_06fa4c27-9487-4d5d-8675-e6fed12c972a/egress-router-binary-copy/0.log" Jun 13 01:50:11.710644 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:11.710602 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tktw8_06fa4c27-9487-4d5d-8675-e6fed12c972a/cni-plugins/0.log" Jun 13 01:50:11.731203 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:11.731174 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tktw8_06fa4c27-9487-4d5d-8675-e6fed12c972a/bond-cni-plugin/0.log" Jun 13 01:50:11.732905 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:11.732883 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-g7gwg_61c10fac-02a5-4b2c-8220-c69e766730b2/discovery/0.log" Jun 13 01:50:11.743187 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:11.743161 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-678b9f85fb-4rkzs_ce2df81d-1f65-4936-8727-c924f5bdf042/kube-auth-proxy/0.log" Jun 13 01:50:11.752524 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:11.752505 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tktw8_06fa4c27-9487-4d5d-8675-e6fed12c972a/routeoverride-cni/0.log" Jun 13 01:50:11.771701 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:11.771680 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tktw8_06fa4c27-9487-4d5d-8675-e6fed12c972a/whereabouts-cni-bincopy/0.log" Jun 13 01:50:11.793096 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:11.793065 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tktw8_06fa4c27-9487-4d5d-8675-e6fed12c972a/whereabouts-cni/0.log" Jun 13 01:50:11.831451 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:11.831402 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-p9kpm_0021ebc2-c0dd-48ce-969c-7dcbe0e0010e/payload-pre-processing/0.log" Jun 13 01:50:11.916577 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:11.916462 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wqnnb_48784a56-c8d8-44bb-b9e5-f65b352e8d27/payload-processing/0.log" Jun 13 01:50:12.027685 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:12.027648 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tqkdp_9602554f-7ebe-403d-aefc-2a740e24f9d0/kube-multus/0.log" Jun 13 01:50:12.088154 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:12.088109 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h48sb_3e747bdd-f2b9-467c-b520-103a6c772f14/network-metrics-daemon/0.log" Jun 13 01:50:12.107862 ip-10-0-143-139 kubenswrapper[2574]: I0613 01:50:12.107835 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h48sb_3e747bdd-f2b9-467c-b520-103a6c772f14/kube-rbac-proxy/0.log"