Jun 05 21:02:43.089075 ip-10-0-139-39 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 05 21:02:43.089087 ip-10-0-139-39 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 05 21:02:43.089098 ip-10-0-139-39 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 05 21:02:43.089320 ip-10-0-139-39 systemd[1]: Failed to start Kubernetes Kubelet. Jun 05 21:02:53.306360 ip-10-0-139-39 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 05 21:02:53.306383 ip-10-0-139-39 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 374c688e4535435eb0baf99344b2035b -- Jun 05 21:05:34.948044 ip-10-0-139-39 systemd[1]: Starting Kubernetes Kubelet... Jun 05 21:05:35.363495 ip-10-0-139-39 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 21:05:35.363495 ip-10-0-139-39 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 21:05:35.363495 ip-10-0-139-39 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 21:05:35.363495 ip-10-0-139-39 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 21:05:35.363495 ip-10-0-139-39 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 21:05:35.364962 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.364877 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 21:05:35.369273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369258 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:05:35.369273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369274 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369278 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369281 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369285 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369288 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369292 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369295 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369298 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369301 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369304 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369306 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369310 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369312 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369315 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369317 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369320 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369322 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369325 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369335 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369337 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:05:35.369338 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369340 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369343 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369345 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369348 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369351 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369354 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369357 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369359 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369362 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369364 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369367 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369369 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369372 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369374 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369377 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369380 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369383 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369386 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369388 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:05:35.369828 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369391 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369393 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369395 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369398 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369400 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369403 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369406 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369409 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369412 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369414 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369416 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369419 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369422 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369424 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369427 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369433 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369437 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369441 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369445 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:05:35.370273 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369449 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369452 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369455 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369458 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369460 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369463 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369467 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369470 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369472 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369475 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369478 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369481 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369484 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369487 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369489 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369492 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369494 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369497 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369500 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:05:35.370745 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369504 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369507 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369510 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369512 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369514 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369517 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369519 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369522 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369524 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369528 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369531 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369534 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369536 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369539 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369541 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369544 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369546 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369549 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369551 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369554 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:05:35.371237 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.369557 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370276 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370285 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370290 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370293 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370296 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370304 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370307 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370310 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370313 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370315 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370319 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370323 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370326 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370329 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370332 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370334 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370337 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370339 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:05:35.371720 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370342 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370345 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370348 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370351 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370353 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370356 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370359 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370361 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370364 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370366 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370369 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370371 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370374 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370376 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370379 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370381 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370384 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370386 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370389 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370392 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:05:35.372198 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370396 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370415 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370419 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370422 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370425 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370428 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370431 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370435 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370437 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370440 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370443 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370446 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370449 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370451 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370455 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370458 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370460 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370463 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370466 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370469 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:05:35.372690 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370472 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370474 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370477 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370479 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370482 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370485 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370488 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370490 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370493 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370495 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370498 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370501 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370503 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370506 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370509 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370511 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370514 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370517 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370521 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:05:35.373210 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370527 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370530 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370533 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370536 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370539 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370541 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370544 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370547 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370550 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370553 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370556 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370559 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370561 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370564 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370566 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370569 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370571 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370574 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370576 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370579 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:05:35.373693 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370581 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.370584 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371031 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371044 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371048 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371051 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371055 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371058 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371061 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371064 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371067 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371071 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371075 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371079 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371081 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371084 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371087 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371089 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371092 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371094 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:05:35.374189 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371097 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371100 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371103 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371105 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371108 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371111 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371113 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371116 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371118 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371121 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371123 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371126 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371128 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371132 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371134 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371144 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371147 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371150 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371153 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:05:35.374683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371156 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371161 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371165 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371168 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371171 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371174 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371177 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371180 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371183 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371185 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371188 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371190 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371193 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371196 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371198 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371201 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371204 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371206 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371209 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:05:35.375239 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371211 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371214 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371217 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371219 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371222 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371224 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371227 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371229 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371232 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371239 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371243 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371247 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371250 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371253 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371256 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371259 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371261 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371264 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371266 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:05:35.375708 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371269 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371271 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371274 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371277 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371279 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371281 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371285 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371288 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371291 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371293 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371296 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371298 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371301 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371304 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371306 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371309 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371311 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371314 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371316 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371319 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:05:35.376196 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371322 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371324 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371329 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.371332 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371401 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371409 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371415 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371420 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371424 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371427 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371432 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371436 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371439 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371443 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371446 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371450 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371453 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371456 2576 flags.go:64] FLAG: --cgroup-root="" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371459 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371462 2576 flags.go:64] FLAG: --client-ca-file="" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371465 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371468 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371473 2576 flags.go:64] FLAG: --cluster-domain="" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371476 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 21:05:35.376683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371479 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371482 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371486 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371489 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371492 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371496 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371499 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371502 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371505 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371508 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371518 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371521 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371526 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371529 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371532 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371535 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371538 2576 flags.go:64] FLAG: --enable-server="true" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371541 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371545 2576 flags.go:64] FLAG: --event-burst="100" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371549 2576 flags.go:64] FLAG: --event-qps="50" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371551 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371555 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371557 2576 flags.go:64] FLAG: --eviction-hard="" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371561 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 21:05:35.377297 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371564 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371567 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371570 2576 flags.go:64] FLAG: --eviction-soft="" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371573 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371576 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371579 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371582 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371585 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371588 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371591 2576 flags.go:64] FLAG: --feature-gates="" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371595 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371598 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371601 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371604 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371607 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371610 2576 flags.go:64] FLAG: --help="false" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371613 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371616 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371621 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371624 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371628 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371631 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371634 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 21:05:35.377873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371638 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371640 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371643 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371647 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371650 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371653 2576 flags.go:64] FLAG: --kube-reserved="" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371656 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371659 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371662 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371665 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371668 2576 flags.go:64] FLAG: --lock-file="" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371671 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371674 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371677 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371682 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371685 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371688 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371691 2576 flags.go:64] FLAG: --logging-format="text" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371694 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371697 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371700 2576 flags.go:64] FLAG: --manifest-url="" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371703 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371707 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371710 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371714 2576 flags.go:64] FLAG: --max-pods="110" Jun 05 21:05:35.378478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371717 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371720 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371743 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371747 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371750 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371753 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371756 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371764 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371768 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371771 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371774 2576 flags.go:64] FLAG: --pod-cidr="" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371777 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371782 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371785 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371788 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371791 2576 flags.go:64] FLAG: --port="10250" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371794 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371797 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04e3b51e75e1b1e1c" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371800 2576 flags.go:64] FLAG: --qos-reserved="" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371803 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371806 2576 flags.go:64] FLAG: --register-node="true" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371809 2576 flags.go:64] FLAG: --register-with-taints="" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371813 2576 flags.go:64] FLAG: --registry-burst="10" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371816 2576 flags.go:64] FLAG: --registry-qps="5" Jun 05 21:05:35.379143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371819 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371821 2576 flags.go:64] FLAG: --reserved-memory="" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371825 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371828 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371831 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371834 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371837 2576 flags.go:64] FLAG: --runonce="false" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371840 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371843 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371846 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371850 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371854 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371857 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371860 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371863 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371866 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371870 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371872 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371875 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371879 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371882 2576 flags.go:64] FLAG: --system-cgroups="" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371884 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371890 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371892 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371895 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 21:05:35.379745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371900 2576 flags.go:64] FLAG: --tls-min-version="" Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371903 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371905 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371908 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371911 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371915 2576 flags.go:64] FLAG: --v="2" Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371919 2576 flags.go:64] FLAG: --version="false" Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371923 2576 flags.go:64] FLAG: --vmodule="" Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371926 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.371930 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372042 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372045 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372049 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372052 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372054 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372057 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372060 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372063 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372067 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372070 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372072 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372075 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:05:35.380382 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372078 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372081 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372084 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372087 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372089 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372092 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372095 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372097 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372100 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372103 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372106 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372108 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372111 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372114 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372116 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372119 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372122 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372124 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372127 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372129 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:05:35.380935 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372132 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372135 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372138 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372140 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372143 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372146 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372148 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372151 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372155 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372158 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372161 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372163 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372166 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372168 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372171 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372174 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372177 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372180 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372182 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:05:35.381432 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372185 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372188 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372191 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372193 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372196 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372199 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372201 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372204 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372207 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372211 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372215 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372218 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372221 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372224 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372227 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372229 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372232 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372234 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372237 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:05:35.381916 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372240 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372242 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372246 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372249 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372251 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372254 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372257 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372259 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372262 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372264 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372268 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372270 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372273 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372275 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372278 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372280 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372285 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372288 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372291 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372293 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:05:35.382374 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372296 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372298 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372301 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372304 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372308 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372311 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372315 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372318 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.372321 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.372923 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.379616 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.379719 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.379752 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.379758 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379821 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:05:35.383062 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379827 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379830 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379833 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379836 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379839 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379842 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379844 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379847 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379850 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379866 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379870 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379873 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379876 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379880 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379883 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379885 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379890 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379894 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379897 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379900 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:05:35.383640 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379903 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379905 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379908 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379911 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379913 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379916 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379919 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379922 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379925 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379928 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379931 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379934 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379937 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379940 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379943 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379945 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379948 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379950 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379953 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379956 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:05:35.384197 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379958 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379962 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379966 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379969 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379972 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379975 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379977 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379980 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379983 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379985 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379988 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379991 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379994 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379997 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.379999 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380002 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380004 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380007 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380010 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:05:35.384680 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380013 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380018 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380021 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380024 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380027 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380031 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380034 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380037 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380039 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380042 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380052 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380056 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380060 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380063 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380066 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380069 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380071 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380074 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380077 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:05:35.385182 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380079 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380082 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380084 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380087 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380090 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380093 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380095 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380098 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380100 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380103 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380105 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380108 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380110 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380113 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380116 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380119 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380122 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380124 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380127 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:05:35.385679 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380129 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.380135 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380248 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380253 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380255 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380258 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380261 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380263 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380266 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380269 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380271 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380274 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380278 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380282 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380284 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:05:35.386152 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380287 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380289 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380292 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380295 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380297 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380300 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380302 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380305 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380307 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380310 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380312 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380315 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380318 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380321 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380323 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380326 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380330 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380333 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380337 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:05:35.386554 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380341 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380344 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380346 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380349 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380352 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380355 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380357 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380360 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380362 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380365 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380368 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380370 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380373 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380375 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380378 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380381 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380383 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380386 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380389 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380392 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:05:35.387129 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380394 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380397 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380400 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380403 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380405 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380408 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380411 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380413 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380416 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380419 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380421 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380424 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380426 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380430 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380432 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380435 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380437 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380440 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380443 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380445 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:05:35.387622 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380448 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380450 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380453 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380455 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380458 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380460 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380464 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380466 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380469 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380472 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380474 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380477 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380479 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380482 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380484 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380486 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380489 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380492 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380496 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:05:35.388142 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380500 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:05:35.388600 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380502 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:05:35.388600 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380505 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:05:35.388600 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380508 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:05:35.388600 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380512 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:05:35.388600 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380514 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:05:35.388600 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380517 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:05:35.388600 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:35.380520 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:05:35.388600 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.380525 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 21:05:35.388600 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.380623 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 21:05:35.388600 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.385119 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 21:05:35.388600 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.386622 2576 server.go:1019] "Starting client certificate rotation" Jun 05 21:05:35.388600 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.386744 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 21:05:35.388600 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.386797 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 21:05:35.389907 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.389876 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 21:05:35.391040 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.391010 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 21:05:35.400357 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.400339 2576 log.go:25] "Validated CRI v1 runtime API" Jun 05 21:05:35.402978 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.402962 2576 log.go:25] "Validated CRI v1 image API" Jun 05 21:05:35.403775 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.403762 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 21:05:35.408620 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.408602 2576 fs.go:135] Filesystem UUIDs: map[0ba882b5-6fea-4e7a-ba7c-da48eb4aa5a7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 914cfd42-8b02-4953-9596-b40670c95b08:/dev/nvme0n1p4] Jun 05 21:05:35.408675 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.408620 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 21:05:35.414459 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.414354 2576 manager.go:216] Machine: {Timestamp:2026-06-05 21:05:35.412908341 +0000 UTC m=+0.346873269 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3168859 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec271362be8cb3d7650b6749406a89ca SystemUUID:ec271362-be8c-b3d7-650b-6749406a89ca BootID:374c688e-4535-435e-b0ba-f99344b2035b Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:29:6a:04:20:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:29:6a:04:20:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:b9:f4:e5:0b:2f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 21:05:35.414459 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.414457 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 21:05:35.414592 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.414576 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 21:05:35.417339 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.417309 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 21:05:35.417492 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.417342 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-39.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 21:05:35.417753 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.417721 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 21:05:35.418132 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.418121 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 21:05:35.418163 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.418136 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 21:05:35.418163 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.418143 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 21:05:35.418755 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.418744 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 21:05:35.419816 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.419806 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 21:05:35.422643 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.422631 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 05 21:05:35.422761 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.422752 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 21:05:35.422806 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.422782 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 05 21:05:35.422806 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.422792 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 21:05:35.422806 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.422806 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 21:05:35.422919 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.422816 2576 kubelet.go:398] "Adding apiserver pod source" Jun 05 21:05:35.422919 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.422825 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 21:05:35.423337 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.423320 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 21:05:35.423374 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.423355 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 21:05:35.427278 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.426946 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 21:05:35.429104 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.429087 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 21:05:35.429167 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.429119 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 21:05:35.430703 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.430692 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 21:05:35.430770 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.430709 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 21:05:35.430770 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.430715 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 21:05:35.430770 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.430720 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 21:05:35.430770 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.430743 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 21:05:35.430770 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.430748 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 21:05:35.430770 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.430757 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 21:05:35.430770 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.430762 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 21:05:35.430770 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.430770 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 21:05:35.430971 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.430775 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 21:05:35.430971 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.430784 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 21:05:35.430971 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.430789 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 21:05:35.431530 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.431519 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 21:05:35.431574 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.431532 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 21:05:35.434831 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.434815 2576 server.go:1268] "Started kubelet" Jun 05 21:05:35.435040 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.434996 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 21:05:35.435110 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.434987 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 21:05:35.435110 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.435091 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 21:05:35.435477 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.435453 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-39.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 21:05:35.435793 ip-10-0-139-39 systemd[1]: Started Kubernetes Kubelet. Jun 05 21:05:35.436249 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.436005 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 05 21:05:35.436249 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.436028 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 21:05:35.436249 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.436028 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 21:05:35.437105 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.437088 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 21:05:35.441517 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.441500 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 21:05:35.441629 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.441534 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 21:05:35.442124 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.441703 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 21:05:35.442239 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.442227 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 21:05:35.442299 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.442245 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 21:05:35.442480 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.442355 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 21:05:35.442480 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.442449 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ccw2k" Jun 05 21:05:35.442480 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.442468 2576 factory.go:55] Registering systemd factory Jun 05 21:05:35.442638 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.442525 2576 factory.go:223] Registration of the systemd container factory successfully Jun 05 21:05:35.442638 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.442474 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 05 21:05:35.442638 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.442554 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 05 21:05:35.442880 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.442858 2576 factory.go:153] Registering CRI-O factory Jun 05 21:05:35.442880 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.442875 2576 factory.go:223] Registration of the crio container factory successfully Jun 05 21:05:35.442991 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.442928 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 21:05:35.442991 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.442963 2576 factory.go:103] Registering Raw factory Jun 05 21:05:35.442991 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.442981 2576 manager.go:1196] Started watching for new ooms in manager Jun 05 21:05:35.443510 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.443494 2576 manager.go:349] Starting recovery of all containers Jun 05 21:05:35.444527 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.444506 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 21:05:35.445164 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.443296 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-39.ec2.internal.18b64b56016cc47b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-39.ec2.internal,UID:ip-10-0-139-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-39.ec2.internal,},FirstTimestamp:2026-06-05 21:05:35.434785915 +0000 UTC m=+0.368750849,LastTimestamp:2026-06-05 21:05:35.434785915 +0000 UTC m=+0.368750849,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-39.ec2.internal,}" Jun 05 21:05:35.449343 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.449286 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ccw2k" Jun 05 21:05:35.450394 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.450368 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 21:05:35.450893 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.450868 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 21:05:35.450970 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.450942 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 21:05:35.455320 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.455302 2576 manager.go:354] Recovery completed Jun 05 21:05:35.458106 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.458086 2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 05 21:05:35.461001 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.460989 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:05:35.462975 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.462956 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:05:35.463045 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.462990 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:05:35.463045 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.463003 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:05:35.463532 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.463517 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 21:05:35.463532 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.463532 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 21:05:35.463635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.463550 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 05 21:05:35.463635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.463573 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:05:35.464254 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.464239 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:05:35.464310 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.464270 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:05:35.464310 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.464281 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:05:35.464696 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.464685 2576 policy_none.go:49] "None policy: Start" Jun 05 21:05:35.464748 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.464702 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 21:05:35.464748 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.464712 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 21:05:35.465768 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.465758 2576 policy_none.go:47] "Start" Jun 05 21:05:35.503391 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.503375 2576 manager.go:337] "Starting Device Plugin manager" Jun 05 21:05:35.517325 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.503406 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 21:05:35.517325 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.503416 2576 server.go:87] "Starting device plugin registration server" Jun 05 21:05:35.517325 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.503684 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 21:05:35.517325 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.503696 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 21:05:35.517325 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.503878 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 21:05:35.517325 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.503960 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 21:05:35.517325 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.503968 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 21:05:35.517325 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.504350 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 21:05:35.517325 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.504389 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 21:05:35.517325 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.514884 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 21:05:35.517325 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.514919 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 21:05:35.517325 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.514938 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 21:05:35.517325 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.515010 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 21:05:35.517325 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.516967 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:05:35.604615 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.604480 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:05:35.605607 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.605585 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:05:35.605702 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.605623 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:05:35.605702 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.605634 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:05:35.605702 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.605660 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.613808 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.613758 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.613808 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.613787 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-39.ec2.internal\": node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 21:05:35.615105 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.615087 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal"] Jun 05 21:05:35.615180 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.615158 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:05:35.616170 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.616150 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:05:35.616243 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.616178 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:05:35.616243 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.616195 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:05:35.617492 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.617478 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:05:35.617614 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.617601 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.617652 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.617630 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:05:35.618665 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.618651 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:05:35.618740 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.618684 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:05:35.618740 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.618696 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:05:35.618740 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.618650 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:05:35.618833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.618764 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:05:35.618833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.618775 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:05:35.620444 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.620432 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.620486 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.620454 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:05:35.621126 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.621109 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:05:35.621197 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.621140 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:05:35.621197 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.621154 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:05:35.625902 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.625887 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 21:05:35.644489 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.644456 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/646afa05f03c2e82f5695adce95c6bad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal\" (UID: \"646afa05f03c2e82f5695adce95c6bad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.644597 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.644495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/646afa05f03c2e82f5695adce95c6bad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal\" (UID: \"646afa05f03c2e82f5695adce95c6bad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.644597 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.644517 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-39.ec2.internal\" not found" node="ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.644597 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.644524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd7eb7d4f442858d5fa850411397de67-config\") pod \"kube-apiserver-proxy-ip-10-0-139-39.ec2.internal\" (UID: \"cd7eb7d4f442858d5fa850411397de67\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.649024 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.649007 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-39.ec2.internal\" not found" node="ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.726860 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.726834 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 21:05:35.744829 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.744803 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/646afa05f03c2e82f5695adce95c6bad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal\" (UID: \"646afa05f03c2e82f5695adce95c6bad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.744918 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.744834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/646afa05f03c2e82f5695adce95c6bad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal\" (UID: \"646afa05f03c2e82f5695adce95c6bad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.744918 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.744853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd7eb7d4f442858d5fa850411397de67-config\") pod \"kube-apiserver-proxy-ip-10-0-139-39.ec2.internal\" (UID: \"cd7eb7d4f442858d5fa850411397de67\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.744918 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.744880 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd7eb7d4f442858d5fa850411397de67-config\") pod \"kube-apiserver-proxy-ip-10-0-139-39.ec2.internal\" (UID: \"cd7eb7d4f442858d5fa850411397de67\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.744918 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.744886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/646afa05f03c2e82f5695adce95c6bad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal\" (UID: \"646afa05f03c2e82f5695adce95c6bad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.744918 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.744897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/646afa05f03c2e82f5695adce95c6bad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal\" (UID: \"646afa05f03c2e82f5695adce95c6bad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.827206 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.827153 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 21:05:35.928047 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:35.928015 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 21:05:35.948557 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.948521 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 21:05:35.953282 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:35.953261 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" Jun 05 21:05:36.029178 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:36.029138 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 21:05:36.129694 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:36.129654 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 21:05:36.230254 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:36.230174 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 21:05:36.330791 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:36.330757 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 21:05:36.386484 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:36.386297 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 21:05:36.387207 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:36.386647 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 21:05:36.431802 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:36.431770 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 21:05:36.451807 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:36.451754 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 21:00:35 +0000 UTC" deadline="2028-02-27 17:47:42.050258242 +0000 UTC" Jun 05 21:05:36.451807 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:36.451792 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15164h42m5.598469753s" Jun 05 21:05:36.477929 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:36.477896 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod646afa05f03c2e82f5695adce95c6bad.slice/crio-15251dbf5e317be8d1600403ae928ba2fdadc0858679b1a0e8c1fa17d7d0b714 WatchSource:0}: Error finding container 15251dbf5e317be8d1600403ae928ba2fdadc0858679b1a0e8c1fa17d7d0b714: Status 404 returned error can't find the container with id 15251dbf5e317be8d1600403ae928ba2fdadc0858679b1a0e8c1fa17d7d0b714 Jun 05 21:05:36.478183 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:36.478171 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7eb7d4f442858d5fa850411397de67.slice/crio-4dc025c42280f5d4fe2e7267434a9a8effd0be8ce3925684450a6d26726bc3c9 WatchSource:0}: Error finding container 4dc025c42280f5d4fe2e7267434a9a8effd0be8ce3925684450a6d26726bc3c9: Status 404 returned error can't find the container with id 4dc025c42280f5d4fe2e7267434a9a8effd0be8ce3925684450a6d26726bc3c9 Jun 05 21:05:36.484893 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:36.484875 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:05:36.518950 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:36.518904 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" event={"ID":"646afa05f03c2e82f5695adce95c6bad","Type":"ContainerStarted","Data":"15251dbf5e317be8d1600403ae928ba2fdadc0858679b1a0e8c1fa17d7d0b714"} Jun 05 21:05:36.519948 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:36.519920 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" event={"ID":"cd7eb7d4f442858d5fa850411397de67","Type":"ContainerStarted","Data":"4dc025c42280f5d4fe2e7267434a9a8effd0be8ce3925684450a6d26726bc3c9"} Jun 05 21:05:36.532088 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:36.532063 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 21:05:36.632623 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:36.632582 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-39.ec2.internal\" not found" Jun 05 21:05:36.638137 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:36.638111 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:05:36.642128 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:36.642107 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" Jun 05 21:05:36.652463 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:36.652439 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 21:05:36.654341 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:36.654326 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" Jun 05 21:05:36.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:36.662313 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 21:05:36.682737 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:36.682715 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:05:36.784256 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:36.784179 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:05:37.424199 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.424167 2576 apiserver.go:52] "Watching apiserver" Jun 05 21:05:37.435785 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.435750 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 21:05:37.437967 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.437937 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-58p62","openshift-network-diagnostics/network-check-target-2x7pj","openshift-network-operator/iptables-alerter-2pclv","openshift-ovn-kubernetes/ovnkube-node-qcd2w","kube-system/global-pull-secret-syncer-jlqrw","kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz","openshift-cluster-node-tuning-operator/tuned-gx9h7","openshift-dns/node-resolver-wvtmg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal","openshift-multus/multus-additional-cni-plugins-64v2s","openshift-multus/multus-j5jnx","kube-system/konnectivity-agent-nksmx","openshift-image-registry/node-ca-v472d"] Jun 05 21:05:37.439607 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.439586 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.440765 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.440741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nksmx" Jun 05 21:05:37.441760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.441740 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 21:05:37.441945 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.441926 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2pclv" Jun 05 21:05:37.442371 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.442343 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 21:05:37.442446 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.442431 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 21:05:37.442814 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.442534 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4d2jg\"" Jun 05 21:05:37.442814 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.442590 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 21:05:37.443181 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.443119 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 21:05:37.443489 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.443471 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hz9f5\"" Jun 05 21:05:37.443721 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.443704 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 21:05:37.444559 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.443956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.444657 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.444639 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 21:05:37.444767 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.444723 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:05:37.444849 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.444776 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v5b5c\"" Jun 05 21:05:37.444849 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.444830 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 21:05:37.444959 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.444853 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:37.444959 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:37.444940 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:05:37.446300 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.446201 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 21:05:37.446300 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.446249 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 21:05:37.446529 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.446514 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v472d" Jun 05 21:05:37.447143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.446997 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c86vp\"" Jun 05 21:05:37.447143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.447054 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 21:05:37.447143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.447088 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 21:05:37.447757 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.447664 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wvtmg" Jun 05 21:05:37.448052 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.448034 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 21:05:37.448120 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.448082 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 21:05:37.448771 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.448624 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 21:05:37.448900 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.448882 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 21:05:37.449080 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.449061 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:37.449185 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:37.449122 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:05:37.449185 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.449128 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hnmwf\"" Jun 05 21:05:37.449429 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.449412 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 21:05:37.449722 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.449707 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4qbt5\"" Jun 05 21:05:37.449873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.449855 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 21:05:37.450660 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.450614 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:37.450770 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:37.450702 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:05:37.450914 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.450895 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 21:05:37.451687 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.451666 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 21:05:37.452109 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.452092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.453425 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.453402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9062b894-3bd8-42c5-9740-61331b9f42ff-host-slash\") pod \"iptables-alerter-2pclv\" (UID: \"9062b894-3bd8-42c5-9740-61331b9f42ff\") " pod="openshift-network-operator/iptables-alerter-2pclv" Jun 05 21:05:37.453526 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.453441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4420e080-d4f9-43a5-bbbe-6d869c60f720-ovnkube-config\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.453526 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.453466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.453526 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.453514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-systemd-units\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.453686 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.453544 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-sys-fs\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.453686 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.453570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-run-openvswitch\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.453686 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.453595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdk6j\" (UniqueName: \"kubernetes.io/projected/9062b894-3bd8-42c5-9740-61331b9f42ff-kube-api-access-vdk6j\") pod \"iptables-alerter-2pclv\" (UID: \"9062b894-3bd8-42c5-9740-61331b9f42ff\") " pod="openshift-network-operator/iptables-alerter-2pclv" Jun 05 21:05:37.453686 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.453618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-kubelet\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.453686 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.453638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-slash\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.453932 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.453691 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.453932 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.453671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-log-socket\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.454043 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4420e080-d4f9-43a5-bbbe-6d869c60f720-ovn-node-metrics-cert\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.454134 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzmsw\" (UniqueName: \"kubernetes.io/projected/4420e080-d4f9-43a5-bbbe-6d869c60f720-kube-api-access-gzmsw\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.454134 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5906f44b-9c51-4740-9a69-a68188403871-konnectivity-ca\") pod \"konnectivity-agent-nksmx\" (UID: \"5906f44b-9c51-4740-9a69-a68188403871\") " pod="kube-system/konnectivity-agent-nksmx" Jun 05 21:05:37.454134 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454131 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-run-ovn-kubernetes\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.454292 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454153 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-cni-bin\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.454292 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-device-dir\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.454292 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5906f44b-9c51-4740-9a69-a68188403871-agent-certs\") pod \"konnectivity-agent-nksmx\" (UID: \"5906f44b-9c51-4740-9a69-a68188403871\") " pod="kube-system/konnectivity-agent-nksmx" Jun 05 21:05:37.454292 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-etc-openvswitch\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.454292 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.454556 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454296 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-socket-dir\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.454556 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-run-netns\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.454556 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-var-lib-openvswitch\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.454556 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-cni-netd\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.454556 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4420e080-d4f9-43a5-bbbe-6d869c60f720-env-overrides\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.454556 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-run-systemd\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.454556 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454468 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.454556 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggx2f\" (UniqueName: \"kubernetes.io/projected/3d0ad3a9-ce81-482b-95cf-943f591388a1-kube-api-access-ggx2f\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.454556 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9062b894-3bd8-42c5-9740-61331b9f42ff-iptables-alerter-script\") pod \"iptables-alerter-2pclv\" (UID: \"9062b894-3bd8-42c5-9740-61331b9f42ff\") " pod="openshift-network-operator/iptables-alerter-2pclv" Jun 05 21:05:37.454556 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-run-ovn\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.455022 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454582 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-node-log\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.455022 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4420e080-d4f9-43a5-bbbe-6d869c60f720-ovnkube-script-lib\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.455022 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-registration-dir\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.455022 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454773 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:05:37.455022 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454773 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hfsj6\"" Jun 05 21:05:37.455022 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.454775 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 21:05:37.455573 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.455555 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.455827 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.455690 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 21:05:37.456106 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.456087 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 21:05:37.456106 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.456101 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 21:05:37.456247 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.456149 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 21:05:37.456511 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.456493 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ddkjz\"" Jun 05 21:05:37.458205 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.458184 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k8cpm\"" Jun 05 21:05:37.458422 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.458403 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 21:05:37.458622 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.458531 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 21:05:37.474395 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.474374 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6ss2b" Jun 05 21:05:37.481511 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.481487 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6ss2b" Jun 05 21:05:37.536795 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.536760 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:05:37.543459 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.543435 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 21:05:37.555482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-run-systemd\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.555629 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-run-systemd\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.555629 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggx2f\" (UniqueName: \"kubernetes.io/projected/3d0ad3a9-ce81-482b-95cf-943f591388a1-kube-api-access-ggx2f\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.555629 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62xxt\" (UniqueName: \"kubernetes.io/projected/7ed0bd96-8b60-4fc6-8b00-af33bc8ce160-kube-api-access-62xxt\") pod \"node-ca-v472d\" (UID: \"7ed0bd96-8b60-4fc6-8b00-af33bc8ce160\") " pod="openshift-image-registry/node-ca-v472d" Jun 05 21:05:37.555629 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73b69734-c94d-4c7d-928a-50c104ee18ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.555927 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555675 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9062b894-3bd8-42c5-9740-61331b9f42ff-iptables-alerter-script\") pod \"iptables-alerter-2pclv\" (UID: \"9062b894-3bd8-42c5-9740-61331b9f42ff\") " pod="openshift-network-operator/iptables-alerter-2pclv" Jun 05 21:05:37.555927 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555759 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-node-log\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.555927 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-node-log\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.555927 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4420e080-d4f9-43a5-bbbe-6d869c60f720-ovnkube-script-lib\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.555927 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-registration-dir\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.555927 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555888 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-tuned\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.555927 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9062b894-3bd8-42c5-9740-61331b9f42ff-host-slash\") pod \"iptables-alerter-2pclv\" (UID: \"9062b894-3bd8-42c5-9740-61331b9f42ff\") " pod="openshift-network-operator/iptables-alerter-2pclv" Jun 05 21:05:37.556257 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4420e080-d4f9-43a5-bbbe-6d869c60f720-ovnkube-config\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.556257 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555953 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-registration-dir\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.556257 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fee022b1-01bb-42bf-9dd7-d2e62573afba-cni-binary-copy\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.556257 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.555987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9062b894-3bd8-42c5-9740-61331b9f42ff-host-slash\") pod \"iptables-alerter-2pclv\" (UID: \"9062b894-3bd8-42c5-9740-61331b9f42ff\") " pod="openshift-network-operator/iptables-alerter-2pclv" Jun 05 21:05:37.556257 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73b69734-c94d-4c7d-928a-50c104ee18ef-cnibin\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.556257 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73b69734-c94d-4c7d-928a-50c104ee18ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.556257 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-systemd-units\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.556257 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-sys-fs\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.556257 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-run-k8s-cni-cncf-io\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.556257 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556105 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-systemd-units\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.556257 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-sys-fs\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.556257 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fee022b1-01bb-42bf-9dd7-d2e62573afba-multus-daemon-config\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.556257 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-modprobe-d\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.556257 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrhnz\" (UniqueName: \"kubernetes.io/projected/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-kube-api-access-xrhnz\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzmsw\" (UniqueName: \"kubernetes.io/projected/4420e080-d4f9-43a5-bbbe-6d869c60f720-kube-api-access-gzmsw\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj248\" (UniqueName: \"kubernetes.io/projected/fee022b1-01bb-42bf-9dd7-d2e62573afba-kube-api-access-wj248\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9062b894-3bd8-42c5-9740-61331b9f42ff-iptables-alerter-script\") pod \"iptables-alerter-2pclv\" (UID: \"9062b894-3bd8-42c5-9740-61331b9f42ff\") " pod="openshift-network-operator/iptables-alerter-2pclv" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb-hosts-file\") pod \"node-resolver-wvtmg\" (UID: \"dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb\") " pod="openshift-dns/node-resolver-wvtmg" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-host\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556405 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-cni-bin\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556455 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-device-dir\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-cni-bin\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-multus-cni-dir\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556528 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-device-dir\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556530 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4420e080-d4f9-43a5-bbbe-6d869c60f720-ovnkube-config\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-cnibin\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-os-release\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-etc-kubernetes\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556648 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556672 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb-tmp-dir\") pod \"node-resolver-wvtmg\" (UID: \"dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb\") " pod="openshift-dns/node-resolver-wvtmg" Jun 05 21:05:37.556956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556705 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4420e080-d4f9-43a5-bbbe-6d869c60f720-ovnkube-script-lib\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-etc-openvswitch\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556760 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-etc-openvswitch\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-var-lib-cni-bin\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556809 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-multus-conf-dir\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556825 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ed0bd96-8b60-4fc6-8b00-af33bc8ce160-host\") pod \"node-ca-v472d\" (UID: \"7ed0bd96-8b60-4fc6-8b00-af33bc8ce160\") " pod="openshift-image-registry/node-ca-v472d" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-kubernetes\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-var-lib-openvswitch\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.556975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-cni-netd\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4420e080-d4f9-43a5-bbbe-6d869c60f720-env-overrides\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557006 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-var-lib-openvswitch\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-hostroot\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557053 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-cni-netd\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxjgn\" (UniqueName: \"kubernetes.io/projected/dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb-kube-api-access-cxjgn\") pod \"node-resolver-wvtmg\" (UID: \"dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb\") " pod="openshift-dns/node-resolver-wvtmg" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-var-lib-kubelet\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.557760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557225 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-var-lib-kubelet\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557265 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a81b9d5-40dc-4e24-95de-28ce457cc14d-dbus\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557335 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-systemd\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73b69734-c94d-4c7d-928a-50c104ee18ef-os-release\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4420e080-d4f9-43a5-bbbe-6d869c60f720-env-overrides\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73b69734-c94d-4c7d-928a-50c104ee18ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfqcg\" (UniqueName: \"kubernetes.io/projected/73b69734-c94d-4c7d-928a-50c104ee18ef-kube-api-access-tfqcg\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557480 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-run-ovn\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-run-netns\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557515 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-sys\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557555 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-run-ovn\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-system-cni-dir\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-sysconfig\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-sysctl-conf\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.558482 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-run-multus-certs\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpl97\" (UniqueName: \"kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97\") pod \"network-check-target-2x7pj\" (UID: \"b7a49979-1d6c-451e-8770-1a2b207321fd\") " pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557710 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-tmp\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73b69734-c94d-4c7d-928a-50c104ee18ef-system-cni-dir\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73b69734-c94d-4c7d-928a-50c104ee18ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-run-openvswitch\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557777 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdk6j\" (UniqueName: \"kubernetes.io/projected/9062b894-3bd8-42c5-9740-61331b9f42ff-kube-api-access-vdk6j\") pod \"iptables-alerter-2pclv\" (UID: \"9062b894-3bd8-42c5-9740-61331b9f42ff\") " pod="openshift-network-operator/iptables-alerter-2pclv" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-kubelet\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-run-openvswitch\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-slash\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.557987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-slash\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-log-socket\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4420e080-d4f9-43a5-bbbe-6d869c60f720-ovn-node-metrics-cert\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5906f44b-9c51-4740-9a69-a68188403871-konnectivity-ca\") pod \"konnectivity-agent-nksmx\" (UID: \"5906f44b-9c51-4740-9a69-a68188403871\") " pod="kube-system/konnectivity-agent-nksmx" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-multus-socket-dir-parent\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558100 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-log-socket\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.559218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-run-ovn-kubernetes\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5906f44b-9c51-4740-9a69-a68188403871-agent-certs\") pod \"konnectivity-agent-nksmx\" (UID: \"5906f44b-9c51-4740-9a69-a68188403871\") " pod="kube-system/konnectivity-agent-nksmx" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a81b9d5-40dc-4e24-95de-28ce457cc14d-kubelet-config\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7ed0bd96-8b60-4fc6-8b00-af33bc8ce160-serviceca\") pod \"node-ca-v472d\" (UID: \"7ed0bd96-8b60-4fc6-8b00-af33bc8ce160\") " pod="openshift-image-registry/node-ca-v472d" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwlfw\" (UniqueName: \"kubernetes.io/projected/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-kube-api-access-zwlfw\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-sysctl-d\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558290 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-kubelet\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558336 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-run-ovn-kubernetes\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-lib-modules\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-socket-dir\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558443 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-var-lib-cni-multus\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-run-netns\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-run\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558564 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d0ad3a9-ce81-482b-95cf-943f591388a1-socket-dir\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558642 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4420e080-d4f9-43a5-bbbe-6d869c60f720-host-run-netns\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.559833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.558642 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5906f44b-9c51-4740-9a69-a68188403871-konnectivity-ca\") pod \"konnectivity-agent-nksmx\" (UID: \"5906f44b-9c51-4740-9a69-a68188403871\") " pod="kube-system/konnectivity-agent-nksmx" Jun 05 21:05:37.561982 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.561957 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4420e080-d4f9-43a5-bbbe-6d869c60f720-ovn-node-metrics-cert\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.562149 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.562128 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5906f44b-9c51-4740-9a69-a68188403871-agent-certs\") pod \"konnectivity-agent-nksmx\" (UID: \"5906f44b-9c51-4740-9a69-a68188403871\") " pod="kube-system/konnectivity-agent-nksmx" Jun 05 21:05:37.563692 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.563669 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggx2f\" (UniqueName: \"kubernetes.io/projected/3d0ad3a9-ce81-482b-95cf-943f591388a1-kube-api-access-ggx2f\") pod \"aws-ebs-csi-driver-node-6mxmz\" (UID: \"3d0ad3a9-ce81-482b-95cf-943f591388a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.564504 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.564483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzmsw\" (UniqueName: \"kubernetes.io/projected/4420e080-d4f9-43a5-bbbe-6d869c60f720-kube-api-access-gzmsw\") pod \"ovnkube-node-qcd2w\" (UID: \"4420e080-d4f9-43a5-bbbe-6d869c60f720\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.567866 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.567848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdk6j\" (UniqueName: \"kubernetes.io/projected/9062b894-3bd8-42c5-9740-61331b9f42ff-kube-api-access-vdk6j\") pod \"iptables-alerter-2pclv\" (UID: \"9062b894-3bd8-42c5-9740-61331b9f42ff\") " pod="openshift-network-operator/iptables-alerter-2pclv" Jun 05 21:05:37.658989 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.658945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-system-cni-dir\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.658989 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.658986 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-sysconfig\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.659278 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-sysctl-conf\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.659278 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-run-multus-certs\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.659278 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpl97\" (UniqueName: \"kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97\") pod \"network-check-target-2x7pj\" (UID: \"b7a49979-1d6c-451e-8770-1a2b207321fd\") " pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:37.659278 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-tmp\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.659278 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659097 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-system-cni-dir\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.659278 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659113 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-sysconfig\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.659278 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659146 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-run-multus-certs\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.659278 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659166 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73b69734-c94d-4c7d-928a-50c104ee18ef-system-cni-dir\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.659278 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73b69734-c94d-4c7d-928a-50c104ee18ef-system-cni-dir\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.659278 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73b69734-c94d-4c7d-928a-50c104ee18ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.659278 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659217 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-sysctl-conf\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.659278 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659237 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-multus-socket-dir-parent\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659293 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-multus-socket-dir-parent\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a81b9d5-40dc-4e24-95de-28ce457cc14d-kubelet-config\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7ed0bd96-8b60-4fc6-8b00-af33bc8ce160-serviceca\") pod \"node-ca-v472d\" (UID: \"7ed0bd96-8b60-4fc6-8b00-af33bc8ce160\") " pod="openshift-image-registry/node-ca-v472d" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659339 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a81b9d5-40dc-4e24-95de-28ce457cc14d-kubelet-config\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlfw\" (UniqueName: \"kubernetes.io/projected/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-kube-api-access-zwlfw\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659374 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73b69734-c94d-4c7d-928a-50c104ee18ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-sysctl-d\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-lib-modules\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-var-lib-cni-multus\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-sysctl-d\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659561 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-run\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62xxt\" (UniqueName: \"kubernetes.io/projected/7ed0bd96-8b60-4fc6-8b00-af33bc8ce160-kube-api-access-62xxt\") pod \"node-ca-v472d\" (UID: \"7ed0bd96-8b60-4fc6-8b00-af33bc8ce160\") " pod="openshift-image-registry/node-ca-v472d" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73b69734-c94d-4c7d-928a-50c104ee18ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-lib-modules\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-tuned\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.659751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659675 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fee022b1-01bb-42bf-9dd7-d2e62573afba-cni-binary-copy\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-var-lib-cni-multus\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73b69734-c94d-4c7d-928a-50c104ee18ef-cnibin\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659646 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-run\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659754 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73b69734-c94d-4c7d-928a-50c104ee18ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7ed0bd96-8b60-4fc6-8b00-af33bc8ce160-serviceca\") pod \"node-ca-v472d\" (UID: \"7ed0bd96-8b60-4fc6-8b00-af33bc8ce160\") " pod="openshift-image-registry/node-ca-v472d" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-run-k8s-cni-cncf-io\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:37.659705 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fee022b1-01bb-42bf-9dd7-d2e62573afba-multus-daemon-config\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-modprobe-d\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:37.659871 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs podName:d4172ca3-a21e-4f3e-8be9-9108b28c82b1 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:38.159849149 +0000 UTC m=+3.093814089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs") pod "network-metrics-daemon-58p62" (UID: "d4172ca3-a21e-4f3e-8be9-9108b28c82b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrhnz\" (UniqueName: \"kubernetes.io/projected/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-kube-api-access-xrhnz\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj248\" (UniqueName: \"kubernetes.io/projected/fee022b1-01bb-42bf-9dd7-d2e62573afba-kube-api-access-wj248\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-modprobe-d\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.659949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb-hosts-file\") pod \"node-resolver-wvtmg\" (UID: \"dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb\") " pod="openshift-dns/node-resolver-wvtmg" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660000 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb-hosts-file\") pod \"node-resolver-wvtmg\" (UID: \"dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb\") " pod="openshift-dns/node-resolver-wvtmg" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-host\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.660583 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-multus-cni-dir\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-cnibin\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-os-release\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-etc-kubernetes\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660132 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-host\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb-tmp-dir\") pod \"node-resolver-wvtmg\" (UID: \"dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb\") " pod="openshift-dns/node-resolver-wvtmg" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-var-lib-cni-bin\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-multus-conf-dir\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ed0bd96-8b60-4fc6-8b00-af33bc8ce160-host\") pod \"node-ca-v472d\" (UID: \"7ed0bd96-8b60-4fc6-8b00-af33bc8ce160\") " pod="openshift-image-registry/node-ca-v472d" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660271 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-kubernetes\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-hostroot\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660311 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73b69734-c94d-4c7d-928a-50c104ee18ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxjgn\" (UniqueName: \"kubernetes.io/projected/dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb-kube-api-access-cxjgn\") pod \"node-resolver-wvtmg\" (UID: \"dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb\") " pod="openshift-dns/node-resolver-wvtmg" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-var-lib-kubelet\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-var-lib-kubelet\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660373 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-run-k8s-cni-cncf-io\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a81b9d5-40dc-4e24-95de-28ce457cc14d-dbus\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:37.661417 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-systemd\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660434 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-os-release\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73b69734-c94d-4c7d-928a-50c104ee18ef-os-release\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660450 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73b69734-c94d-4c7d-928a-50c104ee18ef-cnibin\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73b69734-c94d-4c7d-928a-50c104ee18ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660490 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73b69734-c94d-4c7d-928a-50c104ee18ef-os-release\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660543 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-var-lib-kubelet\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660577 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb-tmp-dir\") pod \"node-resolver-wvtmg\" (UID: \"dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb\") " pod="openshift-dns/node-resolver-wvtmg" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660597 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a81b9d5-40dc-4e24-95de-28ce457cc14d-dbus\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-systemd\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660649 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-etc-kubernetes\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660413 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73b69734-c94d-4c7d-928a-50c104ee18ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660674 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fee022b1-01bb-42bf-9dd7-d2e62573afba-cni-binary-copy\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660710 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-kubernetes\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-hostroot\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:37.660758 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-cnibin\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660781 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-multus-conf-dir\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.662329 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:37.660816 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret podName:1a81b9d5-40dc-4e24-95de-28ce457cc14d nodeName:}" failed. No retries permitted until 2026-06-05 21:05:38.160800059 +0000 UTC m=+3.094765002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret") pod "global-pull-secret-syncer-jlqrw" (UID: "1a81b9d5-40dc-4e24-95de-28ce457cc14d") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:37.662995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ed0bd96-8b60-4fc6-8b00-af33bc8ce160-host\") pod \"node-ca-v472d\" (UID: \"7ed0bd96-8b60-4fc6-8b00-af33bc8ce160\") " pod="openshift-image-registry/node-ca-v472d" Jun 05 21:05:37.662995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-var-lib-kubelet\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.662995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfqcg\" (UniqueName: \"kubernetes.io/projected/73b69734-c94d-4c7d-928a-50c104ee18ef-kube-api-access-tfqcg\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.662995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-run-netns\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.662995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660889 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-var-lib-cni-bin\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.662995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-sys\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.662995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fee022b1-01bb-42bf-9dd7-d2e62573afba-multus-daemon-config\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.662995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-host-run-netns\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.662995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.660997 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-sys\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.662995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.661110 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee022b1-01bb-42bf-9dd7-d2e62573afba-multus-cni-dir\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.662995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.661164 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73b69734-c94d-4c7d-928a-50c104ee18ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.662995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.661834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-tmp\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.662995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.662672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-etc-tuned\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.665886 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:37.665848 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:05:37.665986 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:37.665894 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:05:37.665986 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:37.665909 2576 projected.go:196] Error preparing data for projected volume kube-api-access-qpl97 for pod openshift-network-diagnostics/network-check-target-2x7pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:37.666091 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:37.666004 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97 podName:b7a49979-1d6c-451e-8770-1a2b207321fd nodeName:}" failed. No retries permitted until 2026-06-05 21:05:38.165974326 +0000 UTC m=+3.099939245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qpl97" (UniqueName: "kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97") pod "network-check-target-2x7pj" (UID: "b7a49979-1d6c-451e-8770-1a2b207321fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:37.667719 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.667676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwlfw\" (UniqueName: \"kubernetes.io/projected/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-kube-api-access-zwlfw\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:37.669068 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.669044 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj248\" (UniqueName: \"kubernetes.io/projected/fee022b1-01bb-42bf-9dd7-d2e62573afba-kube-api-access-wj248\") pod \"multus-j5jnx\" (UID: \"fee022b1-01bb-42bf-9dd7-d2e62573afba\") " pod="openshift-multus/multus-j5jnx" Jun 05 21:05:37.669483 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.669463 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62xxt\" (UniqueName: \"kubernetes.io/projected/7ed0bd96-8b60-4fc6-8b00-af33bc8ce160-kube-api-access-62xxt\") pod \"node-ca-v472d\" (UID: \"7ed0bd96-8b60-4fc6-8b00-af33bc8ce160\") " pod="openshift-image-registry/node-ca-v472d" Jun 05 21:05:37.669582 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.669561 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfqcg\" (UniqueName: \"kubernetes.io/projected/73b69734-c94d-4c7d-928a-50c104ee18ef-kube-api-access-tfqcg\") pod \"multus-additional-cni-plugins-64v2s\" (UID: \"73b69734-c94d-4c7d-928a-50c104ee18ef\") " pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.670147 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.670130 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrhnz\" (UniqueName: \"kubernetes.io/projected/ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b-kube-api-access-xrhnz\") pod \"tuned-gx9h7\" (UID: \"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b\") " pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.670221 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.670196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxjgn\" (UniqueName: \"kubernetes.io/projected/dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb-kube-api-access-cxjgn\") pod \"node-resolver-wvtmg\" (UID: \"dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb\") " pod="openshift-dns/node-resolver-wvtmg" Jun 05 21:05:37.751785 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.751704 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" Jun 05 21:05:37.761827 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.761799 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:05:37.770451 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.770428 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nksmx" Jun 05 21:05:37.776065 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.776036 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2pclv" Jun 05 21:05:37.782808 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.782787 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v472d" Jun 05 21:05:37.788674 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.788652 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wvtmg" Jun 05 21:05:37.794488 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.794470 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" Jun 05 21:05:37.801159 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.801138 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-64v2s" Jun 05 21:05:37.805178 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:37.805161 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j5jnx" Jun 05 21:05:38.163741 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.163695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:38.163919 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.163780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:38.163919 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:38.163858 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:38.163919 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:38.163919 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret podName:1a81b9d5-40dc-4e24-95de-28ce457cc14d nodeName:}" failed. No retries permitted until 2026-06-05 21:05:39.163904404 +0000 UTC m=+4.097869325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret") pod "global-pull-secret-syncer-jlqrw" (UID: "1a81b9d5-40dc-4e24-95de-28ce457cc14d") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:38.164050 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:38.163858 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:38.164050 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:38.163996 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs podName:d4172ca3-a21e-4f3e-8be9-9108b28c82b1 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:39.163984776 +0000 UTC m=+4.097949696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs") pod "network-metrics-daemon-58p62" (UID: "d4172ca3-a21e-4f3e-8be9-9108b28c82b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:38.264969 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.264936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpl97\" (UniqueName: \"kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97\") pod \"network-check-target-2x7pj\" (UID: \"b7a49979-1d6c-451e-8770-1a2b207321fd\") " pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:38.265122 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:38.265091 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:05:38.265122 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:38.265109 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:05:38.265122 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:38.265118 2576 projected.go:196] Error preparing data for projected volume kube-api-access-qpl97 for pod openshift-network-diagnostics/network-check-target-2x7pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:38.265221 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:38.265171 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97 podName:b7a49979-1d6c-451e-8770-1a2b207321fd nodeName:}" failed. No retries permitted until 2026-06-05 21:05:39.265156314 +0000 UTC m=+4.199121251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpl97" (UniqueName: "kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97") pod "network-check-target-2x7pj" (UID: "b7a49979-1d6c-451e-8770-1a2b207321fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:38.298616 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:38.298586 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b69734_c94d_4c7d_928a_50c104ee18ef.slice/crio-38d5331bf20c94d42329699fb1c5ffd0030c250b5db34042526fa48708388be3 WatchSource:0}: Error finding container 38d5331bf20c94d42329699fb1c5ffd0030c250b5db34042526fa48708388be3: Status 404 returned error can't find the container with id 38d5331bf20c94d42329699fb1c5ffd0030c250b5db34042526fa48708388be3 Jun 05 21:05:38.299931 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:38.299890 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed0bd96_8b60_4fc6_8b00_af33bc8ce160.slice/crio-be74b201fae4d844eb79ba9ed2f3d83ec823b02792a682856a452eb9083e57ff WatchSource:0}: Error finding container be74b201fae4d844eb79ba9ed2f3d83ec823b02792a682856a452eb9083e57ff: Status 404 returned error can't find the container with id be74b201fae4d844eb79ba9ed2f3d83ec823b02792a682856a452eb9083e57ff Jun 05 21:05:38.304106 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:38.304081 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9062b894_3bd8_42c5_9740_61331b9f42ff.slice/crio-a2bce00c559913ae7cf563e20fc0d15a419ce74fe7327d66e197ccc0a9d76dd8 WatchSource:0}: Error finding container a2bce00c559913ae7cf563e20fc0d15a419ce74fe7327d66e197ccc0a9d76dd8: Status 404 returned error can't find the container with id a2bce00c559913ae7cf563e20fc0d15a419ce74fe7327d66e197ccc0a9d76dd8 Jun 05 21:05:38.304960 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:38.304938 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0ad3a9_ce81_482b_95cf_943f591388a1.slice/crio-bb6d6de777685f5eb179b3938fe076e164c0d7d77d748503c22e320216112992 WatchSource:0}: Error finding container bb6d6de777685f5eb179b3938fe076e164c0d7d77d748503c22e320216112992: Status 404 returned error can't find the container with id bb6d6de777685f5eb179b3938fe076e164c0d7d77d748503c22e320216112992 Jun 05 21:05:38.305475 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:38.305434 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5906f44b_9c51_4740_9a69_a68188403871.slice/crio-f071b7e9363c4129f86369776b3aba7492b24177dd89d66c6e87f30f0950e358 WatchSource:0}: Error finding container f071b7e9363c4129f86369776b3aba7492b24177dd89d66c6e87f30f0950e358: Status 404 returned error can't find the container with id f071b7e9363c4129f86369776b3aba7492b24177dd89d66c6e87f30f0950e358 Jun 05 21:05:38.306380 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:38.306298 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd66c9b9_cd41_4519_ac23_b8ea2ef5b9bb.slice/crio-51f653feab5314fe1c3cea1e4c90817555faa099c0f4ee88fd108d1550475fd2 WatchSource:0}: Error finding container 51f653feab5314fe1c3cea1e4c90817555faa099c0f4ee88fd108d1550475fd2: Status 404 returned error can't find the container with id 51f653feab5314fe1c3cea1e4c90817555faa099c0f4ee88fd108d1550475fd2 Jun 05 21:05:38.307337 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:38.307297 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8df7a6_07d8_4a2d_83b0_8e5d5e84bc6b.slice/crio-3c63f64029cf916a43440971466c7842e8909cfab6f54576eff2c27a1d4e5ebb WatchSource:0}: Error finding container 3c63f64029cf916a43440971466c7842e8909cfab6f54576eff2c27a1d4e5ebb: Status 404 returned error can't find the container with id 3c63f64029cf916a43440971466c7842e8909cfab6f54576eff2c27a1d4e5ebb Jun 05 21:05:38.309748 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:38.309294 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4420e080_d4f9_43a5_bbbe_6d869c60f720.slice/crio-a8b10d11cf1c3417a8c57e98a7629f133865b51ec7f1a9a481690dfaed38e4f8 WatchSource:0}: Error finding container a8b10d11cf1c3417a8c57e98a7629f133865b51ec7f1a9a481690dfaed38e4f8: Status 404 returned error can't find the container with id a8b10d11cf1c3417a8c57e98a7629f133865b51ec7f1a9a481690dfaed38e4f8 Jun 05 21:05:38.310506 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:05:38.310435 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee022b1_01bb_42bf_9dd7_d2e62573afba.slice/crio-e906dd840755f66cbf2ea1badc7c17a8e40359916d3448e61461d559351163cd WatchSource:0}: Error finding container e906dd840755f66cbf2ea1badc7c17a8e40359916d3448e61461d559351163cd: Status 404 returned error can't find the container with id e906dd840755f66cbf2ea1badc7c17a8e40359916d3448e61461d559351163cd Jun 05 21:05:38.484182 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.484099 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 21:00:37 +0000 UTC" deadline="2028-01-27 07:39:35.060193998 +0000 UTC" Jun 05 21:05:38.484182 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.484131 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14410h33m56.576066143s" Jun 05 21:05:38.525885 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.525849 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nksmx" event={"ID":"5906f44b-9c51-4740-9a69-a68188403871","Type":"ContainerStarted","Data":"f071b7e9363c4129f86369776b3aba7492b24177dd89d66c6e87f30f0950e358"} Jun 05 21:05:38.528005 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.527982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v472d" event={"ID":"7ed0bd96-8b60-4fc6-8b00-af33bc8ce160","Type":"ContainerStarted","Data":"be74b201fae4d844eb79ba9ed2f3d83ec823b02792a682856a452eb9083e57ff"} Jun 05 21:05:38.529205 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.529183 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" event={"ID":"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b","Type":"ContainerStarted","Data":"3c63f64029cf916a43440971466c7842e8909cfab6f54576eff2c27a1d4e5ebb"} Jun 05 21:05:38.530430 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.530401 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" event={"ID":"4420e080-d4f9-43a5-bbbe-6d869c60f720","Type":"ContainerStarted","Data":"a8b10d11cf1c3417a8c57e98a7629f133865b51ec7f1a9a481690dfaed38e4f8"} Jun 05 21:05:38.531494 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.531471 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wvtmg" event={"ID":"dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb","Type":"ContainerStarted","Data":"51f653feab5314fe1c3cea1e4c90817555faa099c0f4ee88fd108d1550475fd2"} Jun 05 21:05:38.532480 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.532462 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" event={"ID":"3d0ad3a9-ce81-482b-95cf-943f591388a1","Type":"ContainerStarted","Data":"bb6d6de777685f5eb179b3938fe076e164c0d7d77d748503c22e320216112992"} Jun 05 21:05:38.533528 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.533504 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2pclv" event={"ID":"9062b894-3bd8-42c5-9740-61331b9f42ff","Type":"ContainerStarted","Data":"a2bce00c559913ae7cf563e20fc0d15a419ce74fe7327d66e197ccc0a9d76dd8"} Jun 05 21:05:38.534547 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.534521 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64v2s" event={"ID":"73b69734-c94d-4c7d-928a-50c104ee18ef","Type":"ContainerStarted","Data":"38d5331bf20c94d42329699fb1c5ffd0030c250b5db34042526fa48708388be3"} Jun 05 21:05:38.539238 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.539210 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" event={"ID":"cd7eb7d4f442858d5fa850411397de67","Type":"ContainerStarted","Data":"c889a53837cce02a4398eaf682b2d68278d85d63d93ed0a25ea0e3f7335f265a"} Jun 05 21:05:38.540506 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.540484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j5jnx" event={"ID":"fee022b1-01bb-42bf-9dd7-d2e62573afba","Type":"ContainerStarted","Data":"e906dd840755f66cbf2ea1badc7c17a8e40359916d3448e61461d559351163cd"} Jun 05 21:05:38.552997 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:38.552953 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-39.ec2.internal" podStartSLOduration=2.552939952 podStartE2EDuration="2.552939952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:38.552239893 +0000 UTC m=+3.486204841" watchObservedRunningTime="2026-06-05 21:05:38.552939952 +0000 UTC m=+3.486904889" Jun 05 21:05:39.173107 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:39.172367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:39.173107 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:39.172452 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:39.173107 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:39.172566 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:39.173107 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:39.172630 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs podName:d4172ca3-a21e-4f3e-8be9-9108b28c82b1 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:41.172611432 +0000 UTC m=+6.106576370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs") pod "network-metrics-daemon-58p62" (UID: "d4172ca3-a21e-4f3e-8be9-9108b28c82b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:39.173107 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:39.173026 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:39.173107 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:39.173072 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret podName:1a81b9d5-40dc-4e24-95de-28ce457cc14d nodeName:}" failed. No retries permitted until 2026-06-05 21:05:41.173058359 +0000 UTC m=+6.107023289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret") pod "global-pull-secret-syncer-jlqrw" (UID: "1a81b9d5-40dc-4e24-95de-28ce457cc14d") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:39.273439 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:39.272772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpl97\" (UniqueName: \"kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97\") pod \"network-check-target-2x7pj\" (UID: \"b7a49979-1d6c-451e-8770-1a2b207321fd\") " pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:39.273439 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:39.272998 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:05:39.273439 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:39.273024 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:05:39.273439 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:39.273037 2576 projected.go:196] Error preparing data for projected volume kube-api-access-qpl97 for pod openshift-network-diagnostics/network-check-target-2x7pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:39.273439 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:39.273097 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97 podName:b7a49979-1d6c-451e-8770-1a2b207321fd nodeName:}" failed. No retries permitted until 2026-06-05 21:05:41.273077113 +0000 UTC m=+6.207042031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpl97" (UniqueName: "kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97") pod "network-check-target-2x7pj" (UID: "b7a49979-1d6c-451e-8770-1a2b207321fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:39.485437 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:39.485257 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 21:00:37 +0000 UTC" deadline="2028-02-22 08:28:28.800539174 +0000 UTC" Jun 05 21:05:39.485437 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:39.485316 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15035h22m49.315227064s" Jun 05 21:05:39.518401 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:39.518342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:39.518561 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:39.518461 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:05:39.518878 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:39.518857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:39.518981 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:39.518965 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:05:39.519056 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:39.519042 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:39.519135 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:39.519118 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:05:39.558810 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:39.558776 2576 generic.go:356] "Generic (PLEG): container finished" podID="646afa05f03c2e82f5695adce95c6bad" containerID="729a20c554a68db612628474354e34214c843ea7e2804d79815e828e4e2b2812" exitCode=0 Jun 05 21:05:39.559720 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:39.559693 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" event={"ID":"646afa05f03c2e82f5695adce95c6bad","Type":"ContainerDied","Data":"729a20c554a68db612628474354e34214c843ea7e2804d79815e828e4e2b2812"} Jun 05 21:05:40.580653 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:40.580354 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" event={"ID":"646afa05f03c2e82f5695adce95c6bad","Type":"ContainerStarted","Data":"4cfed3b86f5d5c7f718d44564c119283e7fb856ca18a7e4547a80acbf2424bd3"} Jun 05 21:05:41.192887 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:41.192616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:41.193084 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:41.192792 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:41.193084 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:41.192976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:41.193084 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:41.193029 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret podName:1a81b9d5-40dc-4e24-95de-28ce457cc14d nodeName:}" failed. No retries permitted until 2026-06-05 21:05:45.193007344 +0000 UTC m=+10.126972273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret") pod "global-pull-secret-syncer-jlqrw" (UID: "1a81b9d5-40dc-4e24-95de-28ce457cc14d") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:41.193084 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:41.193081 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:41.193299 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:41.193130 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs podName:d4172ca3-a21e-4f3e-8be9-9108b28c82b1 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:45.193114847 +0000 UTC m=+10.127079765 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs") pod "network-metrics-daemon-58p62" (UID: "d4172ca3-a21e-4f3e-8be9-9108b28c82b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:41.295035 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:41.294329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpl97\" (UniqueName: \"kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97\") pod \"network-check-target-2x7pj\" (UID: \"b7a49979-1d6c-451e-8770-1a2b207321fd\") " pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:41.295035 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:41.294505 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:05:41.295035 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:41.294526 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:05:41.295035 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:41.294542 2576 projected.go:196] Error preparing data for projected volume kube-api-access-qpl97 for pod openshift-network-diagnostics/network-check-target-2x7pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:41.295035 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:41.294604 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97 podName:b7a49979-1d6c-451e-8770-1a2b207321fd nodeName:}" failed. No retries permitted until 2026-06-05 21:05:45.294587374 +0000 UTC m=+10.228552293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpl97" (UniqueName: "kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97") pod "network-check-target-2x7pj" (UID: "b7a49979-1d6c-451e-8770-1a2b207321fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:41.516074 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:41.515994 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:41.516249 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:41.516125 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:05:41.516249 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:41.516131 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:41.516249 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:41.516155 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:41.516249 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:41.516216 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:05:41.516456 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:41.516294 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:05:43.516120 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:43.516041 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:43.516120 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:43.516074 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:43.516658 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:43.516183 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:05:43.516658 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:43.516261 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:05:43.516658 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:43.516288 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:43.516658 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:43.516384 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:05:45.230116 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:45.230076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:45.230543 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:45.230149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:45.230543 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:45.230210 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:45.230543 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:45.230279 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:45.230543 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:45.230295 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs podName:d4172ca3-a21e-4f3e-8be9-9108b28c82b1 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:53.230273099 +0000 UTC m=+18.164238034 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs") pod "network-metrics-daemon-58p62" (UID: "d4172ca3-a21e-4f3e-8be9-9108b28c82b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:45.230543 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:45.230330 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret podName:1a81b9d5-40dc-4e24-95de-28ce457cc14d nodeName:}" failed. No retries permitted until 2026-06-05 21:05:53.23031543 +0000 UTC m=+18.164280346 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret") pod "global-pull-secret-syncer-jlqrw" (UID: "1a81b9d5-40dc-4e24-95de-28ce457cc14d") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:45.331324 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:45.331287 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpl97\" (UniqueName: \"kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97\") pod \"network-check-target-2x7pj\" (UID: \"b7a49979-1d6c-451e-8770-1a2b207321fd\") " pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:45.331497 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:45.331428 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:05:45.331497 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:45.331449 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:05:45.331497 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:45.331462 2576 projected.go:196] Error preparing data for projected volume kube-api-access-qpl97 for pod openshift-network-diagnostics/network-check-target-2x7pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:45.331658 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:45.331520 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97 podName:b7a49979-1d6c-451e-8770-1a2b207321fd nodeName:}" failed. No retries permitted until 2026-06-05 21:05:53.33150248 +0000 UTC m=+18.265467417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpl97" (UniqueName: "kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97") pod "network-check-target-2x7pj" (UID: "b7a49979-1d6c-451e-8770-1a2b207321fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:45.516806 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:45.516244 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:45.516806 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:45.516359 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:05:45.516806 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:45.516411 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:45.516806 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:45.516484 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:05:45.516806 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:45.516529 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:45.516806 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:45.516603 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:05:47.515425 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:47.515347 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:47.515425 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:47.515364 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:47.515955 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:47.515482 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:05:47.515955 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:47.515529 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:47.515955 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:47.515609 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:05:47.515955 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:47.515683 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:05:49.518237 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:49.518205 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:49.518704 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:49.518318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:49.518704 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:49.518318 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:05:49.518704 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:49.518359 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:49.518704 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:49.518442 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:05:49.518704 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:49.518531 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:05:51.516162 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:51.516130 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:51.516656 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:51.516130 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:51.516656 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:51.516234 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:05:51.516656 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:51.516341 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:05:51.516656 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:51.516139 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:51.516656 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:51.516454 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:05:53.289507 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:53.289459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:53.289940 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:53.289533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:53.289940 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:53.289622 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:53.289940 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:53.289694 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs podName:d4172ca3-a21e-4f3e-8be9-9108b28c82b1 nodeName:}" failed. No retries permitted until 2026-06-05 21:06:09.289664456 +0000 UTC m=+34.223629371 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs") pod "network-metrics-daemon-58p62" (UID: "d4172ca3-a21e-4f3e-8be9-9108b28c82b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:53.289940 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:53.289622 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:53.289940 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:53.289773 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret podName:1a81b9d5-40dc-4e24-95de-28ce457cc14d nodeName:}" failed. No retries permitted until 2026-06-05 21:06:09.289759055 +0000 UTC m=+34.223723981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret") pod "global-pull-secret-syncer-jlqrw" (UID: "1a81b9d5-40dc-4e24-95de-28ce457cc14d") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:53.390396 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:53.390360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpl97\" (UniqueName: \"kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97\") pod \"network-check-target-2x7pj\" (UID: \"b7a49979-1d6c-451e-8770-1a2b207321fd\") " pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:53.390569 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:53.390518 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:05:53.390569 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:53.390535 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:05:53.390569 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:53.390544 2576 projected.go:196] Error preparing data for projected volume kube-api-access-qpl97 for pod openshift-network-diagnostics/network-check-target-2x7pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:53.390694 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:53.390594 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97 podName:b7a49979-1d6c-451e-8770-1a2b207321fd nodeName:}" failed. No retries permitted until 2026-06-05 21:06:09.390582278 +0000 UTC m=+34.324547198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpl97" (UniqueName: "kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97") pod "network-check-target-2x7pj" (UID: "b7a49979-1d6c-451e-8770-1a2b207321fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:53.515607 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:53.515529 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:53.515607 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:53.515597 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:53.515852 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:53.515610 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:53.515852 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:53.515740 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:05:53.515852 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:53.515830 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:05:53.515945 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:53.515919 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:05:55.516118 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:55.516083 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:55.516558 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:55.516242 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:55.516558 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:55.516255 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:05:55.516558 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:55.516335 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:05:55.516558 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:55.516353 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:55.516558 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:55.516447 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:05:57.515573 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.515382 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:57.516345 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.515386 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:57.516345 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:57.515675 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:05:57.516345 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:57.515774 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:05:57.516345 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.515386 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:57.516345 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:57.515881 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:05:57.614424 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.614389 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" event={"ID":"ad8df7a6-07d8-4a2d-83b0-8e5d5e84bc6b","Type":"ContainerStarted","Data":"f3871694a631158c616c07a8817037c3c3817c55a7af8a10ce79b1cf473f623a"} Jun 05 21:05:57.616373 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.616353 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcd2w_4420e080-d4f9-43a5-bbbe-6d869c60f720/ovn-acl-logging/0.log" Jun 05 21:05:57.616659 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.616641 2576 generic.go:356] "Generic (PLEG): container finished" podID="4420e080-d4f9-43a5-bbbe-6d869c60f720" containerID="b400c8d75bae7b6c13549299ad951e6eeb33067c9469fbe677079a2af78c895b" exitCode=1 Jun 05 21:05:57.616740 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.616710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" event={"ID":"4420e080-d4f9-43a5-bbbe-6d869c60f720","Type":"ContainerStarted","Data":"54481fbe533507f2331d509cf1fba29a3153dc9812b7960efb58a158f97722af"} Jun 05 21:05:57.616796 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.616779 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" event={"ID":"4420e080-d4f9-43a5-bbbe-6d869c60f720","Type":"ContainerStarted","Data":"2033750cd7368bf6479546adde0f5095c614d0eeb2328b6d69b0722c66ea6c99"} Jun 05 21:05:57.616836 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.616811 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" event={"ID":"4420e080-d4f9-43a5-bbbe-6d869c60f720","Type":"ContainerDied","Data":"b400c8d75bae7b6c13549299ad951e6eeb33067c9469fbe677079a2af78c895b"} Jun 05 21:05:57.616871 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.616841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" event={"ID":"4420e080-d4f9-43a5-bbbe-6d869c60f720","Type":"ContainerStarted","Data":"5847cb636d1b976bf7f810a4fd30b4a7e12ba77ac7fe4639ca12837ac0418c65"} Jun 05 21:05:57.617998 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.617962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wvtmg" event={"ID":"dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb","Type":"ContainerStarted","Data":"777cc3dd5ed312bf0e39cfcca4e22ea676fb07b98e0cdedda50323955a8ef51b"} Jun 05 21:05:57.619333 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.619308 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" event={"ID":"3d0ad3a9-ce81-482b-95cf-943f591388a1","Type":"ContainerStarted","Data":"03c9224545bb08755b9cfad8ecb0b081284a7dd2fa25a3e6e6a8e0a5304a0765"} Jun 05 21:05:57.620618 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.620599 2576 generic.go:356] "Generic (PLEG): container finished" podID="73b69734-c94d-4c7d-928a-50c104ee18ef" containerID="63b6838e014324294de5b792b64efa6f95ed69f202dfcf6cc6c6c177d059cbb8" exitCode=0 Jun 05 21:05:57.620711 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.620663 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64v2s" event={"ID":"73b69734-c94d-4c7d-928a-50c104ee18ef","Type":"ContainerDied","Data":"63b6838e014324294de5b792b64efa6f95ed69f202dfcf6cc6c6c177d059cbb8"} Jun 05 21:05:57.622041 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.622014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j5jnx" event={"ID":"fee022b1-01bb-42bf-9dd7-d2e62573afba","Type":"ContainerStarted","Data":"46d6c32a5062af698391074907db4d42d994d1b269a3761b74002747477ec78f"} Jun 05 21:05:57.623535 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.623517 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nksmx" event={"ID":"5906f44b-9c51-4740-9a69-a68188403871","Type":"ContainerStarted","Data":"9a117b216ddfbe464ab84c1b89d5900c02126fbe9f407dd7e8a05254378ade70"} Jun 05 21:05:57.624856 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.624838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v472d" event={"ID":"7ed0bd96-8b60-4fc6-8b00-af33bc8ce160","Type":"ContainerStarted","Data":"a4f33e58c45e716f39d15e94d883b92cbaf010585a2f5fe2c7c2a5976d2eb425"} Jun 05 21:05:57.631478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.631427 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gx9h7" podStartSLOduration=4.130751759 podStartE2EDuration="22.631408628s" totalImagesPullingTime="18.500656869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:57.630783408 +0000 UTC m=+22.564748350" watchObservedRunningTime="2026-06-05 21:05:57.631408628 +0000 UTC m=+22.565373567" Jun 05 21:05:57.631651 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.631619 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-39.ec2.internal" podStartSLOduration=21.631611962 podStartE2EDuration="21.631611962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:40.599227786 +0000 UTC m=+5.533192725" watchObservedRunningTime="2026-06-05 21:05:57.631611962 +0000 UTC m=+22.565576902" Jun 05 21:05:57.644584 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.644542 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nksmx" podStartSLOduration=8.817081874 podStartE2EDuration="22.644528824s" totalImagesPullingTime="13.82744695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:57.643963455 +0000 UTC m=+22.577928395" watchObservedRunningTime="2026-06-05 21:05:57.644528824 +0000 UTC m=+22.578493762" Jun 05 21:05:57.657263 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.657212 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v472d" podStartSLOduration=4.198317097 podStartE2EDuration="22.657191833s" totalImagesPullingTime="18.458874736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:57.656642098 +0000 UTC m=+22.590607038" watchObservedRunningTime="2026-06-05 21:05:57.657191833 +0000 UTC m=+22.591156773" Jun 05 21:05:57.670499 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.670444 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wvtmg" podStartSLOduration=4.191017239 podStartE2EDuration="22.670431564s" totalImagesPullingTime="18.479414325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:57.670124477 +0000 UTC m=+22.604089415" watchObservedRunningTime="2026-06-05 21:05:57.670431564 +0000 UTC m=+22.604396504" Jun 05 21:05:57.705665 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:57.705603 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j5jnx" podStartSLOduration=4.188940955 podStartE2EDuration="22.705583846s" totalImagesPullingTime="18.516642891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:57.704679517 +0000 UTC m=+22.638644482" watchObservedRunningTime="2026-06-05 21:05:57.705583846 +0000 UTC m=+22.639548786" Jun 05 21:05:58.222797 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:58.222601 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 21:05:58.517453 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:58.517327 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T21:05:58.222788038Z","UUID":"2bee93e7-5e64-4533-86d0-196c29c02164","Handler":null,"Name":"","Endpoint":""} Jun 05 21:05:58.518918 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:58.518898 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 21:05:58.519031 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:58.518935 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 21:05:58.630456 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:58.630430 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcd2w_4420e080-d4f9-43a5-bbbe-6d869c60f720/ovn-acl-logging/0.log" Jun 05 21:05:58.630943 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:58.630913 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" event={"ID":"4420e080-d4f9-43a5-bbbe-6d869c60f720","Type":"ContainerStarted","Data":"7b0dd2464a92f485c5f6daeb76091b91aed820f20037a4017879b71159f90da5"} Jun 05 21:05:58.631067 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:58.631045 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" event={"ID":"4420e080-d4f9-43a5-bbbe-6d869c60f720","Type":"ContainerStarted","Data":"28981e34c0d0319414bc5cd7dcfbc8b787c34572404bc1fdd1011c2ca21b2fc6"} Jun 05 21:05:58.632781 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:58.632754 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" event={"ID":"3d0ad3a9-ce81-482b-95cf-943f591388a1","Type":"ContainerStarted","Data":"877bd9c6470193dd8c4ec956708bb0142e27235ee0d0706de75cc10bfd63de55"} Jun 05 21:05:58.634408 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:58.634382 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2pclv" event={"ID":"9062b894-3bd8-42c5-9740-61331b9f42ff","Type":"ContainerStarted","Data":"0505dd68c67e3b55d81bb1c59a33dc68af763209aa6eb0fc7768f83d4e2919a6"} Jun 05 21:05:58.648106 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:58.648045 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2pclv" podStartSLOduration=5.192063489 podStartE2EDuration="23.648023552s" totalImagesPullingTime="18.455960063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:58.647510257 +0000 UTC m=+23.581475196" watchObservedRunningTime="2026-06-05 21:05:58.648023552 +0000 UTC m=+23.581988492" Jun 05 21:05:59.515547 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:59.515462 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:05:59.515718 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:59.515465 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:05:59.515718 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:59.515594 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:05:59.515718 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:59.515470 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:05:59.515718 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:59.515655 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:05:59.515950 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:05:59.515824 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:05:59.638705 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:59.638668 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" event={"ID":"3d0ad3a9-ce81-482b-95cf-943f591388a1","Type":"ContainerStarted","Data":"d9c76d96892451c2a31941d54a627300b498655351b7e6bbe7bcb04d57c93a58"} Jun 05 21:05:59.655103 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:59.655056 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mxmz" podStartSLOduration=4.127937169 podStartE2EDuration="24.655038373s" totalImagesPullingTime="20.527101204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:59.654998116 +0000 UTC m=+24.588963095" watchObservedRunningTime="2026-06-05 21:05:59.655038373 +0000 UTC m=+24.589003310" Jun 05 21:05:59.712318 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:59.712284 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nksmx" Jun 05 21:05:59.712945 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:05:59.712925 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nksmx" Jun 05 21:06:00.644127 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:00.644094 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcd2w_4420e080-d4f9-43a5-bbbe-6d869c60f720/ovn-acl-logging/0.log" Jun 05 21:06:00.644604 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:00.644571 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" event={"ID":"4420e080-d4f9-43a5-bbbe-6d869c60f720","Type":"ContainerStarted","Data":"ad32061631001d4a6a8a02c0abf302a900bae66a756f4f40cf54029a865cf7d0"} Jun 05 21:06:00.644767 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:00.644745 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nksmx" Jun 05 21:06:00.645617 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:00.645596 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nksmx" Jun 05 21:06:01.515525 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:01.515488 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:06:01.515721 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:01.515490 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:06:01.515721 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:01.515638 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:06:01.515721 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:01.515486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:06:01.515721 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:01.515700 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:06:01.515960 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:01.515788 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:06:02.651933 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:02.651910 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcd2w_4420e080-d4f9-43a5-bbbe-6d869c60f720/ovn-acl-logging/0.log" Jun 05 21:06:02.652441 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:02.652304 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" event={"ID":"4420e080-d4f9-43a5-bbbe-6d869c60f720","Type":"ContainerStarted","Data":"19342b1ebe940165c2a96cab1dd5fa70af06fc4928d0e00f0de0497f7230ed45"} Jun 05 21:06:02.652643 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:02.652625 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:06:02.652801 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:02.652771 2576 scope.go:117] "RemoveContainer" containerID="b400c8d75bae7b6c13549299ad951e6eeb33067c9469fbe677079a2af78c895b" Jun 05 21:06:02.654302 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:02.654279 2576 generic.go:356] "Generic (PLEG): container finished" podID="73b69734-c94d-4c7d-928a-50c104ee18ef" containerID="ff96138a476424bc84f22131a88f87e2bf12a4c58890e38cf41235d38d14ef9a" exitCode=0 Jun 05 21:06:02.654403 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:02.654358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64v2s" event={"ID":"73b69734-c94d-4c7d-928a-50c104ee18ef","Type":"ContainerDied","Data":"ff96138a476424bc84f22131a88f87e2bf12a4c58890e38cf41235d38d14ef9a"} Jun 05 21:06:02.670180 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:02.670156 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:06:03.515493 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:03.515314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:06:03.515647 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:03.515314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:06:03.515647 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:03.515400 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:06:03.515647 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:03.515607 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:06:03.515798 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:03.515769 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:06:03.515883 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:03.515857 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:06:03.660703 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:03.660676 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcd2w_4420e080-d4f9-43a5-bbbe-6d869c60f720/ovn-acl-logging/0.log" Jun 05 21:06:03.661157 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:03.661133 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" event={"ID":"4420e080-d4f9-43a5-bbbe-6d869c60f720","Type":"ContainerStarted","Data":"796185b0ca74c736107a4291c1b9be4102f06ebd33f9d92f1b3b8e85dde19c88"} Jun 05 21:06:03.661211 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:03.661190 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 21:06:03.661415 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:03.661379 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:06:03.663372 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:03.663346 2576 generic.go:356] "Generic (PLEG): container finished" podID="73b69734-c94d-4c7d-928a-50c104ee18ef" containerID="e803d6fda292c472ea1c5495bee755241692005f23c43e933b4ecd9c8ebf5a4f" exitCode=0 Jun 05 21:06:03.663487 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:03.663392 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64v2s" event={"ID":"73b69734-c94d-4c7d-928a-50c104ee18ef","Type":"ContainerDied","Data":"e803d6fda292c472ea1c5495bee755241692005f23c43e933b4ecd9c8ebf5a4f"} Jun 05 21:06:03.678003 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:03.677977 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:06:03.687030 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:03.686984 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" podStartSLOduration=10.133186284 podStartE2EDuration="28.686970022s" totalImagesPullingTime="18.553783738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:06:03.685319033 +0000 UTC m=+28.619283994" watchObservedRunningTime="2026-06-05 21:06:03.686970022 +0000 UTC m=+28.620934959" Jun 05 21:06:04.088231 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:04.088139 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-58p62"] Jun 05 21:06:04.088385 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:04.088291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:06:04.088435 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:04.088406 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:06:04.093346 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:04.093312 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jlqrw"] Jun 05 21:06:04.093528 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:04.093417 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2x7pj"] Jun 05 21:06:04.093528 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:04.093509 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:06:04.093696 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:04.093628 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:06:04.094074 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:04.093709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:06:04.094074 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:04.093833 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:06:04.667614 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:04.667576 2576 generic.go:356] "Generic (PLEG): container finished" podID="73b69734-c94d-4c7d-928a-50c104ee18ef" containerID="c407ecf3564a4eff043c44a420f868933a380580b7ed3147cc3276f71e9e8772" exitCode=0 Jun 05 21:06:04.668393 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:04.667656 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64v2s" event={"ID":"73b69734-c94d-4c7d-928a-50c104ee18ef","Type":"ContainerDied","Data":"c407ecf3564a4eff043c44a420f868933a380580b7ed3147cc3276f71e9e8772"} Jun 05 21:06:04.668393 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:04.667743 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 21:06:04.939336 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:04.939261 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:06:05.518199 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:05.518162 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:06:05.518199 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:05.518191 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:06:05.518424 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:05.518254 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:06:05.518424 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:05.518271 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:06:05.518424 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:05.518344 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:06:05.518424 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:05.518394 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:06:07.516442 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:07.516214 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:06:07.516992 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:07.516214 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:06:07.516992 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:07.516556 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:06:07.516992 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:07.516625 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:06:07.516992 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:07.516251 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:06:07.516992 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:07.516712 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:06:09.313088 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.313019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:06:09.313088 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.313073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:06:09.313452 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:09.313165 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:06:09.313452 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:09.313166 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:06:09.313452 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:09.313214 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs podName:d4172ca3-a21e-4f3e-8be9-9108b28c82b1 nodeName:}" failed. No retries permitted until 2026-06-05 21:06:41.313201396 +0000 UTC m=+66.247166312 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs") pod "network-metrics-daemon-58p62" (UID: "d4172ca3-a21e-4f3e-8be9-9108b28c82b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:06:09.313452 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:09.313226 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret podName:1a81b9d5-40dc-4e24-95de-28ce457cc14d nodeName:}" failed. No retries permitted until 2026-06-05 21:06:41.313220816 +0000 UTC m=+66.247185732 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret") pod "global-pull-secret-syncer-jlqrw" (UID: "1a81b9d5-40dc-4e24-95de-28ce457cc14d") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:06:09.413565 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.413527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpl97\" (UniqueName: \"kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97\") pod \"network-check-target-2x7pj\" (UID: \"b7a49979-1d6c-451e-8770-1a2b207321fd\") " pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:06:09.413775 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:09.413679 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:06:09.413775 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:09.413695 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:06:09.413775 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:09.413705 2576 projected.go:196] Error preparing data for projected volume kube-api-access-qpl97 for pod openshift-network-diagnostics/network-check-target-2x7pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:06:09.413902 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:09.413776 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97 podName:b7a49979-1d6c-451e-8770-1a2b207321fd nodeName:}" failed. No retries permitted until 2026-06-05 21:06:41.413762649 +0000 UTC m=+66.347727578 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpl97" (UniqueName: "kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97") pod "network-check-target-2x7pj" (UID: "b7a49979-1d6c-451e-8770-1a2b207321fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:06:09.515862 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.515821 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:06:09.515862 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.515854 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:06:09.516095 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.515821 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:06:09.516095 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:09.515949 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jlqrw" podUID="1a81b9d5-40dc-4e24-95de-28ce457cc14d" Jun 05 21:06:09.516095 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:09.515996 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2x7pj" podUID="b7a49979-1d6c-451e-8770-1a2b207321fd" Jun 05 21:06:09.516095 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:09.516079 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:06:09.682592 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.682556 2576 generic.go:356] "Generic (PLEG): container finished" podID="73b69734-c94d-4c7d-928a-50c104ee18ef" containerID="482e2cb4fcccea6654f85f3641a9b58bf12d3c46d2b628c4eb0652b7f9d4ac86" exitCode=0 Jun 05 21:06:09.682769 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.682622 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64v2s" event={"ID":"73b69734-c94d-4c7d-928a-50c104ee18ef","Type":"ContainerDied","Data":"482e2cb4fcccea6654f85f3641a9b58bf12d3c46d2b628c4eb0652b7f9d4ac86"} Jun 05 21:06:09.895873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.895848 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-39.ec2.internal" event="NodeReady" Jun 05 21:06:09.896040 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.895988 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 21:06:09.934349 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.934322 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jhf8c"] Jun 05 21:06:09.948460 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.948438 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xxvsh"] Jun 05 21:06:09.948607 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.948567 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:09.951061 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.951036 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 21:06:09.951198 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.951087 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zr9h5\"" Jun 05 21:06:09.951198 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.951102 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 21:06:09.984886 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.984850 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jhf8c"] Jun 05 21:06:09.985042 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.984899 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xxvsh"] Jun 05 21:06:09.985042 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.984996 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xxvsh" Jun 05 21:06:09.987663 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.987614 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 21:06:09.987805 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.987707 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 21:06:09.987865 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.987810 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6g4pq\"" Jun 05 21:06:09.987916 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:09.987864 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 21:06:10.019797 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.019771 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:10.019797 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.019797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/039971b5-5787-49a6-834f-c712bae1967a-tmp-dir\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:10.019939 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.019838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c49kr\" (UniqueName: \"kubernetes.io/projected/039971b5-5787-49a6-834f-c712bae1967a-kube-api-access-c49kr\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:10.019939 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.019894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/039971b5-5787-49a6-834f-c712bae1967a-config-volume\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:10.121115 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.121039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/039971b5-5787-49a6-834f-c712bae1967a-config-volume\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:10.121115 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.121094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:10.121115 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.121113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/039971b5-5787-49a6-834f-c712bae1967a-tmp-dir\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:10.121358 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.121131 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhz6g\" (UniqueName: \"kubernetes.io/projected/371ed11d-a1a5-4aa3-a7aa-545ee2460b6b-kube-api-access-vhz6g\") pod \"ingress-canary-xxvsh\" (UID: \"371ed11d-a1a5-4aa3-a7aa-545ee2460b6b\") " pod="openshift-ingress-canary/ingress-canary-xxvsh" Jun 05 21:06:10.121358 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.121182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c49kr\" (UniqueName: \"kubernetes.io/projected/039971b5-5787-49a6-834f-c712bae1967a-kube-api-access-c49kr\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:10.121358 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.121199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/371ed11d-a1a5-4aa3-a7aa-545ee2460b6b-cert\") pod \"ingress-canary-xxvsh\" (UID: \"371ed11d-a1a5-4aa3-a7aa-545ee2460b6b\") " pod="openshift-ingress-canary/ingress-canary-xxvsh" Jun 05 21:06:10.121358 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:10.121261 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:06:10.121358 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:10.121337 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls podName:039971b5-5787-49a6-834f-c712bae1967a nodeName:}" failed. No retries permitted until 2026-06-05 21:06:10.621318749 +0000 UTC m=+35.555283685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls") pod "dns-default-jhf8c" (UID: "039971b5-5787-49a6-834f-c712bae1967a") : secret "dns-default-metrics-tls" not found Jun 05 21:06:10.121607 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.121491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/039971b5-5787-49a6-834f-c712bae1967a-tmp-dir\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:10.121750 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.121712 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/039971b5-5787-49a6-834f-c712bae1967a-config-volume\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:10.130995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.130975 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c49kr\" (UniqueName: \"kubernetes.io/projected/039971b5-5787-49a6-834f-c712bae1967a-kube-api-access-c49kr\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:10.221642 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.221603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhz6g\" (UniqueName: \"kubernetes.io/projected/371ed11d-a1a5-4aa3-a7aa-545ee2460b6b-kube-api-access-vhz6g\") pod \"ingress-canary-xxvsh\" (UID: \"371ed11d-a1a5-4aa3-a7aa-545ee2460b6b\") " pod="openshift-ingress-canary/ingress-canary-xxvsh" Jun 05 21:06:10.221875 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.221676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/371ed11d-a1a5-4aa3-a7aa-545ee2460b6b-cert\") pod \"ingress-canary-xxvsh\" (UID: \"371ed11d-a1a5-4aa3-a7aa-545ee2460b6b\") " pod="openshift-ingress-canary/ingress-canary-xxvsh" Jun 05 21:06:10.224394 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.224369 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/371ed11d-a1a5-4aa3-a7aa-545ee2460b6b-cert\") pod \"ingress-canary-xxvsh\" (UID: \"371ed11d-a1a5-4aa3-a7aa-545ee2460b6b\") " pod="openshift-ingress-canary/ingress-canary-xxvsh" Jun 05 21:06:10.229019 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.229000 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhz6g\" (UniqueName: \"kubernetes.io/projected/371ed11d-a1a5-4aa3-a7aa-545ee2460b6b-kube-api-access-vhz6g\") pod \"ingress-canary-xxvsh\" (UID: \"371ed11d-a1a5-4aa3-a7aa-545ee2460b6b\") " pod="openshift-ingress-canary/ingress-canary-xxvsh" Jun 05 21:06:10.293190 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.293155 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xxvsh" Jun 05 21:06:10.459674 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.459643 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xxvsh"] Jun 05 21:06:10.463818 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:06:10.463793 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371ed11d_a1a5_4aa3_a7aa_545ee2460b6b.slice/crio-00b0c702ff8fae3ba2636db217e076cbe30d2f647047a2dd7c5e71f70cfea1d7 WatchSource:0}: Error finding container 00b0c702ff8fae3ba2636db217e076cbe30d2f647047a2dd7c5e71f70cfea1d7: Status 404 returned error can't find the container with id 00b0c702ff8fae3ba2636db217e076cbe30d2f647047a2dd7c5e71f70cfea1d7 Jun 05 21:06:10.624166 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.624126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:10.624332 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:10.624232 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:06:10.624332 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:10.624288 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls podName:039971b5-5787-49a6-834f-c712bae1967a nodeName:}" failed. No retries permitted until 2026-06-05 21:06:11.624272644 +0000 UTC m=+36.558237561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls") pod "dns-default-jhf8c" (UID: "039971b5-5787-49a6-834f-c712bae1967a") : secret "dns-default-metrics-tls" not found Jun 05 21:06:10.687600 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.687514 2576 generic.go:356] "Generic (PLEG): container finished" podID="73b69734-c94d-4c7d-928a-50c104ee18ef" containerID="e2eb179813ba60c3b46c7a3d9803382019e19b8c59e5b8b73e6ba93f908f3c3d" exitCode=0 Jun 05 21:06:10.687798 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.687596 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64v2s" event={"ID":"73b69734-c94d-4c7d-928a-50c104ee18ef","Type":"ContainerDied","Data":"e2eb179813ba60c3b46c7a3d9803382019e19b8c59e5b8b73e6ba93f908f3c3d"} Jun 05 21:06:10.688856 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:10.688836 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xxvsh" event={"ID":"371ed11d-a1a5-4aa3-a7aa-545ee2460b6b","Type":"ContainerStarted","Data":"00b0c702ff8fae3ba2636db217e076cbe30d2f647047a2dd7c5e71f70cfea1d7"} Jun 05 21:06:11.515765 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:11.515528 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:06:11.516387 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:11.515557 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:06:11.516387 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:11.515557 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:06:11.519653 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:11.519633 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 21:06:11.519807 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:11.519654 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nklfc\"" Jun 05 21:06:11.519807 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:11.519673 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 21:06:11.519807 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:11.519710 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 21:06:11.519807 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:11.519788 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hrxkp\"" Jun 05 21:06:11.520081 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:11.519827 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 21:06:11.633920 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:11.633882 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:11.634104 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:11.634012 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:06:11.634104 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:11.634071 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls podName:039971b5-5787-49a6-834f-c712bae1967a nodeName:}" failed. No retries permitted until 2026-06-05 21:06:13.634055875 +0000 UTC m=+38.568020792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls") pod "dns-default-jhf8c" (UID: "039971b5-5787-49a6-834f-c712bae1967a") : secret "dns-default-metrics-tls" not found Jun 05 21:06:11.696072 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:11.696033 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64v2s" event={"ID":"73b69734-c94d-4c7d-928a-50c104ee18ef","Type":"ContainerStarted","Data":"cea5734a89871f1663961f34c82dffe453d0187e0c60526a908d40c887206e45"} Jun 05 21:06:11.717077 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:11.716751 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-64v2s" podStartSLOduration=8.585027802 podStartE2EDuration="36.7167122s" totalImagesPullingTime="28.131684398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:06:11.715080868 +0000 UTC m=+36.649045805" watchObservedRunningTime="2026-06-05 21:06:11.7167122 +0000 UTC m=+36.650677140" Jun 05 21:06:13.647716 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:13.647683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:13.648248 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:13.647813 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:06:13.648248 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:13.647869 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls podName:039971b5-5787-49a6-834f-c712bae1967a nodeName:}" failed. No retries permitted until 2026-06-05 21:06:17.647852958 +0000 UTC m=+42.581817893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls") pod "dns-default-jhf8c" (UID: "039971b5-5787-49a6-834f-c712bae1967a") : secret "dns-default-metrics-tls" not found Jun 05 21:06:13.702679 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:13.702643 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xxvsh" event={"ID":"371ed11d-a1a5-4aa3-a7aa-545ee2460b6b","Type":"ContainerStarted","Data":"c5a75cfd3ba7c3a6474a5ec5e0ebc8623970f5840a3f64209d056b4e30310d48"} Jun 05 21:06:13.716564 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:13.716515 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xxvsh" podStartSLOduration=2.482896792 podStartE2EDuration="4.716496341s" totalImagesPullingTime="2.233599549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:06:13.716102481 +0000 UTC m=+38.650067418" watchObservedRunningTime="2026-06-05 21:06:13.716496341 +0000 UTC m=+38.650461279" Jun 05 21:06:15.725674 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.725640 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz"] Jun 05 21:06:15.749049 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.749012 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz"] Jun 05 21:06:15.749206 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.749102 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz" Jun 05 21:06:15.751906 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.751880 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 05 21:06:15.753173 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.753152 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 05 21:06:15.753288 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.753190 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vcv9j\"" Jun 05 21:06:15.753288 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.753154 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 05 21:06:15.753392 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.753284 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 05 21:06:15.758410 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.758389 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj"] Jun 05 21:06:15.771036 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.771006 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj"] Jun 05 21:06:15.771164 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.771104 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:06:15.773495 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.773472 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 05 21:06:15.862252 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.862209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d080b1ce-5a40-4ebe-aabc-e71e26f198d7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz\" (UID: \"d080b1ce-5a40-4ebe-aabc-e71e26f198d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz" Jun 05 21:06:15.862252 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.862253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e45e9a-b7a4-42e0-aeee-9bbb3de86233-tmp\") pod \"klusterlet-addon-workmgr-67db8cff74-sn6pj\" (UID: \"08e45e9a-b7a4-42e0-aeee-9bbb3de86233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:06:15.862470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.862338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2hns\" (UniqueName: \"kubernetes.io/projected/08e45e9a-b7a4-42e0-aeee-9bbb3de86233-kube-api-access-x2hns\") pod \"klusterlet-addon-workmgr-67db8cff74-sn6pj\" (UID: \"08e45e9a-b7a4-42e0-aeee-9bbb3de86233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:06:15.862470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.862391 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs2sz\" (UniqueName: \"kubernetes.io/projected/d080b1ce-5a40-4ebe-aabc-e71e26f198d7-kube-api-access-vs2sz\") pod \"managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz\" (UID: \"d080b1ce-5a40-4ebe-aabc-e71e26f198d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz" Jun 05 21:06:15.862470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.862419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/08e45e9a-b7a4-42e0-aeee-9bbb3de86233-klusterlet-config\") pod \"klusterlet-addon-workmgr-67db8cff74-sn6pj\" (UID: \"08e45e9a-b7a4-42e0-aeee-9bbb3de86233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:06:15.962745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.962698 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/08e45e9a-b7a4-42e0-aeee-9bbb3de86233-klusterlet-config\") pod \"klusterlet-addon-workmgr-67db8cff74-sn6pj\" (UID: \"08e45e9a-b7a4-42e0-aeee-9bbb3de86233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:06:15.962903 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.962778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d080b1ce-5a40-4ebe-aabc-e71e26f198d7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz\" (UID: \"d080b1ce-5a40-4ebe-aabc-e71e26f198d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz" Jun 05 21:06:15.962903 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.962801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e45e9a-b7a4-42e0-aeee-9bbb3de86233-tmp\") pod \"klusterlet-addon-workmgr-67db8cff74-sn6pj\" (UID: \"08e45e9a-b7a4-42e0-aeee-9bbb3de86233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:06:15.962903 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.962826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2hns\" (UniqueName: \"kubernetes.io/projected/08e45e9a-b7a4-42e0-aeee-9bbb3de86233-kube-api-access-x2hns\") pod \"klusterlet-addon-workmgr-67db8cff74-sn6pj\" (UID: \"08e45e9a-b7a4-42e0-aeee-9bbb3de86233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:06:15.963016 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.962976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs2sz\" (UniqueName: \"kubernetes.io/projected/d080b1ce-5a40-4ebe-aabc-e71e26f198d7-kube-api-access-vs2sz\") pod \"managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz\" (UID: \"d080b1ce-5a40-4ebe-aabc-e71e26f198d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz" Jun 05 21:06:15.963366 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.963336 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e45e9a-b7a4-42e0-aeee-9bbb3de86233-tmp\") pod \"klusterlet-addon-workmgr-67db8cff74-sn6pj\" (UID: \"08e45e9a-b7a4-42e0-aeee-9bbb3de86233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:06:15.966336 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.966315 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/08e45e9a-b7a4-42e0-aeee-9bbb3de86233-klusterlet-config\") pod \"klusterlet-addon-workmgr-67db8cff74-sn6pj\" (UID: \"08e45e9a-b7a4-42e0-aeee-9bbb3de86233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:06:15.966451 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.966430 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d080b1ce-5a40-4ebe-aabc-e71e26f198d7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz\" (UID: \"d080b1ce-5a40-4ebe-aabc-e71e26f198d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz" Jun 05 21:06:15.970134 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.970109 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs2sz\" (UniqueName: \"kubernetes.io/projected/d080b1ce-5a40-4ebe-aabc-e71e26f198d7-kube-api-access-vs2sz\") pod \"managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz\" (UID: \"d080b1ce-5a40-4ebe-aabc-e71e26f198d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz" Jun 05 21:06:15.970390 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:15.970363 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2hns\" (UniqueName: \"kubernetes.io/projected/08e45e9a-b7a4-42e0-aeee-9bbb3de86233-kube-api-access-x2hns\") pod \"klusterlet-addon-workmgr-67db8cff74-sn6pj\" (UID: \"08e45e9a-b7a4-42e0-aeee-9bbb3de86233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:06:16.070817 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:16.070714 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz" Jun 05 21:06:16.079901 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:16.079864 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:06:16.208961 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:16.208931 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz"] Jun 05 21:06:16.211936 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:06:16.211906 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd080b1ce_5a40_4ebe_aabc_e71e26f198d7.slice/crio-0eafd00141a8ffff06522ac4131d73f77625ef7d4c64922282d3e0cf02b9705d WatchSource:0}: Error finding container 0eafd00141a8ffff06522ac4131d73f77625ef7d4c64922282d3e0cf02b9705d: Status 404 returned error can't find the container with id 0eafd00141a8ffff06522ac4131d73f77625ef7d4c64922282d3e0cf02b9705d Jun 05 21:06:16.223660 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:16.223638 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj"] Jun 05 21:06:16.226675 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:06:16.226653 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e45e9a_b7a4_42e0_aeee_9bbb3de86233.slice/crio-52d14dfb5b6ce30e0f69af3d1ee3f176a03c1343238dbcbf4c64c4e72fcaaa84 WatchSource:0}: Error finding container 52d14dfb5b6ce30e0f69af3d1ee3f176a03c1343238dbcbf4c64c4e72fcaaa84: Status 404 returned error can't find the container with id 52d14dfb5b6ce30e0f69af3d1ee3f176a03c1343238dbcbf4c64c4e72fcaaa84 Jun 05 21:06:16.710677 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:16.710639 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" event={"ID":"08e45e9a-b7a4-42e0-aeee-9bbb3de86233","Type":"ContainerStarted","Data":"52d14dfb5b6ce30e0f69af3d1ee3f176a03c1343238dbcbf4c64c4e72fcaaa84"} Jun 05 21:06:16.711712 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:16.711688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz" event={"ID":"d080b1ce-5a40-4ebe-aabc-e71e26f198d7","Type":"ContainerStarted","Data":"0eafd00141a8ffff06522ac4131d73f77625ef7d4c64922282d3e0cf02b9705d"} Jun 05 21:06:17.677100 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:17.677048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:17.677582 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:17.677225 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:06:17.677582 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:17.677299 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls podName:039971b5-5787-49a6-834f-c712bae1967a nodeName:}" failed. No retries permitted until 2026-06-05 21:06:25.67727837 +0000 UTC m=+50.611243292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls") pod "dns-default-jhf8c" (UID: "039971b5-5787-49a6-834f-c712bae1967a") : secret "dns-default-metrics-tls" not found Jun 05 21:06:21.726514 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:21.726467 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz" event={"ID":"d080b1ce-5a40-4ebe-aabc-e71e26f198d7","Type":"ContainerStarted","Data":"3ad3984442e77e21b4272fef38905d1c8e272ceabab6984443c7104970176bf2"} Jun 05 21:06:21.740675 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:21.740629 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz" podStartSLOduration=2.3170902829999998 podStartE2EDuration="6.740611075s" totalImagesPullingTime="4.423520792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:06:21.739544608 +0000 UTC m=+46.673509550" watchObservedRunningTime="2026-06-05 21:06:21.740611075 +0000 UTC m=+46.674576015" Jun 05 21:06:23.732458 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:23.732426 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" event={"ID":"08e45e9a-b7a4-42e0-aeee-9bbb3de86233","Type":"ContainerStarted","Data":"0274ee3e104e84e5f6bf06229f2598fbf9ab7a14dcfcb1f5b87c89ea91238ace"} Jun 05 21:06:23.732870 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:23.732633 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:06:23.734155 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:23.734136 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:06:23.747946 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:23.747903 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" podStartSLOduration=2.200700402 podStartE2EDuration="8.747888746s" totalImagesPullingTime="6.547188344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:06:23.746942573 +0000 UTC m=+48.680907507" watchObservedRunningTime="2026-06-05 21:06:23.747888746 +0000 UTC m=+48.681853683" Jun 05 21:06:25.737908 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:25.737875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:25.738266 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:25.737989 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:06:25.738266 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:25.738068 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls podName:039971b5-5787-49a6-834f-c712bae1967a nodeName:}" failed. No retries permitted until 2026-06-05 21:06:41.738056407 +0000 UTC m=+66.672021324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls") pod "dns-default-jhf8c" (UID: "039971b5-5787-49a6-834f-c712bae1967a") : secret "dns-default-metrics-tls" not found Jun 05 21:06:36.683701 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:36.683672 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qcd2w" Jun 05 21:06:41.352928 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.352875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:06:41.353312 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.352950 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:06:41.355542 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.355523 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 21:06:41.355643 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.355625 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 21:06:41.363573 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:41.363551 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 21:06:41.363644 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:41.363623 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs podName:d4172ca3-a21e-4f3e-8be9-9108b28c82b1 nodeName:}" failed. No retries permitted until 2026-06-05 21:07:45.363607856 +0000 UTC m=+130.297572772 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs") pod "network-metrics-daemon-58p62" (UID: "d4172ca3-a21e-4f3e-8be9-9108b28c82b1") : secret "metrics-daemon-secret" not found Jun 05 21:06:41.365802 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.365770 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a81b9d5-40dc-4e24-95de-28ce457cc14d-original-pull-secret\") pod \"global-pull-secret-syncer-jlqrw\" (UID: \"1a81b9d5-40dc-4e24-95de-28ce457cc14d\") " pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:06:41.453914 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.453880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpl97\" (UniqueName: \"kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97\") pod \"network-check-target-2x7pj\" (UID: \"b7a49979-1d6c-451e-8770-1a2b207321fd\") " pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:06:41.456454 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.456434 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 21:06:41.466493 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.466471 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 21:06:41.477751 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.477716 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpl97\" (UniqueName: \"kubernetes.io/projected/b7a49979-1d6c-451e-8770-1a2b207321fd-kube-api-access-qpl97\") pod \"network-check-target-2x7pj\" (UID: \"b7a49979-1d6c-451e-8770-1a2b207321fd\") " pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:06:41.530318 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.530287 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hrxkp\"" Jun 05 21:06:41.535286 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.535268 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jlqrw" Jun 05 21:06:41.537409 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.537388 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:06:41.664113 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.664080 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2x7pj"] Jun 05 21:06:41.667543 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:06:41.667507 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a49979_1d6c_451e_8770_1a2b207321fd.slice/crio-984e34ff531c6a2a774b813b39b380e01c36122a4463b16d37d124875bb628b5 WatchSource:0}: Error finding container 984e34ff531c6a2a774b813b39b380e01c36122a4463b16d37d124875bb628b5: Status 404 returned error can't find the container with id 984e34ff531c6a2a774b813b39b380e01c36122a4463b16d37d124875bb628b5 Jun 05 21:06:41.676065 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.676040 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jlqrw"] Jun 05 21:06:41.685963 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:06:41.685935 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a81b9d5_40dc_4e24_95de_28ce457cc14d.slice/crio-38038096b0470acef7aa9fcef468107fd4d374a749112a5f99dfd1cb06a2f74b WatchSource:0}: Error finding container 38038096b0470acef7aa9fcef468107fd4d374a749112a5f99dfd1cb06a2f74b: Status 404 returned error can't find the container with id 38038096b0470acef7aa9fcef468107fd4d374a749112a5f99dfd1cb06a2f74b Jun 05 21:06:41.756419 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.756377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:06:41.756624 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:41.756547 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:06:41.756689 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:06:41.756625 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls podName:039971b5-5787-49a6-834f-c712bae1967a nodeName:}" failed. No retries permitted until 2026-06-05 21:07:13.756604847 +0000 UTC m=+98.690569766 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls") pod "dns-default-jhf8c" (UID: "039971b5-5787-49a6-834f-c712bae1967a") : secret "dns-default-metrics-tls" not found Jun 05 21:06:41.775207 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.775177 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2x7pj" event={"ID":"b7a49979-1d6c-451e-8770-1a2b207321fd","Type":"ContainerStarted","Data":"984e34ff531c6a2a774b813b39b380e01c36122a4463b16d37d124875bb628b5"} Jun 05 21:06:41.776194 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:41.776170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jlqrw" event={"ID":"1a81b9d5-40dc-4e24-95de-28ce457cc14d","Type":"ContainerStarted","Data":"38038096b0470acef7aa9fcef468107fd4d374a749112a5f99dfd1cb06a2f74b"} Jun 05 21:06:46.793701 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:46.793663 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2x7pj" event={"ID":"b7a49979-1d6c-451e-8770-1a2b207321fd","Type":"ContainerStarted","Data":"a17949ba6c49b514f117d16ef4c4dce34c9560735390169bb61635dd8435f2d7"} Jun 05 21:06:46.794165 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:46.793780 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:06:46.795175 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:46.795152 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jlqrw" event={"ID":"1a81b9d5-40dc-4e24-95de-28ce457cc14d","Type":"ContainerStarted","Data":"e225cf2c146c59e78c08b65f5a4f65ad1ba8e90d905dbd28a48086cc40071252"} Jun 05 21:06:46.809241 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:46.809199 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2x7pj" podStartSLOduration=67.448122508 podStartE2EDuration="1m11.809187764s" totalImagesPullingTime="4.361065256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:06:46.808879017 +0000 UTC m=+71.742843954" watchObservedRunningTime="2026-06-05 21:06:46.809187764 +0000 UTC m=+71.743152702" Jun 05 21:06:46.823352 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:06:46.823315 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jlqrw" podStartSLOduration=67.476985507 podStartE2EDuration="1m11.823303045s" totalImagesPullingTime="4.346317538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:06:46.82239029 +0000 UTC m=+71.756355228" watchObservedRunningTime="2026-06-05 21:06:46.823303045 +0000 UTC m=+71.757267982" Jun 05 21:07:13.771612 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:07:13.771577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:07:13.772147 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:07:13.771689 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:07:13.772147 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:07:13.771755 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls podName:039971b5-5787-49a6-834f-c712bae1967a nodeName:}" failed. No retries permitted until 2026-06-05 21:08:17.771724737 +0000 UTC m=+162.705689654 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls") pod "dns-default-jhf8c" (UID: "039971b5-5787-49a6-834f-c712bae1967a") : secret "dns-default-metrics-tls" not found Jun 05 21:07:17.800692 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:07:17.800660 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2x7pj" Jun 05 21:07:45.381125 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:07:45.381092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:07:45.381608 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:07:45.381213 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 21:07:45.381608 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:07:45.381273 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs podName:d4172ca3-a21e-4f3e-8be9-9108b28c82b1 nodeName:}" failed. No retries permitted until 2026-06-05 21:09:47.381256365 +0000 UTC m=+252.315221298 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs") pod "network-metrics-daemon-58p62" (UID: "d4172ca3-a21e-4f3e-8be9-9108b28c82b1") : secret "metrics-daemon-secret" not found Jun 05 21:08:12.967204 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:08:12.967163 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jhf8c" podUID="039971b5-5787-49a6-834f-c712bae1967a" Jun 05 21:08:13.036501 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:13.036473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jhf8c" Jun 05 21:08:14.540708 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:08:14.540659 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-58p62" podUID="d4172ca3-a21e-4f3e-8be9-9108b28c82b1" Jun 05 21:08:17.790352 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:17.790304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:08:17.790958 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:08:17.790470 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:08:17.790958 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:08:17.790562 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls podName:039971b5-5787-49a6-834f-c712bae1967a nodeName:}" failed. No retries permitted until 2026-06-05 21:10:19.790540508 +0000 UTC m=+284.724505425 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls") pod "dns-default-jhf8c" (UID: "039971b5-5787-49a6-834f-c712bae1967a") : secret "dns-default-metrics-tls" not found Jun 05 21:08:21.058960 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:21.058922 2576 generic.go:356] "Generic (PLEG): container finished" podID="d080b1ce-5a40-4ebe-aabc-e71e26f198d7" containerID="3ad3984442e77e21b4272fef38905d1c8e272ceabab6984443c7104970176bf2" exitCode=255 Jun 05 21:08:21.059320 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:21.058980 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz" event={"ID":"d080b1ce-5a40-4ebe-aabc-e71e26f198d7","Type":"ContainerDied","Data":"3ad3984442e77e21b4272fef38905d1c8e272ceabab6984443c7104970176bf2"} Jun 05 21:08:21.064552 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:21.064494 2576 scope.go:117] "RemoveContainer" containerID="3ad3984442e77e21b4272fef38905d1c8e272ceabab6984443c7104970176bf2" Jun 05 21:08:22.063567 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:22.063533 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bcc8dd7b-rkvtz" event={"ID":"d080b1ce-5a40-4ebe-aabc-e71e26f198d7","Type":"ContainerStarted","Data":"98da980b92513fe7017cd210e45654ca1c8c796c06665416ac55acd818978067"} Jun 05 21:08:23.068299 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:23.068261 2576 generic.go:356] "Generic (PLEG): container finished" podID="08e45e9a-b7a4-42e0-aeee-9bbb3de86233" containerID="0274ee3e104e84e5f6bf06229f2598fbf9ab7a14dcfcb1f5b87c89ea91238ace" exitCode=1 Jun 05 21:08:23.068779 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:23.068306 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" event={"ID":"08e45e9a-b7a4-42e0-aeee-9bbb3de86233","Type":"ContainerDied","Data":"0274ee3e104e84e5f6bf06229f2598fbf9ab7a14dcfcb1f5b87c89ea91238ace"} Jun 05 21:08:23.068779 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:23.068674 2576 scope.go:117] "RemoveContainer" containerID="0274ee3e104e84e5f6bf06229f2598fbf9ab7a14dcfcb1f5b87c89ea91238ace" Jun 05 21:08:23.733008 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:23.732973 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:08:24.072796 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:24.072691 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" event={"ID":"08e45e9a-b7a4-42e0-aeee-9bbb3de86233","Type":"ContainerStarted","Data":"977e35e861c4822a1559e7597d6e4cc8ff61eb866f6479575e00fa0a183f90b8"} Jun 05 21:08:24.073242 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:24.072914 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:08:24.073508 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:24.073492 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67db8cff74-sn6pj" Jun 05 21:08:25.519989 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.519552 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:08:25.619216 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.619182 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-4r5w2"] Jun 05 21:08:25.621981 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.621966 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.625539 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.625509 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 05 21:08:25.625539 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.625524 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 05 21:08:25.625739 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.625551 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 21:08:25.625739 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.625521 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 21:08:25.626831 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.626814 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7m946\"" Jun 05 21:08:25.633172 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.633153 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 05 21:08:25.638835 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.638813 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-4r5w2"] Jun 05 21:08:25.645177 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.645156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5367770-de61-4e1f-b45b-884b42ea2dba-serving-cert\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.645296 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.645184 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5367770-de61-4e1f-b45b-884b42ea2dba-tmp\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.645296 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.645200 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4d4k\" (UniqueName: \"kubernetes.io/projected/e5367770-de61-4e1f-b45b-884b42ea2dba-kube-api-access-g4d4k\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.645427 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.645300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5367770-de61-4e1f-b45b-884b42ea2dba-trusted-ca-bundle\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.645427 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.645321 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5367770-de61-4e1f-b45b-884b42ea2dba-service-ca-bundle\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.645427 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.645340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5367770-de61-4e1f-b45b-884b42ea2dba-snapshots\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.714772 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.714743 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w"] Jun 05 21:08:25.717572 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.717552 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" Jun 05 21:08:25.721126 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.721106 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zmcbc\"" Jun 05 21:08:25.721364 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.721340 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 05 21:08:25.721494 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.721368 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 05 21:08:25.721608 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.721593 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:08:25.729499 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.729479 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w"] Jun 05 21:08:25.745702 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.745679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5367770-de61-4e1f-b45b-884b42ea2dba-snapshots\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.745812 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.745741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5367770-de61-4e1f-b45b-884b42ea2dba-serving-cert\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.745812 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.745765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5367770-de61-4e1f-b45b-884b42ea2dba-tmp\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.745812 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.745782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4d4k\" (UniqueName: \"kubernetes.io/projected/e5367770-de61-4e1f-b45b-884b42ea2dba-kube-api-access-g4d4k\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.745812 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.745804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-726p2\" (UniqueName: \"kubernetes.io/projected/5731af6b-451f-4ebd-9aa0-122c8d9bd629-kube-api-access-726p2\") pod \"cluster-samples-operator-854f8b96b6-4rp4w\" (UID: \"5731af6b-451f-4ebd-9aa0-122c8d9bd629\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" Jun 05 21:08:25.745968 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.745827 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rp4w\" (UID: \"5731af6b-451f-4ebd-9aa0-122c8d9bd629\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" Jun 05 21:08:25.745968 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.745906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5367770-de61-4e1f-b45b-884b42ea2dba-trusted-ca-bundle\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.745968 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.745924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5367770-de61-4e1f-b45b-884b42ea2dba-service-ca-bundle\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.746280 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.746258 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5367770-de61-4e1f-b45b-884b42ea2dba-tmp\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.746344 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.746290 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5367770-de61-4e1f-b45b-884b42ea2dba-snapshots\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.746543 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.746525 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5367770-de61-4e1f-b45b-884b42ea2dba-service-ca-bundle\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.746682 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.746664 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5367770-de61-4e1f-b45b-884b42ea2dba-trusted-ca-bundle\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.747936 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.747920 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5367770-de61-4e1f-b45b-884b42ea2dba-serving-cert\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.759468 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.759447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4d4k\" (UniqueName: \"kubernetes.io/projected/e5367770-de61-4e1f-b45b-884b42ea2dba-kube-api-access-g4d4k\") pod \"insights-operator-896549976-4r5w2\" (UID: \"e5367770-de61-4e1f-b45b-884b42ea2dba\") " pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.812721 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.812651 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-kchmr"] Jun 05 21:08:25.815642 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.815626 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-kchmr" Jun 05 21:08:25.818280 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.818258 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:08:25.818386 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.818340 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gpz8s\"" Jun 05 21:08:25.818386 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.818372 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 05 21:08:25.823812 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.823789 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-kchmr"] Jun 05 21:08:25.846139 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.846117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq5b8\" (UniqueName: \"kubernetes.io/projected/9555ef33-dfae-4e01-a467-782f4ca0a878-kube-api-access-sq5b8\") pod \"volume-data-source-validator-78dd696465-kchmr\" (UID: \"9555ef33-dfae-4e01-a467-782f4ca0a878\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-kchmr" Jun 05 21:08:25.846248 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.846185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-726p2\" (UniqueName: \"kubernetes.io/projected/5731af6b-451f-4ebd-9aa0-122c8d9bd629-kube-api-access-726p2\") pod \"cluster-samples-operator-854f8b96b6-4rp4w\" (UID: \"5731af6b-451f-4ebd-9aa0-122c8d9bd629\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" Jun 05 21:08:25.846248 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.846224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rp4w\" (UID: \"5731af6b-451f-4ebd-9aa0-122c8d9bd629\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" Jun 05 21:08:25.846321 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:08:25.846306 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:08:25.846374 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:08:25.846363 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls podName:5731af6b-451f-4ebd-9aa0-122c8d9bd629 nodeName:}" failed. No retries permitted until 2026-06-05 21:08:26.346346111 +0000 UTC m=+171.280311030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4rp4w" (UID: "5731af6b-451f-4ebd-9aa0-122c8d9bd629") : secret "samples-operator-tls" not found Jun 05 21:08:25.854304 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.854283 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-726p2\" (UniqueName: \"kubernetes.io/projected/5731af6b-451f-4ebd-9aa0-122c8d9bd629-kube-api-access-726p2\") pod \"cluster-samples-operator-854f8b96b6-4rp4w\" (UID: \"5731af6b-451f-4ebd-9aa0-122c8d9bd629\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" Jun 05 21:08:25.931428 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.931396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-4r5w2" Jun 05 21:08:25.946506 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.946479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq5b8\" (UniqueName: \"kubernetes.io/projected/9555ef33-dfae-4e01-a467-782f4ca0a878-kube-api-access-sq5b8\") pod \"volume-data-source-validator-78dd696465-kchmr\" (UID: \"9555ef33-dfae-4e01-a467-782f4ca0a878\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-kchmr" Jun 05 21:08:25.953994 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:25.953975 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq5b8\" (UniqueName: \"kubernetes.io/projected/9555ef33-dfae-4e01-a467-782f4ca0a878-kube-api-access-sq5b8\") pod \"volume-data-source-validator-78dd696465-kchmr\" (UID: \"9555ef33-dfae-4e01-a467-782f4ca0a878\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-kchmr" Jun 05 21:08:26.049681 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:26.049651 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-4r5w2"] Jun 05 21:08:26.052503 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:08:26.052480 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5367770_de61_4e1f_b45b_884b42ea2dba.slice/crio-7a0993155ddc8359e30b7d1a5fb7faac0bf7c18befbcc63833ec160336d50c57 WatchSource:0}: Error finding container 7a0993155ddc8359e30b7d1a5fb7faac0bf7c18befbcc63833ec160336d50c57: Status 404 returned error can't find the container with id 7a0993155ddc8359e30b7d1a5fb7faac0bf7c18befbcc63833ec160336d50c57 Jun 05 21:08:26.080160 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:26.080090 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4r5w2" event={"ID":"e5367770-de61-4e1f-b45b-884b42ea2dba","Type":"ContainerStarted","Data":"7a0993155ddc8359e30b7d1a5fb7faac0bf7c18befbcc63833ec160336d50c57"} Jun 05 21:08:26.124811 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:26.124780 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-kchmr" Jun 05 21:08:26.238944 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:26.238912 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-kchmr"] Jun 05 21:08:26.241665 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:08:26.241638 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9555ef33_dfae_4e01_a467_782f4ca0a878.slice/crio-020ab2d2eb2271961efe65d728f05204639e2245ac899022362128b4826adb3d WatchSource:0}: Error finding container 020ab2d2eb2271961efe65d728f05204639e2245ac899022362128b4826adb3d: Status 404 returned error can't find the container with id 020ab2d2eb2271961efe65d728f05204639e2245ac899022362128b4826adb3d Jun 05 21:08:26.349675 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:26.349597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rp4w\" (UID: \"5731af6b-451f-4ebd-9aa0-122c8d9bd629\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" Jun 05 21:08:26.349832 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:08:26.349750 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:08:26.349832 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:08:26.349809 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls podName:5731af6b-451f-4ebd-9aa0-122c8d9bd629 nodeName:}" failed. No retries permitted until 2026-06-05 21:08:27.349792325 +0000 UTC m=+172.283757260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4rp4w" (UID: "5731af6b-451f-4ebd-9aa0-122c8d9bd629") : secret "samples-operator-tls" not found Jun 05 21:08:27.084667 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:27.084621 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-kchmr" event={"ID":"9555ef33-dfae-4e01-a467-782f4ca0a878","Type":"ContainerStarted","Data":"020ab2d2eb2271961efe65d728f05204639e2245ac899022362128b4826adb3d"} Jun 05 21:08:27.357354 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:27.357279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rp4w\" (UID: \"5731af6b-451f-4ebd-9aa0-122c8d9bd629\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" Jun 05 21:08:27.357645 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:08:27.357393 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:08:27.357645 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:08:27.357465 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls podName:5731af6b-451f-4ebd-9aa0-122c8d9bd629 nodeName:}" failed. No retries permitted until 2026-06-05 21:08:29.357446565 +0000 UTC m=+174.291411486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4rp4w" (UID: "5731af6b-451f-4ebd-9aa0-122c8d9bd629") : secret "samples-operator-tls" not found Jun 05 21:08:28.089438 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:28.089401 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-kchmr" event={"ID":"9555ef33-dfae-4e01-a467-782f4ca0a878","Type":"ContainerStarted","Data":"015f89ac6395ac7cf92c346e7730b252d75e2c730e6204cf9ed0e68449acb5ea"} Jun 05 21:08:28.109027 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:28.108969 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-kchmr" podStartSLOduration=2.096077851 podStartE2EDuration="3.108948476s" totalImagesPullingTime="1.012870625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:28.107582288 +0000 UTC m=+173.041547225" watchObservedRunningTime="2026-06-05 21:08:28.108948476 +0000 UTC m=+173.042913415" Jun 05 21:08:29.095023 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:29.094974 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4r5w2" event={"ID":"e5367770-de61-4e1f-b45b-884b42ea2dba","Type":"ContainerStarted","Data":"768cafe792b5b13c4a9d729fa5978e434c797bf28e6b3737376eb16b59dae966"} Jun 05 21:08:29.119515 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:29.119468 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-4r5w2" podStartSLOduration=1.789248585 podStartE2EDuration="4.119451106s" totalImagesPullingTime="2.330202521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:29.118797598 +0000 UTC m=+174.052762535" watchObservedRunningTime="2026-06-05 21:08:29.119451106 +0000 UTC m=+174.053416043" Jun 05 21:08:29.371251 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:29.371155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rp4w\" (UID: \"5731af6b-451f-4ebd-9aa0-122c8d9bd629\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" Jun 05 21:08:29.371393 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:08:29.371301 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:08:29.371393 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:08:29.371370 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls podName:5731af6b-451f-4ebd-9aa0-122c8d9bd629 nodeName:}" failed. No retries permitted until 2026-06-05 21:08:33.37135458 +0000 UTC m=+178.305319497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4rp4w" (UID: "5731af6b-451f-4ebd-9aa0-122c8d9bd629") : secret "samples-operator-tls" not found Jun 05 21:08:29.896113 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:29.896077 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-lt4tn"] Jun 05 21:08:29.899246 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:29.899230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lt4tn" Jun 05 21:08:29.901878 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:29.901857 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8fc2j\"" Jun 05 21:08:29.901974 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:29.901901 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 05 21:08:29.903002 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:29.902988 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 05 21:08:29.908967 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:29.908943 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-lt4tn"] Jun 05 21:08:29.977279 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:29.977234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbn52\" (UniqueName: \"kubernetes.io/projected/e5d9c92c-a22d-4b28-a2d6-afec38d84615-kube-api-access-gbn52\") pod \"migrator-955ffdf5f-lt4tn\" (UID: \"e5d9c92c-a22d-4b28-a2d6-afec38d84615\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lt4tn" Jun 05 21:08:30.077695 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:30.077660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbn52\" (UniqueName: \"kubernetes.io/projected/e5d9c92c-a22d-4b28-a2d6-afec38d84615-kube-api-access-gbn52\") pod \"migrator-955ffdf5f-lt4tn\" (UID: \"e5d9c92c-a22d-4b28-a2d6-afec38d84615\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lt4tn" Jun 05 21:08:30.085043 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:30.085017 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbn52\" (UniqueName: \"kubernetes.io/projected/e5d9c92c-a22d-4b28-a2d6-afec38d84615-kube-api-access-gbn52\") pod \"migrator-955ffdf5f-lt4tn\" (UID: \"e5d9c92c-a22d-4b28-a2d6-afec38d84615\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lt4tn" Jun 05 21:08:30.207881 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:30.207787 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lt4tn" Jun 05 21:08:30.325879 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:30.325848 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-lt4tn"] Jun 05 21:08:30.329574 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:08:30.329544 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d9c92c_a22d_4b28_a2d6_afec38d84615.slice/crio-f8734ee06baa11982cf2b893539224e5e5dab0b7f543596f23866797ab8f681a WatchSource:0}: Error finding container f8734ee06baa11982cf2b893539224e5e5dab0b7f543596f23866797ab8f681a: Status 404 returned error can't find the container with id f8734ee06baa11982cf2b893539224e5e5dab0b7f543596f23866797ab8f681a Jun 05 21:08:31.102129 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:31.102093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lt4tn" event={"ID":"e5d9c92c-a22d-4b28-a2d6-afec38d84615","Type":"ContainerStarted","Data":"f8734ee06baa11982cf2b893539224e5e5dab0b7f543596f23866797ab8f681a"} Jun 05 21:08:31.296246 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:31.296220 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wvtmg_dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb/dns-node-resolver/0.log" Jun 05 21:08:32.110438 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:32.110401 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lt4tn" event={"ID":"e5d9c92c-a22d-4b28-a2d6-afec38d84615","Type":"ContainerStarted","Data":"7c58924ab5fdbafd5b30ea8fc65720f5bc8362c0f288c13b0062e21461da78c6"} Jun 05 21:08:32.110585 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:32.110491 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lt4tn" event={"ID":"e5d9c92c-a22d-4b28-a2d6-afec38d84615","Type":"ContainerStarted","Data":"34d4790510b80b15ecd0f49d1c1ba732c81eedad4fad920d2363b0e0984a74bb"} Jun 05 21:08:32.124809 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:32.124761 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lt4tn" podStartSLOduration=1.8658313560000002 podStartE2EDuration="3.124743924s" totalImagesPullingTime="1.258912568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:32.123598218 +0000 UTC m=+177.057563158" watchObservedRunningTime="2026-06-05 21:08:32.124743924 +0000 UTC m=+177.058708852" Jun 05 21:08:32.292223 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:32.292198 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v472d_7ed0bd96-8b60-4fc6-8b00-af33bc8ce160/node-ca/0.log" Jun 05 21:08:33.093621 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:33.093595 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xxvsh_371ed11d-a1a5-4aa3-a7aa-545ee2460b6b/serve-healthcheck-canary/0.log" Jun 05 21:08:33.404551 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:33.404509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rp4w\" (UID: \"5731af6b-451f-4ebd-9aa0-122c8d9bd629\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" Jun 05 21:08:33.404721 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:08:33.404670 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:08:33.404798 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:08:33.404766 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls podName:5731af6b-451f-4ebd-9aa0-122c8d9bd629 nodeName:}" failed. No retries permitted until 2026-06-05 21:08:41.40474991 +0000 UTC m=+186.338714839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4rp4w" (UID: "5731af6b-451f-4ebd-9aa0-122c8d9bd629") : secret "samples-operator-tls" not found Jun 05 21:08:41.465506 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:41.465473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rp4w\" (UID: \"5731af6b-451f-4ebd-9aa0-122c8d9bd629\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" Jun 05 21:08:41.467786 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:41.467761 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5731af6b-451f-4ebd-9aa0-122c8d9bd629-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rp4w\" (UID: \"5731af6b-451f-4ebd-9aa0-122c8d9bd629\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" Jun 05 21:08:41.629093 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:41.629062 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zmcbc\"" Jun 05 21:08:41.637172 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:41.637150 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" Jun 05 21:08:41.756893 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:41.756829 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w"] Jun 05 21:08:42.139827 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:42.139794 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" event={"ID":"5731af6b-451f-4ebd-9aa0-122c8d9bd629","Type":"ContainerStarted","Data":"06e97f1f21782570a8c684792212823f0a3d6bb882f64de9f5c76ecd3aea2f03"} Jun 05 21:08:44.149031 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:44.148983 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" event={"ID":"5731af6b-451f-4ebd-9aa0-122c8d9bd629","Type":"ContainerStarted","Data":"1e0615370ebc26b5917be76cdd42f49b7e7d95020c93bf1e9d231d3393e98670"} Jun 05 21:08:44.149364 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:44.149091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" event={"ID":"5731af6b-451f-4ebd-9aa0-122c8d9bd629","Type":"ContainerStarted","Data":"40facc11ec14caa5503046491b0a00eff3e0e97e9af8808901542aaec6b9753b"} Jun 05 21:08:44.164967 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:44.164920 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rp4w" podStartSLOduration=17.723782119 podStartE2EDuration="19.164905969s" totalImagesPullingTime="1.44112385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:44.164363895 +0000 UTC m=+189.098328834" watchObservedRunningTime="2026-06-05 21:08:44.164905969 +0000 UTC m=+189.098870908" Jun 05 21:08:53.651223 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.651188 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5nq8c"] Jun 05 21:08:53.654498 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.654478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.658010 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.657983 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 21:08:53.658131 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.658008 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 21:08:53.658131 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.657984 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gfwsm\"" Jun 05 21:08:53.666313 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.666286 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5nq8c"] Jun 05 21:08:53.705767 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.705716 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b456ff697-ghgkw"] Jun 05 21:08:53.708861 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.708839 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.711687 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.711668 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 21:08:53.711879 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.711859 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 21:08:53.712249 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.712234 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 21:08:53.712341 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.712293 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v8s2r\"" Jun 05 21:08:53.716435 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.716417 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 21:08:53.721610 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.721591 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b456ff697-ghgkw"] Jun 05 21:08:53.751106 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.751063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2666050a-4592-469d-a556-86a842d51d17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.751289 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.751113 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4abcded6-2b40-49de-9752-6d805373eb53-ca-trust-extracted\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.751289 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.751141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlzs2\" (UniqueName: \"kubernetes.io/projected/4abcded6-2b40-49de-9752-6d805373eb53-kube-api-access-mlzs2\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.751289 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.751194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4abcded6-2b40-49de-9752-6d805373eb53-image-registry-private-configuration\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.751289 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.751242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4abcded6-2b40-49de-9752-6d805373eb53-bound-sa-token\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.751508 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.751313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2666050a-4592-469d-a556-86a842d51d17-data-volume\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.751508 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.751340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvpsz\" (UniqueName: \"kubernetes.io/projected/2666050a-4592-469d-a556-86a842d51d17-kube-api-access-tvpsz\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.751508 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.751370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4abcded6-2b40-49de-9752-6d805373eb53-trusted-ca\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.751508 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.751403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4abcded6-2b40-49de-9752-6d805373eb53-registry-certificates\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.751508 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.751428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4abcded6-2b40-49de-9752-6d805373eb53-installation-pull-secrets\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.751508 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.751457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2666050a-4592-469d-a556-86a842d51d17-crio-socket\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.751508 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.751489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2666050a-4592-469d-a556-86a842d51d17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.751780 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.751519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4abcded6-2b40-49de-9752-6d805373eb53-registry-tls\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.852360 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4abcded6-2b40-49de-9752-6d805373eb53-installation-pull-secrets\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.852360 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2666050a-4592-469d-a556-86a842d51d17-crio-socket\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.852606 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2666050a-4592-469d-a556-86a842d51d17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.852606 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4abcded6-2b40-49de-9752-6d805373eb53-registry-tls\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.852606 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2666050a-4592-469d-a556-86a842d51d17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.852606 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4abcded6-2b40-49de-9752-6d805373eb53-ca-trust-extracted\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.852606 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852464 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2666050a-4592-469d-a556-86a842d51d17-crio-socket\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.852606 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlzs2\" (UniqueName: \"kubernetes.io/projected/4abcded6-2b40-49de-9752-6d805373eb53-kube-api-access-mlzs2\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.852956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4abcded6-2b40-49de-9752-6d805373eb53-image-registry-private-configuration\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.852956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4abcded6-2b40-49de-9752-6d805373eb53-bound-sa-token\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.852956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2666050a-4592-469d-a556-86a842d51d17-data-volume\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.852956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvpsz\" (UniqueName: \"kubernetes.io/projected/2666050a-4592-469d-a556-86a842d51d17-kube-api-access-tvpsz\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.852956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852815 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4abcded6-2b40-49de-9752-6d805373eb53-trusted-ca\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.852956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4abcded6-2b40-49de-9752-6d805373eb53-registry-certificates\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.852956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.852935 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4abcded6-2b40-49de-9752-6d805373eb53-ca-trust-extracted\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.853301 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.853125 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2666050a-4592-469d-a556-86a842d51d17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.853301 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.853253 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2666050a-4592-469d-a556-86a842d51d17-data-volume\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.853666 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.853639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4abcded6-2b40-49de-9752-6d805373eb53-registry-certificates\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.854245 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.854181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4abcded6-2b40-49de-9752-6d805373eb53-trusted-ca\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.855016 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.854992 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2666050a-4592-469d-a556-86a842d51d17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.855171 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.855131 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4abcded6-2b40-49de-9752-6d805373eb53-installation-pull-secrets\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.855239 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.855192 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4abcded6-2b40-49de-9752-6d805373eb53-registry-tls\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.855766 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.855749 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4abcded6-2b40-49de-9752-6d805373eb53-image-registry-private-configuration\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.861302 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.861270 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvpsz\" (UniqueName: \"kubernetes.io/projected/2666050a-4592-469d-a556-86a842d51d17-kube-api-access-tvpsz\") pod \"insights-runtime-extractor-5nq8c\" (UID: \"2666050a-4592-469d-a556-86a842d51d17\") " pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:53.861302 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.861283 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4abcded6-2b40-49de-9752-6d805373eb53-bound-sa-token\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.861565 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.861545 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlzs2\" (UniqueName: \"kubernetes.io/projected/4abcded6-2b40-49de-9752-6d805373eb53-kube-api-access-mlzs2\") pod \"image-registry-7b456ff697-ghgkw\" (UID: \"4abcded6-2b40-49de-9752-6d805373eb53\") " pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:53.963718 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:53.963627 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5nq8c" Jun 05 21:08:54.017632 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:54.017476 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:54.100453 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:54.100407 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5nq8c"] Jun 05 21:08:54.103885 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:08:54.103859 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2666050a_4592_469d_a556_86a842d51d17.slice/crio-a68f5a0f4ac061840cbf7f737bdcb90fc9ac52ae0528e4dffc5041908debd13a WatchSource:0}: Error finding container a68f5a0f4ac061840cbf7f737bdcb90fc9ac52ae0528e4dffc5041908debd13a: Status 404 returned error can't find the container with id a68f5a0f4ac061840cbf7f737bdcb90fc9ac52ae0528e4dffc5041908debd13a Jun 05 21:08:54.156674 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:54.156605 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b456ff697-ghgkw"] Jun 05 21:08:54.158647 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:08:54.158624 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4abcded6_2b40_49de_9752_6d805373eb53.slice/crio-26f7b5ec189468d13fc6f6ddd8d91ec9cab83e8e320f8f605e62c8f2815d8ce9 WatchSource:0}: Error finding container 26f7b5ec189468d13fc6f6ddd8d91ec9cab83e8e320f8f605e62c8f2815d8ce9: Status 404 returned error can't find the container with id 26f7b5ec189468d13fc6f6ddd8d91ec9cab83e8e320f8f605e62c8f2815d8ce9 Jun 05 21:08:54.183935 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:54.183899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" event={"ID":"4abcded6-2b40-49de-9752-6d805373eb53","Type":"ContainerStarted","Data":"26f7b5ec189468d13fc6f6ddd8d91ec9cab83e8e320f8f605e62c8f2815d8ce9"} Jun 05 21:08:54.185903 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:54.185853 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nq8c" event={"ID":"2666050a-4592-469d-a556-86a842d51d17","Type":"ContainerStarted","Data":"14ac6d856e5d13255411a7db3a03c2d748f51559b2b1c59faa2f8ea0d02d4e9d"} Jun 05 21:08:54.186016 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:54.185922 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nq8c" event={"ID":"2666050a-4592-469d-a556-86a842d51d17","Type":"ContainerStarted","Data":"a68f5a0f4ac061840cbf7f737bdcb90fc9ac52ae0528e4dffc5041908debd13a"} Jun 05 21:08:55.189897 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:55.189795 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" event={"ID":"4abcded6-2b40-49de-9752-6d805373eb53","Type":"ContainerStarted","Data":"0a6cffb1fcd383d7f44c9e36644b4cdeb46fc67f82977c2d383cdb47d7cee839"} Jun 05 21:08:55.189897 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:55.189873 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:08:55.191514 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:55.191485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nq8c" event={"ID":"2666050a-4592-469d-a556-86a842d51d17","Type":"ContainerStarted","Data":"819dbb55b0bc4a61e3312cb7032008a11f85f37e628235b81ac584fb438b2236"} Jun 05 21:08:55.208825 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:55.208773 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" podStartSLOduration=2.208758822 podStartE2EDuration="2.208758822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:55.207803175 +0000 UTC m=+200.141768113" watchObservedRunningTime="2026-06-05 21:08:55.208758822 +0000 UTC m=+200.142723738" Jun 05 21:08:57.201859 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:57.201817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nq8c" event={"ID":"2666050a-4592-469d-a556-86a842d51d17","Type":"ContainerStarted","Data":"50b212f5e222b201592a4b7214751525cafcd293a2e3a8f3f2e446ac1fa2306b"} Jun 05 21:08:57.222110 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:08:57.222058 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5nq8c" podStartSLOduration=1.897845443 podStartE2EDuration="4.222039375s" totalImagesPullingTime="2.324193932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:08:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:57.220351465 +0000 UTC m=+202.154316423" watchObservedRunningTime="2026-06-05 21:08:57.222039375 +0000 UTC m=+202.156004312" Jun 05 21:09:02.801237 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.801199 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bd868765-4jk7q"] Jun 05 21:09:02.806003 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.805984 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:02.808602 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.808578 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 21:09:02.808784 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.808766 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 21:09:02.808878 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.808773 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 21:09:02.809922 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.809902 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 21:09:02.810012 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.809927 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 21:09:02.810012 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.809906 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 21:09:02.810012 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.809998 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rdhp4\"" Jun 05 21:09:02.810146 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.810037 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 21:09:02.812760 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.812719 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd868765-4jk7q"] Jun 05 21:09:02.932953 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.932888 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-service-ca\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:02.932953 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.932947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh5kp\" (UniqueName: \"kubernetes.io/projected/1594066d-4f34-46e4-a92a-9f2bd77069aa-kube-api-access-gh5kp\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:02.932953 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.932971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-serving-cert\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:02.933209 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.932986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-oauth-config\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:02.933209 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.933085 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-oauth-serving-cert\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:02.933209 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:02.933117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-config\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:03.034217 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.034181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-service-ca\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:03.034217 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.034216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh5kp\" (UniqueName: \"kubernetes.io/projected/1594066d-4f34-46e4-a92a-9f2bd77069aa-kube-api-access-gh5kp\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:03.034429 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.034242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-serving-cert\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:03.034429 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.034259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-oauth-config\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:03.034429 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.034308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-oauth-serving-cert\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:03.034429 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.034340 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-config\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:03.034999 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.034972 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-service-ca\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:03.035096 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.035057 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-config\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:03.035096 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.035088 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-oauth-serving-cert\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:03.036792 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.036767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-oauth-config\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:03.036873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.036808 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-serving-cert\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:03.050972 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.050949 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh5kp\" (UniqueName: \"kubernetes.io/projected/1594066d-4f34-46e4-a92a-9f2bd77069aa-kube-api-access-gh5kp\") pod \"console-5bd868765-4jk7q\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:03.116411 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.116320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:03.248635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.248467 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd868765-4jk7q"] Jun 05 21:09:03.251016 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:09:03.250992 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1594066d_4f34_46e4_a92a_9f2bd77069aa.slice/crio-08df33fdc04906548bf7772b555b4076987b16cbfbc09736ad1827c57aca5919 WatchSource:0}: Error finding container 08df33fdc04906548bf7772b555b4076987b16cbfbc09736ad1827c57aca5919: Status 404 returned error can't find the container with id 08df33fdc04906548bf7772b555b4076987b16cbfbc09736ad1827c57aca5919 Jun 05 21:09:03.352380 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.352344 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6dwt9"] Jun 05 21:09:03.356833 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.356811 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.359322 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.359298 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 21:09:03.359422 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.359387 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 21:09:03.359480 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.359467 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-464xt\"" Jun 05 21:09:03.359582 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.359565 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 21:09:03.359632 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.359590 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 21:09:03.359706 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.359692 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 21:09:03.359766 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.359720 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 21:09:03.436939 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.436905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-textfile\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.437122 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.436962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83a33a6f-7161-4849-b841-40cc3fbd4128-root\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.437122 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.437031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83a33a6f-7161-4849-b841-40cc3fbd4128-metrics-client-ca\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.437122 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.437072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.437122 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.437097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-accelerators-collector-config\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.437248 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.437128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-tls\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.437248 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.437151 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83a33a6f-7161-4849-b841-40cc3fbd4128-sys\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.437248 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.437199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-wtmp\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.437248 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.437228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rksqv\" (UniqueName: \"kubernetes.io/projected/83a33a6f-7161-4849-b841-40cc3fbd4128-kube-api-access-rksqv\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.538446 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.538417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-tls\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.538635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.538461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83a33a6f-7161-4849-b841-40cc3fbd4128-sys\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.538635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.538491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-wtmp\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.538635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.538512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rksqv\" (UniqueName: \"kubernetes.io/projected/83a33a6f-7161-4849-b841-40cc3fbd4128-kube-api-access-rksqv\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.538635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.538537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-textfile\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.538635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.538552 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83a33a6f-7161-4849-b841-40cc3fbd4128-sys\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.538635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.538571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83a33a6f-7161-4849-b841-40cc3fbd4128-root\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.538635 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:09:03.538594 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 05 21:09:03.538635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.538613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83a33a6f-7161-4849-b841-40cc3fbd4128-metrics-client-ca\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.539119 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.538642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.539119 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.538652 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-wtmp\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.539119 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.538658 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83a33a6f-7161-4849-b841-40cc3fbd4128-root\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.539119 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:09:03.538660 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-tls podName:83a33a6f-7161-4849-b841-40cc3fbd4128 nodeName:}" failed. No retries permitted until 2026-06-05 21:09:04.038640125 +0000 UTC m=+208.972605047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-tls") pod "node-exporter-6dwt9" (UID: "83a33a6f-7161-4849-b841-40cc3fbd4128") : secret "node-exporter-tls" not found Jun 05 21:09:03.539119 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.538721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-accelerators-collector-config\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.539119 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.538932 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-textfile\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.539402 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.539186 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83a33a6f-7161-4849-b841-40cc3fbd4128-metrics-client-ca\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.539402 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.539301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-accelerators-collector-config\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.540888 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.540871 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:03.552345 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:03.552315 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rksqv\" (UniqueName: \"kubernetes.io/projected/83a33a6f-7161-4849-b841-40cc3fbd4128-kube-api-access-rksqv\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:04.044311 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:04.044278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-tls\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:04.044886 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:09:04.044452 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 05 21:09:04.044886 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:09:04.044556 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-tls podName:83a33a6f-7161-4849-b841-40cc3fbd4128 nodeName:}" failed. No retries permitted until 2026-06-05 21:09:05.044532504 +0000 UTC m=+209.978497443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-tls") pod "node-exporter-6dwt9" (UID: "83a33a6f-7161-4849-b841-40cc3fbd4128") : secret "node-exporter-tls" not found Jun 05 21:09:04.223808 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:04.223770 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd868765-4jk7q" event={"ID":"1594066d-4f34-46e4-a92a-9f2bd77069aa","Type":"ContainerStarted","Data":"08df33fdc04906548bf7772b555b4076987b16cbfbc09736ad1827c57aca5919"} Jun 05 21:09:05.052508 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:05.052472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-tls\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:05.054845 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:05.054826 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83a33a6f-7161-4849-b841-40cc3fbd4128-node-exporter-tls\") pod \"node-exporter-6dwt9\" (UID: \"83a33a6f-7161-4849-b841-40cc3fbd4128\") " pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:05.166339 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:05.166303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6dwt9" Jun 05 21:09:05.178159 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:09:05.178130 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a33a6f_7161_4849_b841_40cc3fbd4128.slice/crio-5a9db70d0ce4bf1831a62d096022c0e5505924d208c0381a0263cdfa12e0d681 WatchSource:0}: Error finding container 5a9db70d0ce4bf1831a62d096022c0e5505924d208c0381a0263cdfa12e0d681: Status 404 returned error can't find the container with id 5a9db70d0ce4bf1831a62d096022c0e5505924d208c0381a0263cdfa12e0d681 Jun 05 21:09:05.228541 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:05.228510 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dwt9" event={"ID":"83a33a6f-7161-4849-b841-40cc3fbd4128","Type":"ContainerStarted","Data":"5a9db70d0ce4bf1831a62d096022c0e5505924d208c0381a0263cdfa12e0d681"} Jun 05 21:09:07.238230 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:07.238190 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd868765-4jk7q" event={"ID":"1594066d-4f34-46e4-a92a-9f2bd77069aa","Type":"ContainerStarted","Data":"b9a6ba03760edf3ceb1835db604ec190927be31f70d59b38e003b1edb6d68980"} Jun 05 21:09:07.239754 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:07.239713 2576 generic.go:356] "Generic (PLEG): container finished" podID="83a33a6f-7161-4849-b841-40cc3fbd4128" containerID="bd31e971779ddbf0c2cf59d77d0387aa45a4d5f67049e771d1cd21611848a691" exitCode=0 Jun 05 21:09:07.239900 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:07.239758 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dwt9" event={"ID":"83a33a6f-7161-4849-b841-40cc3fbd4128","Type":"ContainerDied","Data":"bd31e971779ddbf0c2cf59d77d0387aa45a4d5f67049e771d1cd21611848a691"} Jun 05 21:09:07.254190 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:07.254149 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bd868765-4jk7q" podStartSLOduration=1.984606533 podStartE2EDuration="5.254133847s" totalImagesPullingTime="3.269527314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:07.253164621 +0000 UTC m=+212.187129571" watchObservedRunningTime="2026-06-05 21:09:07.254133847 +0000 UTC m=+212.188098784" Jun 05 21:09:08.096444 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.096411 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-jvst4"] Jun 05 21:09:08.099488 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.099472 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jvst4" Jun 05 21:09:08.101875 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.101834 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 05 21:09:08.101985 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.101970 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qpzmp\"" Jun 05 21:09:08.108399 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.108340 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-jvst4"] Jun 05 21:09:08.180977 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.180951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1206b9d2-6183-4065-b3eb-c26e4c27eb65-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-jvst4\" (UID: \"1206b9d2-6183-4065-b3eb-c26e4c27eb65\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jvst4" Jun 05 21:09:08.181101 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.181006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgjrb\" (UniqueName: \"kubernetes.io/projected/1206b9d2-6183-4065-b3eb-c26e4c27eb65-kube-api-access-vgjrb\") pod \"monitoring-plugin-76b68cc874-jvst4\" (UID: \"1206b9d2-6183-4065-b3eb-c26e4c27eb65\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jvst4" Jun 05 21:09:08.244962 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.244930 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dwt9" event={"ID":"83a33a6f-7161-4849-b841-40cc3fbd4128","Type":"ContainerStarted","Data":"60ba9a45c76e6193d0c221d5e45e5d6f90306cdef10f08d072f99d0b362a6475"} Jun 05 21:09:08.245350 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.244987 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dwt9" event={"ID":"83a33a6f-7161-4849-b841-40cc3fbd4128","Type":"ContainerStarted","Data":"e690308478bb6f5d361636b790dff3acb922280e55f1c5699db1c79d8cfc4bf6"} Jun 05 21:09:08.264753 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.264685 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6dwt9" podStartSLOduration=3.36947322 podStartE2EDuration="5.264667979s" totalImagesPullingTime="1.830015234s" totalInitContainerRuntime="65.179525ms" isStatefulPod=true podCreationTimestamp="2026-06-05 21:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:08.264595749 +0000 UTC m=+213.198560689" watchObservedRunningTime="2026-06-05 21:09:08.264667979 +0000 UTC m=+213.198632918" Jun 05 21:09:08.281862 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.281832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgjrb\" (UniqueName: \"kubernetes.io/projected/1206b9d2-6183-4065-b3eb-c26e4c27eb65-kube-api-access-vgjrb\") pod \"monitoring-plugin-76b68cc874-jvst4\" (UID: \"1206b9d2-6183-4065-b3eb-c26e4c27eb65\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jvst4" Jun 05 21:09:08.281964 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.281896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1206b9d2-6183-4065-b3eb-c26e4c27eb65-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-jvst4\" (UID: \"1206b9d2-6183-4065-b3eb-c26e4c27eb65\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jvst4" Jun 05 21:09:08.282012 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:09:08.281983 2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 05 21:09:08.282047 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:09:08.282035 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1206b9d2-6183-4065-b3eb-c26e4c27eb65-monitoring-plugin-cert podName:1206b9d2-6183-4065-b3eb-c26e4c27eb65 nodeName:}" failed. No retries permitted until 2026-06-05 21:09:08.782023411 +0000 UTC m=+213.715988328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1206b9d2-6183-4065-b3eb-c26e4c27eb65-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-jvst4" (UID: "1206b9d2-6183-4065-b3eb-c26e4c27eb65") : secret "monitoring-plugin-cert" not found Jun 05 21:09:08.290228 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.290203 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgjrb\" (UniqueName: \"kubernetes.io/projected/1206b9d2-6183-4065-b3eb-c26e4c27eb65-kube-api-access-vgjrb\") pod \"monitoring-plugin-76b68cc874-jvst4\" (UID: \"1206b9d2-6183-4065-b3eb-c26e4c27eb65\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jvst4" Jun 05 21:09:08.784985 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.784927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1206b9d2-6183-4065-b3eb-c26e4c27eb65-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-jvst4\" (UID: \"1206b9d2-6183-4065-b3eb-c26e4c27eb65\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jvst4" Jun 05 21:09:08.787293 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:08.787273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1206b9d2-6183-4065-b3eb-c26e4c27eb65-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-jvst4\" (UID: \"1206b9d2-6183-4065-b3eb-c26e4c27eb65\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jvst4" Jun 05 21:09:09.007770 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.007721 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jvst4" Jun 05 21:09:09.129940 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.129908 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-jvst4"] Jun 05 21:09:09.133229 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:09:09.133203 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1206b9d2_6183_4065_b3eb_c26e4c27eb65.slice/crio-f8f2eaa7cf23dc7965d0a9c3bd2616e09f4b7e07f46d62333d44366157b728c8 WatchSource:0}: Error finding container f8f2eaa7cf23dc7965d0a9c3bd2616e09f4b7e07f46d62333d44366157b728c8: Status 404 returned error can't find the container with id f8f2eaa7cf23dc7965d0a9c3bd2616e09f4b7e07f46d62333d44366157b728c8 Jun 05 21:09:09.248972 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.248939 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jvst4" event={"ID":"1206b9d2-6183-4065-b3eb-c26e4c27eb65","Type":"ContainerStarted","Data":"f8f2eaa7cf23dc7965d0a9c3bd2616e09f4b7e07f46d62333d44366157b728c8"} Jun 05 21:09:09.520699 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.520669 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:09:09.525367 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.525349 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.528020 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.527989 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 21:09:09.528155 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.528036 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 21:09:09.528155 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.528071 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 21:09:09.528155 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.528082 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 21:09:09.528332 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.528294 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 21:09:09.528389 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.528329 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 21:09:09.528506 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.528486 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 21:09:09.528621 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.528589 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kbvdw\"" Jun 05 21:09:09.529202 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.529166 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 21:09:09.529202 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.529185 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 21:09:09.529202 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.529202 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 21:09:09.529402 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.529167 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 21:09:09.529402 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.529167 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 21:09:09.529719 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.529702 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 21:09:09.529819 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.529802 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 21:09:09.529874 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.529805 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7mik4v29s8fp3\"" Jun 05 21:09:09.531114 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.531096 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 21:09:09.540877 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.540857 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:09:09.591962 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.591926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.591962 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.591965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592185 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.591997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592185 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592185 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592085 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592185 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592185 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lcwp\" (UniqueName: \"kubernetes.io/projected/4bd41770-04f5-4d76-a223-6c3513b2eea0-kube-api-access-9lcwp\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592185 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592185 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592151 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-web-config\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592463 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592463 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592463 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592463 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-config\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592463 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592463 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592710 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592710 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4bd41770-04f5-4d76-a223-6c3513b2eea0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592710 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592710 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.592710 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.592596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4bd41770-04f5-4d76-a223-6c3513b2eea0-config-out\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.693624 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.693585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-config\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.693624 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.693627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.693882 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.693652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.693882 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.693699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.693882 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.693746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4bd41770-04f5-4d76-a223-6c3513b2eea0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694024 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.693880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694024 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.693924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694024 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.693955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4bd41770-04f5-4d76-a223-6c3513b2eea0-config-out\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694024 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.693995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694024 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.694022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694272 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.694076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694272 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.694107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694272 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.694158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694272 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.694181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694272 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.694210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lcwp\" (UniqueName: \"kubernetes.io/projected/4bd41770-04f5-4d76-a223-6c3513b2eea0-kube-api-access-9lcwp\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694272 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.694244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694562 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.694276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-web-config\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694562 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.694302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694562 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.694349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694562 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.694373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.694562 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.694394 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.695679 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.695649 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.698018 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.696538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.698018 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.696812 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4bd41770-04f5-4d76-a223-6c3513b2eea0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.698018 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.696928 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4bd41770-04f5-4d76-a223-6c3513b2eea0-config-out\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.698018 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.697034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.698018 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.697184 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.698018 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.697439 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.698018 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.697584 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.698018 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.697824 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.698512 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.698455 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.698512 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.698455 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.698701 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.698683 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.698982 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.698960 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.699287 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.699267 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-config\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.699363 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.699344 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.699464 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.699440 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.699943 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.699924 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-web-config\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.700691 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.700676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.704592 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.704576 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lcwp\" (UniqueName: \"kubernetes.io/projected/4bd41770-04f5-4d76-a223-6c3513b2eea0-kube-api-access-9lcwp\") pod \"prometheus-k8s-0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.835929 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.835847 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:09.990862 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:09.990828 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:09:09.993724 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:09:09.993692 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd41770_04f5_4d76_a223_6c3513b2eea0.slice/crio-af5fe0ff496cbe9a25e690a38b509bf4313414e25cbb6441510fb20603f0306f WatchSource:0}: Error finding container af5fe0ff496cbe9a25e690a38b509bf4313414e25cbb6441510fb20603f0306f: Status 404 returned error can't find the container with id af5fe0ff496cbe9a25e690a38b509bf4313414e25cbb6441510fb20603f0306f Jun 05 21:09:10.253160 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:10.253126 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerStarted","Data":"af5fe0ff496cbe9a25e690a38b509bf4313414e25cbb6441510fb20603f0306f"} Jun 05 21:09:11.258234 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:11.258149 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jvst4" event={"ID":"1206b9d2-6183-4065-b3eb-c26e4c27eb65","Type":"ContainerStarted","Data":"a2446bbd5d58ec01bb65b4637c5758e6569395d47cdb24fafdede7a10ece1fe9"} Jun 05 21:09:11.258643 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:11.258240 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jvst4" Jun 05 21:09:11.259858 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:11.259830 2576 generic.go:356] "Generic (PLEG): container finished" podID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerID="5f0b2557833e7df485205c859d239c333cf12608abce2085df2ccdb2552845f0" exitCode=0 Jun 05 21:09:11.260008 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:11.259889 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerDied","Data":"5f0b2557833e7df485205c859d239c333cf12608abce2085df2ccdb2552845f0"} Jun 05 21:09:11.263068 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:11.263036 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jvst4" Jun 05 21:09:11.272600 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:11.272563 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jvst4" podStartSLOduration=1.456275444 podStartE2EDuration="3.272550598s" totalImagesPullingTime="1.816275154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:11.271957781 +0000 UTC m=+216.205922724" watchObservedRunningTime="2026-06-05 21:09:11.272550598 +0000 UTC m=+216.206515552" Jun 05 21:09:13.117074 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:13.117038 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:13.117533 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:13.117108 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:09:13.118710 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:13.118683 2576 patch_prober.go:28] interesting pod/console-5bd868765-4jk7q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 05 21:09:13.118871 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:13.118742 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bd868765-4jk7q" podUID="1594066d-4f34-46e4-a92a-9f2bd77069aa" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 05 21:09:14.023777 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:14.023719 2576 patch_prober.go:28] interesting pod/image-registry-7b456ff697-ghgkw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:09:14.023956 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:14.023800 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" podUID="4abcded6-2b40-49de-9752-6d805373eb53" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:09:15.278331 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:15.278282 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerStarted","Data":"da91dbe36e68ccdb4ee6d6c28617bcb9448bfd8352e688fe0ddd53362ca83fa8"} Jun 05 21:09:15.278747 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:15.278378 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerStarted","Data":"f767795930b9ab14c476b6355706e66910f6c69d9abd6a97ab75688313722f87"} Jun 05 21:09:16.201157 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:16.201122 2576 patch_prober.go:28] interesting pod/image-registry-7b456ff697-ghgkw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:09:16.201346 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:16.201190 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" podUID="4abcded6-2b40-49de-9752-6d805373eb53" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:09:17.289375 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:17.289341 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerStarted","Data":"d6ee968d6de391a6599cd5ea792e6cabff4eb63faa1d78ee18468b2602ac732b"} Jun 05 21:09:17.289879 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:17.289413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerStarted","Data":"dd9a50ea1b5964a3b1f01fed0c52a959fa2b44c97ef1ddd9647d13694f9c7edc"} Jun 05 21:09:17.289879 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:17.289454 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerStarted","Data":"1e34d492d5b69aefd3110b9428474f20a6dab9adb79c437808cbbe123b742cf9"} Jun 05 21:09:17.289879 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:17.289496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerStarted","Data":"b7209384db77279ec9c8dc660cdbe93f1c679b98ffe2b06fa251161b7a33d4bf"} Jun 05 21:09:17.315282 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:17.315227 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.458646841 podStartE2EDuration="8.315208248s" totalImagesPullingTime="5.83868303s" totalInitContainerRuntime="17.878377ms" isStatefulPod=false podCreationTimestamp="2026-06-05 21:09:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:17.313614087 +0000 UTC m=+222.247579025" watchObservedRunningTime="2026-06-05 21:09:17.315208248 +0000 UTC m=+222.249173188" Jun 05 21:09:19.836464 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:19.836422 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:09:23.117193 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:23.117153 2576 patch_prober.go:28] interesting pod/console-5bd868765-4jk7q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 05 21:09:23.117655 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:23.117206 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bd868765-4jk7q" podUID="1594066d-4f34-46e4-a92a-9f2bd77069aa" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 05 21:09:24.022486 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:24.022446 2576 patch_prober.go:28] interesting pod/image-registry-7b456ff697-ghgkw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:09:24.022689 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:24.022511 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" podUID="4abcded6-2b40-49de-9752-6d805373eb53" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:09:26.199087 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:26.199054 2576 patch_prober.go:28] interesting pod/image-registry-7b456ff697-ghgkw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:09:26.199455 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:26.199106 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" podUID="4abcded6-2b40-49de-9752-6d805373eb53" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:09:33.117186 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:33.117145 2576 patch_prober.go:28] interesting pod/console-5bd868765-4jk7q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 05 21:09:33.117571 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:33.117202 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bd868765-4jk7q" podUID="1594066d-4f34-46e4-a92a-9f2bd77069aa" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 05 21:09:34.022113 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:34.022079 2576 patch_prober.go:28] interesting pod/image-registry-7b456ff697-ghgkw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:09:34.022275 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:34.022137 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" podUID="4abcded6-2b40-49de-9752-6d805373eb53" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:09:34.022275 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:34.022174 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:09:34.022591 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:34.022562 2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"0a6cffb1fcd383d7f44c9e36644b4cdeb46fc67f82977c2d383cdb47d7cee839"} pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 21:09:34.026025 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:34.025998 2576 patch_prober.go:28] interesting pod/image-registry-7b456ff697-ghgkw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:09:34.026140 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:34.026034 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" podUID="4abcded6-2b40-49de-9752-6d805373eb53" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:09:43.117007 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:43.116969 2576 patch_prober.go:28] interesting pod/console-5bd868765-4jk7q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 05 21:09:43.117460 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:43.117034 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bd868765-4jk7q" podUID="1594066d-4f34-46e4-a92a-9f2bd77069aa" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 05 21:09:44.027024 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:44.026991 2576 patch_prober.go:28] interesting pod/image-registry-7b456ff697-ghgkw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:09:44.027183 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:44.027052 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" podUID="4abcded6-2b40-49de-9752-6d805373eb53" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:09:47.395574 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:47.395542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:09:47.397844 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:47.397826 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4172ca3-a21e-4f3e-8be9-9108b28c82b1-metrics-certs\") pod \"network-metrics-daemon-58p62\" (UID: \"d4172ca3-a21e-4f3e-8be9-9108b28c82b1\") " pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:09:47.423792 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:47.423767 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nklfc\"" Jun 05 21:09:47.430843 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:47.430816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58p62" Jun 05 21:09:47.655681 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:47.655035 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-58p62"] Jun 05 21:09:47.661646 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:09:47.661606 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4172ca3_a21e_4f3e_8be9_9108b28c82b1.slice/crio-e4e831a29cd4cdfaea0ca686b6ccede7d136f0cda83b0ffeba1cf9fde4df12d4 WatchSource:0}: Error finding container e4e831a29cd4cdfaea0ca686b6ccede7d136f0cda83b0ffeba1cf9fde4df12d4: Status 404 returned error can't find the container with id e4e831a29cd4cdfaea0ca686b6ccede7d136f0cda83b0ffeba1cf9fde4df12d4 Jun 05 21:09:48.400432 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:48.400397 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58p62" event={"ID":"d4172ca3-a21e-4f3e-8be9-9108b28c82b1","Type":"ContainerStarted","Data":"e4e831a29cd4cdfaea0ca686b6ccede7d136f0cda83b0ffeba1cf9fde4df12d4"} Jun 05 21:09:49.406109 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:49.406077 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58p62" event={"ID":"d4172ca3-a21e-4f3e-8be9-9108b28c82b1","Type":"ContainerStarted","Data":"b27a7afbf4cd2b2b21a77538f60a721ce01f49af21a99ab3e96cbc6ec495e7eb"} Jun 05 21:09:49.406541 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:49.406127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58p62" event={"ID":"d4172ca3-a21e-4f3e-8be9-9108b28c82b1","Type":"ContainerStarted","Data":"4563f268a1619e3eadfe57570acadbad8b1829fbf504f58929ea0f70b6f56ae4"} Jun 05 21:09:49.422986 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:49.422943 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-58p62" podStartSLOduration=253.484262791 podStartE2EDuration="4m14.42292854s" totalImagesPullingTime="938.665749ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:49.421806702 +0000 UTC m=+254.355771641" watchObservedRunningTime="2026-06-05 21:09:49.42292854 +0000 UTC m=+254.356893478" Jun 05 21:09:53.117294 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:53.117262 2576 patch_prober.go:28] interesting pod/console-5bd868765-4jk7q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 05 21:09:53.117718 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:53.117312 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bd868765-4jk7q" podUID="1594066d-4f34-46e4-a92a-9f2bd77069aa" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 05 21:09:54.026819 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:54.026786 2576 patch_prober.go:28] interesting pod/image-registry-7b456ff697-ghgkw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:09:54.027012 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:54.026838 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" podUID="4abcded6-2b40-49de-9752-6d805373eb53" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:09:59.041382 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:59.041341 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" podUID="4abcded6-2b40-49de-9752-6d805373eb53" containerName="registry" containerID="cri-o://0a6cffb1fcd383d7f44c9e36644b4cdeb46fc67f82977c2d383cdb47d7cee839" gracePeriod=30 Jun 05 21:09:59.444691 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:59.444660 2576 generic.go:356] "Generic (PLEG): container finished" podID="e5367770-de61-4e1f-b45b-884b42ea2dba" containerID="768cafe792b5b13c4a9d729fa5978e434c797bf28e6b3737376eb16b59dae966" exitCode=0 Jun 05 21:09:59.444889 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:59.444744 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4r5w2" event={"ID":"e5367770-de61-4e1f-b45b-884b42ea2dba","Type":"ContainerDied","Data":"768cafe792b5b13c4a9d729fa5978e434c797bf28e6b3737376eb16b59dae966"} Jun 05 21:09:59.445090 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:09:59.445076 2576 scope.go:117] "RemoveContainer" containerID="768cafe792b5b13c4a9d729fa5978e434c797bf28e6b3737376eb16b59dae966" Jun 05 21:10:00.451015 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:00.450982 2576 generic.go:356] "Generic (PLEG): container finished" podID="4abcded6-2b40-49de-9752-6d805373eb53" containerID="0a6cffb1fcd383d7f44c9e36644b4cdeb46fc67f82977c2d383cdb47d7cee839" exitCode=0 Jun 05 21:10:00.451535 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:00.451066 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" event={"ID":"4abcded6-2b40-49de-9752-6d805373eb53","Type":"ContainerDied","Data":"0a6cffb1fcd383d7f44c9e36644b4cdeb46fc67f82977c2d383cdb47d7cee839"} Jun 05 21:10:00.451535 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:00.451116 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" event={"ID":"4abcded6-2b40-49de-9752-6d805373eb53","Type":"ContainerStarted","Data":"9dc777342c3e75785eefb6e776c4c26b1d17c2b8d201e48e459739f935298bb7"} Jun 05 21:10:00.451535 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:00.451280 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:10:00.452896 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:00.452875 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4r5w2" event={"ID":"e5367770-de61-4e1f-b45b-884b42ea2dba","Type":"ContainerStarted","Data":"d162ecb1bf669057f97cb9a8d8bca2dcf6a0477a0fba5afadd15f9c89abad982"} Jun 05 21:10:03.117683 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:03.117637 2576 patch_prober.go:28] interesting pod/console-5bd868765-4jk7q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 05 21:10:03.118098 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:03.117710 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bd868765-4jk7q" podUID="1594066d-4f34-46e4-a92a-9f2bd77069aa" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 05 21:10:04.643971 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:04.643940 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-jvst4_1206b9d2-6183-4065-b3eb-c26e4c27eb65/monitoring-plugin/0.log" Jun 05 21:10:04.831095 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:04.831068 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dwt9_83a33a6f-7161-4849-b841-40cc3fbd4128/init-textfile/0.log" Jun 05 21:10:05.033435 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:05.033356 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dwt9_83a33a6f-7161-4849-b841-40cc3fbd4128/node-exporter/0.log" Jun 05 21:10:05.231562 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:05.231534 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dwt9_83a33a6f-7161-4849-b841-40cc3fbd4128/kube-rbac-proxy/0.log" Jun 05 21:10:07.232268 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:07.232237 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4bd41770-04f5-4d76-a223-6c3513b2eea0/init-config-reloader/0.log" Jun 05 21:10:07.432973 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:07.432941 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4bd41770-04f5-4d76-a223-6c3513b2eea0/prometheus/0.log" Jun 05 21:10:07.632361 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:07.632324 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4bd41770-04f5-4d76-a223-6c3513b2eea0/config-reloader/0.log" Jun 05 21:10:07.832185 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:07.832135 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4bd41770-04f5-4d76-a223-6c3513b2eea0/thanos-sidecar/0.log" Jun 05 21:10:08.031336 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:08.031263 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4bd41770-04f5-4d76-a223-6c3513b2eea0/kube-rbac-proxy-web/0.log" Jun 05 21:10:08.234428 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:08.234399 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4bd41770-04f5-4d76-a223-6c3513b2eea0/kube-rbac-proxy/0.log" Jun 05 21:10:08.431830 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:08.431780 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4bd41770-04f5-4d76-a223-6c3513b2eea0/kube-rbac-proxy-thanos/0.log" Jun 05 21:10:09.837049 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:09.837013 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:09.857984 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:09.857957 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:10.503747 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:10.503710 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:11.031594 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:11.031556 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5bd868765-4jk7q_1594066d-4f34-46e4-a92a-9f2bd77069aa/console/0.log" Jun 05 21:10:11.975953 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:11.975919 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bd868765-4jk7q"] Jun 05 21:10:13.232794 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:13.232763 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wvtmg_dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb/dns-node-resolver/0.log" Jun 05 21:10:13.632154 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:13.632125 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7b456ff697-ghgkw_4abcded6-2b40-49de-9752-6d805373eb53/registry/0.log" Jun 05 21:10:13.831316 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:13.831283 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7b456ff697-ghgkw_4abcded6-2b40-49de-9752-6d805373eb53/registry/1.log" Jun 05 21:10:14.431300 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:14.431263 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v472d_7ed0bd96-8b60-4fc6-8b00-af33bc8ce160/node-ca/0.log" Jun 05 21:10:15.231974 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:15.231942 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xxvsh_371ed11d-a1a5-4aa3-a7aa-545ee2460b6b/serve-healthcheck-canary/0.log" Jun 05 21:10:16.037257 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:10:16.037216 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jhf8c" podUID="039971b5-5787-49a6-834f-c712bae1967a" Jun 05 21:10:16.511402 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:16.511375 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jhf8c" Jun 05 21:10:19.870748 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:19.870694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:10:19.872745 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:19.872699 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/039971b5-5787-49a6-834f-c712bae1967a-metrics-tls\") pod \"dns-default-jhf8c\" (UID: \"039971b5-5787-49a6-834f-c712bae1967a\") " pod="openshift-dns/dns-default-jhf8c" Jun 05 21:10:20.114451 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:20.114426 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zr9h5\"" Jun 05 21:10:20.122484 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:20.122439 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jhf8c" Jun 05 21:10:20.245475 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:20.245454 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jhf8c"] Jun 05 21:10:20.248149 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:10:20.248123 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039971b5_5787_49a6_834f_c712bae1967a.slice/crio-be4aa2ad2a34ad5bcb42baf0173d43865f90b2a8f1433b7a0afe722d35120634 WatchSource:0}: Error finding container be4aa2ad2a34ad5bcb42baf0173d43865f90b2a8f1433b7a0afe722d35120634: Status 404 returned error can't find the container with id be4aa2ad2a34ad5bcb42baf0173d43865f90b2a8f1433b7a0afe722d35120634 Jun 05 21:10:20.531998 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:20.531963 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jhf8c" event={"ID":"039971b5-5787-49a6-834f-c712bae1967a","Type":"ContainerStarted","Data":"be4aa2ad2a34ad5bcb42baf0173d43865f90b2a8f1433b7a0afe722d35120634"} Jun 05 21:10:21.461066 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:21.461036 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b456ff697-ghgkw" Jun 05 21:10:24.548029 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:24.547992 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jhf8c" event={"ID":"039971b5-5787-49a6-834f-c712bae1967a","Type":"ContainerStarted","Data":"1721e120334bc4b00e0f14224ac45dc9a899001a2eedd8242fb622fd0b69d9e7"} Jun 05 21:10:24.548435 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:24.548046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jhf8c" event={"ID":"039971b5-5787-49a6-834f-c712bae1967a","Type":"ContainerStarted","Data":"c62fca34ad31de31d1474f6caba11cf39e9ad4db9f09c049ee87c33a01ba8f1d"} Jun 05 21:10:24.548435 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:24.548066 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jhf8c" Jun 05 21:10:24.565785 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:24.565702 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jhf8c" podStartSLOduration=252.151311728 podStartE2EDuration="4m15.565688813s" totalImagesPullingTime="3.414377085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:10:24.564248002 +0000 UTC m=+289.498212951" watchObservedRunningTime="2026-06-05 21:10:24.565688813 +0000 UTC m=+289.499653752" Jun 05 21:10:27.841418 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:27.841376 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:10:27.841923 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:27.841799 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="kube-rbac-proxy-web" containerID="cri-o://1e34d492d5b69aefd3110b9428474f20a6dab9adb79c437808cbbe123b742cf9" gracePeriod=600 Jun 05 21:10:27.841923 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:27.841810 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="thanos-sidecar" containerID="cri-o://b7209384db77279ec9c8dc660cdbe93f1c679b98ffe2b06fa251161b7a33d4bf" gracePeriod=600 Jun 05 21:10:27.841923 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:27.841820 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d6ee968d6de391a6599cd5ea792e6cabff4eb63faa1d78ee18468b2602ac732b" gracePeriod=600 Jun 05 21:10:27.841923 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:27.841829 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="config-reloader" containerID="cri-o://da91dbe36e68ccdb4ee6d6c28617bcb9448bfd8352e688fe0ddd53362ca83fa8" gracePeriod=600 Jun 05 21:10:27.841923 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:27.841771 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="prometheus" containerID="cri-o://f767795930b9ab14c476b6355706e66910f6c69d9abd6a97ab75688313722f87" gracePeriod=600 Jun 05 21:10:27.841923 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:27.841775 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="kube-rbac-proxy" containerID="cri-o://dd9a50ea1b5964a3b1f01fed0c52a959fa2b44c97ef1ddd9647d13694f9c7edc" gracePeriod=600 Jun 05 21:10:28.565251 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:28.565212 2576 generic.go:356] "Generic (PLEG): container finished" podID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerID="d6ee968d6de391a6599cd5ea792e6cabff4eb63faa1d78ee18468b2602ac732b" exitCode=0 Jun 05 21:10:28.565251 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:28.565239 2576 generic.go:356] "Generic (PLEG): container finished" podID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerID="dd9a50ea1b5964a3b1f01fed0c52a959fa2b44c97ef1ddd9647d13694f9c7edc" exitCode=0 Jun 05 21:10:28.565251 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:28.565250 2576 generic.go:356] "Generic (PLEG): container finished" podID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerID="b7209384db77279ec9c8dc660cdbe93f1c679b98ffe2b06fa251161b7a33d4bf" exitCode=0 Jun 05 21:10:28.565251 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:28.565258 2576 generic.go:356] "Generic (PLEG): container finished" podID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerID="da91dbe36e68ccdb4ee6d6c28617bcb9448bfd8352e688fe0ddd53362ca83fa8" exitCode=0 Jun 05 21:10:28.565513 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:28.565269 2576 generic.go:356] "Generic (PLEG): container finished" podID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerID="f767795930b9ab14c476b6355706e66910f6c69d9abd6a97ab75688313722f87" exitCode=0 Jun 05 21:10:28.565513 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:28.565284 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerDied","Data":"d6ee968d6de391a6599cd5ea792e6cabff4eb63faa1d78ee18468b2602ac732b"} Jun 05 21:10:28.565513 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:28.565346 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerDied","Data":"dd9a50ea1b5964a3b1f01fed0c52a959fa2b44c97ef1ddd9647d13694f9c7edc"} Jun 05 21:10:28.565513 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:28.565374 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerDied","Data":"b7209384db77279ec9c8dc660cdbe93f1c679b98ffe2b06fa251161b7a33d4bf"} Jun 05 21:10:28.565513 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:28.565398 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerDied","Data":"da91dbe36e68ccdb4ee6d6c28617bcb9448bfd8352e688fe0ddd53362ca83fa8"} Jun 05 21:10:28.565513 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:28.565423 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerDied","Data":"f767795930b9ab14c476b6355706e66910f6c69d9abd6a97ab75688313722f87"} Jun 05 21:10:29.094954 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.094933 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.247027 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.246936 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lcwp\" (UniqueName: \"kubernetes.io/projected/4bd41770-04f5-4d76-a223-6c3513b2eea0-kube-api-access-9lcwp\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247027 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.246981 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-kubelet-serving-ca-bundle\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247027 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247003 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-grpc-tls\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247027 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247023 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-metrics-client-ca\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247336 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247047 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247336 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247073 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-kube-rbac-proxy\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247336 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247114 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247336 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247145 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-config\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247336 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247169 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-serving-certs-ca-bundle\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247336 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247190 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4bd41770-04f5-4d76-a223-6c3513b2eea0-config-out\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247336 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247226 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-web-config\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247336 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247257 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-thanos-prometheus-http-client-file\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247336 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247291 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-db\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247336 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247313 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4bd41770-04f5-4d76-a223-6c3513b2eea0-tls-assets\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247828 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247353 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-metrics-client-certs\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247828 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247386 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-tls\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247828 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247411 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-trusted-ca-bundle\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247828 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247452 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-2\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247828 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247495 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-1\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247828 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247520 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-0\") pod \"4bd41770-04f5-4d76-a223-6c3513b2eea0\" (UID: \"4bd41770-04f5-4d76-a223-6c3513b2eea0\") " Jun 05 21:10:29.247828 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247526 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:10:29.247828 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247567 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:10:29.247828 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247812 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.247828 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.247832 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-metrics-client-ca\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.248354 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.248218 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:10:29.248526 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.248500 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:10:29.248950 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.248910 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:10:29.249634 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.249582 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:10:29.250254 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.249999 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:10:29.250790 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.250743 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd41770-04f5-4d76-a223-6c3513b2eea0-kube-api-access-9lcwp" (OuterVolumeSpecName: "kube-api-access-9lcwp") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "kube-api-access-9lcwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:10:29.250917 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.250894 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:10:29.251283 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.251250 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:10:29.251283 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.251261 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:10:29.251544 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.251509 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:10:29.251652 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.251630 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:10:29.251716 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.251648 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd41770-04f5-4d76-a223-6c3513b2eea0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:10:29.252100 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.252078 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-config" (OuterVolumeSpecName: "config") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:10:29.252462 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.252440 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:10:29.252552 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.252475 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:10:29.252686 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.252662 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:10:29.253244 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.253224 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bd41770-04f5-4d76-a223-6c3513b2eea0-config-out" (OuterVolumeSpecName: "config-out") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:10:29.261834 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.261814 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-web-config" (OuterVolumeSpecName: "web-config") pod "4bd41770-04f5-4d76-a223-6c3513b2eea0" (UID: "4bd41770-04f5-4d76-a223-6c3513b2eea0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:10:29.348225 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348183 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348225 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348224 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348238 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348253 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lcwp\" (UniqueName: \"kubernetes.io/projected/4bd41770-04f5-4d76-a223-6c3513b2eea0-kube-api-access-9lcwp\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348266 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-grpc-tls\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348279 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348292 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-kube-rbac-proxy\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348304 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348316 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-config\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348328 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348341 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4bd41770-04f5-4d76-a223-6c3513b2eea0-config-out\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348380 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-web-config\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348392 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348405 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-k8s-db\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348417 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4bd41770-04f5-4d76-a223-6c3513b2eea0-tls-assets\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348430 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-metrics-client-certs\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348444 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4bd41770-04f5-4d76-a223-6c3513b2eea0-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.348470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.348457 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bd41770-04f5-4d76-a223-6c3513b2eea0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:29.571796 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.571763 2576 generic.go:356] "Generic (PLEG): container finished" podID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerID="1e34d492d5b69aefd3110b9428474f20a6dab9adb79c437808cbbe123b742cf9" exitCode=0 Jun 05 21:10:29.571921 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.571801 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerDied","Data":"1e34d492d5b69aefd3110b9428474f20a6dab9adb79c437808cbbe123b742cf9"} Jun 05 21:10:29.571921 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.571836 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.571921 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.571858 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bd41770-04f5-4d76-a223-6c3513b2eea0","Type":"ContainerDied","Data":"af5fe0ff496cbe9a25e690a38b509bf4313414e25cbb6441510fb20603f0306f"} Jun 05 21:10:29.571921 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.571893 2576 scope.go:117] "RemoveContainer" containerID="d6ee968d6de391a6599cd5ea792e6cabff4eb63faa1d78ee18468b2602ac732b" Jun 05 21:10:29.579664 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.579647 2576 scope.go:117] "RemoveContainer" containerID="dd9a50ea1b5964a3b1f01fed0c52a959fa2b44c97ef1ddd9647d13694f9c7edc" Jun 05 21:10:29.588776 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.588756 2576 scope.go:117] "RemoveContainer" containerID="1e34d492d5b69aefd3110b9428474f20a6dab9adb79c437808cbbe123b742cf9" Jun 05 21:10:29.591783 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.591751 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:10:29.596207 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.596191 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:10:29.596267 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.596243 2576 scope.go:117] "RemoveContainer" containerID="b7209384db77279ec9c8dc660cdbe93f1c679b98ffe2b06fa251161b7a33d4bf" Jun 05 21:10:29.603061 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.603044 2576 scope.go:117] "RemoveContainer" containerID="da91dbe36e68ccdb4ee6d6c28617bcb9448bfd8352e688fe0ddd53362ca83fa8" Jun 05 21:10:29.609960 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.609940 2576 scope.go:117] "RemoveContainer" containerID="f767795930b9ab14c476b6355706e66910f6c69d9abd6a97ab75688313722f87" Jun 05 21:10:29.617402 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.617387 2576 scope.go:117] "RemoveContainer" containerID="5f0b2557833e7df485205c859d239c333cf12608abce2085df2ccdb2552845f0" Jun 05 21:10:29.618173 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618152 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:10:29.618390 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618379 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="kube-rbac-proxy" Jun 05 21:10:29.618428 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618391 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="kube-rbac-proxy" Jun 05 21:10:29.618428 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618405 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="config-reloader" Jun 05 21:10:29.618428 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618410 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="config-reloader" Jun 05 21:10:29.618428 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618417 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="thanos-sidecar" Jun 05 21:10:29.618428 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618422 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="thanos-sidecar" Jun 05 21:10:29.618563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618432 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="kube-rbac-proxy-thanos" Jun 05 21:10:29.618563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618437 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="kube-rbac-proxy-thanos" Jun 05 21:10:29.618563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618444 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="kube-rbac-proxy-web" Jun 05 21:10:29.618563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618449 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="kube-rbac-proxy-web" Jun 05 21:10:29.618563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618458 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="init-config-reloader" Jun 05 21:10:29.618563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618463 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="init-config-reloader" Jun 05 21:10:29.618563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618468 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="prometheus" Jun 05 21:10:29.618563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618473 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="prometheus" Jun 05 21:10:29.618563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618514 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="prometheus" Jun 05 21:10:29.618563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618521 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="kube-rbac-proxy-web" Jun 05 21:10:29.618563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618527 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="config-reloader" Jun 05 21:10:29.618563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618533 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="kube-rbac-proxy-thanos" Jun 05 21:10:29.618563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618542 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="thanos-sidecar" Jun 05 21:10:29.618563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.618549 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" containerName="kube-rbac-proxy" Jun 05 21:10:29.623359 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.623343 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.623951 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.623933 2576 scope.go:117] "RemoveContainer" containerID="d6ee968d6de391a6599cd5ea792e6cabff4eb63faa1d78ee18468b2602ac732b" Jun 05 21:10:29.624218 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:10:29.624194 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6ee968d6de391a6599cd5ea792e6cabff4eb63faa1d78ee18468b2602ac732b\": container with ID starting with d6ee968d6de391a6599cd5ea792e6cabff4eb63faa1d78ee18468b2602ac732b not found: ID does not exist" containerID="d6ee968d6de391a6599cd5ea792e6cabff4eb63faa1d78ee18468b2602ac732b" Jun 05 21:10:29.624263 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.624226 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6ee968d6de391a6599cd5ea792e6cabff4eb63faa1d78ee18468b2602ac732b"} err="failed to get container status \"d6ee968d6de391a6599cd5ea792e6cabff4eb63faa1d78ee18468b2602ac732b\": rpc error: code = NotFound desc = could not find container \"d6ee968d6de391a6599cd5ea792e6cabff4eb63faa1d78ee18468b2602ac732b\": container with ID starting with d6ee968d6de391a6599cd5ea792e6cabff4eb63faa1d78ee18468b2602ac732b not found: ID does not exist" Jun 05 21:10:29.624263 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.624242 2576 scope.go:117] "RemoveContainer" containerID="dd9a50ea1b5964a3b1f01fed0c52a959fa2b44c97ef1ddd9647d13694f9c7edc" Jun 05 21:10:29.624503 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:10:29.624483 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd9a50ea1b5964a3b1f01fed0c52a959fa2b44c97ef1ddd9647d13694f9c7edc\": container with ID starting with dd9a50ea1b5964a3b1f01fed0c52a959fa2b44c97ef1ddd9647d13694f9c7edc not found: ID does not exist" containerID="dd9a50ea1b5964a3b1f01fed0c52a959fa2b44c97ef1ddd9647d13694f9c7edc" Jun 05 21:10:29.624552 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.624508 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd9a50ea1b5964a3b1f01fed0c52a959fa2b44c97ef1ddd9647d13694f9c7edc"} err="failed to get container status \"dd9a50ea1b5964a3b1f01fed0c52a959fa2b44c97ef1ddd9647d13694f9c7edc\": rpc error: code = NotFound desc = could not find container \"dd9a50ea1b5964a3b1f01fed0c52a959fa2b44c97ef1ddd9647d13694f9c7edc\": container with ID starting with dd9a50ea1b5964a3b1f01fed0c52a959fa2b44c97ef1ddd9647d13694f9c7edc not found: ID does not exist" Jun 05 21:10:29.624552 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.624523 2576 scope.go:117] "RemoveContainer" containerID="1e34d492d5b69aefd3110b9428474f20a6dab9adb79c437808cbbe123b742cf9" Jun 05 21:10:29.624721 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:10:29.624705 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e34d492d5b69aefd3110b9428474f20a6dab9adb79c437808cbbe123b742cf9\": container with ID starting with 1e34d492d5b69aefd3110b9428474f20a6dab9adb79c437808cbbe123b742cf9 not found: ID does not exist" containerID="1e34d492d5b69aefd3110b9428474f20a6dab9adb79c437808cbbe123b742cf9" Jun 05 21:10:29.624773 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.624747 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e34d492d5b69aefd3110b9428474f20a6dab9adb79c437808cbbe123b742cf9"} err="failed to get container status \"1e34d492d5b69aefd3110b9428474f20a6dab9adb79c437808cbbe123b742cf9\": rpc error: code = NotFound desc = could not find container \"1e34d492d5b69aefd3110b9428474f20a6dab9adb79c437808cbbe123b742cf9\": container with ID starting with 1e34d492d5b69aefd3110b9428474f20a6dab9adb79c437808cbbe123b742cf9 not found: ID does not exist" Jun 05 21:10:29.624773 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.624767 2576 scope.go:117] "RemoveContainer" containerID="b7209384db77279ec9c8dc660cdbe93f1c679b98ffe2b06fa251161b7a33d4bf" Jun 05 21:10:29.625021 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:10:29.625004 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7209384db77279ec9c8dc660cdbe93f1c679b98ffe2b06fa251161b7a33d4bf\": container with ID starting with b7209384db77279ec9c8dc660cdbe93f1c679b98ffe2b06fa251161b7a33d4bf not found: ID does not exist" containerID="b7209384db77279ec9c8dc660cdbe93f1c679b98ffe2b06fa251161b7a33d4bf" Jun 05 21:10:29.625091 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.625025 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7209384db77279ec9c8dc660cdbe93f1c679b98ffe2b06fa251161b7a33d4bf"} err="failed to get container status \"b7209384db77279ec9c8dc660cdbe93f1c679b98ffe2b06fa251161b7a33d4bf\": rpc error: code = NotFound desc = could not find container \"b7209384db77279ec9c8dc660cdbe93f1c679b98ffe2b06fa251161b7a33d4bf\": container with ID starting with b7209384db77279ec9c8dc660cdbe93f1c679b98ffe2b06fa251161b7a33d4bf not found: ID does not exist" Jun 05 21:10:29.625091 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.625040 2576 scope.go:117] "RemoveContainer" containerID="da91dbe36e68ccdb4ee6d6c28617bcb9448bfd8352e688fe0ddd53362ca83fa8" Jun 05 21:10:29.625294 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:10:29.625272 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da91dbe36e68ccdb4ee6d6c28617bcb9448bfd8352e688fe0ddd53362ca83fa8\": container with ID starting with da91dbe36e68ccdb4ee6d6c28617bcb9448bfd8352e688fe0ddd53362ca83fa8 not found: ID does not exist" containerID="da91dbe36e68ccdb4ee6d6c28617bcb9448bfd8352e688fe0ddd53362ca83fa8" Jun 05 21:10:29.625364 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.625298 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da91dbe36e68ccdb4ee6d6c28617bcb9448bfd8352e688fe0ddd53362ca83fa8"} err="failed to get container status \"da91dbe36e68ccdb4ee6d6c28617bcb9448bfd8352e688fe0ddd53362ca83fa8\": rpc error: code = NotFound desc = could not find container \"da91dbe36e68ccdb4ee6d6c28617bcb9448bfd8352e688fe0ddd53362ca83fa8\": container with ID starting with da91dbe36e68ccdb4ee6d6c28617bcb9448bfd8352e688fe0ddd53362ca83fa8 not found: ID does not exist" Jun 05 21:10:29.625364 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.625318 2576 scope.go:117] "RemoveContainer" containerID="f767795930b9ab14c476b6355706e66910f6c69d9abd6a97ab75688313722f87" Jun 05 21:10:29.625591 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:10:29.625565 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f767795930b9ab14c476b6355706e66910f6c69d9abd6a97ab75688313722f87\": container with ID starting with f767795930b9ab14c476b6355706e66910f6c69d9abd6a97ab75688313722f87 not found: ID does not exist" containerID="f767795930b9ab14c476b6355706e66910f6c69d9abd6a97ab75688313722f87" Jun 05 21:10:29.625680 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.625597 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f767795930b9ab14c476b6355706e66910f6c69d9abd6a97ab75688313722f87"} err="failed to get container status \"f767795930b9ab14c476b6355706e66910f6c69d9abd6a97ab75688313722f87\": rpc error: code = NotFound desc = could not find container \"f767795930b9ab14c476b6355706e66910f6c69d9abd6a97ab75688313722f87\": container with ID starting with f767795930b9ab14c476b6355706e66910f6c69d9abd6a97ab75688313722f87 not found: ID does not exist" Jun 05 21:10:29.625680 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.625619 2576 scope.go:117] "RemoveContainer" containerID="5f0b2557833e7df485205c859d239c333cf12608abce2085df2ccdb2552845f0" Jun 05 21:10:29.625897 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:10:29.625876 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f0b2557833e7df485205c859d239c333cf12608abce2085df2ccdb2552845f0\": container with ID starting with 5f0b2557833e7df485205c859d239c333cf12608abce2085df2ccdb2552845f0 not found: ID does not exist" containerID="5f0b2557833e7df485205c859d239c333cf12608abce2085df2ccdb2552845f0" Jun 05 21:10:29.625995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.625934 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 21:10:29.625995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.625940 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0b2557833e7df485205c859d239c333cf12608abce2085df2ccdb2552845f0"} err="failed to get container status \"5f0b2557833e7df485205c859d239c333cf12608abce2085df2ccdb2552845f0\": rpc error: code = NotFound desc = could not find container \"5f0b2557833e7df485205c859d239c333cf12608abce2085df2ccdb2552845f0\": container with ID starting with 5f0b2557833e7df485205c859d239c333cf12608abce2085df2ccdb2552845f0 not found: ID does not exist" Jun 05 21:10:29.626099 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.625990 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 21:10:29.626408 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.626389 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 21:10:29.626481 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.626420 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 21:10:29.626481 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.626450 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 21:10:29.626562 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.626452 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 21:10:29.626562 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.626454 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 21:10:29.626688 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.626671 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7mik4v29s8fp3\"" Jun 05 21:10:29.626753 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.626679 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 21:10:29.626795 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.626765 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 21:10:29.626983 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.626969 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 21:10:29.627299 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.627282 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kbvdw\"" Jun 05 21:10:29.627299 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.627293 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 21:10:29.627451 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.627301 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 21:10:29.627451 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.627361 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 21:10:29.632764 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.631751 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 21:10:29.635122 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.634631 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 21:10:29.638630 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.638612 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:10:29.750928 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.750900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d07be5c-f930-41ce-b2a5-ec9c79804a25-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751066 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.750936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d07be5c-f930-41ce-b2a5-ec9c79804a25-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751066 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.750961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751066 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751030 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-config\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751066 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751256 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751256 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t74tc\" (UniqueName: \"kubernetes.io/projected/2d07be5c-f930-41ce-b2a5-ec9c79804a25-kube-api-access-t74tc\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751256 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751256 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751435 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751435 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751435 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751435 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751435 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751435 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751391 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751453 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.751635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.751580 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852223 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852223 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852223 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852440 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852226 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852440 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852440 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852440 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852632 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d07be5c-f930-41ce-b2a5-ec9c79804a25-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852632 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d07be5c-f930-41ce-b2a5-ec9c79804a25-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852632 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852632 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-config\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852632 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852885 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852885 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t74tc\" (UniqueName: \"kubernetes.io/projected/2d07be5c-f930-41ce-b2a5-ec9c79804a25-kube-api-access-t74tc\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852885 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852885 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852749 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852885 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852885 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852885 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.852885 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.853270 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.852968 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.853321 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.853286 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.853462 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.853436 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.853532 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.853483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.853995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.853969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.854723 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.854698 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.854838 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.854719 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.855647 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.855602 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.856176 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.856152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d07be5c-f930-41ce-b2a5-ec9c79804a25-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.856273 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.856229 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.856898 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.856443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.856898 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.856847 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d07be5c-f930-41ce-b2a5-ec9c79804a25-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.857059 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.856982 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.857140 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.857115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.857593 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.857572 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.857707 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.857693 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.857949 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.857928 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d07be5c-f930-41ce-b2a5-ec9c79804a25-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.858249 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.858231 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.858317 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.858254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d07be5c-f930-41ce-b2a5-ec9c79804a25-config\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.860529 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.860511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t74tc\" (UniqueName: \"kubernetes.io/projected/2d07be5c-f930-41ce-b2a5-ec9c79804a25-kube-api-access-t74tc\") pod \"prometheus-k8s-0\" (UID: \"2d07be5c-f930-41ce-b2a5-ec9c79804a25\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:29.938476 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:29.938450 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:30.076195 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:30.076167 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:10:30.079310 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:10:30.079285 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d07be5c_f930_41ce_b2a5_ec9c79804a25.slice/crio-070b94a6c6b9001b31dd66770f293dfb1192a697c12283f80ab6f9f4b7a304f5 WatchSource:0}: Error finding container 070b94a6c6b9001b31dd66770f293dfb1192a697c12283f80ab6f9f4b7a304f5: Status 404 returned error can't find the container with id 070b94a6c6b9001b31dd66770f293dfb1192a697c12283f80ab6f9f4b7a304f5 Jun 05 21:10:30.576412 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:30.576380 2576 generic.go:356] "Generic (PLEG): container finished" podID="2d07be5c-f930-41ce-b2a5-ec9c79804a25" containerID="e114ab36e50cecdaf1bb85466043eaaf774ef25c2d66b884737136faa2e1a93e" exitCode=0 Jun 05 21:10:30.576848 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:30.576470 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d07be5c-f930-41ce-b2a5-ec9c79804a25","Type":"ContainerDied","Data":"e114ab36e50cecdaf1bb85466043eaaf774ef25c2d66b884737136faa2e1a93e"} Jun 05 21:10:30.576848 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:30.576550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d07be5c-f930-41ce-b2a5-ec9c79804a25","Type":"ContainerStarted","Data":"070b94a6c6b9001b31dd66770f293dfb1192a697c12283f80ab6f9f4b7a304f5"} Jun 05 21:10:31.520565 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:31.520532 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bd41770-04f5-4d76-a223-6c3513b2eea0" path="/var/lib/kubelet/pods/4bd41770-04f5-4d76-a223-6c3513b2eea0/volumes" Jun 05 21:10:31.583453 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:31.583428 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d07be5c-f930-41ce-b2a5-ec9c79804a25","Type":"ContainerStarted","Data":"3d278e4b8f2fdaaa8e2d9696d3a13b93eaa09265d62d80067211fc90ad8c3cbe"} Jun 05 21:10:31.583842 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:31.583484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d07be5c-f930-41ce-b2a5-ec9c79804a25","Type":"ContainerStarted","Data":"8630b3a84a88d87aecec55c8715a34f1e0dfe5ffd86f7517eb10f0191c6f9009"} Jun 05 21:10:31.583842 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:31.583512 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d07be5c-f930-41ce-b2a5-ec9c79804a25","Type":"ContainerStarted","Data":"6f9d4a93f71a373018cdb099364e61d07e1a28cc7f1c2f0425b27665d5da9f5c"} Jun 05 21:10:31.583842 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:31.583536 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d07be5c-f930-41ce-b2a5-ec9c79804a25","Type":"ContainerStarted","Data":"51ca7c1201b4afb9c7d04389a336f7cd3600e78bc6818f04a3c693539690e8c1"} Jun 05 21:10:31.583842 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:31.583565 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d07be5c-f930-41ce-b2a5-ec9c79804a25","Type":"ContainerStarted","Data":"d13c8784add071d745a06bd5b4810f7dc2e818f28c2a074831691e38109feca1"} Jun 05 21:10:31.583842 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:31.583593 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d07be5c-f930-41ce-b2a5-ec9c79804a25","Type":"ContainerStarted","Data":"bbd366ce415185fa88a3b30b112e45200c99680f665df5a7e67c59fb881e8340"} Jun 05 21:10:31.615218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:31.615163 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.597597876 podStartE2EDuration="2.615144229s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.546353ms" isStatefulPod=false podCreationTimestamp="2026-06-05 21:10:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:10:31.612027884 +0000 UTC m=+296.545992823" watchObservedRunningTime="2026-06-05 21:10:31.615144229 +0000 UTC m=+296.549109167" Jun 05 21:10:34.554415 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:34.554387 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jhf8c" Jun 05 21:10:34.939180 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:34.939147 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:10:35.474996 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:35.474974 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcd2w_4420e080-d4f9-43a5-bbbe-6d869c60f720/ovn-acl-logging/0.log" Jun 05 21:10:35.476206 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:35.476182 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcd2w_4420e080-d4f9-43a5-bbbe-6d869c60f720/ovn-acl-logging/0.log" Jun 05 21:10:35.480908 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:35.480893 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 21:10:36.995575 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:36.995517 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5bd868765-4jk7q" podUID="1594066d-4f34-46e4-a92a-9f2bd77069aa" containerName="console" containerID="cri-o://b9a6ba03760edf3ceb1835db604ec190927be31f70d59b38e003b1edb6d68980" gracePeriod=15 Jun 05 21:10:37.236959 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.236930 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:10:37.411208 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.411178 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-config\") pod \"1594066d-4f34-46e4-a92a-9f2bd77069aa\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " Jun 05 21:10:37.411393 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.411221 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-oauth-config\") pod \"1594066d-4f34-46e4-a92a-9f2bd77069aa\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " Jun 05 21:10:37.411393 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.411254 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-oauth-serving-cert\") pod \"1594066d-4f34-46e4-a92a-9f2bd77069aa\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " Jun 05 21:10:37.411393 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.411314 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-serving-cert\") pod \"1594066d-4f34-46e4-a92a-9f2bd77069aa\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " Jun 05 21:10:37.411393 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.411333 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh5kp\" (UniqueName: \"kubernetes.io/projected/1594066d-4f34-46e4-a92a-9f2bd77069aa-kube-api-access-gh5kp\") pod \"1594066d-4f34-46e4-a92a-9f2bd77069aa\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " Jun 05 21:10:37.411393 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.411387 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-service-ca\") pod \"1594066d-4f34-46e4-a92a-9f2bd77069aa\" (UID: \"1594066d-4f34-46e4-a92a-9f2bd77069aa\") " Jun 05 21:10:37.411767 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.411711 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1594066d-4f34-46e4-a92a-9f2bd77069aa" (UID: "1594066d-4f34-46e4-a92a-9f2bd77069aa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:10:37.411860 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.411789 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-config" (OuterVolumeSpecName: "console-config") pod "1594066d-4f34-46e4-a92a-9f2bd77069aa" (UID: "1594066d-4f34-46e4-a92a-9f2bd77069aa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:10:37.411860 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.411837 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-service-ca" (OuterVolumeSpecName: "service-ca") pod "1594066d-4f34-46e4-a92a-9f2bd77069aa" (UID: "1594066d-4f34-46e4-a92a-9f2bd77069aa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:10:37.413550 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.413521 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1594066d-4f34-46e4-a92a-9f2bd77069aa-kube-api-access-gh5kp" (OuterVolumeSpecName: "kube-api-access-gh5kp") pod "1594066d-4f34-46e4-a92a-9f2bd77069aa" (UID: "1594066d-4f34-46e4-a92a-9f2bd77069aa"). InnerVolumeSpecName "kube-api-access-gh5kp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:10:37.413652 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.413562 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1594066d-4f34-46e4-a92a-9f2bd77069aa" (UID: "1594066d-4f34-46e4-a92a-9f2bd77069aa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:10:37.413652 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.413603 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1594066d-4f34-46e4-a92a-9f2bd77069aa" (UID: "1594066d-4f34-46e4-a92a-9f2bd77069aa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:10:37.512320 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.512282 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-serving-cert\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:37.512320 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.512313 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh5kp\" (UniqueName: \"kubernetes.io/projected/1594066d-4f34-46e4-a92a-9f2bd77069aa-kube-api-access-gh5kp\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:37.512320 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.512325 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-service-ca\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:37.512586 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.512333 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-config\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:37.512586 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.512343 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1594066d-4f34-46e4-a92a-9f2bd77069aa-console-oauth-config\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:37.512586 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.512351 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1594066d-4f34-46e4-a92a-9f2bd77069aa-oauth-serving-cert\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:10:37.609071 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.609035 2576 generic.go:356] "Generic (PLEG): container finished" podID="1594066d-4f34-46e4-a92a-9f2bd77069aa" containerID="b9a6ba03760edf3ceb1835db604ec190927be31f70d59b38e003b1edb6d68980" exitCode=0 Jun 05 21:10:37.609218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.609081 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd868765-4jk7q" event={"ID":"1594066d-4f34-46e4-a92a-9f2bd77069aa","Type":"ContainerDied","Data":"b9a6ba03760edf3ceb1835db604ec190927be31f70d59b38e003b1edb6d68980"} Jun 05 21:10:37.609218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.609090 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd868765-4jk7q" Jun 05 21:10:37.609218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.609126 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd868765-4jk7q" event={"ID":"1594066d-4f34-46e4-a92a-9f2bd77069aa","Type":"ContainerDied","Data":"08df33fdc04906548bf7772b555b4076987b16cbfbc09736ad1827c57aca5919"} Jun 05 21:10:37.609218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.609148 2576 scope.go:117] "RemoveContainer" containerID="b9a6ba03760edf3ceb1835db604ec190927be31f70d59b38e003b1edb6d68980" Jun 05 21:10:37.617080 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.617061 2576 scope.go:117] "RemoveContainer" containerID="b9a6ba03760edf3ceb1835db604ec190927be31f70d59b38e003b1edb6d68980" Jun 05 21:10:37.617339 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:10:37.617314 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9a6ba03760edf3ceb1835db604ec190927be31f70d59b38e003b1edb6d68980\": container with ID starting with b9a6ba03760edf3ceb1835db604ec190927be31f70d59b38e003b1edb6d68980 not found: ID does not exist" containerID="b9a6ba03760edf3ceb1835db604ec190927be31f70d59b38e003b1edb6d68980" Jun 05 21:10:37.617378 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.617348 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9a6ba03760edf3ceb1835db604ec190927be31f70d59b38e003b1edb6d68980"} err="failed to get container status \"b9a6ba03760edf3ceb1835db604ec190927be31f70d59b38e003b1edb6d68980\": rpc error: code = NotFound desc = could not find container \"b9a6ba03760edf3ceb1835db604ec190927be31f70d59b38e003b1edb6d68980\": container with ID starting with b9a6ba03760edf3ceb1835db604ec190927be31f70d59b38e003b1edb6d68980 not found: ID does not exist" Jun 05 21:10:37.625508 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.625487 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bd868765-4jk7q"] Jun 05 21:10:37.628636 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:37.628616 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bd868765-4jk7q"] Jun 05 21:10:39.519942 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:10:39.519903 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1594066d-4f34-46e4-a92a-9f2bd77069aa" path="/var/lib/kubelet/pods/1594066d-4f34-46e4-a92a-9f2bd77069aa/volumes" Jun 05 21:11:29.939367 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:11:29.939266 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:11:29.954614 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:11:29.954580 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:11:30.820773 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:11:30.820746 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:13:43.983364 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:43.983324 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77f48f848-4p86l"] Jun 05 21:13:43.984038 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:43.983651 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1594066d-4f34-46e4-a92a-9f2bd77069aa" containerName="console" Jun 05 21:13:43.984038 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:43.983663 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1594066d-4f34-46e4-a92a-9f2bd77069aa" containerName="console" Jun 05 21:13:43.984038 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:43.983712 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1594066d-4f34-46e4-a92a-9f2bd77069aa" containerName="console" Jun 05 21:13:43.986650 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:43.986632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:43.990557 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:43.990412 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:13:43.990557 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:43.990427 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 05 21:13:43.990557 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:43.990466 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 05 21:13:43.990557 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:43.990481 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-24s78\"" Jun 05 21:13:43.990557 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:43.990432 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 05 21:13:43.990557 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:43.990526 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 21:13:43.997660 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:43.997638 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77f48f848-4p86l"] Jun 05 21:13:44.102800 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.102767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx9rd\" (UniqueName: \"kubernetes.io/projected/4524a924-f1a7-4c33-a041-517568c1e3f7-kube-api-access-wx9rd\") pod \"lws-controller-manager-77f48f848-4p86l\" (UID: \"4524a924-f1a7-4c33-a041-517568c1e3f7\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:44.102986 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.102813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4524a924-f1a7-4c33-a041-517568c1e3f7-cert\") pod \"lws-controller-manager-77f48f848-4p86l\" (UID: \"4524a924-f1a7-4c33-a041-517568c1e3f7\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:44.102986 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.102849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4524a924-f1a7-4c33-a041-517568c1e3f7-manager-config\") pod \"lws-controller-manager-77f48f848-4p86l\" (UID: \"4524a924-f1a7-4c33-a041-517568c1e3f7\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:44.102986 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.102898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4524a924-f1a7-4c33-a041-517568c1e3f7-metrics-cert\") pod \"lws-controller-manager-77f48f848-4p86l\" (UID: \"4524a924-f1a7-4c33-a041-517568c1e3f7\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:44.204061 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.204018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx9rd\" (UniqueName: \"kubernetes.io/projected/4524a924-f1a7-4c33-a041-517568c1e3f7-kube-api-access-wx9rd\") pod \"lws-controller-manager-77f48f848-4p86l\" (UID: \"4524a924-f1a7-4c33-a041-517568c1e3f7\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:44.204252 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.204071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4524a924-f1a7-4c33-a041-517568c1e3f7-cert\") pod \"lws-controller-manager-77f48f848-4p86l\" (UID: \"4524a924-f1a7-4c33-a041-517568c1e3f7\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:44.204252 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.204114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4524a924-f1a7-4c33-a041-517568c1e3f7-manager-config\") pod \"lws-controller-manager-77f48f848-4p86l\" (UID: \"4524a924-f1a7-4c33-a041-517568c1e3f7\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:44.204252 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.204137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4524a924-f1a7-4c33-a041-517568c1e3f7-metrics-cert\") pod \"lws-controller-manager-77f48f848-4p86l\" (UID: \"4524a924-f1a7-4c33-a041-517568c1e3f7\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:44.204829 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.204809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4524a924-f1a7-4c33-a041-517568c1e3f7-manager-config\") pod \"lws-controller-manager-77f48f848-4p86l\" (UID: \"4524a924-f1a7-4c33-a041-517568c1e3f7\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:44.206600 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.206578 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4524a924-f1a7-4c33-a041-517568c1e3f7-cert\") pod \"lws-controller-manager-77f48f848-4p86l\" (UID: \"4524a924-f1a7-4c33-a041-517568c1e3f7\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:44.206690 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.206645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4524a924-f1a7-4c33-a041-517568c1e3f7-metrics-cert\") pod \"lws-controller-manager-77f48f848-4p86l\" (UID: \"4524a924-f1a7-4c33-a041-517568c1e3f7\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:44.212533 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.212505 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx9rd\" (UniqueName: \"kubernetes.io/projected/4524a924-f1a7-4c33-a041-517568c1e3f7-kube-api-access-wx9rd\") pod \"lws-controller-manager-77f48f848-4p86l\" (UID: \"4524a924-f1a7-4c33-a041-517568c1e3f7\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:44.297564 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.297481 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:44.422470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.422318 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77f48f848-4p86l"] Jun 05 21:13:44.425143 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:13:44.425113 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4524a924_f1a7_4c33_a041_517568c1e3f7.slice/crio-d6bd32360039ed0a70e64d8611567c519d19e86d941c326e069a02bb86365f8b WatchSource:0}: Error finding container d6bd32360039ed0a70e64d8611567c519d19e86d941c326e069a02bb86365f8b: Status 404 returned error can't find the container with id d6bd32360039ed0a70e64d8611567c519d19e86d941c326e069a02bb86365f8b Jun 05 21:13:44.427044 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:44.427031 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:13:45.292443 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:45.292399 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" event={"ID":"4524a924-f1a7-4c33-a041-517568c1e3f7","Type":"ContainerStarted","Data":"d6bd32360039ed0a70e64d8611567c519d19e86d941c326e069a02bb86365f8b"} Jun 05 21:13:47.301332 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:47.301280 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" event={"ID":"4524a924-f1a7-4c33-a041-517568c1e3f7","Type":"ContainerStarted","Data":"429d468968a11abdcdad7d3fae4e35cf5ea9c18ead5e4c5320ffe4017153a1d2"} Jun 05 21:13:47.301710 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:47.301382 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:47.318084 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:47.318033 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" podStartSLOduration=2.094739728 podStartE2EDuration="4.318016781s" totalImagesPullingTime="2.223277053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:13:47.317264375 +0000 UTC m=+492.251229314" watchObservedRunningTime="2026-06-05 21:13:47.318016781 +0000 UTC m=+492.251981783" Jun 05 21:13:54.429660 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.429598 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p"] Jun 05 21:13:54.434261 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.434234 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.437157 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.437137 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 21:13:54.437285 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.437146 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 21:13:54.437372 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.437358 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bmwlw\"" Jun 05 21:13:54.437615 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.437598 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 21:13:54.437700 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.437632 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 21:13:54.454525 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.454499 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p"] Jun 05 21:13:54.471658 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.471634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a5773295-c6ce-4244-849a-02b383fc095d-manifests\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.471775 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.471673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rdhn\" (UniqueName: \"kubernetes.io/projected/a5773295-c6ce-4244-849a-02b383fc095d-kube-api-access-4rdhn\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.471775 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.471692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a5773295-c6ce-4244-849a-02b383fc095d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.471775 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.471715 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5773295-c6ce-4244-849a-02b383fc095d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.471775 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.471769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5773295-c6ce-4244-849a-02b383fc095d-tmp\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.572452 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.572413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5773295-c6ce-4244-849a-02b383fc095d-tmp\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.572640 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.572495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a5773295-c6ce-4244-849a-02b383fc095d-manifests\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.572640 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.572544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rdhn\" (UniqueName: \"kubernetes.io/projected/a5773295-c6ce-4244-849a-02b383fc095d-kube-api-access-4rdhn\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.572640 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.572574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a5773295-c6ce-4244-849a-02b383fc095d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.572640 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.572626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5773295-c6ce-4244-849a-02b383fc095d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.572984 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.572964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a5773295-c6ce-4244-849a-02b383fc095d-manifests\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.574951 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.574928 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5773295-c6ce-4244-849a-02b383fc095d-tmp\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.575009 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.574996 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a5773295-c6ce-4244-849a-02b383fc095d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.575049 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.575032 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5773295-c6ce-4244-849a-02b383fc095d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.584414 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.584384 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rdhn\" (UniqueName: \"kubernetes.io/projected/a5773295-c6ce-4244-849a-02b383fc095d-kube-api-access-4rdhn\") pod \"opendatahub-operator-controller-manager-5b79b9d749-tf49p\" (UID: \"a5773295-c6ce-4244-849a-02b383fc095d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.744924 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.744822 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:13:54.876108 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:54.876070 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p"] Jun 05 21:13:54.879831 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:13:54.879801 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5773295_c6ce_4244_849a_02b383fc095d.slice/crio-acb87c9ab938f553b16e1fe0c233216aa28e228552ae5948d2a7a893e955bb00 WatchSource:0}: Error finding container acb87c9ab938f553b16e1fe0c233216aa28e228552ae5948d2a7a893e955bb00: Status 404 returned error can't find the container with id acb87c9ab938f553b16e1fe0c233216aa28e228552ae5948d2a7a893e955bb00 Jun 05 21:13:55.331411 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:55.331374 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" event={"ID":"a5773295-c6ce-4244-849a-02b383fc095d","Type":"ContainerStarted","Data":"acb87c9ab938f553b16e1fe0c233216aa28e228552ae5948d2a7a893e955bb00"} Jun 05 21:13:58.307143 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:58.307103 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77f48f848-4p86l" Jun 05 21:13:58.350565 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:58.350525 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" event={"ID":"a5773295-c6ce-4244-849a-02b383fc095d","Type":"ContainerStarted","Data":"da8af45795d277707dae65b6c9dfe8d4265059a6a73feb55fa546c1c987fce10"} Jun 05 21:13:59.360032 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:59.359995 2576 generic.go:356] "Generic (PLEG): container finished" podID="a5773295-c6ce-4244-849a-02b383fc095d" containerID="da8af45795d277707dae65b6c9dfe8d4265059a6a73feb55fa546c1c987fce10" exitCode=0 Jun 05 21:13:59.360476 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:13:59.360087 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" event={"ID":"a5773295-c6ce-4244-849a-02b383fc095d","Type":"ContainerDied","Data":"da8af45795d277707dae65b6c9dfe8d4265059a6a73feb55fa546c1c987fce10"} Jun 05 21:14:00.365921 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:00.365890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" event={"ID":"a5773295-c6ce-4244-849a-02b383fc095d","Type":"ContainerStarted","Data":"1a5ee13a411683fc2ba9b96b0175d5aea65898bd04dc2f58c9c7c5357c2e95e1"} Jun 05 21:14:00.366296 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:00.366017 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:14:00.389128 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:00.389079 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" podStartSLOduration=2.126543475 podStartE2EDuration="6.389063007s" totalImagesPullingTime="3.205215064s" totalInitContainerRuntime="1.057304468s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:13:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:14:00.387846477 +0000 UTC m=+505.321811418" watchObservedRunningTime="2026-06-05 21:14:00.389063007 +0000 UTC m=+505.323027944" Jun 05 21:14:11.372316 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:11.372285 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-tf49p" Jun 05 21:14:24.234219 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.234144 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg"] Jun 05 21:14:24.237264 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.237248 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" Jun 05 21:14:24.240544 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.240518 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 05 21:14:24.240673 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.240583 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 05 21:14:24.241762 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.241738 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-w644p\"" Jun 05 21:14:24.241866 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.241721 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 21:14:24.241866 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.241724 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 21:14:24.264036 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.264013 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg"] Jun 05 21:14:24.311521 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.311498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75sbf\" (UniqueName: \"kubernetes.io/projected/12fbb505-fac0-4ac2-a3a9-e7c030399fd5-kube-api-access-75sbf\") pod \"kube-auth-proxy-744cfcbb8c-lh7xg\" (UID: \"12fbb505-fac0-4ac2-a3a9-e7c030399fd5\") " pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" Jun 05 21:14:24.311645 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.311534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12fbb505-fac0-4ac2-a3a9-e7c030399fd5-tls-certs\") pod \"kube-auth-proxy-744cfcbb8c-lh7xg\" (UID: \"12fbb505-fac0-4ac2-a3a9-e7c030399fd5\") " pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" Jun 05 21:14:24.311645 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.311551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12fbb505-fac0-4ac2-a3a9-e7c030399fd5-tmp\") pod \"kube-auth-proxy-744cfcbb8c-lh7xg\" (UID: \"12fbb505-fac0-4ac2-a3a9-e7c030399fd5\") " pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" Jun 05 21:14:24.412604 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.412577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12fbb505-fac0-4ac2-a3a9-e7c030399fd5-tls-certs\") pod \"kube-auth-proxy-744cfcbb8c-lh7xg\" (UID: \"12fbb505-fac0-4ac2-a3a9-e7c030399fd5\") " pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" Jun 05 21:14:24.412689 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.412610 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12fbb505-fac0-4ac2-a3a9-e7c030399fd5-tmp\") pod \"kube-auth-proxy-744cfcbb8c-lh7xg\" (UID: \"12fbb505-fac0-4ac2-a3a9-e7c030399fd5\") " pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" Jun 05 21:14:24.412689 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.412681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75sbf\" (UniqueName: \"kubernetes.io/projected/12fbb505-fac0-4ac2-a3a9-e7c030399fd5-kube-api-access-75sbf\") pod \"kube-auth-proxy-744cfcbb8c-lh7xg\" (UID: \"12fbb505-fac0-4ac2-a3a9-e7c030399fd5\") " pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" Jun 05 21:14:24.412803 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:14:24.412752 2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 05 21:14:24.412837 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:14:24.412829 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12fbb505-fac0-4ac2-a3a9-e7c030399fd5-tls-certs podName:12fbb505-fac0-4ac2-a3a9-e7c030399fd5 nodeName:}" failed. No retries permitted until 2026-06-05 21:14:24.91281 +0000 UTC m=+529.846774916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/12fbb505-fac0-4ac2-a3a9-e7c030399fd5-tls-certs") pod "kube-auth-proxy-744cfcbb8c-lh7xg" (UID: "12fbb505-fac0-4ac2-a3a9-e7c030399fd5") : secret "kube-auth-proxy-tls" not found Jun 05 21:14:24.414772 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.414754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12fbb505-fac0-4ac2-a3a9-e7c030399fd5-tmp\") pod \"kube-auth-proxy-744cfcbb8c-lh7xg\" (UID: \"12fbb505-fac0-4ac2-a3a9-e7c030399fd5\") " pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" Jun 05 21:14:24.423499 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.423477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75sbf\" (UniqueName: \"kubernetes.io/projected/12fbb505-fac0-4ac2-a3a9-e7c030399fd5-kube-api-access-75sbf\") pod \"kube-auth-proxy-744cfcbb8c-lh7xg\" (UID: \"12fbb505-fac0-4ac2-a3a9-e7c030399fd5\") " pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" Jun 05 21:14:24.916121 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.916080 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12fbb505-fac0-4ac2-a3a9-e7c030399fd5-tls-certs\") pod \"kube-auth-proxy-744cfcbb8c-lh7xg\" (UID: \"12fbb505-fac0-4ac2-a3a9-e7c030399fd5\") " pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" Jun 05 21:14:24.918436 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:24.918406 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12fbb505-fac0-4ac2-a3a9-e7c030399fd5-tls-certs\") pod \"kube-auth-proxy-744cfcbb8c-lh7xg\" (UID: \"12fbb505-fac0-4ac2-a3a9-e7c030399fd5\") " pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" Jun 05 21:14:25.146824 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:25.146795 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" Jun 05 21:14:25.269959 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:25.269931 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg"] Jun 05 21:14:25.272254 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:14:25.272226 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fbb505_fac0_4ac2_a3a9_e7c030399fd5.slice/crio-a5f3cc8e82ea7c62adec7e0e3a75a079e7f5ea0570e6264022e1c2945e250355 WatchSource:0}: Error finding container a5f3cc8e82ea7c62adec7e0e3a75a079e7f5ea0570e6264022e1c2945e250355: Status 404 returned error can't find the container with id a5f3cc8e82ea7c62adec7e0e3a75a079e7f5ea0570e6264022e1c2945e250355 Jun 05 21:14:25.467552 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:25.467491 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" event={"ID":"12fbb505-fac0-4ac2-a3a9-e7c030399fd5","Type":"ContainerStarted","Data":"a5f3cc8e82ea7c62adec7e0e3a75a079e7f5ea0570e6264022e1c2945e250355"} Jun 05 21:14:28.482849 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:28.482812 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" event={"ID":"12fbb505-fac0-4ac2-a3a9-e7c030399fd5","Type":"ContainerStarted","Data":"2536f3d5a51120811ed0785acdcb5d7bcb30fc6cec45146ddf3347b546707fe5"} Jun 05 21:14:28.499381 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:14:28.499286 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-744cfcbb8c-lh7xg" podStartSLOduration=1.831689773 podStartE2EDuration="4.499269693s" totalImagesPullingTime="2.66757992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:14:28.498553977 +0000 UTC m=+533.432518914" watchObservedRunningTime="2026-06-05 21:14:28.499269693 +0000 UTC m=+533.433234633" Jun 05 21:15:35.501126 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:35.501099 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcd2w_4420e080-d4f9-43a5-bbbe-6d869c60f720/ovn-acl-logging/0.log" Jun 05 21:15:35.501873 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:35.501851 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcd2w_4420e080-d4f9-43a5-bbbe-6d869c60f720/ovn-acl-logging/0.log" Jun 05 21:15:52.946421 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:52.946336 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7"] Jun 05 21:15:52.949563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:52.949548 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7" Jun 05 21:15:52.953070 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:52.953033 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 05 21:15:52.953205 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:52.953048 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 05 21:15:52.953353 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:52.953337 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 21:15:52.954256 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:52.954238 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4hfk5\"" Jun 05 21:15:52.954530 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:52.954516 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 21:15:52.965699 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:52.965678 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7"] Jun 05 21:15:53.115241 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:53.115215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2kqx\" (UniqueName: \"kubernetes.io/projected/8539e2bd-1bb6-4310-81da-b00323b5d079-kube-api-access-q2kqx\") pod \"kuadrant-console-plugin-66b5774985-slgd7\" (UID: \"8539e2bd-1bb6-4310-81da-b00323b5d079\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7" Jun 05 21:15:53.115363 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:53.115262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8539e2bd-1bb6-4310-81da-b00323b5d079-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-slgd7\" (UID: \"8539e2bd-1bb6-4310-81da-b00323b5d079\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7" Jun 05 21:15:53.115363 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:53.115322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8539e2bd-1bb6-4310-81da-b00323b5d079-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-slgd7\" (UID: \"8539e2bd-1bb6-4310-81da-b00323b5d079\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7" Jun 05 21:15:53.215938 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:53.215864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2kqx\" (UniqueName: \"kubernetes.io/projected/8539e2bd-1bb6-4310-81da-b00323b5d079-kube-api-access-q2kqx\") pod \"kuadrant-console-plugin-66b5774985-slgd7\" (UID: \"8539e2bd-1bb6-4310-81da-b00323b5d079\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7" Jun 05 21:15:53.215938 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:53.215924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8539e2bd-1bb6-4310-81da-b00323b5d079-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-slgd7\" (UID: \"8539e2bd-1bb6-4310-81da-b00323b5d079\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7" Jun 05 21:15:53.216111 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:53.215964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8539e2bd-1bb6-4310-81da-b00323b5d079-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-slgd7\" (UID: \"8539e2bd-1bb6-4310-81da-b00323b5d079\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7" Jun 05 21:15:53.216626 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:53.216603 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8539e2bd-1bb6-4310-81da-b00323b5d079-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-slgd7\" (UID: \"8539e2bd-1bb6-4310-81da-b00323b5d079\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7" Jun 05 21:15:53.218477 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:53.218456 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8539e2bd-1bb6-4310-81da-b00323b5d079-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-slgd7\" (UID: \"8539e2bd-1bb6-4310-81da-b00323b5d079\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7" Jun 05 21:15:53.233669 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:53.233642 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2kqx\" (UniqueName: \"kubernetes.io/projected/8539e2bd-1bb6-4310-81da-b00323b5d079-kube-api-access-q2kqx\") pod \"kuadrant-console-plugin-66b5774985-slgd7\" (UID: \"8539e2bd-1bb6-4310-81da-b00323b5d079\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7" Jun 05 21:15:53.258349 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:53.258311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7" Jun 05 21:15:53.405128 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:53.405098 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7"] Jun 05 21:15:53.406644 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:15:53.406616 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8539e2bd_1bb6_4310_81da_b00323b5d079.slice/crio-6b57d718169ce52c774ff80e9810395d311c949a5140a62e9575c3f92599c284 WatchSource:0}: Error finding container 6b57d718169ce52c774ff80e9810395d311c949a5140a62e9575c3f92599c284: Status 404 returned error can't find the container with id 6b57d718169ce52c774ff80e9810395d311c949a5140a62e9575c3f92599c284 Jun 05 21:15:53.812540 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:15:53.812508 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7" event={"ID":"8539e2bd-1bb6-4310-81da-b00323b5d079","Type":"ContainerStarted","Data":"6b57d718169ce52c774ff80e9810395d311c949a5140a62e9575c3f92599c284"} Jun 05 21:16:16.931491 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:16.931457 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7" event={"ID":"8539e2bd-1bb6-4310-81da-b00323b5d079","Type":"ContainerStarted","Data":"f6a307307dc14213cb363aed0c7f744b1d246ba115e7adfd014b8101a998c04d"} Jun 05 21:16:16.973944 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:16.973903 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-slgd7" podStartSLOduration=1.923227928 podStartE2EDuration="24.973890492s" totalImagesPullingTime="23.050662564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:16:16.969894212 +0000 UTC m=+641.903859161" watchObservedRunningTime="2026-06-05 21:16:16.973890492 +0000 UTC m=+641.907855431" Jun 05 21:16:40.250815 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:40.250710 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hs25p"] Jun 05 21:16:40.305249 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:40.305218 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hs25p"] Jun 05 21:16:40.305409 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:40.305339 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" Jun 05 21:16:40.307817 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:40.307784 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 21:16:40.310234 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:40.310177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2247l\" (UniqueName: \"kubernetes.io/projected/368f2e34-4e4d-4e03-a9c0-111f0531fa93-kube-api-access-2247l\") pod \"limitador-limitador-64c94fd64f-hs25p\" (UID: \"368f2e34-4e4d-4e03-a9c0-111f0531fa93\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" Jun 05 21:16:40.310360 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:40.310334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/368f2e34-4e4d-4e03-a9c0-111f0531fa93-config-file\") pod \"limitador-limitador-64c94fd64f-hs25p\" (UID: \"368f2e34-4e4d-4e03-a9c0-111f0531fa93\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" Jun 05 21:16:40.348085 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:40.348057 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hs25p"] Jun 05 21:16:40.411680 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:40.411647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2247l\" (UniqueName: \"kubernetes.io/projected/368f2e34-4e4d-4e03-a9c0-111f0531fa93-kube-api-access-2247l\") pod \"limitador-limitador-64c94fd64f-hs25p\" (UID: \"368f2e34-4e4d-4e03-a9c0-111f0531fa93\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" Jun 05 21:16:40.411842 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:40.411757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/368f2e34-4e4d-4e03-a9c0-111f0531fa93-config-file\") pod \"limitador-limitador-64c94fd64f-hs25p\" (UID: \"368f2e34-4e4d-4e03-a9c0-111f0531fa93\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" Jun 05 21:16:40.412335 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:40.412313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/368f2e34-4e4d-4e03-a9c0-111f0531fa93-config-file\") pod \"limitador-limitador-64c94fd64f-hs25p\" (UID: \"368f2e34-4e4d-4e03-a9c0-111f0531fa93\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" Jun 05 21:16:40.420189 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:40.420165 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2247l\" (UniqueName: \"kubernetes.io/projected/368f2e34-4e4d-4e03-a9c0-111f0531fa93-kube-api-access-2247l\") pod \"limitador-limitador-64c94fd64f-hs25p\" (UID: \"368f2e34-4e4d-4e03-a9c0-111f0531fa93\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" Jun 05 21:16:40.616502 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:40.616424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" Jun 05 21:16:40.747109 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:40.747085 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hs25p"] Jun 05 21:16:40.748255 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:16:40.748229 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod368f2e34_4e4d_4e03_a9c0_111f0531fa93.slice/crio-e877d7e453254a8321e560479fc169d3bdaf1781fbda8ab9ce8aa91226483c9c WatchSource:0}: Error finding container e877d7e453254a8321e560479fc169d3bdaf1781fbda8ab9ce8aa91226483c9c: Status 404 returned error can't find the container with id e877d7e453254a8321e560479fc169d3bdaf1781fbda8ab9ce8aa91226483c9c Jun 05 21:16:41.030111 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:41.030075 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" event={"ID":"368f2e34-4e4d-4e03-a9c0-111f0531fa93","Type":"ContainerStarted","Data":"e877d7e453254a8321e560479fc169d3bdaf1781fbda8ab9ce8aa91226483c9c"} Jun 05 21:16:41.058146 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:41.058113 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-fjxvn"] Jun 05 21:16:41.062705 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:41.062688 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fjxvn" Jun 05 21:16:41.065318 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:41.065303 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f2mt6\"" Jun 05 21:16:41.070369 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:41.070345 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fjxvn"] Jun 05 21:16:41.116544 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:41.116519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2csls\" (UniqueName: \"kubernetes.io/projected/cb78cada-fb18-4229-914b-cf481e5d64fa-kube-api-access-2csls\") pod \"authorino-58cd955675-fjxvn\" (UID: \"cb78cada-fb18-4229-914b-cf481e5d64fa\") " pod="kuadrant-system/authorino-58cd955675-fjxvn" Jun 05 21:16:41.217184 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:41.217156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2csls\" (UniqueName: \"kubernetes.io/projected/cb78cada-fb18-4229-914b-cf481e5d64fa-kube-api-access-2csls\") pod \"authorino-58cd955675-fjxvn\" (UID: \"cb78cada-fb18-4229-914b-cf481e5d64fa\") " pod="kuadrant-system/authorino-58cd955675-fjxvn" Jun 05 21:16:41.225763 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:41.225719 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2csls\" (UniqueName: \"kubernetes.io/projected/cb78cada-fb18-4229-914b-cf481e5d64fa-kube-api-access-2csls\") pod \"authorino-58cd955675-fjxvn\" (UID: \"cb78cada-fb18-4229-914b-cf481e5d64fa\") " pod="kuadrant-system/authorino-58cd955675-fjxvn" Jun 05 21:16:41.373455 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:41.373378 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fjxvn" Jun 05 21:16:41.538741 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:41.538691 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fjxvn"] Jun 05 21:16:41.541966 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:16:41.541935 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb78cada_fb18_4229_914b_cf481e5d64fa.slice/crio-7473d23cbc2e899c137f2a1a5f7693dbc8a98a4e1e36c1c59b0696dd1e0608c4 WatchSource:0}: Error finding container 7473d23cbc2e899c137f2a1a5f7693dbc8a98a4e1e36c1c59b0696dd1e0608c4: Status 404 returned error can't find the container with id 7473d23cbc2e899c137f2a1a5f7693dbc8a98a4e1e36c1c59b0696dd1e0608c4 Jun 05 21:16:42.040670 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:42.040633 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fjxvn" event={"ID":"cb78cada-fb18-4229-914b-cf481e5d64fa","Type":"ContainerStarted","Data":"7473d23cbc2e899c137f2a1a5f7693dbc8a98a4e1e36c1c59b0696dd1e0608c4"} Jun 05 21:16:46.062558 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:46.062521 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" event={"ID":"368f2e34-4e4d-4e03-a9c0-111f0531fa93","Type":"ContainerStarted","Data":"569255f5a194cb2133de7c62d957462cb5f8e5fee656db616bb6bc8424298070"} Jun 05 21:16:46.063001 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:46.062592 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" Jun 05 21:16:46.064188 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:46.064155 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fjxvn" event={"ID":"cb78cada-fb18-4229-914b-cf481e5d64fa","Type":"ContainerStarted","Data":"ddead6235a83d1079d5a61c2e96dddac2ce4e108719dea34c60c4c04bbf6b4f7"} Jun 05 21:16:46.082139 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:46.082095 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" podStartSLOduration=1.541490092 podStartE2EDuration="6.082081953s" totalImagesPullingTime="4.540591861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:16:46.080448068 +0000 UTC m=+671.014413007" watchObservedRunningTime="2026-06-05 21:16:46.082081953 +0000 UTC m=+671.016046890" Jun 05 21:16:46.095574 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:46.095531 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-fjxvn" podStartSLOduration=1.260988207 podStartE2EDuration="5.095518816s" totalImagesPullingTime="3.834530609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:16:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:16:46.094886569 +0000 UTC m=+671.028851507" watchObservedRunningTime="2026-06-05 21:16:46.095518816 +0000 UTC m=+671.029483800" Jun 05 21:16:46.517485 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:46.517445 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fjxvn"] Jun 05 21:16:48.072097 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:48.072057 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-fjxvn" podUID="cb78cada-fb18-4229-914b-cf481e5d64fa" containerName="authorino" containerID="cri-o://ddead6235a83d1079d5a61c2e96dddac2ce4e108719dea34c60c4c04bbf6b4f7" gracePeriod=30 Jun 05 21:16:48.303913 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:48.303890 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fjxvn" Jun 05 21:16:48.376849 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:48.376819 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2csls\" (UniqueName: \"kubernetes.io/projected/cb78cada-fb18-4229-914b-cf481e5d64fa-kube-api-access-2csls\") pod \"cb78cada-fb18-4229-914b-cf481e5d64fa\" (UID: \"cb78cada-fb18-4229-914b-cf481e5d64fa\") " Jun 05 21:16:48.378913 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:48.378887 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb78cada-fb18-4229-914b-cf481e5d64fa-kube-api-access-2csls" (OuterVolumeSpecName: "kube-api-access-2csls") pod "cb78cada-fb18-4229-914b-cf481e5d64fa" (UID: "cb78cada-fb18-4229-914b-cf481e5d64fa"). InnerVolumeSpecName "kube-api-access-2csls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:16:48.477692 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:48.477666 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2csls\" (UniqueName: \"kubernetes.io/projected/cb78cada-fb18-4229-914b-cf481e5d64fa-kube-api-access-2csls\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:16:49.077590 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:49.077550 2576 generic.go:356] "Generic (PLEG): container finished" podID="cb78cada-fb18-4229-914b-cf481e5d64fa" containerID="ddead6235a83d1079d5a61c2e96dddac2ce4e108719dea34c60c4c04bbf6b4f7" exitCode=0 Jun 05 21:16:49.078037 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:49.077600 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fjxvn" Jun 05 21:16:49.078037 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:49.077632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fjxvn" event={"ID":"cb78cada-fb18-4229-914b-cf481e5d64fa","Type":"ContainerDied","Data":"ddead6235a83d1079d5a61c2e96dddac2ce4e108719dea34c60c4c04bbf6b4f7"} Jun 05 21:16:49.078037 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:49.077679 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fjxvn" event={"ID":"cb78cada-fb18-4229-914b-cf481e5d64fa","Type":"ContainerDied","Data":"7473d23cbc2e899c137f2a1a5f7693dbc8a98a4e1e36c1c59b0696dd1e0608c4"} Jun 05 21:16:49.078037 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:49.077697 2576 scope.go:117] "RemoveContainer" containerID="ddead6235a83d1079d5a61c2e96dddac2ce4e108719dea34c60c4c04bbf6b4f7" Jun 05 21:16:49.086076 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:49.086056 2576 scope.go:117] "RemoveContainer" containerID="ddead6235a83d1079d5a61c2e96dddac2ce4e108719dea34c60c4c04bbf6b4f7" Jun 05 21:16:49.086323 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:16:49.086305 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddead6235a83d1079d5a61c2e96dddac2ce4e108719dea34c60c4c04bbf6b4f7\": container with ID starting with ddead6235a83d1079d5a61c2e96dddac2ce4e108719dea34c60c4c04bbf6b4f7 not found: ID does not exist" containerID="ddead6235a83d1079d5a61c2e96dddac2ce4e108719dea34c60c4c04bbf6b4f7" Jun 05 21:16:49.086367 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:49.086332 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddead6235a83d1079d5a61c2e96dddac2ce4e108719dea34c60c4c04bbf6b4f7"} err="failed to get container status \"ddead6235a83d1079d5a61c2e96dddac2ce4e108719dea34c60c4c04bbf6b4f7\": rpc error: code = NotFound desc = could not find container \"ddead6235a83d1079d5a61c2e96dddac2ce4e108719dea34c60c4c04bbf6b4f7\": container with ID starting with ddead6235a83d1079d5a61c2e96dddac2ce4e108719dea34c60c4c04bbf6b4f7 not found: ID does not exist" Jun 05 21:16:49.098556 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:49.098530 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fjxvn"] Jun 05 21:16:49.102837 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:49.102816 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-fjxvn"] Jun 05 21:16:49.520466 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:49.520432 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb78cada-fb18-4229-914b-cf481e5d64fa" path="/var/lib/kubelet/pods/cb78cada-fb18-4229-914b-cf481e5d64fa/volumes" Jun 05 21:16:57.069691 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:57.069660 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" Jun 05 21:16:57.509679 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:57.509646 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hs25p"] Jun 05 21:16:57.509928 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:57.509902 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" podUID="368f2e34-4e4d-4e03-a9c0-111f0531fa93" containerName="limitador" containerID="cri-o://569255f5a194cb2133de7c62d957462cb5f8e5fee656db616bb6bc8424298070" gracePeriod=30 Jun 05 21:16:58.099635 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.099614 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" Jun 05 21:16:58.115859 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.115829 2576 generic.go:356] "Generic (PLEG): container finished" podID="368f2e34-4e4d-4e03-a9c0-111f0531fa93" containerID="569255f5a194cb2133de7c62d957462cb5f8e5fee656db616bb6bc8424298070" exitCode=0 Jun 05 21:16:58.115957 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.115862 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" Jun 05 21:16:58.115957 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.115869 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" event={"ID":"368f2e34-4e4d-4e03-a9c0-111f0531fa93","Type":"ContainerDied","Data":"569255f5a194cb2133de7c62d957462cb5f8e5fee656db616bb6bc8424298070"} Jun 05 21:16:58.115957 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.115917 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hs25p" event={"ID":"368f2e34-4e4d-4e03-a9c0-111f0531fa93","Type":"ContainerDied","Data":"e877d7e453254a8321e560479fc169d3bdaf1781fbda8ab9ce8aa91226483c9c"} Jun 05 21:16:58.115957 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.115947 2576 scope.go:117] "RemoveContainer" containerID="569255f5a194cb2133de7c62d957462cb5f8e5fee656db616bb6bc8424298070" Jun 05 21:16:58.125686 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.125666 2576 scope.go:117] "RemoveContainer" containerID="569255f5a194cb2133de7c62d957462cb5f8e5fee656db616bb6bc8424298070" Jun 05 21:16:58.125953 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:16:58.125931 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"569255f5a194cb2133de7c62d957462cb5f8e5fee656db616bb6bc8424298070\": container with ID starting with 569255f5a194cb2133de7c62d957462cb5f8e5fee656db616bb6bc8424298070 not found: ID does not exist" containerID="569255f5a194cb2133de7c62d957462cb5f8e5fee656db616bb6bc8424298070" Jun 05 21:16:58.126019 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.125972 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569255f5a194cb2133de7c62d957462cb5f8e5fee656db616bb6bc8424298070"} err="failed to get container status \"569255f5a194cb2133de7c62d957462cb5f8e5fee656db616bb6bc8424298070\": rpc error: code = NotFound desc = could not find container \"569255f5a194cb2133de7c62d957462cb5f8e5fee656db616bb6bc8424298070\": container with ID starting with 569255f5a194cb2133de7c62d957462cb5f8e5fee656db616bb6bc8424298070 not found: ID does not exist" Jun 05 21:16:58.160485 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.160457 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2247l\" (UniqueName: \"kubernetes.io/projected/368f2e34-4e4d-4e03-a9c0-111f0531fa93-kube-api-access-2247l\") pod \"368f2e34-4e4d-4e03-a9c0-111f0531fa93\" (UID: \"368f2e34-4e4d-4e03-a9c0-111f0531fa93\") " Jun 05 21:16:58.160596 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.160501 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/368f2e34-4e4d-4e03-a9c0-111f0531fa93-config-file\") pod \"368f2e34-4e4d-4e03-a9c0-111f0531fa93\" (UID: \"368f2e34-4e4d-4e03-a9c0-111f0531fa93\") " Jun 05 21:16:58.160872 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.160849 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/368f2e34-4e4d-4e03-a9c0-111f0531fa93-config-file" (OuterVolumeSpecName: "config-file") pod "368f2e34-4e4d-4e03-a9c0-111f0531fa93" (UID: "368f2e34-4e4d-4e03-a9c0-111f0531fa93"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:16:58.162476 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.162451 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/368f2e34-4e4d-4e03-a9c0-111f0531fa93-kube-api-access-2247l" (OuterVolumeSpecName: "kube-api-access-2247l") pod "368f2e34-4e4d-4e03-a9c0-111f0531fa93" (UID: "368f2e34-4e4d-4e03-a9c0-111f0531fa93"). InnerVolumeSpecName "kube-api-access-2247l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:16:58.261879 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.261838 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2247l\" (UniqueName: \"kubernetes.io/projected/368f2e34-4e4d-4e03-a9c0-111f0531fa93-kube-api-access-2247l\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:16:58.261879 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.261871 2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/368f2e34-4e4d-4e03-a9c0-111f0531fa93-config-file\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:16:58.437247 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.437220 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hs25p"] Jun 05 21:16:58.441132 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:58.441102 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hs25p"] Jun 05 21:16:59.521025 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:16:59.520981 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="368f2e34-4e4d-4e03-a9c0-111f0531fa93" path="/var/lib/kubelet/pods/368f2e34-4e4d-4e03-a9c0-111f0531fa93/volumes" Jun 05 21:17:25.491299 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.491220 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-hm7zc"] Jun 05 21:17:25.491810 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.491522 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb78cada-fb18-4229-914b-cf481e5d64fa" containerName="authorino" Jun 05 21:17:25.491810 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.491533 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb78cada-fb18-4229-914b-cf481e5d64fa" containerName="authorino" Jun 05 21:17:25.491810 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.491554 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="368f2e34-4e4d-4e03-a9c0-111f0531fa93" containerName="limitador" Jun 05 21:17:25.491810 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.491559 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="368f2e34-4e4d-4e03-a9c0-111f0531fa93" containerName="limitador" Jun 05 21:17:25.491810 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.491607 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="368f2e34-4e4d-4e03-a9c0-111f0531fa93" containerName="limitador" Jun 05 21:17:25.491810 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.491616 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb78cada-fb18-4229-914b-cf481e5d64fa" containerName="authorino" Jun 05 21:17:25.493394 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.493378 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-hm7zc" Jun 05 21:17:25.495884 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.495859 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 21:17:25.495982 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.495862 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 21:17:25.497064 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.497037 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-hb7fp\"" Jun 05 21:17:25.504019 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.503997 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-hm7zc"] Jun 05 21:17:25.575612 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.575580 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg2gg\" (UniqueName: \"kubernetes.io/projected/7248d989-8431-404b-afcb-80d3fe500b85-kube-api-access-wg2gg\") pod \"keycloak-operator-dd84cbf46-hm7zc\" (UID: \"7248d989-8431-404b-afcb-80d3fe500b85\") " pod="keycloak-system/keycloak-operator-dd84cbf46-hm7zc" Jun 05 21:17:25.676181 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.676152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg2gg\" (UniqueName: \"kubernetes.io/projected/7248d989-8431-404b-afcb-80d3fe500b85-kube-api-access-wg2gg\") pod \"keycloak-operator-dd84cbf46-hm7zc\" (UID: \"7248d989-8431-404b-afcb-80d3fe500b85\") " pod="keycloak-system/keycloak-operator-dd84cbf46-hm7zc" Jun 05 21:17:25.685427 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.685396 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg2gg\" (UniqueName: \"kubernetes.io/projected/7248d989-8431-404b-afcb-80d3fe500b85-kube-api-access-wg2gg\") pod \"keycloak-operator-dd84cbf46-hm7zc\" (UID: \"7248d989-8431-404b-afcb-80d3fe500b85\") " pod="keycloak-system/keycloak-operator-dd84cbf46-hm7zc" Jun 05 21:17:25.802945 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.802861 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-hm7zc" Jun 05 21:17:25.928070 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:25.928046 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-hm7zc"] Jun 05 21:17:25.930309 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:17:25.930270 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7248d989_8431_404b_afcb_80d3fe500b85.slice/crio-2f49f3ed3e5431a0fa4879031cf6ac094e820cd1a0727daf8423d16ff33595d4 WatchSource:0}: Error finding container 2f49f3ed3e5431a0fa4879031cf6ac094e820cd1a0727daf8423d16ff33595d4: Status 404 returned error can't find the container with id 2f49f3ed3e5431a0fa4879031cf6ac094e820cd1a0727daf8423d16ff33595d4 Jun 05 21:17:26.234358 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:26.234322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-hm7zc" event={"ID":"7248d989-8431-404b-afcb-80d3fe500b85","Type":"ContainerStarted","Data":"2f49f3ed3e5431a0fa4879031cf6ac094e820cd1a0727daf8423d16ff33595d4"} Jun 05 21:17:32.267008 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:32.266962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-hm7zc" event={"ID":"7248d989-8431-404b-afcb-80d3fe500b85","Type":"ContainerStarted","Data":"62bb6f5ecc86e210befe5b98bb4d2cf38e16b83d447767f3fc2dd6bf51e60dd6"} Jun 05 21:17:32.283329 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:17:32.283269 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-hm7zc" podStartSLOduration=1.663541239 podStartE2EDuration="7.283249933s" totalImagesPullingTime="5.619708694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:17:32.282597127 +0000 UTC m=+717.216562068" watchObservedRunningTime="2026-06-05 21:17:32.283249933 +0000 UTC m=+717.217214871" Jun 05 21:18:10.250169 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:10.250138 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57cbcff549-cz5xt"] Jun 05 21:18:10.256702 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:10.256685 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57cbcff549-cz5xt" Jun 05 21:18:10.259399 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:10.259379 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f2mt6\"" Jun 05 21:18:10.259847 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:10.259826 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57cbcff549-cz5xt"] Jun 05 21:18:10.353431 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:10.353406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qs9r\" (UniqueName: \"kubernetes.io/projected/fddbb64f-ad53-4f00-9e41-8b70da6cb3f8-kube-api-access-9qs9r\") pod \"authorino-57cbcff549-cz5xt\" (UID: \"fddbb64f-ad53-4f00-9e41-8b70da6cb3f8\") " pod="kuadrant-system/authorino-57cbcff549-cz5xt" Jun 05 21:18:10.453880 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:10.453850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qs9r\" (UniqueName: \"kubernetes.io/projected/fddbb64f-ad53-4f00-9e41-8b70da6cb3f8-kube-api-access-9qs9r\") pod \"authorino-57cbcff549-cz5xt\" (UID: \"fddbb64f-ad53-4f00-9e41-8b70da6cb3f8\") " pod="kuadrant-system/authorino-57cbcff549-cz5xt" Jun 05 21:18:10.462477 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:10.462458 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qs9r\" (UniqueName: \"kubernetes.io/projected/fddbb64f-ad53-4f00-9e41-8b70da6cb3f8-kube-api-access-9qs9r\") pod \"authorino-57cbcff549-cz5xt\" (UID: \"fddbb64f-ad53-4f00-9e41-8b70da6cb3f8\") " pod="kuadrant-system/authorino-57cbcff549-cz5xt" Jun 05 21:18:10.567235 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:10.567167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57cbcff549-cz5xt" Jun 05 21:18:10.685333 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:10.683826 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57cbcff549-cz5xt"] Jun 05 21:18:10.724325 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:10.724291 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57cbcff549-cz5xt"] Jun 05 21:18:10.727549 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:18:10.727525 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfddbb64f_ad53_4f00_9e41_8b70da6cb3f8.slice/crio-94c5cd49f5ae3881e769ac660b1e05eef94eed6363dde944bdefe23fffb124c5 WatchSource:0}: Error finding container 94c5cd49f5ae3881e769ac660b1e05eef94eed6363dde944bdefe23fffb124c5: Status 404 returned error can't find the container with id 94c5cd49f5ae3881e769ac660b1e05eef94eed6363dde944bdefe23fffb124c5 Jun 05 21:18:11.427861 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:11.427770 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57cbcff549-cz5xt" event={"ID":"fddbb64f-ad53-4f00-9e41-8b70da6cb3f8","Type":"ContainerStarted","Data":"209b78f832f4493c6a442a13df32ce916e68f9a7ff29774e09a40a5393e691e1"} Jun 05 21:18:11.427861 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:11.427815 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57cbcff549-cz5xt" event={"ID":"fddbb64f-ad53-4f00-9e41-8b70da6cb3f8","Type":"ContainerStarted","Data":"94c5cd49f5ae3881e769ac660b1e05eef94eed6363dde944bdefe23fffb124c5"} Jun 05 21:18:11.427861 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:11.427811 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-57cbcff549-cz5xt" podUID="fddbb64f-ad53-4f00-9e41-8b70da6cb3f8" containerName="authorino" containerID="cri-o://209b78f832f4493c6a442a13df32ce916e68f9a7ff29774e09a40a5393e691e1" gracePeriod=30 Jun 05 21:18:11.443569 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:11.443524 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57cbcff549-cz5xt" podStartSLOduration=1.013594732 podStartE2EDuration="1.443509479s" totalImagesPullingTime="429.914747ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:11.442341238 +0000 UTC m=+756.376306176" watchObservedRunningTime="2026-06-05 21:18:11.443509479 +0000 UTC m=+756.377474417" Jun 05 21:18:11.666233 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:11.666207 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57cbcff549-cz5xt" Jun 05 21:18:11.765123 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:11.765054 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qs9r\" (UniqueName: \"kubernetes.io/projected/fddbb64f-ad53-4f00-9e41-8b70da6cb3f8-kube-api-access-9qs9r\") pod \"fddbb64f-ad53-4f00-9e41-8b70da6cb3f8\" (UID: \"fddbb64f-ad53-4f00-9e41-8b70da6cb3f8\") " Jun 05 21:18:11.766979 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:11.766948 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fddbb64f-ad53-4f00-9e41-8b70da6cb3f8-kube-api-access-9qs9r" (OuterVolumeSpecName: "kube-api-access-9qs9r") pod "fddbb64f-ad53-4f00-9e41-8b70da6cb3f8" (UID: "fddbb64f-ad53-4f00-9e41-8b70da6cb3f8"). InnerVolumeSpecName "kube-api-access-9qs9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:18:11.865548 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:11.865522 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qs9r\" (UniqueName: \"kubernetes.io/projected/fddbb64f-ad53-4f00-9e41-8b70da6cb3f8-kube-api-access-9qs9r\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:18:12.432747 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:12.432699 2576 generic.go:356] "Generic (PLEG): container finished" podID="fddbb64f-ad53-4f00-9e41-8b70da6cb3f8" containerID="209b78f832f4493c6a442a13df32ce916e68f9a7ff29774e09a40a5393e691e1" exitCode=0 Jun 05 21:18:12.432747 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:12.432749 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57cbcff549-cz5xt" Jun 05 21:18:12.433289 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:12.432785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57cbcff549-cz5xt" event={"ID":"fddbb64f-ad53-4f00-9e41-8b70da6cb3f8","Type":"ContainerDied","Data":"209b78f832f4493c6a442a13df32ce916e68f9a7ff29774e09a40a5393e691e1"} Jun 05 21:18:12.433289 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:12.432825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57cbcff549-cz5xt" event={"ID":"fddbb64f-ad53-4f00-9e41-8b70da6cb3f8","Type":"ContainerDied","Data":"94c5cd49f5ae3881e769ac660b1e05eef94eed6363dde944bdefe23fffb124c5"} Jun 05 21:18:12.433289 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:12.432844 2576 scope.go:117] "RemoveContainer" containerID="209b78f832f4493c6a442a13df32ce916e68f9a7ff29774e09a40a5393e691e1" Jun 05 21:18:12.441412 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:12.441397 2576 scope.go:117] "RemoveContainer" containerID="209b78f832f4493c6a442a13df32ce916e68f9a7ff29774e09a40a5393e691e1" Jun 05 21:18:12.441676 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:18:12.441658 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"209b78f832f4493c6a442a13df32ce916e68f9a7ff29774e09a40a5393e691e1\": container with ID starting with 209b78f832f4493c6a442a13df32ce916e68f9a7ff29774e09a40a5393e691e1 not found: ID does not exist" containerID="209b78f832f4493c6a442a13df32ce916e68f9a7ff29774e09a40a5393e691e1" Jun 05 21:18:12.441756 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:12.441683 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"209b78f832f4493c6a442a13df32ce916e68f9a7ff29774e09a40a5393e691e1"} err="failed to get container status \"209b78f832f4493c6a442a13df32ce916e68f9a7ff29774e09a40a5393e691e1\": rpc error: code = NotFound desc = could not find container \"209b78f832f4493c6a442a13df32ce916e68f9a7ff29774e09a40a5393e691e1\": container with ID starting with 209b78f832f4493c6a442a13df32ce916e68f9a7ff29774e09a40a5393e691e1 not found: ID does not exist" Jun 05 21:18:12.451886 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:12.451854 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57cbcff549-cz5xt"] Jun 05 21:18:12.453933 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:12.453911 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57cbcff549-cz5xt"] Jun 05 21:18:13.520685 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:13.520643 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fddbb64f-ad53-4f00-9e41-8b70da6cb3f8" path="/var/lib/kubelet/pods/fddbb64f-ad53-4f00-9e41-8b70da6cb3f8/volumes" Jun 05 21:18:15.535415 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.535382 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bffc8cf64-9xq22"] Jun 05 21:18:15.535809 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.535669 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fddbb64f-ad53-4f00-9e41-8b70da6cb3f8" containerName="authorino" Jun 05 21:18:15.535809 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.535681 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fddbb64f-ad53-4f00-9e41-8b70da6cb3f8" containerName="authorino" Jun 05 21:18:15.535809 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.535761 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fddbb64f-ad53-4f00-9e41-8b70da6cb3f8" containerName="authorino" Jun 05 21:18:15.538550 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.538534 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bffc8cf64-9xq22" Jun 05 21:18:15.541987 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.541965 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 05 21:18:15.542117 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.542099 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 05 21:18:15.542338 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.542316 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gm77s\"" Jun 05 21:18:15.549757 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.549714 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bffc8cf64-9xq22"] Jun 05 21:18:15.695621 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.695590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-webhook-cert\") pod \"maas-controller-bffc8cf64-9xq22\" (UID: \"4089d6ec-b68b-405c-ae01-5d29ea0ceffd\") " pod="opendatahub/maas-controller-bffc8cf64-9xq22" Jun 05 21:18:15.695801 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.695627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rvh8\" (UniqueName: \"kubernetes.io/projected/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-kube-api-access-2rvh8\") pod \"maas-controller-bffc8cf64-9xq22\" (UID: \"4089d6ec-b68b-405c-ae01-5d29ea0ceffd\") " pod="opendatahub/maas-controller-bffc8cf64-9xq22" Jun 05 21:18:15.713271 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.713243 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64d4fdd96-mlvbg"] Jun 05 21:18:15.715387 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.715372 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64d4fdd96-mlvbg" Jun 05 21:18:15.724900 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.724871 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64d4fdd96-mlvbg"] Jun 05 21:18:15.797040 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.796971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rvh8\" (UniqueName: \"kubernetes.io/projected/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-kube-api-access-2rvh8\") pod \"maas-controller-bffc8cf64-9xq22\" (UID: \"4089d6ec-b68b-405c-ae01-5d29ea0ceffd\") " pod="opendatahub/maas-controller-bffc8cf64-9xq22" Jun 05 21:18:15.797040 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.797020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhxzt\" (UniqueName: \"kubernetes.io/projected/ffbc9001-46ac-4d4c-9f98-57801b877ccb-kube-api-access-jhxzt\") pod \"maas-controller-64d4fdd96-mlvbg\" (UID: \"ffbc9001-46ac-4d4c-9f98-57801b877ccb\") " pod="opendatahub/maas-controller-64d4fdd96-mlvbg" Jun 05 21:18:15.797218 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.797078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffbc9001-46ac-4d4c-9f98-57801b877ccb-webhook-cert\") pod \"maas-controller-64d4fdd96-mlvbg\" (UID: \"ffbc9001-46ac-4d4c-9f98-57801b877ccb\") " pod="opendatahub/maas-controller-64d4fdd96-mlvbg" Jun 05 21:18:15.797259 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.797214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-webhook-cert\") pod \"maas-controller-bffc8cf64-9xq22\" (UID: \"4089d6ec-b68b-405c-ae01-5d29ea0ceffd\") " pod="opendatahub/maas-controller-bffc8cf64-9xq22" Jun 05 21:18:15.797324 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:18:15.797311 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 05 21:18:15.797370 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:18:15.797361 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-webhook-cert podName:4089d6ec-b68b-405c-ae01-5d29ea0ceffd nodeName:}" failed. No retries permitted until 2026-06-05 21:18:16.297345919 +0000 UTC m=+761.231310835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-webhook-cert") pod "maas-controller-bffc8cf64-9xq22" (UID: "4089d6ec-b68b-405c-ae01-5d29ea0ceffd") : secret "maas-controller-webhook-cert" not found Jun 05 21:18:15.805454 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.805433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rvh8\" (UniqueName: \"kubernetes.io/projected/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-kube-api-access-2rvh8\") pod \"maas-controller-bffc8cf64-9xq22\" (UID: \"4089d6ec-b68b-405c-ae01-5d29ea0ceffd\") " pod="opendatahub/maas-controller-bffc8cf64-9xq22" Jun 05 21:18:15.898231 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.898202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffbc9001-46ac-4d4c-9f98-57801b877ccb-webhook-cert\") pod \"maas-controller-64d4fdd96-mlvbg\" (UID: \"ffbc9001-46ac-4d4c-9f98-57801b877ccb\") " pod="opendatahub/maas-controller-64d4fdd96-mlvbg" Jun 05 21:18:15.898363 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.898303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhxzt\" (UniqueName: \"kubernetes.io/projected/ffbc9001-46ac-4d4c-9f98-57801b877ccb-kube-api-access-jhxzt\") pod \"maas-controller-64d4fdd96-mlvbg\" (UID: \"ffbc9001-46ac-4d4c-9f98-57801b877ccb\") " pod="opendatahub/maas-controller-64d4fdd96-mlvbg" Jun 05 21:18:15.900558 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.900538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffbc9001-46ac-4d4c-9f98-57801b877ccb-webhook-cert\") pod \"maas-controller-64d4fdd96-mlvbg\" (UID: \"ffbc9001-46ac-4d4c-9f98-57801b877ccb\") " pod="opendatahub/maas-controller-64d4fdd96-mlvbg" Jun 05 21:18:15.906644 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:15.906621 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhxzt\" (UniqueName: \"kubernetes.io/projected/ffbc9001-46ac-4d4c-9f98-57801b877ccb-kube-api-access-jhxzt\") pod \"maas-controller-64d4fdd96-mlvbg\" (UID: \"ffbc9001-46ac-4d4c-9f98-57801b877ccb\") " pod="opendatahub/maas-controller-64d4fdd96-mlvbg" Jun 05 21:18:16.025905 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:16.025876 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64d4fdd96-mlvbg" Jun 05 21:18:16.154609 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:16.154572 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64d4fdd96-mlvbg"] Jun 05 21:18:16.157492 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:18:16.157470 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffbc9001_46ac_4d4c_9f98_57801b877ccb.slice/crio-85f40902089e0daa23c823c966096d28eac54e8c30bf9120ffbdd42532694a2b WatchSource:0}: Error finding container 85f40902089e0daa23c823c966096d28eac54e8c30bf9120ffbdd42532694a2b: Status 404 returned error can't find the container with id 85f40902089e0daa23c823c966096d28eac54e8c30bf9120ffbdd42532694a2b Jun 05 21:18:16.301591 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:16.301560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-webhook-cert\") pod \"maas-controller-bffc8cf64-9xq22\" (UID: \"4089d6ec-b68b-405c-ae01-5d29ea0ceffd\") " pod="opendatahub/maas-controller-bffc8cf64-9xq22" Jun 05 21:18:16.303881 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:16.303854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-webhook-cert\") pod \"maas-controller-bffc8cf64-9xq22\" (UID: \"4089d6ec-b68b-405c-ae01-5d29ea0ceffd\") " pod="opendatahub/maas-controller-bffc8cf64-9xq22" Jun 05 21:18:16.447762 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:16.447722 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bffc8cf64-9xq22" Jun 05 21:18:16.452741 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:16.452693 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64d4fdd96-mlvbg" event={"ID":"ffbc9001-46ac-4d4c-9f98-57801b877ccb","Type":"ContainerStarted","Data":"85f40902089e0daa23c823c966096d28eac54e8c30bf9120ffbdd42532694a2b"} Jun 05 21:18:16.574967 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:16.574936 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bffc8cf64-9xq22"] Jun 05 21:18:16.578155 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:18:16.578131 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4089d6ec_b68b_405c_ae01_5d29ea0ceffd.slice/crio-41794f7ad6765f90a5a0e6b2549fa86d54253e70f47f5587140de0e733b6395d WatchSource:0}: Error finding container 41794f7ad6765f90a5a0e6b2549fa86d54253e70f47f5587140de0e733b6395d: Status 404 returned error can't find the container with id 41794f7ad6765f90a5a0e6b2549fa86d54253e70f47f5587140de0e733b6395d Jun 05 21:18:17.461978 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:17.461893 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bffc8cf64-9xq22" event={"ID":"4089d6ec-b68b-405c-ae01-5d29ea0ceffd","Type":"ContainerStarted","Data":"41794f7ad6765f90a5a0e6b2549fa86d54253e70f47f5587140de0e733b6395d"} Jun 05 21:18:19.472830 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:19.472795 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64d4fdd96-mlvbg" event={"ID":"ffbc9001-46ac-4d4c-9f98-57801b877ccb","Type":"ContainerStarted","Data":"4f1b50027d62f131cf65037ada03bebb897d0962821b0b033fe2f1812d5fd36c"} Jun 05 21:18:19.473294 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:19.472908 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64d4fdd96-mlvbg" Jun 05 21:18:19.474290 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:19.474269 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bffc8cf64-9xq22" event={"ID":"4089d6ec-b68b-405c-ae01-5d29ea0ceffd","Type":"ContainerStarted","Data":"10472907c4520d5499ddc878dd23dd55f91b29b78b4ed78dd0e50427d5841961"} Jun 05 21:18:19.474405 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:19.474389 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bffc8cf64-9xq22" Jun 05 21:18:19.490783 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:19.490743 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-64d4fdd96-mlvbg" podStartSLOduration=1.742619309 podStartE2EDuration="4.490716636s" totalImagesPullingTime="2.748097327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:19.489678183 +0000 UTC m=+764.423643175" watchObservedRunningTime="2026-06-05 21:18:19.490716636 +0000 UTC m=+764.424681573" Jun 05 21:18:19.506975 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:19.506935 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bffc8cf64-9xq22" podStartSLOduration=2.170320058 podStartE2EDuration="4.506924134s" totalImagesPullingTime="2.336604076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:19.506618162 +0000 UTC m=+764.440583112" watchObservedRunningTime="2026-06-05 21:18:19.506924134 +0000 UTC m=+764.440889072" Jun 05 21:18:30.484199 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:30.484170 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bffc8cf64-9xq22" Jun 05 21:18:30.484563 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:30.484235 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64d4fdd96-mlvbg" Jun 05 21:18:30.545788 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:30.545754 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bffc8cf64-9xq22"] Jun 05 21:18:30.545980 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:30.545935 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-bffc8cf64-9xq22" podUID="4089d6ec-b68b-405c-ae01-5d29ea0ceffd" containerName="manager" containerID="cri-o://10472907c4520d5499ddc878dd23dd55f91b29b78b4ed78dd0e50427d5841961" gracePeriod=30 Jun 05 21:18:30.792627 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:30.792603 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bffc8cf64-9xq22" Jun 05 21:18:30.818183 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:30.818157 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rvh8\" (UniqueName: \"kubernetes.io/projected/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-kube-api-access-2rvh8\") pod \"4089d6ec-b68b-405c-ae01-5d29ea0ceffd\" (UID: \"4089d6ec-b68b-405c-ae01-5d29ea0ceffd\") " Jun 05 21:18:30.818312 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:30.818267 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-webhook-cert\") pod \"4089d6ec-b68b-405c-ae01-5d29ea0ceffd\" (UID: \"4089d6ec-b68b-405c-ae01-5d29ea0ceffd\") " Jun 05 21:18:30.820326 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:30.820290 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4089d6ec-b68b-405c-ae01-5d29ea0ceffd" (UID: "4089d6ec-b68b-405c-ae01-5d29ea0ceffd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:18:30.820326 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:30.820294 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-kube-api-access-2rvh8" (OuterVolumeSpecName: "kube-api-access-2rvh8") pod "4089d6ec-b68b-405c-ae01-5d29ea0ceffd" (UID: "4089d6ec-b68b-405c-ae01-5d29ea0ceffd"). InnerVolumeSpecName "kube-api-access-2rvh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:18:30.918854 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:30.918819 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rvh8\" (UniqueName: \"kubernetes.io/projected/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-kube-api-access-2rvh8\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:18:30.918854 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:30.918847 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4089d6ec-b68b-405c-ae01-5d29ea0ceffd-webhook-cert\") on node \"ip-10-0-139-39.ec2.internal\" DevicePath \"\"" Jun 05 21:18:31.529707 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:31.529680 2576 generic.go:356] "Generic (PLEG): container finished" podID="4089d6ec-b68b-405c-ae01-5d29ea0ceffd" containerID="10472907c4520d5499ddc878dd23dd55f91b29b78b4ed78dd0e50427d5841961" exitCode=0 Jun 05 21:18:31.530074 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:31.529713 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bffc8cf64-9xq22" Jun 05 21:18:31.530074 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:31.529768 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bffc8cf64-9xq22" event={"ID":"4089d6ec-b68b-405c-ae01-5d29ea0ceffd","Type":"ContainerDied","Data":"10472907c4520d5499ddc878dd23dd55f91b29b78b4ed78dd0e50427d5841961"} Jun 05 21:18:31.530074 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:31.529816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bffc8cf64-9xq22" event={"ID":"4089d6ec-b68b-405c-ae01-5d29ea0ceffd","Type":"ContainerDied","Data":"41794f7ad6765f90a5a0e6b2549fa86d54253e70f47f5587140de0e733b6395d"} Jun 05 21:18:31.530074 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:31.529846 2576 scope.go:117] "RemoveContainer" containerID="10472907c4520d5499ddc878dd23dd55f91b29b78b4ed78dd0e50427d5841961" Jun 05 21:18:31.538528 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:31.538512 2576 scope.go:117] "RemoveContainer" containerID="10472907c4520d5499ddc878dd23dd55f91b29b78b4ed78dd0e50427d5841961" Jun 05 21:18:31.538793 ip-10-0-139-39 kubenswrapper[2576]: E0605 21:18:31.538774 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10472907c4520d5499ddc878dd23dd55f91b29b78b4ed78dd0e50427d5841961\": container with ID starting with 10472907c4520d5499ddc878dd23dd55f91b29b78b4ed78dd0e50427d5841961 not found: ID does not exist" containerID="10472907c4520d5499ddc878dd23dd55f91b29b78b4ed78dd0e50427d5841961" Jun 05 21:18:31.538856 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:31.538800 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10472907c4520d5499ddc878dd23dd55f91b29b78b4ed78dd0e50427d5841961"} err="failed to get container status \"10472907c4520d5499ddc878dd23dd55f91b29b78b4ed78dd0e50427d5841961\": rpc error: code = NotFound desc = could not find container \"10472907c4520d5499ddc878dd23dd55f91b29b78b4ed78dd0e50427d5841961\": container with ID starting with 10472907c4520d5499ddc878dd23dd55f91b29b78b4ed78dd0e50427d5841961 not found: ID does not exist" Jun 05 21:18:31.546062 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:31.546041 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bffc8cf64-9xq22"] Jun 05 21:18:31.550197 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:31.550173 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bffc8cf64-9xq22"] Jun 05 21:18:33.520633 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:33.520601 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4089d6ec-b68b-405c-ae01-5d29ea0ceffd" path="/var/lib/kubelet/pods/4089d6ec-b68b-405c-ae01-5d29ea0ceffd/volumes" Jun 05 21:18:50.278882 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.278799 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd"] Jun 05 21:18:50.279359 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.279115 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4089d6ec-b68b-405c-ae01-5d29ea0ceffd" containerName="manager" Jun 05 21:18:50.279359 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.279125 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4089d6ec-b68b-405c-ae01-5d29ea0ceffd" containerName="manager" Jun 05 21:18:50.279359 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.279177 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4089d6ec-b68b-405c-ae01-5d29ea0ceffd" containerName="manager" Jun 05 21:18:50.287996 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.287972 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd" Jun 05 21:18:50.290779 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.290755 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 05 21:18:50.290923 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.290791 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-tsxb6\"" Jun 05 21:18:50.291020 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.290983 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 05 21:18:50.291962 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.291945 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 05 21:18:50.296207 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.296184 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd"] Jun 05 21:18:50.386188 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.386155 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7phlp\" (UniqueName: \"kubernetes.io/projected/1252b6ff-e69e-4c0b-9d3b-381b200359e0-kube-api-access-7phlp\") pod \"maas-api-8458cf8c74-nrdvd\" (UID: \"1252b6ff-e69e-4c0b-9d3b-381b200359e0\") " pod="redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd" Jun 05 21:18:50.386356 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.386207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1252b6ff-e69e-4c0b-9d3b-381b200359e0-maas-api-tls\") pod \"maas-api-8458cf8c74-nrdvd\" (UID: \"1252b6ff-e69e-4c0b-9d3b-381b200359e0\") " pod="redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd" Jun 05 21:18:50.487024 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.486986 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7phlp\" (UniqueName: \"kubernetes.io/projected/1252b6ff-e69e-4c0b-9d3b-381b200359e0-kube-api-access-7phlp\") pod \"maas-api-8458cf8c74-nrdvd\" (UID: \"1252b6ff-e69e-4c0b-9d3b-381b200359e0\") " pod="redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd" Jun 05 21:18:50.487024 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.487030 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1252b6ff-e69e-4c0b-9d3b-381b200359e0-maas-api-tls\") pod \"maas-api-8458cf8c74-nrdvd\" (UID: \"1252b6ff-e69e-4c0b-9d3b-381b200359e0\") " pod="redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd" Jun 05 21:18:50.489378 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.489357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1252b6ff-e69e-4c0b-9d3b-381b200359e0-maas-api-tls\") pod \"maas-api-8458cf8c74-nrdvd\" (UID: \"1252b6ff-e69e-4c0b-9d3b-381b200359e0\") " pod="redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd" Jun 05 21:18:50.500511 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.500486 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7phlp\" (UniqueName: \"kubernetes.io/projected/1252b6ff-e69e-4c0b-9d3b-381b200359e0-kube-api-access-7phlp\") pod \"maas-api-8458cf8c74-nrdvd\" (UID: \"1252b6ff-e69e-4c0b-9d3b-381b200359e0\") " pod="redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd" Jun 05 21:18:50.598344 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.598247 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd" Jun 05 21:18:50.733467 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.733440 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd"] Jun 05 21:18:50.736141 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:18:50.736116 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1252b6ff_e69e_4c0b_9d3b_381b200359e0.slice/crio-3b68bf3c1636280e9cc3588fc40eb0010c2a6ffb2d7f9822635f480fe4560b5d WatchSource:0}: Error finding container 3b68bf3c1636280e9cc3588fc40eb0010c2a6ffb2d7f9822635f480fe4560b5d: Status 404 returned error can't find the container with id 3b68bf3c1636280e9cc3588fc40eb0010c2a6ffb2d7f9822635f480fe4560b5d Jun 05 21:18:50.737515 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.737497 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:18:50.760658 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.760623 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-zzdhs"] Jun 05 21:18:50.765628 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.765607 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-zzdhs" Jun 05 21:18:50.768273 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.768255 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-phhvk\"" Jun 05 21:18:50.768369 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.768292 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 05 21:18:50.771633 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.771595 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-zzdhs"] Jun 05 21:18:50.890965 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.890933 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btbq5\" (UniqueName: \"kubernetes.io/projected/f2f8492d-4ee9-4648-8ac5-39e1dae3c796-kube-api-access-btbq5\") pod \"payload-pre-processing-67d7689b65-zzdhs\" (UID: \"f2f8492d-4ee9-4648-8ac5-39e1dae3c796\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-zzdhs" Jun 05 21:18:50.991887 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:50.991855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btbq5\" (UniqueName: \"kubernetes.io/projected/f2f8492d-4ee9-4648-8ac5-39e1dae3c796-kube-api-access-btbq5\") pod \"payload-pre-processing-67d7689b65-zzdhs\" (UID: \"f2f8492d-4ee9-4648-8ac5-39e1dae3c796\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-zzdhs" Jun 05 21:18:51.001655 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:51.001631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btbq5\" (UniqueName: \"kubernetes.io/projected/f2f8492d-4ee9-4648-8ac5-39e1dae3c796-kube-api-access-btbq5\") pod \"payload-pre-processing-67d7689b65-zzdhs\" (UID: \"f2f8492d-4ee9-4648-8ac5-39e1dae3c796\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-zzdhs" Jun 05 21:18:51.076771 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:51.076718 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-zzdhs" Jun 05 21:18:51.204625 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:51.204597 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-zzdhs"] Jun 05 21:18:51.206334 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:18:51.206309 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f8492d_4ee9_4648_8ac5_39e1dae3c796.slice/crio-24c39c4b24fdc884390cd08494b306dccb8da5316379775527c94ac2964153f7 WatchSource:0}: Error finding container 24c39c4b24fdc884390cd08494b306dccb8da5316379775527c94ac2964153f7: Status 404 returned error can't find the container with id 24c39c4b24fdc884390cd08494b306dccb8da5316379775527c94ac2964153f7 Jun 05 21:18:51.615797 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:51.615687 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-zzdhs" event={"ID":"f2f8492d-4ee9-4648-8ac5-39e1dae3c796","Type":"ContainerStarted","Data":"24c39c4b24fdc884390cd08494b306dccb8da5316379775527c94ac2964153f7"} Jun 05 21:18:51.616792 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:51.616765 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd" event={"ID":"1252b6ff-e69e-4c0b-9d3b-381b200359e0","Type":"ContainerStarted","Data":"3b68bf3c1636280e9cc3588fc40eb0010c2a6ffb2d7f9822635f480fe4560b5d"} Jun 05 21:18:53.626949 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:53.626909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-zzdhs" event={"ID":"f2f8492d-4ee9-4648-8ac5-39e1dae3c796","Type":"ContainerStarted","Data":"72382e8ebf3d2a7c4ec005cf3b30ae98ed21b0dd7787e7195bd95a9fa2770079"} Jun 05 21:18:53.627376 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:53.626964 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-zzdhs" Jun 05 21:18:53.628301 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:53.628276 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd" event={"ID":"1252b6ff-e69e-4c0b-9d3b-381b200359e0","Type":"ContainerStarted","Data":"9f031b0f999cb70a665c8b04b06c767be22e4ad5e9ffe0a54acf6b84fc720d64"} Jun 05 21:18:53.628424 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:53.628389 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd" Jun 05 21:18:53.645471 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:53.645423 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-zzdhs" podStartSLOduration=2.173816473 podStartE2EDuration="3.645406865s" totalImagesPullingTime="1.471590392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:53.645346836 +0000 UTC m=+798.579311774" watchObservedRunningTime="2026-06-05 21:18:53.645406865 +0000 UTC m=+798.579371804" Jun 05 21:18:53.661290 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:53.661251 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd" podStartSLOduration=1.7209762720000001 podStartE2EDuration="3.661237132s" totalImagesPullingTime="1.94026086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:53.660714215 +0000 UTC m=+798.594679154" watchObservedRunningTime="2026-06-05 21:18:53.661237132 +0000 UTC m=+798.595202088" Jun 05 21:18:59.640149 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:18:59.640124 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-8458cf8c74-nrdvd" Jun 05 21:19:04.635814 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:04.635785 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-zzdhs" Jun 05 21:19:59.434857 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.434826 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn"] Jun 05 21:19:59.438800 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.438771 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.441534 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.441511 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 21:19:59.442761 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.442741 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-482pd\"" Jun 05 21:19:59.442930 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.442913 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 05 21:19:59.442977 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.442952 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 21:19:59.447315 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.447290 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn"] Jun 05 21:19:59.558150 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.558119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.558317 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.558159 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kdvh\" (UniqueName: \"kubernetes.io/projected/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-kube-api-access-8kdvh\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.558317 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.558196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.558317 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.558239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.558423 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.558316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.558423 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.558345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.659177 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.659147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.659177 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.659181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.659395 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.659206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.659395 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.659228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.659395 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.659305 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.659395 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.659337 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kdvh\" (UniqueName: \"kubernetes.io/projected/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-kube-api-access-8kdvh\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.659630 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.659606 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.659693 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.659674 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.659914 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.659892 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.661598 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.661579 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.661779 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.661761 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.667900 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.667878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kdvh\" (UniqueName: \"kubernetes.io/projected/4ec737ae-a5ac-42e5-8e2d-8bf273805f7d-kube-api-access-8kdvh\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4dbsn\" (UID: \"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.750694 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.750607 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" Jun 05 21:19:59.881923 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.881857 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn"] Jun 05 21:19:59.884294 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:19:59.884266 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec737ae_a5ac_42e5_8e2d_8bf273805f7d.slice/crio-3260f81324f01a6aa9742dd1941a13196d8a1ba17a1b3ee6c32cd9a01a080b6b WatchSource:0}: Error finding container 3260f81324f01a6aa9742dd1941a13196d8a1ba17a1b3ee6c32cd9a01a080b6b: Status 404 returned error can't find the container with id 3260f81324f01a6aa9742dd1941a13196d8a1ba17a1b3ee6c32cd9a01a080b6b Jun 05 21:19:59.916719 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:19:59.916686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" event={"ID":"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d","Type":"ContainerStarted","Data":"3260f81324f01a6aa9742dd1941a13196d8a1ba17a1b3ee6c32cd9a01a080b6b"} Jun 05 21:20:03.937903 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:03.937863 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4dbsn" event={"ID":"4ec737ae-a5ac-42e5-8e2d-8bf273805f7d","Type":"ContainerStarted","Data":"5d33419feb56ef189a2ffd846d724360648b70e9c67569604ab6c0e2ef68dde4"} Jun 05 21:20:28.410126 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.410047 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d"] Jun 05 21:20:28.428318 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.428288 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d"] Jun 05 21:20:28.428452 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.428386 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.431045 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.431023 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 05 21:20:28.499625 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.499602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64966243-6f3a-4b4c-852a-7c0c409f2665-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.499746 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.499633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64966243-6f3a-4b4c-852a-7c0c409f2665-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.499746 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.499656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/64966243-6f3a-4b4c-852a-7c0c409f2665-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.499746 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.499679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mws8k\" (UniqueName: \"kubernetes.io/projected/64966243-6f3a-4b4c-852a-7c0c409f2665-kube-api-access-mws8k\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.499912 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.499838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64966243-6f3a-4b4c-852a-7c0c409f2665-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.499912 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.499900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64966243-6f3a-4b4c-852a-7c0c409f2665-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.600722 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.600694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/64966243-6f3a-4b4c-852a-7c0c409f2665-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.600866 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.600746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mws8k\" (UniqueName: \"kubernetes.io/projected/64966243-6f3a-4b4c-852a-7c0c409f2665-kube-api-access-mws8k\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.600866 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.600790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64966243-6f3a-4b4c-852a-7c0c409f2665-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.600866 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.600818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64966243-6f3a-4b4c-852a-7c0c409f2665-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.600866 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.600866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64966243-6f3a-4b4c-852a-7c0c409f2665-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.601084 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.600884 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64966243-6f3a-4b4c-852a-7c0c409f2665-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.601084 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.601058 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/64966243-6f3a-4b4c-852a-7c0c409f2665-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.601176 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.601149 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64966243-6f3a-4b4c-852a-7c0c409f2665-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.601235 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.601216 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64966243-6f3a-4b4c-852a-7c0c409f2665-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.602995 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.602969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64966243-6f3a-4b4c-852a-7c0c409f2665-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.603325 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.603304 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64966243-6f3a-4b4c-852a-7c0c409f2665-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.608637 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.608613 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mws8k\" (UniqueName: \"kubernetes.io/projected/64966243-6f3a-4b4c-852a-7c0c409f2665-kube-api-access-mws8k\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d\" (UID: \"64966243-6f3a-4b4c-852a-7c0c409f2665\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.746460 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.746371 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:20:28.877470 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:28.877435 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d"] Jun 05 21:20:28.880352 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:20:28.880325 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64966243_6f3a_4b4c_852a_7c0c409f2665.slice/crio-921d80c0db4abb4fe47c547a0c2b20a4b3f4d674d8d915518286eabb922130f2 WatchSource:0}: Error finding container 921d80c0db4abb4fe47c547a0c2b20a4b3f4d674d8d915518286eabb922130f2: Status 404 returned error can't find the container with id 921d80c0db4abb4fe47c547a0c2b20a4b3f4d674d8d915518286eabb922130f2 Jun 05 21:20:29.050783 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:29.050675 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" event={"ID":"64966243-6f3a-4b4c-852a-7c0c409f2665","Type":"ContainerStarted","Data":"34fe0d08676daea1582ef5e1cae18ea1076d6d32fa1bb974296e7673a8e8d0a1"} Jun 05 21:20:29.050783 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:29.050761 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" event={"ID":"64966243-6f3a-4b4c-852a-7c0c409f2665","Type":"ContainerStarted","Data":"921d80c0db4abb4fe47c547a0c2b20a4b3f4d674d8d915518286eabb922130f2"} Jun 05 21:20:35.529506 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:35.529479 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcd2w_4420e080-d4f9-43a5-bbbe-6d869c60f720/ovn-acl-logging/0.log" Jun 05 21:20:35.530175 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:20:35.530156 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcd2w_4420e080-d4f9-43a5-bbbe-6d869c60f720/ovn-acl-logging/0.log" Jun 05 21:21:22.298975 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:21:22.298940 2576 generic.go:356] "Generic (PLEG): container finished" podID="64966243-6f3a-4b4c-852a-7c0c409f2665" containerID="34fe0d08676daea1582ef5e1cae18ea1076d6d32fa1bb974296e7673a8e8d0a1" exitCode=0 Jun 05 21:21:22.299355 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:21:22.299010 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" event={"ID":"64966243-6f3a-4b4c-852a-7c0c409f2665","Type":"ContainerDied","Data":"34fe0d08676daea1582ef5e1cae18ea1076d6d32fa1bb974296e7673a8e8d0a1"} Jun 05 21:21:24.310740 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:21:24.310702 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" event={"ID":"64966243-6f3a-4b4c-852a-7c0c409f2665","Type":"ContainerStarted","Data":"841d4de5b552b7a6a9d7d316f7f5c0cdeb87e96d07c4ddbf1f0277ce94732cb4"} Jun 05 21:21:24.331420 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:21:24.331367 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" podStartSLOduration=2.036246229 podStartE2EDuration="56.331353493s" totalImagesPullingTime="1.066959157s" totalInitContainerRuntime="53.228148107s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:21:24.329096955 +0000 UTC m=+949.263061894" watchObservedRunningTime="2026-06-05 21:21:24.331353493 +0000 UTC m=+949.265318431" Jun 05 21:21:28.746577 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:21:28.746535 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:21:28.747084 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:21:28.746618 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:21:28.758986 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:21:28.758961 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:21:29.344032 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:21:29.344004 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d" Jun 05 21:22:04.985279 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:04.985178 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-64d4fdd96-mlvbg_ffbc9001-46ac-4d4c-9f98-57801b877ccb/manager/0.log" Jun 05 21:22:05.593999 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:05.593970 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b79b9d749-tf49p_a5773295-c6ce-4244-849a-02b383fc095d/copy-manifests/0.log" Jun 05 21:22:05.604135 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:05.604115 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b79b9d749-tf49p_a5773295-c6ce-4244-849a-02b383fc095d/manager/0.log" Jun 05 21:22:07.259609 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:07.259580 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-slgd7_8539e2bd-1bb6-4310-81da-b00323b5d079/kuadrant-console-plugin/0.log" Jun 05 21:22:08.310961 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:08.306034 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-744cfcbb8c-lh7xg_12fbb505-fac0-4ac2-a3a9-e7c030399fd5/kube-auth-proxy/0.log" Jun 05 21:22:08.663699 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:08.663662 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-zzdhs_f2f8492d-4ee9-4648-8ac5-39e1dae3c796/payload-pre-processing/0.log" Jun 05 21:22:09.349576 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:09.349548 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-4dbsn_4ec737ae-a5ac-42e5-8e2d-8bf273805f7d/storage-initializer/0.log" Jun 05 21:22:09.594820 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:09.594786 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d_64966243-6f3a-4b4c-852a-7c0c409f2665/storage-initializer/0.log" Jun 05 21:22:09.604959 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:09.604895 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5pb8d_64966243-6f3a-4b4c-852a-7c0c409f2665/main/0.log" Jun 05 21:22:16.927323 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:16.927282 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jlqrw_1a81b9d5-40dc-4e24-95de-28ce457cc14d/global-pull-secret-syncer/0.log" Jun 05 21:22:17.012650 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:17.012600 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nksmx_5906f44b-9c51-4740-9a69-a68188403871/konnectivity-agent/0.log" Jun 05 21:22:17.106589 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:17.106561 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-39.ec2.internal_cd7eb7d4f442858d5fa850411397de67/haproxy/0.log" Jun 05 21:22:22.191056 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:22.191026 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-slgd7_8539e2bd-1bb6-4310-81da-b00323b5d079/kuadrant-console-plugin/0.log" Jun 05 21:22:24.402073 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:24.402047 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-jvst4_1206b9d2-6183-4065-b3eb-c26e4c27eb65/monitoring-plugin/0.log" Jun 05 21:22:24.449027 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:24.448972 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dwt9_83a33a6f-7161-4849-b841-40cc3fbd4128/node-exporter/0.log" Jun 05 21:22:24.472836 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:24.472810 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dwt9_83a33a6f-7161-4849-b841-40cc3fbd4128/kube-rbac-proxy/0.log" Jun 05 21:22:24.503327 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:24.503303 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dwt9_83a33a6f-7161-4849-b841-40cc3fbd4128/init-textfile/0.log" Jun 05 21:22:24.840094 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:24.840048 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d07be5c-f930-41ce-b2a5-ec9c79804a25/prometheus/0.log" Jun 05 21:22:24.861559 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:24.861527 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d07be5c-f930-41ce-b2a5-ec9c79804a25/config-reloader/0.log" Jun 05 21:22:24.885170 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:24.885147 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d07be5c-f930-41ce-b2a5-ec9c79804a25/thanos-sidecar/0.log" Jun 05 21:22:24.907327 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:24.907308 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d07be5c-f930-41ce-b2a5-ec9c79804a25/kube-rbac-proxy-web/0.log" Jun 05 21:22:24.933496 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:24.933473 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d07be5c-f930-41ce-b2a5-ec9c79804a25/kube-rbac-proxy/0.log" Jun 05 21:22:24.957852 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:24.957827 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d07be5c-f930-41ce-b2a5-ec9c79804a25/kube-rbac-proxy-thanos/0.log" Jun 05 21:22:24.984406 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:24.984381 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d07be5c-f930-41ce-b2a5-ec9c79804a25/init-config-reloader/0.log" Jun 05 21:22:27.492875 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.492842 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd"] Jun 05 21:22:27.496031 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.496012 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.498639 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.498619 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-58whj\"/\"kube-root-ca.crt\"" Jun 05 21:22:27.499713 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.499696 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-58whj\"/\"openshift-service-ca.crt\"" Jun 05 21:22:27.499780 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.499697 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-58whj\"/\"default-dockercfg-tqjqs\"" Jun 05 21:22:27.506566 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.506544 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd"] Jun 05 21:22:27.622515 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.622483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-sys\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.622685 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.622522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-lib-modules\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.622685 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.622551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-proc\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.622685 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.622617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md452\" (UniqueName: \"kubernetes.io/projected/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-kube-api-access-md452\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.622685 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.622670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-podres\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.723955 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.723921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-sys\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.724127 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.723961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-lib-modules\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.724127 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.723983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-proc\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.724127 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.724011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md452\" (UniqueName: \"kubernetes.io/projected/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-kube-api-access-md452\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.724127 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.724053 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-sys\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.724127 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.724080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-proc\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.724127 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.724061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-podres\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.724360 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.724136 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-lib-modules\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.724360 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.724145 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-podres\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.734262 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.734241 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md452\" (UniqueName: \"kubernetes.io/projected/6f848b97-4621-436f-9ffc-f2c03e8f3b1b-kube-api-access-md452\") pod \"perf-node-gather-daemonset-6g8xd\" (UID: \"6f848b97-4621-436f-9ffc-f2c03e8f3b1b\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.806589 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.806521 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:27.936977 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:27.936912 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd"] Jun 05 21:22:27.939803 ip-10-0-139-39 kubenswrapper[2576]: W0605 21:22:27.939779 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6f848b97_4621_436f_9ffc_f2c03e8f3b1b.slice/crio-840287bf61e2a7903477d644077b845adaa3cb85a1e44fb0b8c5782dfd197c4a WatchSource:0}: Error finding container 840287bf61e2a7903477d644077b845adaa3cb85a1e44fb0b8c5782dfd197c4a: Status 404 returned error can't find the container with id 840287bf61e2a7903477d644077b845adaa3cb85a1e44fb0b8c5782dfd197c4a Jun 05 21:22:28.589153 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:28.589117 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" event={"ID":"6f848b97-4621-436f-9ffc-f2c03e8f3b1b","Type":"ContainerStarted","Data":"39217279846e5f20c0c272b86c59fe94d7084d38c31114b61ba1443ebef4bfef"} Jun 05 21:22:28.589640 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:28.589174 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" event={"ID":"6f848b97-4621-436f-9ffc-f2c03e8f3b1b","Type":"ContainerStarted","Data":"840287bf61e2a7903477d644077b845adaa3cb85a1e44fb0b8c5782dfd197c4a"} Jun 05 21:22:28.589640 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:28.589211 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:28.606140 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:28.606094 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" podStartSLOduration=1.606080867 podStartE2EDuration="1.606080867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:22:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:28.605621965 +0000 UTC m=+1013.539586904" watchObservedRunningTime="2026-06-05 21:22:28.606080867 +0000 UTC m=+1013.540045804" Jun 05 21:22:28.690525 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:28.690496 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-kchmr_9555ef33-dfae-4e01-a467-782f4ca0a878/volume-data-source-validator/0.log" Jun 05 21:22:30.059479 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:30.059433 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jhf8c_039971b5-5787-49a6-834f-c712bae1967a/dns/0.log" Jun 05 21:22:30.101372 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:30.101345 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jhf8c_039971b5-5787-49a6-834f-c712bae1967a/kube-rbac-proxy/0.log" Jun 05 21:22:30.345323 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:30.345247 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wvtmg_dd66c9b9-cd41-4519-ac23-b8ea2ef5b9bb/dns-node-resolver/0.log" Jun 05 21:22:30.963478 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:30.963442 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7b456ff697-ghgkw_4abcded6-2b40-49de-9752-6d805373eb53/registry/0.log" Jun 05 21:22:30.968547 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:30.968518 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7b456ff697-ghgkw_4abcded6-2b40-49de-9752-6d805373eb53/registry/1.log" Jun 05 21:22:31.079403 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:31.079374 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v472d_7ed0bd96-8b60-4fc6-8b00-af33bc8ce160/node-ca/0.log" Jun 05 21:22:32.525718 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:32.525692 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-744cfcbb8c-lh7xg_12fbb505-fac0-4ac2-a3a9-e7c030399fd5/kube-auth-proxy/0.log" Jun 05 21:22:32.698407 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:32.698383 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-zzdhs_f2f8492d-4ee9-4648-8ac5-39e1dae3c796/payload-pre-processing/0.log" Jun 05 21:22:33.715180 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:33.715151 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xxvsh_371ed11d-a1a5-4aa3-a7aa-545ee2460b6b/serve-healthcheck-canary/0.log" Jun 05 21:22:34.402961 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:34.402935 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-4r5w2_e5367770-de61-4e1f-b45b-884b42ea2dba/insights-operator/0.log" Jun 05 21:22:34.406292 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:34.406272 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-4r5w2_e5367770-de61-4e1f-b45b-884b42ea2dba/insights-operator/1.log" Jun 05 21:22:34.475505 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:34.475477 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nq8c_2666050a-4592-469d-a556-86a842d51d17/kube-rbac-proxy/0.log" Jun 05 21:22:34.538000 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:34.537973 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nq8c_2666050a-4592-469d-a556-86a842d51d17/exporter/0.log" Jun 05 21:22:34.598163 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:34.598137 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nq8c_2666050a-4592-469d-a556-86a842d51d17/extractor/0.log" Jun 05 21:22:34.603615 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:34.603597 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-58whj/perf-node-gather-daemonset-6g8xd" Jun 05 21:22:38.201842 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:38.201809 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-64d4fdd96-mlvbg_ffbc9001-46ac-4d4c-9f98-57801b877ccb/manager/0.log" Jun 05 21:22:38.644972 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:38.644937 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b79b9d749-tf49p_a5773295-c6ce-4244-849a-02b383fc095d/manager/0.log" Jun 05 21:22:38.687177 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:38.687144 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b79b9d749-tf49p_a5773295-c6ce-4244-849a-02b383fc095d/copy-manifests/0.log" Jun 05 21:22:40.534570 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:40.534539 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-77f48f848-4p86l_4524a924-f1a7-4c33-a041-517568c1e3f7/manager/0.log" Jun 05 21:22:42.101571 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:42.101518 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-744cfcbb8c-lh7xg_12fbb505-fac0-4ac2-a3a9-e7c030399fd5/kube-auth-proxy/0.log" Jun 05 21:22:42.160539 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:42.160493 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-zzdhs_f2f8492d-4ee9-4648-8ac5-39e1dae3c796/payload-pre-processing/0.log" Jun 05 21:22:43.403716 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:43.403687 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-744cfcbb8c-lh7xg_12fbb505-fac0-4ac2-a3a9-e7c030399fd5/kube-auth-proxy/0.log" Jun 05 21:22:43.469832 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:43.469801 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-zzdhs_f2f8492d-4ee9-4648-8ac5-39e1dae3c796/payload-pre-processing/0.log" Jun 05 21:22:45.356504 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:45.356474 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-744cfcbb8c-lh7xg_12fbb505-fac0-4ac2-a3a9-e7c030399fd5/kube-auth-proxy/0.log" Jun 05 21:22:45.411301 ip-10-0-139-39 kubenswrapper[2576]: I0605 21:22:45.411264 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-zzdhs_f2f8492d-4ee9-4648-8ac5-39e1dae3c796/payload-pre-processing/0.log"